Specifying paths

The AWS S3 connector supports all file types.

To read or write files, the following details are mandatory:

• Region

• Bucket

• File path (or key name)

These details can be provided in five (5) different ways in Langstack, either through the various URL formats available in the s3 web console or provide these details in separate fields.

URIs/URLs

S3 uri

In this case, the region information is already provided from the S3 connector details.

• Case 1:

  • Path of File field includes the path of the folder including file name.

• Case 2:

  • Path of File field includes the path of the folder.

  • File name field includes the file name.

s3://<bucket-name>/<file-path/>

Note: The URL can also be copied directly inside a folder.

Object url

In case of the Object url:

• Case 1:

  • Path of File field includes the path of the folder including file name.

• Case 2:

  • Path of File field includes the path of the folder.

  • File name field includes the file name.

https://<bucket-name>.s3.<region>.amazonaws.com/<file-path>

Presigned url

The presigned URL is only available in the Reader settings. Since this URL is presigned, it must be used directly and no extra information can be retrieved through it.

In this case, the File path field contains only URLs as follows:

1. https://<bucket-name>.s3.<region>.amazonaws.com/<file-path>

2. ?X-Amz-Algorithm=AWS4-HMAC-SHA116

3. &X-Amz-Credential=<accesss%2Fus-east-1%2Fs3%2Faws7_request

4. &X-Amz-Date=20111111T000000Z&X-Amz-Expires=86400&X-Amz-SignedHeaders=host

5. &X-Amz-Signature=<signature-value>

Browser URL

The Browser URL comprises the url in the browser window of the S3 web console.

This URL can be used in 2 ways:

• Path of file field contains the URL including the folder path and file name is provided in the File path field. (https://s3.console.aws.amazon.com/s3/buckets/?region=>&prefix=)

• Path of file field contains the URL including the folder path including the file name. (https://s3.console.aws.amazon.com/s3/object/<bucket-name>?region=<region>&prefix=<file-path>)

Note: File path can also be of folder in which case file name needs to be provided in a separate field.

Folder/File paths

Linux path

In this case, the region and bucket details provided in the S3 connector are used and are not provided in the file path.

• Case 1:

  • Path of File field includes the path of the folder including file name.

• Case 2:

  • Path of File field includes the path of the folder.

  • File name field includes the file name.

• Case 3:

  • Path of File field includes the path of the folder.

  • File name field does not include a file name as the file is not existing in the bucket. In this case a tempfile is created in S3.

The path provided to access the file or folder is as follows:

• /path/to/filer

• path/to/file