How do I include file names and row numbers for Amazon S3 Read Connectors?

If you are using Ascend's S3 read connector to ingest data and want to include the file name and row number for each record in the schema, there are a few things you should know.

Firstly, it is not possible to get the row number for each record from the file unless it is already part of the data. However, you can get the file name by using Object Aggregation, which is how you adjust partitioning in Ascend.

To include a "filename" column that stores the filename of each record, follow the steps outlined within our Object Aggregation documentation. This will allow you to access the file names of each record in the schema.