S3 Amazon Delimited file Aggregation

[sbhagat (swapnil bhagat)]

I have one requirement where I need to use aggregate the delimited file from S3. File stored in S3.
First Question is it possible to do it and Which connector should we use?

[Anshu_Kunal]

@sbhagat

Please try the SQLLoader connector, we are using this connector to connect to Azure blob storage which is having the csv file.

Thanks

[sbhagat (swapnil bhagat)]

Ok …Can you give me how the hostname will look as never worked before?
We are having s3 to store the csv file , So how do we configure in IDN Side?

[Anshu_Kunal]

@sbhagat
This connector will work similar to a JDBC connector

Azure blob storage had to be enabled for SFTP connection

Account Query

Select * from <filename>.csv

Thanks

[sbhagat (swapnil bhagat)]

Yeah but In my case , I’m using S3 , So has anybody integrate using S3?

[Anshu_Kunal]

Not sure on S3 bucket, another approach could be to programmatically download the file from S3 bucket to any local server and then use it for a delimited source on ISC.

Thanks