Hello everyone,
I am trying to write an SSIS package that can list or load into a table all the files and folders inside an Azure Data Lake Store directory so that i can selectively process the files which are inside a folder. I am already using the "Azure Feature Pack for Integration Services (SSIS) by Microsoft" to connect and interact with the Azure Services. Refer: https://docs.microsoft.com/en-us/sql/integration-services/azure-feature-pack-for-integration-services-ssis?view=sql-server-2017
This is somewhat similar to how the file system task works normally in SSIS, but the Azure Data Lake Store File System Task does not provide these features as of now.
Hence i am looking for a workaround to list the Azure Data Lake Store files and directories using SSIS.
Any inputs on how can this be achieved will be appreciated.
Thanks in advance.
Suvrat