I have a SSIS ETL package with a process task that transfer files to AWS S3 through a AWS CLI command:
aws.exe s3 cp C:\folder s3://bucket_name/folder --recursive --exclude "*" --include "*.pdf"
If I run this ETL in visual studio the files get transfer to S3 fine. If I run this ETL as a SQL job on the machine it does not work (no error. the files do not get transfer). Apparently the SQL job is unable to pick up the AWS credential.
I already have the AWS credential (access key and secret access key) setup in a service account on this machine. In the SQL job, SSIS package is "run as" a proxy account of this service account. The proxy is active on SSIS and cmd. Any ideas? Thanks.
I have SQL Server 2014 and AWS CLI v2.