Hi all,
I have a performance issue when loading a csv file into a staging environment when this csv file is stored remotely.
My csv files are stored on an SFTP server that is mapped to my windows server via SAMBA.
My SSIS package uses a standard Flat File connection manager using the mapped drive as source.
It takes 60 hours to load 60G of data.
So I copied the csv files manually on a local disk. This copy/paste from the mapped drive to a local disk process took me 1h15min to complete. Running the exact same package using the local files ran for 6h40min.
Can somebody explain to me why loading the data remotely takes 7,5 times longer than a local copy-load?
Any help is much appreciated.
My csv files are stored on an SFTP server that is mapped to my windows server via SAMBA.
My SSIS package uses a standard Flat File connection manager using the mapped drive as source.
It takes 60 hours to load 60G of data.
So I copied the csv files manually on a local disk. This copy/paste from the mapped drive to a local disk process took me 1h15min to complete. Running the exact same package using the local files ran for 6h40min.
Can somebody explain to me why loading the data remotely takes 7,5 times longer than a local copy-load?
Any help is much appreciated.
kind regards
Geert
Geert Vanhove DCOD ------ http://geertvanhove.wordpress.com/ ----------- Please click the Mark as Answer or Vote As Helpful if a post solves your problem or is helpful!