Hi,
I am using SQL 2008 SSIS. I have an api from which I need to download XML and populate some tables.
I have successfully managed to do this by putting the URL into a XML Source Data flow. This then downloads into a table for each node - which I then reconstruct back to make sense.
The challenge I am having is that the api will only let me download 3 months (or so) of data each time - then it times out. I know I can't change the time out so what I was thinking was iterating through date ranges. The parameters in the URL are like "&from=20100101&to=20100630".
What is the "easiest" way (I'm not a developer) to do this? I've read about scripts and things but haven't found an example of passing variables to a URL - let alone iterating through a list of them. Should I have a list of dates somewhere - or is there a way to automatically generate them as we go?
Any input gladly accepted. Bryan