Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS - Calling Windows Batch File Get Current Date changed when moved to the new server

$
0
0

Hi,

We have a Job  that calls a SSIS package 2005 that does some processing and execute a BAT file.  This Job is being called by a web application.

The BAT file creates a folder and named it based on the current date ( YYYY_MM) e.g 2015_07

echo %date:~10,4%_%date:~4,2%
md %date:~10,4%_%date:~4,2%
pause
exit 0	

It was working okay in the SQL Agent 2005 server until we moved  to the new server SQL Agent 2012 using the same package SSIS package 2005. 

Now the issue is, instead of creating the folder based on YYYY_MM, it's now being created as YYYY_DD.

I've checked the Regional settings of both server and they have the same "ENGLISH (United States) format. I even ran the code below and they're returning the same output

echo %date:~10,4%_%date:~4,2%

I know the BAT file can be improved by not depending current locale in WINDOWS, but I just want to understand how this issue occurs and how does the regional setting being overridden?

Many thanks.



upgrading from NAV 2009 to NAV 2013

$
0
0
Hello friends.

I have a task as i'm migrating from  NAV 2009 to 2013. from current DW(which is running in NAV 2009) i need to copy it to a new DW(Nav 2013), and from there history + new data into a cube.
Later the old DW wont be in use as it will truncate the date after transfer.

please suggest me how to be done???

Thanks

Ranjan DS

Ranjan DS

Hold data path in Lookup SSIS

$
0
0
Hi ,

In my SSIS Package I am loading data from source to destination.
I am using lookup to get the matching and not matching records.due to identity on itmkey i want to load matching record first then non matching records.
can we hold the data path under DFT.
Kindly find the attachment to understand the scenario.

Thankx & regards, Vipin jha MCP

Communication link failure

$
0
0

Hi all,

i am looking for solution for "Communication link failure"  since many months in google but no luck, am running an SSIS package to load data. job failing many times with error 'Communication link failure', searched every where but found nothing. Below is the complete error description when job failed, can any one let me know how to resolve / suggestions or any ideas about issue.

OS - Windows server 2008 R2 Enterprise Edition

RAM - 198GB

 SQL server 2008 R2 Enterprise Edition and error description is below,

Started:  6:22:40 AM  Error: 2015-08-19 18:50:32.70     Code: 0xC0202009     

Source: Data Flow Task Lookup [193]     
Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. 
Error code: 0x80004005.  An OLE DB record is available.  

Source: "Microsoft SQL Server Native Client 10.0"  
Hresult: 0x80004005  Description: "Communication link failure".  An OLE DB record is available.  

Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80004005  
Description: "Communication link failure".  An OLE DB record is available.  

Source: "Microsoft SQL Server Native Client 10.0"  
Hresult: 0x80004005  Description: "TCP Provider: An existing connection was forcibly closed by the remote host.  ".  End Error  Error: 2015-08-19 18:50:32.80  Code: 0xC020824C     

Source: Data Flow Task Lookup [193]     
Description: OLE DB error occurred while loading column metadata. Check SQLCommand 
and SqlCommandParam properties.  End Error  Error: 2015-08-19 18:50:32.80     
Code: 0xC0208235     

Source: Data Flow Task Lookup [193]     
Description: Unable to locate reference column "lkey".  

End Error  Error: 2015-08-19 18:50:32.81     Code: 0xC004701A     Source: Data Flow Task SSIS.Pipeline     
Description: component "Lookup" (193) failed the pre-execute phase and returned 
error code 0xC0208235.  End Error  DTExec: The package execution returned 
DTSER_FAILURE (1).  Started:  6:22:40 AM  Finished: 6:50:38 PM  Elapsed:  44877.7 
seconds.  The package execution failed.  The step failed.

Regards,

Syed Jakeer

Require Suggestion on third party tools both PAID & FREE

$
0
0

Hi All,

I have designed a SSIS package which archives historical data from LiveDB to ArchiveDB.

Archival is done on department basis, each dep lead is given choice of how much amount of live data is required. If the LEAD selects '100'. Only 100 days of data is stored at LiveDB and other data is moved to Archival. All this info is stored in a table and dep LEADS have access to UPDATE the values. SSIS PACKAGE refers to this value while archiving.

However I would keep all the DIM tables in sync with LiveDB and ArchivalDB which would be a simple PROC.

This Package only archives FACT tables, all the FACT tables are kept in a SEQUENCE Container such that they run in parallel.

My Organization wants a third party which validates the outcome of the package sent a mail to DBA's about the archival status.

Validations like:

It should trigger the package at a point of time between 1AM and 5AM as per we schedule.

How many records are INSERT(ed) from STAGING table to PROD table.

How much data is loaded into FLAT files using BCP QUERYOUT and how much did the BULK INSERT process load the data into Archival DB.

It should keep a note of the failed process TABLEs and should include in the mail which tables have succeeded and failed.

There should be a choice to select or run only the failed tables manually.

We would appreciate if there is any option to auto-trigger the package to execute only the failed STEPS/ TABLEs on next day at the same time.

Thank you, please let me know if you require any other info.

Sending Mail with HTML Format in Send Mail task

$
0
0

Hi,

I have to send mail with HTML format  and attaching multiple files dynamically via send mail task. Please provide any suggestions to achieve this?

By

Guru


SSIS packages migration from 2005 to 2012

$
0
0

Dear Experts,

I am SSIS newbie. Please excuse my understanding of this concept. I am in the process of migrating all the SSIS packages from SQL Server 2005 to SQL Server 2012 (side by side migration). There are totally 6 packages. I exported all of the packages in SQL 2005 by this process.

Go to SQL 2005 Integration Services-> Under "Stored Packages", right click the package and click "Export Package". These packages get saved in .dtsx format.

Then I got to SQL Server 2012, open these packages in SSDT and get many error messages. Example below.

"The component metadata for could not be upgraded to the new version of the component. The performupgrade method failed"

"Convert to dates failed validation and returned error code". "The component is missing, not registered, not upgradable or missing required interfaces."

It is quite frustrating, I searched these error messages but couldn't figure out how to fix. Also, when I saw some videos online, some of them have showed opening the package as a project but my packages are all in .dtsx format. Is there someway by which I can save them as a project in sql 2005.

Please provide your inputs. Thank you for your help.

Thanks.


MM


Converting RTF files to PDF files

$
0
0

Hi Experts,

I have a scenario where I need to convert RDF files to PDF files? may I know is this achievable in SSIS - writing C# code? please share your suggestions or code.

appreciate your reply.

Thanks,

Sathish


-- Sathish


SQL job agent

$
0
0

Hello Friends,

Can i create a job to transfer data from DW from one server to another server DW?

Thanks 

Ranjan ds


Ranjan DS

SSIS not pulling all data from source

$
0
0

Hello ,

I have ssis package that pull data from SAP (Using ADO.net connection) to SQL server every night but i have noticed that all data from source is not getting pulled by package . package losing some amount of row.i don't know why its happening and how to solved this. can any buddy help me to resolved this problem.

Thanks

 


Akshay Adivarekar

How to insert rows in a wide table with over 13K columns

$
0
0

I have a flat file with 13K columns which I need to load in a wide table.

The flat file does not even have column names and no datatypes defined.

How to load data in the wide table?

Also if i choose to load the data in 13 different work tables.

How do I define datatypes in the flatfile connection manager in SSIS for 13000 columns ?

Thanks in Advance,

Sagar

SSIS 2005 - SharePoint List Source does not show all of its properties in BIDS 2005

$
0
0

Hello everyone,

Has anyone see this error before? When I try to edit my SharePoint List Source Component in BIDS 2005, it does not show all the properties as ListName, URL etc.



A normal state would be like this:

Image

Any ideas?

I already opened a thread at sharepointlistadapter codeplex discussion session as well. https://sqlsrvintegrationsrv.codeplex.com/discussions/643986

Thanks in advance, 

Thiago.


Thiago Patrocinio

Excel column more than 255 characters

$
0
0

Hi Experts,

Can anybody tell me how to import data into SQL table from Excel column which has more than 255 characters?

Thanks

Regards,

Kumar


KG, MCTS

How to load a 64 bit Excel(2010) if SSIS only provides tools for 32 bit and only up to 2007

$
0
0
When configuring an excel destination in SSIS it only allows for a 32 bit 2007 version.  If the destination is a higher version of excel and is 64 bit what is the work around.

overriding variable value with DTEXCECUI /SET option not working

$
0
0

hi I am trying to change variable value at run time in ssis 2012 package using DTEXECUI utility but can not see any changes happening in config file variable value and also data is not getting populated in my table as per new variable value.

Can anyone show me the right syntax or method of dynamically changing variable value either through DTEXECUI or DTEXEC
command propmt command.

Thanks in advance


srm_2010


What use is the "Validate..." function in SSISDB?

$
0
0

I have an SSIS package that I just deployed using the new Project Deployment model.  Last night it failed on its first attempted execution due to a missing field, which I had added to the development environment for debugging.

So, after slapping myself for not using the "Validate..." feature, I added the field and used "Validate..." to see if I'd missed anything else.  The process ran to completion, and the "All Validations" report shows a "Succeeded" status.

Then my paranoia kicked in, so I removed the field and re-ran the "Validate...", to make sure that it would have caught the error.  Much to my surprise, the process ran to completion again, and the "All Validations" report shows a "Succeeded" status again.

So what, exactly, does the "Validate..." function do, and why should I trust its results when I know that they're incorrect?

How to copy folder content/subfolders from FTP using SSIS

$
0
0

Hi Everyone,

Please how can I copy the content of the folder (including sub folders) from FTP location using ssis.

Thanks


me

FOR LOOP CONTAINER

$
0
0

Hello,  I have a nnnnn.cvs  that can be completed with 1 or 2 rows depending on a previous process .  

I need to do a for loop container evaluating : 

If i have 1 row i have to repeat the previous process and if i have 2 rows continuo with the next process.

Can anyone help me ?

Thanks in advance !!! 

migration from nav 2009 to 2013

$
0
0

Hi all,

what is the use of migration from nav 2009 to 2013??

AND IF I NEED TO DO SO can u guide me how to do, r a link which will explain step by step, as moving a old data warehouse to a new data warehouse.

Thanks

Ranjan DS


Ranjan DS

Using SSIS only to build backend enterprise system.

$
0
0

Hi I work with a .net team where the leadership has decided to use SSIS for ALL of backend processing, and that is the only option given to us.  I have pointed out the following issues with using SSIS this way to the leaders but they are disregarding these obvious flaws with this approach.  Could you please provide your expert thoughts on this, so I can share with them and perhaps try to persuade them out of this nightmare approach to development, and/or also do point out if I am wrong on this.  Big Thanks.

Issues I pointed out:

- SSIS is SQL centric technologies ( for mostly fast data transport and some transformation) and should not be over extended to write an entire enterprise transactional system that requires GUI's to maintain and has complex rules.

- You can cannot create reusable components/objects with SSIS, again because that is not what is meant for.

- They are running SSIS on app server (separate from SQL server) which requires additional SQL license.

- It is hard to debug (VS2005) because it does not have the same full fledge debugging and enhancement tools that you get with .net application using visual studio.

- You cannot do text compare against your source control.

- It is very hard to develop/maintain complex rules (which we have plenty of) using only SSIS.

- You cannot build GUI on top of SSIS and reuse anything for the GUI (which our support team is always asking for)

I have many more reasons but I think the above should get my point across.

Thanks again.

Viewing all 24688 articles
Browse latest View live