Hi All,
I want extract data from teradata to flat file destination . I am not able to see any oledb providers for teradata. can you please suggest me the best approach to load that data.
Thanks,
CMK.
Extract Data From Teradata using SSIS Package
↧
↧
long rows text file input
Hi all,
I have a text file with fields separated by pipes that are about 1300 characters long for each row.
When I open the file with Notepad the lines are wrapped as Notepad does not accept more than 1024 caharacters on one line.
I can see the rows wrapping up in the text file connector within SSIS, as well
Anybody has any idea on how do I import this text file using SSIS?
Thanks,
elsvieta
↧
Can I use an OLE DB Connection to process an Excel File in SSIS?
Can I use an OLE DB Connection to access an Excel File rather than an Excel Connection Manager?
Is there a procedure, website, YouTube that might walk me through this?
Do I have to create an OLE DB Connection to process a Microsoft Excel 2010 File?
Thanks for your review and am hopeful for a reply.
↧
Why isn't Microsoft Excel 2010 available within the Excel Version drop-down when creating my Excel Connection Manager
Creating an Excel Connection Manager and when I do so I do not see an Option for Microsoft Excel 2010 in the Excel version drop-down. Why is that?
↧
How to read data from VSAM files of IBM mainframe with SSIS and store it as relational data in SQL Server?
Hi Everyone,
I am working on a task to extract data from a bunch of VSAM files from IBM Mainframe and store it into SQL Server as relational data, I found that in many of the discussions, talking about creating a ADO.net Connection with ADO.NET Data Provider for Host Files, then use Data reader source to access data, but I am not able to find the driver(ADO.NET Data Provider for Host Files) in drop downlist when creating the ADO.net Connection.
I also can't find the provider in SQL Server 2012 SP1 Feature Pack, where can I download the provider without installing HIS 2013?
Johnny Wang
↧
↧
Execute SQL Task does not Update from a Date Variable Reliably
I'm using a DateTime variable in SSIS 2008 that is used to set the SQLStatement property of an Execute SQL Task.
"DELETE FROM Labor WHERE Week = '" + (DT_WSTR, 100) @[User::Week] + "'"
Week is the next Sunday:
DATEADD( "day", @[User::DaysTillSunday] , @[User::TheDayThatIsTwentyMinutesPrior] )
DaysTillSunday:
DATEPART( "dw", @[User::TheDayThatIsTwentyMinutesPrior] ) == 1 ? 0 : 8 - DATEPART( "dw", @[User::TheDayThatIsTwentyMinutesPrior] )
TheDayThatIsTwentyMinutesPrior:
(DT_DATE)(DT_DBDATE)DATEADD("minute",-20,GETDATE())The SSIS Package deletes the current week's data, reloads it with fresh data, then calculates the difference between the current week and last week.
The problem is that randomly, instead of deleting the current week, it will delete the previous week. This happens maybe 5-10% of the time. At least it does until I rebuild the package and import it into SQL Server again.
I'm guessing that the Execute SQL Task is not updating the value of the Week variable before it executes. I started with the source type being a variable. Then I decided to try Direct input and pass in the Week as a parameter (OLE DB Connection Type). That didn't work either.
Most recently I tried writing the Week variable to a table first, then having a sequence container with all the tasks second. Slightly better but I still saw the date was wrong 2 times in about 90 executions. I was hoping that writing the Week variable out to the database would force an update of any associated connections to it, but that didn't seem to work.
Any ideas? Is this a known issue, am I missing a setting?
thanks,
John
↧
Querying from source with different schema but same destination
Hi,
We have a sticky problem. The Data warehouse component runs as an enterprise component, the source systems we collect data from could be on different versions. There could be minor differences between versions of the same source type, for ex. there is a new column added in a table and we need to get this new field as well into the data warehouse.
What we are thinking is to have one ETL package, but run different versions of stored procedures on the source to return the same meta-data. This means whenever we upgrade the Data warehouse to the latest version, we need to generate different stored procedures according to the source system version.
An Ex. latest release 7.31 and prior version supported is 7.3. In 7.31 there is a columnx added to Tabley
the query to pull the data from 7.31 would be SELECT Column1, Coulmn2, column3 ......, columnx from Tabley
the query to pull the data from 7,3 would be SELECT Column1, Column2, Column3,....., 0 AS columnx from Tabley
Is there a way in sql to write a single query that works on all versions of the source. i.e for the system where the column does not exist it should return a default value (based on data type)
Thanks,
lm
↧
Transfer file clean up: What is best practice when creating files with timestamps?
Created an SSIS package to create files that will be sent which are created with a time stamp. What is the best procedure of clean up for the files? I'd like to keep at least a day of files for verification purposes.
↧
Execute process task 7zip
hi,
i am using 7zip in ssis process execute task. variable name defines the files to be zipped. all works fine till at random times the process execute task takes the default values of the variables instead of the run time values. And then ssis package execution stops.
Also the package is executed from code with LoadFromSqlServer so no error is returned back
↧
↧
Possible to send one email notification containing a list of the data flow tasks that completed successfully?
Hello. I have a package that has 7 independent data flows. They each use a script task to check for the existence of an excel file in a folder, and if found they load the data to SQL Server and then move on to the next data flow. If a file is not found,
they just skip that data flow and move on to the next one. They are all in one sequence container in order to use transaction support to rollback upon failure.
I need to notify the users upon a successful data load to SQL Server, and I'd like to do that in one email at the end of the package. So if data flows A, B, C, D, E, F, G are all my data flows, and only the excel files for C and F are present and load data to SQL Server, I'd like to send one email that says the data for C and F were successfully loaded to SQL Server. I am trying to avoid sending 7 separate emails.
I'm adding a screen shot of my package so you get the general idea of what I'm trying to do.
I am open to any suggestions! I am by no means an SSIS expert, still learning the basics. So anything helps. Thanks so much!
WeeLass
↧
Create packages programmatically using C# for PDW destination.
Hi,
We want to generate packages programmatically using C# for PDW destination. We are looking for Microsoft.SqlServer.Dts.Pipeline.SQLPDWDestinationAdapter and Microsoft.SqlServer.ISSQLPDWDest for this. These DLLs are used in SSIS for PDW destination adapter.
Is there any way to do that? Are these DLLs available for developers? We have also tried BIML using BIDS helper but no luck.
Any help is appreciated.
Thanks and regards,
Tejal
↧
Update/Insert records from Oracle to MySQL
Hi team,
My application will insert/update records into Oracle database, I need to sync all of records into MySQL database. I designed a package to load data from Oracle to MySQL, the Oracle database use OLE DB component and MySQL database use ADO.NET.
How to insert new records into MySQL? If the old record exists, we also need to replace with new record. I did some research, someone suggest to create a stage table to handle this scenario, but I have 14 tables in this case. How to handle this scenario with high performance?
If there is anything unclear, please let me know.
Thank you in advance.
↧
[Flat File Source [2]] Error: Cannot open the datafile "VendorPurchases20050512.txt".
hi
I'm trying to use foreachloop container in order to read the data that i have in several txt files and upload it into MRR table.
when i'm trying to run the package, i'm getting the following error:
[Flat File Source [2]] Warning: The system cannot find the file specified.[Flat File Source [2]] Error: Cannot open the datafile "VendorPurchases20050512.txt".
[SSIS.Pipeline] Error: Flat File Source failed the pre-execute phase and returned error code 0xC020200E.
I don't know what's the problem since it was working before.In the flat file connection manager i defined all the path including the name of the file.
I'll be happy for assistance
thanks
Yaron
↧
↧
Prevent SSIS from creating an empty flat file
I created a SSIS to export to a flat file (from a SQL command : a stored proc).
I don't wan't my SSIS to create an empty file if there is no data.
How can I achieve this ?
Thanks,
Vince
↧
"General network error" - while connecting to SQL 2000 DB instance from SQL Agent Service
I seem to get the error as below, when I try to execute an SSIS package from SQL Agent service on a remote server (SQL 2012 instance).
-------------------------------------------
SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available. Source: "Microsoft OLE DB Provider for SQL Server" Hresult: 0x80004005 Description: "[DBNETLIB][ConnectionRead (recv()).]General network error. Check your network documentation.".
------------------------------------
The package tries to Connect to a SQL 2000 database instance, and errors out with this message.
Any ideas how to fix this?
Thanks
P
↧
How to send processed files into one folder and error files into another folder while loading data into destination using FileSystem Task in ssis
How to send processed files into one folder and error files into another folder while loading data into destination using FileSystem Task in ssis
↧
How to run a Dos batch from SSIS based on SQL table content
Hi,
I have a very simple package with an execute sql task. This task checks if a certain record is present in the DWH or not. This record is always a row in a table where the task checks if the time of the latest data import equals today's date. I would like to extend tis package so that if that record exists,so the latest data imoprt was succesfull in the DWH then package runs a .BAT file from the file system, if the reocrd is not present do nothing.
Is there a TSQL command to run a .BAT file from my file system? I did not really find my answers on the net so any help is appreciated
Thanks
↧
↧
Advice needed in opting the best way to update database using flat file sources
Hi
I have a flat file sources and these get updated once in a day.
My job should once in a day, it will update the tables with below info according to the flat files
1. Adding new records in the source file
2. Updating old records information, with a log
Can someone advice me which is the best procedure to implement this?
Should i opt for Slowly Changing Dimension or Merge join to obtain this?
I know SCD has a feature to record the start & end date of the current record and will create a new record when it is updated.
↧
regarding ssis - sending errors to table
Hi,
In running package i am getting an eeror, that error i should send to one table
please help me
↧
Sql Server 2012 Upgrade Advisor SSIS Instance upgrade errors
Running SQL Server 2012 Upgrade Advisor on a SQL 2008 R2 SSIS instance got the following errors all pointing to the data collector/MDW packages deployed under SSIS instance. first error is shown as critical the second one as warning. how to upgrade the dc packages in 2008 R2 SSIS instances to 2012, or the next 2 errors can be neglected?
SQL Server Integration Services PostUpgrade
Recompile third-party and custom components to work with SQL Server 2012. In SQL Server 2012, Integration Services has changed its application programming interfaces (APIs). To be compatible with these new APIs, all third-party and custom components may
need to be recompiled. SQL Server 2008 and 2008 R2 components can use assembly binding redirection to continue working in SQL Server 2012. SQL Server 2005 components may require additional code changes to work with SQL Server 2012. Package Name: TSQLQuery_ServerName_MSSQL10_50_MSSQLSERVER_{GUID}_3_Collect
Source Type: Repository Package Location: /MSDB/Data Collector/Generated/TSQLQuery_ServerName_MSSQL10_50_MSSQLSERVER_{Guid}_3_Collect
as well as
SQL Server Integration Services PostMigration
Update provider names in connection strings to be compatible with SQL Server 2012.In SQL Server 2012, connection strings require a different value for some provider names. The value for the SQL Server Native Client provider is now SQLNCLI11. The value for the
OLE DB Provider for Analysis Services is now MSOLAP.5. To automatically update these provider names, use the Package Upgrade tool to upgrade SQL Server 2005 and SQL Server 2008 packages. You can also manually update these names in Business Intelligence Development
Studio.
Package Name: TSQLQuery_ServerName_MSSQL10_50_MSSQLSERVER_{GUID}_3_Collect Source Type: Repository Package Location: /MSDB/Data Collector/Generated/TSQLQuery_ServerName_MSSQL10_50_MSSQLSERVER_{GUID}_3_Collect
↧
More Pages to Explore .....
