I am sure this has been asked in the past but i am unable to find the relevant information i need.
I have flat filles coming from multiple source and i need to Determine
Data Type. My Flat file connection can determine the data type but based on the say 1000 rows. Is there a transformation in ssis that can scan the whole file and suggest types ?
Good day,
As part of a project I'm working on we have a set of SSIS packages running from a Web API project, to load flat files into Teradata. The packages run smoothly when I debug the Web API project, but I'm now trying to set it up on IIS on a remote server in the company's intranet and I'm running into errors.
The main error is the ODBC acquireconnection method call failure, which I had solved both on SSIS and the WebAPI by setting it all to 32bit. I did the same with the app pool on IIS but the error persists.
I then, attempting to experiment, changed the target platform on the API project and set it to Any CPU and x64 in turn, and in both cases it executed perfectly as well, leaving me a bit confused to be honest.
When I returned to IIS on the server, I decided to make the application pool run in 64bit to see what happened and I get another error, this one saying it can't find the Microsoft.SQLServer.DtsRuntimeWrap assembly. This happens no matter what target platform I use for the API (at this point I was already trying every imaginative combination).
I'm stumped and getting to the "ripping my hair out" level of frustration. If anyone has attempted this in the past and you know what might be done, I hope you can help me.
Hi all,
I do have an Excel connection manager and an excel source. The connection points to a location on SharePoint (which is notated as \\share\folder\file.xlsx). In Visual Studio this works fine, but when it's deployed and started from the job (with another user than my own) I get:
Read files:Error: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNE CTIONMANAGER. The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC0202009. There may be error messages posted before this with more information on why the AcquireConnection method call failed.
Read files Excel Source [11]
Packagname:Error: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005 . An OLE DB record is available. Source: "Microsoft Access Database Engine" Hresult: 0x80004005 Description: "Het bestand is niet gemaakt.".
The last sentence means: File has not been made.
I'm sure that this has worked before in the exact same way.
The error is so generic that I can't determine what's going wrong. Does anybody have an idea?
My guess is that is an rights issue, but I'm not sure how to change rights on a SharePoint location, so I can't try.
Hi All.
I Have A SQL Server 2008.How to link to oracle DB and syn data.
Hi,
I'd like to understand better when it is useful to set the project/pkg protection level to the DontSaveSensitive option. I would apply this setting for a pkg having SQL connection manager that use the SQL Server authentication.
It seems that when I use this option inside the SSDT it doen't maintain the connection info for the validation task, and so I cannot execute any SSIS tasks already in error.
Any hekps to me, please?
I have a problem that I haven't resolved yet, and is the next.
I have a Master package.dstx which has Package1.dtsx and Package2.dtsx inside of it.
Master package invoke Package1 and this one has to send a value to Package 2.
At the beginning I used to run it as a whole project.ispac under SSISDB DB Server using environment variables and It hadn't problems.
But now, as a new requirement I have to execute this project outside of the DB Server, I mean, I have installed SSIS in another machine to use it as SSIS Server.
I can't execute my project or my all packages outside of the DB Server.
I don't want to invoke the packages from SSIS Server to SSISDB Server.
I want to execute them in the SSIS Server. why?
Because the packages access to FTP Site, use Microsoft Excel license, and send emails and we don´t want to expose our DB Server to "Internet".
I tried to use DTExe.exe utility invoking the master package, but then it throws an error which it can´t find neither package1 nor package2 because both are configured as ProjectType: ProjectReference,
So, I changed the configurations in both package to ProjectType:External Reference, and the second problem was that the parameters from Package1 to Package2 was lost.
Package2 doesn't receive Parameters values from Package1.
I had to create a variable in MASTER package and use it in Package1 and Package2 from Script task using (Dts.VariableDispenser.LockOneForRead)
and it was ok, but now, both package are taking the desing package variables that I put from SSDT, I don't know how configure this parameters that package1 and package2 should receive in another environment.
I tried to use package configuration file, but this works only under package deployment Model, so, since they have paremeters itsn't possible.
I need to put the package paremeters in this command code:
"C:\Program Files (x86)\Microsoft SQL Server\120\DTS\Binn\DTExec.exe" /DTS "\"\File System\Cruces GOLDMAN\MASTER\"" /SERVER SERVERNAME /CONNECTION "\"Cruces GOLDMAN_Finamex.dtsx\"";"\"C:\Confirmaciones\CrucesGOLDMAN\Cruces GOLDMAN_Finamex.dtsx\"" /CONNECTION "\"Send Email.dtsx\"";"\"C:\Confirmaciones\CrucesGOLDMAN\Send Email.dtsx\"" /CHECKPOINTING OFF /REPORTING Vusing /SET \Package.Variables[$Package.. doesn't work
I dont know the way to resolve this, can you help me pls?
best regars
Hi,
I am trying to get the start date and end date column in scd2 as below
start date as 23-02-2016(container start time) and end date as 01-01-9999(static) in place of null.
When loading the historical data this row of data should be treated as active and do the updates if any.
I know this how to achieve if enddate is null(standard procedure of SCD2) but i need the enddate as above and achieve same result.
Any suggestions would be helpful.
Thank you.
Kaish
Lava
I have one SSIS package and enabled ssis logging in that package and I selected all the details and saved this log files as Text Files. After completion of every package run log was created and we are using some VB Script to show filename as success or failure by considering onError keyword in log file.
Problem here is for some package runs login file don’t have ‘onError’ keyword and also log file contains information up to onvalidation part only, that’s the reason it don’t have ‘onError’ in log file and vbscript showing it as success in file name.
So What are the reasons and scenarios, If a logging file doesn’t captures the execute information in logging file.
Regards,
Raviteja
I am loading excel files with multi sheets into sql server table(s).
For example, there is only one dataflow task, in there, there are four sets of source to destination and each source being a sheet in the excel file.
On observation, I see that most of the time, the dataflow tasks (source to destinations) run in parallel but sometimes I get errors...
My question is could there be any locking of any sort if the data is being imported from multiple sheets into a sql server table?
Thanks
Currently We have SSIS 2012 Solution in Production Environment. We deploy it in SSISDB and daily running through etl job
This SSIS Solution has 1 master package and 50 child packages(all 50 child packages are running through master package) and variables are used in these packages for logging
What my requirement is
1. ETL Solution Should not be there in production Environment for security reasons.
2. We need to deploy ETL Solution from outside the production environment to ssis db of production environment(both are in same network domain)
3. Is there any possiblity to deploy from my local system to production system(both are different network domains but i am able to connect to production environment from my local system)
4. is there any possiblity to deploy the solution without opening the solution.
5. how to manage vairables.
tsrkreddy
Hi all
As you may all know that the data type for the StartTime and EndTime in the sysSSISLog table is DateTime, but when SSIS log mechanism Inserts records (I don’t think it updates) in these fields they using SmallDateTime, basically the “nnn-seconds” gets trimmed/Rounded off .
So you can’t have an extra custom Logging system on top of the Microsoft sysSSISLog table, the results will always be wrong.
Have this been reported to Microsoft, because this is clear that this is a bug? or am i missing something? I see the same results in SQL12.
Thanks
Sincerely Nik -- Please kindly mark the post(s) that answered your question and/or vote for the post(s).
Today, I'm being a pest.
I've made an SSIS package with several Sequence Containers and assorted tasks that are uncontained. However, all those white box headers makes it hard to visually comprehend.
So, I wondered if it's possible to color the boxes associated to the Sequence Containers. I didn't see any color options in the Properties window, so I figure the answer is "No," but I thought there might be a back-door way to do it.
Is there?
Thanx in advance!
Oh, forgot - I'm using Visual Studio 2008.
Hey everyone...newbie to CDC in SSIS here, so hopefully I can word this correctly...
I have a parent package that has 3 Execute Package Task in it. Each of those child packages (stored on file system in package deployment mode) do CDC on different tables. I have one parent package that runs 3 children to do an initial load of table A, B, and C. I then have a separate parent package that runs 3 children to do incremental loads on tables A, B, and C.
Whether in the Initial Load packages or the Incremental Load packages, do I need to have a different "State Name" (in the CDC Control Task editor)...one for each table?? Or can I always use CDC_State??
thanks in advance!
Brad
I have a job that I want to run that passes a variable to an ssis package. The variable is a filename but the filename changes daily. I have an access front end that the user
enters the filename into. The access program runs a stored procedure which writes the filename to a temp table and then runs the job. I would like the job to query that table for the filename and pass it along to my package variable.
I can get the job to work using a static filename. On the set values tab I used the property path \Package.Variables[User::FileName] and the value \\myserver\..\..\..\filename.txt. But I don't know how to replace that filename with the results of the query
Thanks in advance.
Scott
Hi,
I am trying to implement CDC - incremental for multiple tables. The number of tables is too large so it is not feasible for me to create a separate package for each table. So we have made it configurable using variable. But its behaviour is inconsistent.
I guess the reason maybe is cdc_states table which is storingcdc_state for each table execution.
Can you please tell me the feasible way to handle multiple tables? One more doubt I am having is, to handle multiple tables, do we need to create separate cdc_state tables?
Dear All,
I have a requirement that pulls data from Flat file source to sql Server Destination with business logics. I designed that SSIS package. Now the requirment is needs to send an email alert through Send mail Task.
Requirement:
Select Category,Count(1) as CntRecords from DimCategory group by Category
When I execute above sql query it returns some rows with number of records in Table. Now my requirment is I need to store result of Above query into a variable, that variable I can use in Send mail task message source.
Can some one help on how to fullfill this requirement.
Regards,
Praveen
Regards, Praveen
Hi - I have other steps that I am working on SSIS package, and in the middle I have a requirement where I have a flatfile in the folder, SSIS task should read from that folder and insert in SQL table.
What is that I need to do here ? How can I achieve this ? taking file and inserting into sql table ?
MBH