Hi,
I have a table with email addresses and CC_Flag.
Email | CC_Flag
xxxx 0
yyyy 1
zzzz 1
Using Task SQL, I am trying to pass these email addresses to two separate variables - To_field, Cc_field on basis of the CC_Flag
Is it possible to fill two variables from a single SQl Task, if so can you please help me on this !!
We are using the ssisdb catalog in sql server 2012 sp2.
I have implemented the ssisdb performance fix detailed here http://support.microsoft.com/kb/2972285/en-us to set encryption to the project level. Our default logging level is performance and our retention window is 7 days.
The main issue I'm facing is when the ssisdb cleanup job runs it blows up the ssisdb transaction log to an unacceptable size. We have about 8 sql agent job chains for different ssis jobs, all logging at performance level, and this seems to require a roughly 50-60GB ssisdb. When the cleanup job runs it requires roughly an additional 120GB. This seems excessive for deleting one days worth of performance logging.
Are there any bugs filed for this with MS or is anyone using a custom delete script that doesnt blow up the txlog so much? Everything I'm finding in my research seems to suggest that sp2 'fixed' issues with the ssisdb cleanup task but this seems very problematic to me still.
Hi All,
I have the following questions on Package Deployment using SSIS Catalog.
1. Can we deploy a single package in SSIS Catalog without affecting the other packages that are already deployed.
2. We created a package having lot of script tasks which was configured using SQL Server configuration table to pass the values from table to script variables. Now we need to use environment variable in place of Configuration table. If I do not use the Configuration from SSIS configuration table then I will not able to see any input parameters for the package to map them from environment variables.
Thanks,
Vishal Jharwade
I am working on a Script task that pulls AD info to a SQl table. So far many attribures I pulled from AD work fine.
But for PASSWD_CANT_CHANGE attribute in UserAccessControl, I always get the value of 0 meaning false. Help please
bool CannotChangePassword = false;
const int UF_PASSWD_CANT_CHANGE = 0x0040; if (Convert.ToBoolean(flags & UF_PASSWD_CANT_CHANGE)) { CannotChangePassword = true; // cannot get to here } else { CannotChangePassword = false; //always return false }
SQLFriend
Sometimes when debugging a large ETL process, I put on another data viewer within a data flow task, but forget to to take one or more of them off. Ok, I know this is lazy, but is there anyway to find where they are at without opening each dataflow task?
I am trying to check a excel file tab if it exists and trying to drop it however I am unable to do so as I get error message saying invalid sql statement : expected 'DELETE',INSERT,'PROCEDURE','SELECT' OR 'UPDATE'
My package has execute sql task at the begining which points to oldeb connection manager and is using following script tocheck if exceltab exists prior to creating in the next step
IF (object_id( `excel_tab`) is not null ) drop table `excel_tab`
Is this wrong I have taken care of single quotes as well but still it fails?
Mudassar
Hi all,
I am trying to automate a data flow with BIML. I am using an expression to build my SQL dynamically based on input parameter. Sparing details of the use case, I need this flexibility in my project. I am having 1 master table which consists of file name and source query.
I want to use SQL Command from Variable Data access mode in OLEDB Source.
On the basis of input file source query need to change automatically .However; my query is not being evaluated when the package is generated. The query will populate after package generation, when I open the source and set access mode SQL Command, but I cannot seem to get this configured automatically as desired. This is preventing me from doing transformations in the script.
Please help me to achieve the above scenario
Below is my BIML Script(C#).
<Bimlxmlns="http://schemas.varigence.com/biml.xsd">
<!-- Database Connection manager-->
<Connections>
<ConnectionName="Archive"ConnectionString="Data Source=RLDEVOLP03.DEVELOPMENT.LOCAL;Initial Catalog=Archive;Provider=SQLNCLI11.1;Integrated Security=SSPI;Auto Translate=False;" />
<ConnectionName="DataStaging"ConnectionString="Data Source=RLDEVOLP03.DEVELOPMENT.LOCAL;Initial Catalog=DataStaging;Provider=SQLNCLI11.1;Integrated Security=SSPI;Auto Translate=False;" />
</Connections>
<!-- Name Of the the Package-->
<Packages>
<PackageName="LoadArchive Using BIML"ConstraintMode="Linear"ProtectionLevel="EncryptSensitiveWithUserKey">
<Variables>
<VariableName="V_Archive_tablename"DataType="String"></Variable>
<VariableName="V_Archivequery"DataType="String"EvaluateAsExpression="true">SELECT a.*, b.BBxKey as Archive_BBxKey, b.RowChecksum as Archive_RowChecksum FROM dbo.ImportBBxFbapp a LEFT OUTER JOIN Archive.dbo.ArchiveBBxFbapp b ON a.Col001 = b.BBxKey Where (b.LatestVersion = 1 OR b.LatestVersion IS NULL)
</Variable>
<VariableName="v_Src_FileName"DataType="String">FBAPP</Variable>
<!-- Load Data Truncate Staging Sequence Container-->
<ContainerName="Load Data Truncate Staging"ConstraintMode="Parallel">
<Tasks>
<DataflowName="Archive Data"DelayValidation="true">
<Transformations>
<OleDbSourceName="Source"ConnectionName="DataStaging"ValidateExternalMetadata="false">
<TableFromVariableInputVariableName="User.V_Archivequery"/>
</OleDbSource>
</Transformations>
</Dataflow>
</Tasks>
</Container>
</Tasks>
</Package>
</Packages>
</Biml>
Regards,
Vipin jha
Thankx & regards, Vipin jha MCP
Hi
I checked (using my SSMS2012 from my laptop connecting to SM-CNTS-VWW01 server) the Data Source tab from the Job Properties after I have updated the package configuration but it didn't reflected the changed I made.
Surprisingly, if I remote connect to that server and open SSMS2012 (local). It shows the correct connection string (SM-CNTS-VSQL03 ). Basically I'm connecting to the same server, verify the connection of the same JOB but I'm getting different result?
SSMS version from Laptop
Microsoft SQL Server Management Studio11.0.5058.0SSMS Version from the SM-CNTS-VWW01 Server
Microsoft SQL Server Management Studio11.0.3153.0Hi ,
Can anyone please tell how we can use a stored procedure inside a execte sql task
I have stored proc with one input parameter and the execute sql task I have declare the parameter .
I have geiven the below code in the execute sql task
exec DATA_COMPARE ?
Data_comapre is my stored procedure name and I am getting syntax error . How we can call sp from execute sql task
Thanks
Jeeva
Hi,
I have data rows ( 7 rows and hundreds of colums) obtained by using execute sql task and i placed the output in CSV. Then I also moved this data in csv into excel (first row of excel)using simple data flow task with flat file source(CSV) and excel destination connections. However, I need to push data into 3rd row of excel sheet(I need to write some description and titles in the first two rows) .I need to do this inorder to automate the process of producting the excel which has predefined pivot tables. I only need to update the excel sheet with raw data( 3rd row) which drives the pivot tables.How do I do this? How do i push into the third row instead of first?
Thanks in advance
Hi, We are using SSIS 2014 and have Project parameters & connection managers. In this ETL solution we have packages that use most of the project connection managers. But, there are also a few SSIS packages which do not use all these connection managers. In that I want only those connection managers related to that specific package. If I delete a project connection manager from a package it deletes it altogether from the project itself. What's the work around for this?
For instance: There's ProjConnMgr1, ProjConnMgr2, ProjConnMgr3. I have 5 different SSIS packages and all use ProjConnMgr1 and only 3 use ProjConnMgr2 & 2 use ProjConnMgr3. So, in the 3 SSIS packages in the Connection Manager we just want to see ProjConnMgr1, ProjConnMgr2 and the remaining 2 ProjConnMgr1, ProjConnMgr3.
Hope this expalins....
Thanks in advance......
Ione
Hello,
So I'm creating a package and I want to constantly update my dimension tables when new user information is given. The dimension table I am using is Dimension User including their first name, last name, full name and email ID. Now their is a small glitch
from the data I am pulling. When I pull the data from the source the first name includes the first name and last name and all the other data is fine. So before loading it back into the OLE DB Destination I did a "copy's columns" transformation so
that the first name column is copied into the full name column. Now when I put a data viewer right after the "copy column" transformation it shows everything correctly, first name is the full name, last name is last name and full name is same as
first name.
However the output displayed once it enters back into the DIM user is "unknown" for both first name and full name.
"Unknown" was a condition I had put into original script if their is a NULL term. But there isn't a NULL term because last name and email ID columns are populated
So where is the problem being caused?
Hi experts,
Trying to upload excel in server where excel is not installed. BIDs was there in the server, when i am trying to craete Excel source I am not able.
what the workround for this.. How to upload excel without excel installed on the server.pls guide me.
I have a SSIS master package and then some child packages that performs certain jobs. A for loop (with iteration of around 3000) in the master package executes the child packages using Execute Package Task tasks.
The issue is every Execute Package Task creates threads and these threads get accumulated and never gets closed. And at one point of time I see 3000 threads against the SSIS Debug Host process in windows task manager and ultimately the package fails/ hangs.
I am running the package in Debug mode in BIDS (SQL Server Data Tools) 2012.
I have tested this creating a simple package with for loop and Execute Package Task inside it with child packages that do nothing. The issue is reproducible. Hence it is not something specific to my code.
Now, as creating child packages for better maintainability and re-usability is recommended, how to deal with the threading issue.
Any help will be appreciated.
Thanks.
Hi all,
We have many SSIS packages built in Visual Studio 2008 and previously deployed to SQL 2008 (SSIS 10) and then migrated to SQL 2012 (SSIS 11).
Most packages work OK but a couple hang and never complete. These import text files with a footer which has a different number of columns to the data rows. We have found that SSIS 10 allowed this OK and the footer row was filtered out once in SSIS.
Every bit of documentation states that in SSIS 11 (SQL 2012) the flat file import has been improved but as far as we can see it means that some of our imports do not work. The data looks like this:
10; 234234;SMITH;2015-01-07; 3123123123;VE65
10; 234234;SMITH;2015-01-07; 3123123123;VE65
10; 234234;SMITH;2015-01-07; 3123123123;VE65
99;000277;000000
You can see the footer has a different number of columns. In SSIS 11 (SQL 2012) it starts to process the file and never completes, the SSIS package runs continuously and does not complete, I have to stop it.
I can find no other references to this on the internet, I really do not want to pre-process the file or use a custom script as a data source for the import because there should be a way to handle this - it must surely be a bug if it hangs?
Is there a update I need to do to fix this?
Regards,
Gary.
I have a excel file which has a column called "Code" and their values are A,B,C,D,E,F,G,H. I want to create a new column called "status" based on the values of "Code".
Code:
A
B
C
D
E
F
G
H
If A,C,E,G then "status" = "Active" else if B,D,F,H then "Status" = "Inactive". I like to do it using "Derived Column".
Venkat G
Hi, We are using SSIS 2014 and have not implemented checkpoints in the prior versions of SSIS. Just wanted to explore the idea if a checkpoint file be used for all the packages in a project or is it better for reliability have 1 checkpoint file for each package.
Thanks in advance.....
Ione
I built my first SSIS package. It takes 25 minutes to run. It pulls 3500 rows from a view (15 columns), converts to Excel data types, then updates one column of values using an expression, then writes to an excel file.
The sql script for the view takes 3 mins when run in SSMS.
I am not sure if this is normal, or if I need to debug to make things faster?
I am using OLE DB source to extract data from Oracle. I have query (sample) like below, but SSIS is converting ID as Unicode String [DT_WSTR]. Why is that? and how to avoid this?
SELECT
1 AS ID
FROM
ORACLE_TABLE
I saved an SSIS package that was straight forward import a table from a local access database into a table with the same name in SQL Server using the Wizard in SSMS. Is it possible to have that package drop the table if it exists before import?