Hi,
i have different sources in one folder like csv,excel,rar,pdf .so, i want to send these sources into different destinations like csv source into csv dest,excel-excel,pdf-pdf
↧
Regarding SSIS - send these sources into different destinations
↧
Using Excel 2012 file in the Excel Connection Manager
Hi,
I need to process a 2012 Excel file. In SSIS Connection Manager, I am only given an option until Excel 2007 version. When I use this in my connection for Excel Source, I am prompted with this error when I attempt to select the name of the sheet:
"Could not retrieve the table information for the connection manager 'Excel Connection Manager'.
Failed to connect to the source using the connection manager 'Excel Connection Manager'"
Can someone help on this please? Also my Run64BitRuntime is set to false.
cherriesh
↧
↧
Error Handling and Logging with Propagate as False in SSIS
Hi,
I'm using a Foreach Loop Container with different tasks included like like,XML task,Execute SQL Task,Script Task
Here the foreach container is used to flow through XML files in a folder.The requirement is that,even if i found any file corrupted,i just should log it and transfer the file to a FAILED folder and just continue the foreach with next file.
For that i have set the Propagate Property of ErrorHandler Event as False,which is letting me continue even at the case of error.But my logging and moving the corrupted files to Failed folder is not happening...
Please help with your valuable suggestions..
↧
Debug Host has stopped working - SQL Native Client
Debug crashes when I use an Execute SQL Command or a Data Flow connection using the SQL Native client (10 or 11) in both BIDS (2008) or SDT (2012). This error has appeared very recently, within the last 10 days. A coworker also gets the same error. Problem details are below:
Problem signature:
Problem Event Name: BEX64
Application Name: DtsDebugHost.exe
Application Version: 2011.110.2100.60
Application Timestamp: 4f35eae1
Fault Module Name: sqlncli11.dll_unloaded
Fault Module Version: 0.0.0.0
Fault Module Timestamp: 50821094
Exception Offset: 0000000037f5c71a
Exception Code: c0000005
Exception Data: 0000000000000008
OS Version: 6.1.7601.2.1.0.256.48
Locale ID: 1033
Additional Information 1: 76a1
Additional Information 2: 76a173c26a6dc2e3cd83ac8fd9f8bdb9
Additional Information 3: 87e5
Additional Information 4: 87e55fe84cbc37101714166da3323550
Any assistance would be appreciated
↧
error with reading variable data type not supported in expression in SSIS package
Hi,
In my Sequence container
SQL Task for FULL RESULT SET-SINGLE ROW assign variable with filename:: VFILENAME(Variable in SCOPE of Package level),
SQL task- Create Excel sheet
Data flow-OLEDB -Excel
Package 3 Tasks run successfully and Excel generated as per requirement but Sequence container shows in Red
and while saving the package shows Error of
Non fatal error occurred while saving the package
Data type of variable:VFILENAME not supported in expression
Error code: reading variable :0*COO470D0
Please help on to green in Sequence container
Thanks
--MADHU
↧
↧
SSIS Master Package taking long duration / gap between two sub package execution.
Hi All,
I have a master package which runs other sub packages and its schedule to run in back end, in master package each Execute package task transfers control to other on "Success", we have used logging in each sub packages to report start time and end
time of the package execution in sysssislog table.
The problem is if i query sysssislog table there is huge gap between end time of package A and start time of package B. I don't understand what is happening in between.
If i run the same in front end from IDE this doesn't happen at all, I don't understand how to debug this.
Please help me.
Regards,
Harshit Vasa
↧
date data extration problem in SSIS
Hi All,
I have excel file and having field structure like below
File:
[Brand] [varchar](200) NULL,
[Pack] [varchar](200) NULL,
[Manufacturer] [varchar](200) NULL,
[Division] [varchar](200) NULL,
[ATC1] [varchar](200) NULL,
[ATC2] [varchar](200) NULL,
[ATC3] [varchar](200) NULL,
[ATC4] [varchar](200) NULL,
CU Month/6/2010,
CU Month/7/2010,
CU Month/8/2010 ,
R Month/6/2010,
R Month/7/2010,
R Month/8/2010 ,
UN Month/6/2010,
UN Month/7/2010,
UN Month/8/2010
i Have UNPIVOTED this put it in a table
Table:[CalendarDate] [varchar](50) NULL,
[MapTime] [varchar](200) NULL,
[MapValue] [varchar](200) NULL,
[Brand] [varchar](200) NULL,
[Pack] [varchar](200) NULL,
[Manufacturer] [varchar](200) NULL,
[Division] [varchar](200) NULL,
[ATC1] [varchar](200) NULL,
[ATC2] [varchar](200) NULL,
[ATC3] [varchar](200) NULL,
[ATC4] [varchar](200) NULL,
[Measure] [varchar](200) NULL
in [measure] Column i have put
CU Month/6/2010,
CU Month/7/2010,
CU Month/8/2010 ,
R Month/6/2010,
R Month/7/2010,
R Month/8/2010 ,
UN Month/6/2010,
UN Month/7/2010,
UN Month/8/2010
column's data with
SUBSTRING(LTRIM(MapValue),1,2) == "CU%" ? "CUnits" : (SUBSTRING(LTRIM(MapValue),1,2) == "UN" ? "Units" : (SUBSTRING(LTRIM(MapValue),1,2) == "R " ? "Value" : NULL(DT_WSTR,5)))
SUBSTRING(LTRIM(MapValue),1,1) == "R" ? "02" + SUBSTRING(LTRIM(MapValue),8,8) : "02" + SUBSTRING(LTRIM(MapValue),9,8)
condision
But problem is [CalendarDate] data is showing like 01 rather than
01/8/2010 formate and in [Measure] column data is NULL.
Can anyone suggest how to do it?
Thanks
↧
Can't see DQS knowledge base in SSIS DQS Cleansing component
I have created a knowledge base and published it. But when I go to my SSIS package on the same SQL server and add a DQS Cleansing step I cannot see the knowledge base I have created. I create a new data quality connection manager to the localhost and the test is successful but it doesn't show my knowledgebase.
Why? How can I get the knowledgebase to appear
↧
Calling a SQL agent Job from SP with parameters -2012
I am experimenting with calling a SP with parameters which needs to be passed to SQL Agent JOb which internally calls the package.
we will be getting dynamic values as input for the SP call which needs to be passed to the Job, could you please let me know if there is a way in 2012.
I have checked multiple forums , none suite to my twisted conditions
Thanks!
↧
↧
Executing SSIS Package remotely via Unicentre Scheduler
Currently our SSIS packages were executed via SQL Agent scheduler.Due to a corporate decision all the schedules now needs to be brought to another remote scheduler called Unicentre .My DBA has turned down the design to run the SSIS packages via XP command shell or DTEXEC.EXE Command Line Utility citing various security reasons. Can you please suggest a method by which I could run the SSIS package remotely, without directly running the process on the DBserver box.This has to be scheduled via Unicentre scheduler.
↧
Package Configuration File to change Package Name
BIDS 2008, SQL 2008 R2
I want an easy way to uniquely name the package that is deployed in the MSDB. Want a package deployed as Store01, Store02, etc, each with their own connection strings and passwords.
Have a package with two Connections. Created a XML Configuration File. In the Package Configuration Wizard, picked Properties -> Name as one of the configurations . Save the project and build. When I click on the manifest file the and the Package Installation Wizard launches I can type anything I want in the Name configuration, but the package name is still the one in the manifest <Package> which is basically the dstx file name. How can I control the package name, without manually renaming in SQL SSIS.
↧
Creating a SSIS package to get data from free DBF (Visual FoxPro table) in 64 bit SQL Server
Hi everybody,
I originally posted in the wrong forum MSDN Thread
I'm trying to create (for test purposes) a package to load data from VFP table into SQL Server 64 bit. So far I can not figure out how to do it - I created DSN as outlined in Todd's blog, but I don't know what to do next.
Can someone please give me step by step instructions so I will know if it's possible or not? I was under impression it's not possible, but Todd's blog seems to suggest otherwise.
Thanks in advance.
Premature optimization is the root of all evil in programming. (c) by Donald Knuth
Naomi Nosonovsky, Sr. Programmer-Analyst
My blog
↧
Execute multiple SQL queries and record results using SSIS
Hi All, I'm trying to achieve following in SSIS. Could you please advise what is the best way forward?
Execute multiple SQL files and record the results in a format that an analyst could review (such as excel).
Background - The SQL files are individual test scripts to validate data between source and target post ETL execution. They are written in following format: 'sql1 EXCEPT sql2 UNION ALL sql2 EXCEPT sql1'. If this compound SQL retreives rows, then that data validation test is considered as Fail since mismatches were found, otherwise, it is considered as Pass. Therefore some SQLs will yield rows while some might not.
↧
↧
BIDS SSIS Packages with passwords
BIDS 2008, SQL 2008 RS
So much wrong today. I will try to stay on point.
(1) Created a BIDS SSIS package. Set the Package Properties -> ProtectionLevel to EncryptAllwithPassword. BIDS Save all -> build -> Close Project. DSTX file is encrypted. But when i reopend the project in BIDS it does not ask for a password. At least it did not the first 10 times i opened and closed but now all of a sudden it is asking for one. Is there some kind of delay or something special you must do to get a new ProtectionLevel to take? Is the ProtectionLevel known to be flaky?
(2) Also, click on the manifest file and deploy with the Package Installation Wizard. I tell it to verify the installatino. It asks for a password, asks for my configuration values and does a verifiction. Then the wizard says that package is encrypted with a password and that i did not provide it or it is wrong (i did provide it 3 screen earlier and it was correct). The package installs successfully but it bothers me that an error is given during the verification step. Any idea how to get around this verification step not getting my entered password?
(3) When I go into SQL SSIS packages, Run Package, Connection Managers I can see the connection strings. It never asks me for a password. I have other packages in the shop that ask for passwords when you click on some fo the Execute Package Utility steps. Why is my package not asking for a password not asking for a password?
↧
SSIS XML Configuration Package in plain text
BIDS 2008, SQL 2008 R2
Support SQL 2005, 2008, 2008 R2, 2012
Created a BIDS SSIS package with a configuration file. One of the configuration variables is the password for a connection string. The package is installed with the Deployment Installation Wizard and the password is entered here. Then the package is deployed and the configuration file is copied to the DTS\Package path. If you look in the config file the password is in plain text. This is not acceptable. What are some options? My 2 main requirements are (1) sensitive informatino is secure (2) distribute packages to multiple clients and they must install the package with their own connection strings.
↧
Error - No Value given for one or more required parameters
I have a lot of packages that I run Stored Procs with. I don't write the procs just build the packages and export the data.
In my Source editor I always use this:
SET FMTONLY OFF;SET NOCOUNT ON;
exec [Extract].[usp_HB_VEI_Outbound_Collections] ?,?,?
and in my Set Query Parameters I use the same name for the parameters as they are in the proc
@StartDate, @EndDate and then point them to variables. E.g. user::prmStartDate, user::prmEndDate
Now today I am getting the error "No Value given for one or more required parameters" on a new package. But when I went back to old packages to make sure I was building the SQL Command text and parameters correct I found all my old packages trigger
this error now.
The only thing I can think of is that I have installed SQL Server 2012 data tools on the box and that is causing it or the SQL Server has been updated with a patch or hotfix.
Has anyone else seen this? Is there a work around?
Thanks,
Phil
↧
Error when converting CSV field (DT_STR) to DT_I4 in data conversion task
Hi,
I have a flat file source (CSV) and I am converting one of its field (DT_STR) into DT_I4 through data conversion task when I get this message? The values I'm getting from CSV is either a number or a NULL.
Error: 0xC02020C5 at Load file to SurveyData, Convert to proper data length [2]: Data conversion failed while converting column "OB" (3250) to column "cnv_OB" (1281). The conversion returned status value 2 and status text "The value could not be converted because of a potential loss of data.".Error: 0xC0209029 at Load file to SurveyData, Convert to proper data length [2]: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR. The "Convert to proper data length.Outputs[Data Conversion Output].Columns[cnv_OB]" failed because error code 0xC020907F occurred, and the error row disposition on "Convert to proper data length.Outputs[Data Conversion Output].Columns[cnv_OB]" specifies failure on error. An error occurred on the specified object of the specified component. There may be error messages posted before this with more information about the failure.
What could have caused this error?
cherriesh
↧
↧
Dynamically Create table and insert the records from source to destination in sql query
Hi,
i have written below query for dynamically create the table and insert the records from source table.
Declare @Sql Varchar(Max)
Declare @x int
declare @value varchar(100),@schema varchar(100)
SET @schema='aaa'
Declare @f1 Varchar(100)
Declare @table Table(Idt Int Identity(1,1),grp_id numeric(18,0),id int)
DECLARE @TABLENAME_2 NVARCHAR(100)
DECLARE @TABLENAME_1 NVARCHAR(100)
DECLARE @TABLENAME_3 NVARCHAR(100)
SET @TABLENAME_3 ='cde..table2'
SET @TABLENAME_2 ='abc..table1'
Insert Into @table Select Distinct grp_id,0 from abc..table1
Select @x = Max(Idt) from @table
select @value=(select id from cde..table2 where Shortname='+@schema+')
While @x>0
Begin
Select @f1= grp_id From @table Where Idt = @x
SET @TABLENAME_1='condition_' + @f1
Set @Sql =
'If Exists( Select 1 from sys.objects where name = condition_'+@f1+' And Type_Desc = ''USER_TABLE'')
Insert Into condition_'+@f1+' Select * from '+@TABLENAME_2+' Where grp_id = '''+@f1+'''
Else
Select * Into condition_'+@f1+' from '+@TABLENAME_2+' Where grp_id = '''+@f1+'''
alter table condition_'+@f1+' add id int
update condition_'+@f1+' set id = '+@value+''
Set @x = @x-1
---print @sql
Exec (@Sql)
End
this query is executing but not create the table and insert the records.
please check this query.
Regards,
Abdul Khadir.
i have written below query for dynamically create the table and insert the records from source table.
Declare @Sql Varchar(Max)
Declare @x int
declare @value varchar(100),@schema varchar(100)
SET @schema='aaa'
Declare @f1 Varchar(100)
Declare @table Table(Idt Int Identity(1,1),grp_id numeric(18,0),id int)
DECLARE @TABLENAME_2 NVARCHAR(100)
DECLARE @TABLENAME_1 NVARCHAR(100)
DECLARE @TABLENAME_3 NVARCHAR(100)
SET @TABLENAME_3 ='cde..table2'
SET @TABLENAME_2 ='abc..table1'
Insert Into @table Select Distinct grp_id,0 from abc..table1
Select @x = Max(Idt) from @table
select @value=(select id from cde..table2 where Shortname='+@schema+')
While @x>0
Begin
Select @f1= grp_id From @table Where Idt = @x
SET @TABLENAME_1='condition_' + @f1
Set @Sql =
'If Exists( Select 1 from sys.objects where name = condition_'+@f1+' And Type_Desc = ''USER_TABLE'')
Insert Into condition_'+@f1+' Select * from '+@TABLENAME_2+' Where grp_id = '''+@f1+'''
Else
Select * Into condition_'+@f1+' from '+@TABLENAME_2+' Where grp_id = '''+@f1+'''
alter table condition_'+@f1+' add id int
update condition_'+@f1+' set id = '+@value+''
Set @x = @x-1
---print @sql
Exec (@Sql)
End
this query is executing but not create the table and insert the records.
please check this query.
Regards,
Abdul Khadir.
↧
BIDS DoNotSaveSensitiveData but my deployed package runs with my password
BIDS 2008, SQL 2008 R2
I created a BIDS SSIS package that has two connections. One is a SQL connection and the other is a host ISeries connection that requires a password. In bids I entered my password to test. The package protection level is donotsavesensitivedata (0). I look in the dstx file and there is no 'Password', 'Salt', 'Encryp'. There are multiple 'w3.org'. But I assum that my Iseries password is not in this dstx file. but when I deploy the package, the package runs. So it is using my password. How is that possible? Where is my password is the dstx file and why is it there?
↧
How to convert the string "NULL" from a flat file into an actual dbnull for db insert?
Hi all,
I'm shoving flat file rows into my database, which has columns that are naturally float values. When a row has no value in any of those cols, they've put the string literal "NULL" in.
How can I have this strings-in-my-float-column automagically turned into bonafide dbnull values so the db inserts work?
thanks for tips,
sff
↧