Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Importing Excel File via SSIS error

$
0
0

Hi:

We have a 2014 SQL Server.  I have a SSIS package written in VS 2008 where I am simply importing an .xlsx into an existing table via a mapped drive.  I have it working on my development machine using the 2007 Access 32 bit driver from https://www.microsoft.com/en-us/download/confirmation.aspx?id=23734.  Our DBA is trying to schedule the package to execute on a schedule job on the 2014 server and we received an error. He installed the 32 bit driver and still getting the error.  I set the package to run in 32 bit and we are still getting the error. Any suggestions?  Thank you.

Date                      10/30/2015 2:51:18 PM

Log                         Job History (BD_ISS_Websites_New1)

 

Step ID                 1

Server                   ETSSQL2014DEV

Job Name                            BD_ISS_Websites_New1

Step Name                         ISSWebsite

Duration                              00:00:01

Sql Severity        0

Sql Message ID 0

Operator Emailed           

Operator Net sent          

Operator Paged               

Retries Attempted          0

 

Message

Executed as user: BROWARDSCHOOLS\etssql2014. Microsoft (R) SQL Server Execute Package Utility  Version 12.0.4100.1 for 64-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  2:51:18 PM  Error: 2015-10-30 14:51:19.50     Code: 0xC0209303     Source: Package Connection manager "Excel Connection Manager 1"     Description: The requested OLE DB provider Microsoft.ACE.OLEDB.12.0 is not registered. If the 64-bit driver is not installed, run the package in 32-bit mode. Error code: 0x00000000.  An OLE DB record is available.  Source: "Microsoft OLE DB Service Components"  Hresult: 0x80040154  Description: "Class not registered".  End Error  Error: 2015-10-30 14:51:19.50     Code: 0xC001002B     Source: Package Connection manager "Excel Connection Manager 1"     Description: The 'Microsoft.ACE.OLEDB.12.0' provider is not registered on the local machine. For more information, see http://go.microsoft.com/fwlink/?LinkId=219816  End Error  Error: 2015-10-30 14:51:19.50     Code: 0xC020801C     Source: Data Flow Task Import Sites Excel Source [14]     Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Excel Connection Manager 1" failed with error code 0xC0209303.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.  End Error  Error: 2015-10-30 14:51:19.50     Code: 0xC0047017     Source: Data Flow Task Import Sites SSIS.Pipeline     Description: Excel Source failed validation and returned error code 0xC020801C.  End Error  Error: 2015-10-30 14:51:19.50     Code: 0xC004700C     Source: Data Flow Task Import Sites SSIS.Pipeline     Description: One or more component failed validation.  End Error  Error: 2015-10-30 14:51:19.50     Code: 0xC0024107     Source: Data Flow Task Import Sites      Description: There were errors during task validation.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  2:51:18 PM  Finished: 2:51:19 PM  Elapsed:  0.64 seconds.  The package execution failed.  The step failed.


dynamic column mapping in ssis package

$
0
0

Hi Friends,

I have some requirement, I have some source files is there today it will have 4 columns..

Tomorrow it will have 10 columns...

my package is dynamically load the data to destination table..

How we have do it in Using script task...

Visual Studio 2015 - SSIS Development - Backward Compatibility - Can we develop 2008, 2012, 2014 packages?

$
0
0

Hello and good day to all

I'm trying to determine if Visual Studio 2015 (VS2015) Ultimate or any other version VS2015 will allow for SSIS packages for 2008, 2012, 2014 environments.

Any direction is appreciated

Thank You Forum


Mark Covian

Querying the SSIS catalog info - SQL Server 2012

$
0
0

Hi,

I've deployed a SSIS project (having some packages) on SSIS catalog and I've created a job to invoke the related packages. I'd like to query the SSIS catalog to get the info about the execution of the job to understand if it is completed with success.

I've seen the tables internal.executions and internal.operations. Which of these two tables contains the more useful info about the execution job (f.e. the job name, the execution status)?

Many thanks

SSIS Intermittent Logon Failure - Error: 18456, Severity: 14, State: 8.

$
0
0

Hi,

I've designed several SSIS packages using SSDT 2013 and deployed to a SQL Server 2014 server using the project deployment model.  There are 4 project level connection managers in SSIS, all of which point to SQL Server databases.  The connection string and password are saved as variables, and when the packages are kicked off from the SSIS catalog or an agent job, the values are passed from environment variables. The password variable is marked as sensitive, and the connection string variable is set up like this:

Data Source=ServerName;Initial Catalog=DBName;Provider=SQLNCLI11.1;User ID = SQLAuthUserName; Auto Translate=False;

The problem is that I intermittently get the following error when the package is kicked off from the SSIS catalog: Error: 18456, Severity: 14, State: 8. "Login failed for user 'LOGINNAME'. Reason: Password did not match that for the login provided."

If I run the package again, without changing anything, it works.  But then it will fail after a few attempts again, with the same error.  I'm confused as to why the credentials work sometimes, but not others.  Any help would be appreciated!



Exporting CSV file plit by column value. Do you have a clue?

$
0
0

Hi guys, I need a clue please. I got a table with, let say, one million rows (it's more). I have a column as  key identifier KeyRoot. Now I need to export all these rows in different csv files. The way to split the various csv files is to use the column KeyRoot.  

I know I should use a for each file but how can I split the table? Using a query ad hoc?? I have no clue at the moment. 

How to use temp table/variable

$
0
0

Hello,

It's SQL 2008 R2. I need to bring data from Oracle using .Net Providers/ODBC Data Provider to MS SQL table converting Oracle UTC dates to PST.  The source connection type cannot be changed as it's given. For the Destination I'm using the OLE DB.

As the truncate all and load could take time I'm trying to use a temp table or a variable to use it further with t-sql merge or not exists to bring/add the only new records to the destination table.

I'm trying different scenarios that is all failed.

Scenario A:

1. In DTF after OLE DB Source I'm using the Derived Colum to convert dates. It's working well.

2. Then use Recordset Destination with an object variable User::obj_TableACD. It's also working well.

3. Then I created a string variable with a simple query that I could modify later "select * from " + (DT_WSTR,10)@[User::obj_TableACD] trying to get data from the recordset object variable but it's not working.

Scenario B:

1. Created a store procedure to create a temp table.

2. Created a string variable to execute SP str_CreateTempTable: "EXEC dbo.TempTable". It's working well with the SQL Task with SQLSourceType as Variable.

3. Then how to populate the temp table from the Oracle source to bring data into the Destination?

I could spend another few days to figure it out. So, please help me on it if there is a way to solve it.

Thanks

SSIS package run under proxy account fails when user is ofline

$
0
0

hi 

 i have created proxy account run ssis packag in SQL job it run  succefully when user is log in to the server but it fails when user is loged of and job is scheduled ?

what to do 


SSIS 2012 and sp_describe_first_result_set

$
0
0

Hi,

I have a stored procedure with conditional logic that returns data for an SSIS datasource.  The various conditions in the sproc return the same column names and datatypes, but they still fail the "sp_describe_first_result_set" call from SSIS. After some digging around, I discovered that one of the conditions returns a "hidden" column that is used for lookup purposes, and this is not contained in the other conditions.  How can I resolve this so that SSIS doesn't complain about metadata not matching up?

The conditional query in the sproc is below:

	if @RunTypeLoc <> 'REL' and @RowVersionMinLoc = 0
	begin
		SELECT	pk_col,
                xxx,
                yyy,
                zzz,
				CAST('' AS NCHAR(1)) AS sys_change_operation
		FROM [dbo].aaa;
	end

	else IF @RunTypeLoc = 'INC'
	begin
		SELECT	ct.pk_col,
                xxx,
                yyy,
                zzz,
				ct.sys_change_operation
		FROM [dbo].xxx x
			RIGHT OUTER JOIN CHANGETABLE(CHANGES dbo.xxx, @RowVersionMinLoc) AS ct ON x.pk_col= ct.pk_col
		WHERE   ct.sys_change_version <= @RowVersionMaxLoc;
	END

	else if @RunTypeLoc = 'REL'
	begin
		SELECT	pk_col,
                xxx,
                yyy,
                zzz,
				CAST('' AS NCHAR(1)) AS sys_change_operation
		FROM [dbo].xxx
		where yyy in (select yyy from aaa);
	end 
The middle condition, which uses the CHANGETABLE function, returns dbo.xxx.pk_col as a hidden column.
 

Loading Surrogates key in Fact

$
0
0

I have a multiple dim tables which are about 50 million,40m, 80 million records in it , I'm trying to load their respective surrogate keys into a fact table . To get the surrogate keys I'm using Lookup transformation with config as full cache, Fail component and lookup match output. The problem here is there more millions of records to lookup and lookup transformation requires lot of memory. Is there any other better way to get the surrogate keys to be loaded into the fact table?

Any help is appreciated!!

Thanks,


sree

Can a data resultset is possible to pass from one package to another

$
0
0

Hi,

Is it possible to send a data result set (select Code1,Code2 from tab--suppose this query return 100 rows) from package A to Package B and then in package B we needs to insert these 100 values one by one (i.e. insert into tab2 values(Code1,code2)).

Thanks,

Amit

Formating the timestamp and adding to a file name

$
0
0
public void Main()
        {
            // TODO: Add your code here

            string time = System.DateTime.Now.GetDateTimeFormats('G').ToString();
            string pathD = @"C:\Users\user\Desktop\testFileD";
            string pathR = @"C:\Users\user\Desktop\testFileR";

            time = time.Replace(" ","");
            time = time.Replace("/","");
            time = time.Replace(":","");
            time = time.Replace("(en-US)", "");

            Dts.Variables["OutputPathD"].Value = pathD + time + ".csv";
            Dts.Variables["OutputPathR"].Value = pathR + time + ".csv";

            Dts.TaskResult = (int)ScriptResults.Success;
        }

I am trying to create these paths (in a Script Task) into these variables so I can output a CSV file with a specfically formatted timestamp, unfortunately when my SSIS runs its throws this error:

[EXPORT DATA CSV [19]] Error: Cannot open the datafile "@OutputPathR".

[SSIS.Pipeline] Error: component "EXPORT DATA CSV" (19) failed the pre-execute phase and returned error code 0xC020200E.

Normally (I usually program in JAVA), I would print out the variables to see if there is an issue but I haven't figured out how to do that in SSIS yet.

Any help would be great, Thanks.

UPDATE: I fixed the error. Forgot I have to set the Connection string for the Flat File conection using the Expressions tab instead of putting the variable in the connection string tab.

Now it works but the file that is spitting out is "testFileDSystem.String[]"

SSIS 2014 Application and Database server

$
0
0

I have a database server with SQL Server 2014.  I have and application server with SSIS 2014.

I am running SSIS on the application server under a service account that should have the correct priviledges.

I have created an SSISDB catalog on the database server.

I have altered the config file for SSIS (MsDtsSrvr.ini.xml) and changed the server name from . to<dbserver>

What else do I need to do to configure these two servers to talk to each other?

I have two licenses of SQL Server, one for the database server and another for the application server.

Thanks for your help!

Additional info:

I have also ran DComConfig and allowed the service account to local and remote launch.  I can now see MSDB on the database server.  What do I need to do to see SSISDB?

Multiple Data Flow Tasks within Foreach Loop Container

$
0
0

Suppose if I have a “Foreach Loop Container” that iterates over a list. Is it possible to execute different data flow tasks based on the input?

example : List contains elements L1, L2 & L3.

ForEach Loop Container checks the input. If its L1 then it should execute DF Task1, If L2 then execute DF Task2 and similarly for L3.

Is it possible to achieve this?

Getting a conversation error in SSIS package

$
0
0

Hi All -

I am developing one SSIS package where I bring some details from DWH and insert ii to a table in SQL Server.

But i am getting the error like - The OLE DB provider used by the OLE DB adapter cannot convert between types "DT_I4" and "DT_GUID". Can any one help me on this?


SSIS 2012 flat file does not appear in the destination assistant

$
0
0

Hi guys, I set up a connection file in order to move data from sql to csv files. I should be at the last step, the data flow. but:

I don't see any flat file in my destination assistant. Any clue why?

Many Thanks

Execute Process Task, Passing in variables from SSIS to Powershell Script

$
0
0

I have been trying to build a package that can be called in an agent job to pass in paramaters for the purpose of backing up SSAS cubes. I have the code working but I can't seem to get the variables from SSIS to pass into the Powershell Script.

Here is the script with my latest attempt,

param($SSASServerName,$BackupLocation)$serverName=$SSASServerName$outputFolder=$BackupLocation## load the AMO and XML assemblies into the current runspace [System.Reflection.Assembly]::LoadWithPartialName("Microsoft.AnalysisServices") >$null[System.Reflection.Assembly]::LoadWithPartialName("System.Xml") >$null$dateStamp= (get-Date).ToString("yyyyMMdd")## connect to the server $svr= new-Object Microsoft.AnalysisServices.Server$svr.Connect($serverName)foreach ($dbin$svr.Databases)
{
  write-Host "Scripting: "$db.Name$xw= new-object System.Xml.XmlTextWriter("$($outputFolder)DBScript_$($db.Name)_$($dateStamp).xmla", [System.Text.Encoding]::UTF8)$xw.Formatting =[System.Xml.Formatting]::Indented[Microsoft.AnalysisServices.Scripter]::WriteCreate($xw,$svr,$db,$true,$true)$xw.Close()
}$svr.Disconnect()

And in the Execute Process Task I try and bring them in the arguement field as C:\test\MDBackup.ps1 -$SSASServerName [User::SSASServerName] -$BackupLocation [User::BackupLocation]

What is the proper way to pass in SSIS variables to a powershell script running from an Execute Process Task?

How to load 4300000 data using stored procedure in best optimize way

$
0
0

There are around 4300000 records in staging table . These records need to be loaded into 8 target tables.
The records will be moved from staging area to target tables using stored procedures .

since record volume is quiet big what should be strategy to load the data using stored procedure.

Assume like the whole block of code cannot in a single transaction , if any error comes the whole
data will rollback .

shall the stored proedure be executed batch while by passing filter criteria in the staging table
where record between value1 and value2.

There will a while loop which invokes the sp into batches 
by spiliiting the data into batches and pass the value1 and value2 in where clause of the staging table which has RecordId as an identity column.

Please suggest the best possible way to load the data.


Hardware configuartion 3 GB RAM 2 Core PRocessor . Windows server 2012 64bit OS

XML configuration only for File System Deployment ?

$
0
0
We deployed the ssis package to SQL server and now trying to configure but it only allow use to change environmental variables there is no option to browse and select XML configuration file. Does this mean when you  are using SQL server deployment mode u can only use environmental variable ?

Generate Sequence.NextVal for Oracle OleDb Destination

$
0
0

Hi,

I am new to SQL integration service. May be i am asking a basic question here.

I have a ole db destination for inserting data into Oracle table. I want to pass Sequence.NextVal for Id column of oledb destination.

What would be efficient way to achieve this?

For example, if i write this pl/sql it would be

Insert into TABLE_EMPLOYEE( ID, Name)

Values( sequence.NEXTVAL() , 'Mr John');

Regards,

Umair Ahmed


umair_bs


Viewing all 24688 articles
Browse latest View live