Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Pivot Transformation

$
0
0

I have a Pivot defined in a SQL query (against ORACLE data) that correectly extracts data. I'm attempting to replicate the process using an SSIS package (I need to merge the data with data from Sharepoint lists), and I'm having difficulty with the PIVOT transformation.

In this case, I'm only interested in 3 of the values in "Column_Nm" and the text_Value associated with those 3 values. There are a large number of available valuesthat I need to ignore for the sake of this report.I have an ID field that I'm using to find the specific data, but get an error when the first value in the "Column_Nm" is not one of the values I need.

Any suggestions?


Derived column transformation from varchar(8) YYYYMMDD to DATETIME column

$
0
0

It seems I have tried everything, but all I need to do is change a column from varchar(8) to DATETIME. Some lines are blank, zero length strings, and some have dates such as 20140829. All the rows go to an exception table or it just bombs altogether. The only thing I can get to run is NULL(DT_DATE), but obviously, that won't work in the end.

I tried LTRIM(RTRIM(MyDateColumn) == "" ? (DT_DATE)"1900-01-01" : (DT_DATE)(SUBSTRING(MyDateColumn,1,4) + "-" + SUBSTRING(MyDateColumn,5,2) + "-" + SUBSTRING(MyDateColumn,7,2))

I got truncation errors on that.

Sometimes I got an error: An error occurred while attempting to perform a type cast.

I tried DT_DATE, DT_DBDATE and DB_DBTIMESTAMP

I even tried putting GETDATE() in there or a literal date such as "2014-08-29" like (DT_DBDATE)"2014-08-29"

This wouldn't even compile: MyDatCeolumn == "" ? NULL(DT_DBDATE) : (DT_STR,10,1252)((DT_DBDATE)MyDateColumn)

I tried many variations on these. I either got truncation errors or the transformation would turn red and stop, or the expression wouldn't work (turns red when you leave the row).

Review:

Source MyDateColumn VARCHAR(8) NULL; Target MyDateColumn DATETIME; Source values in format of "" (blank) or "20140829". The blanks should end up null, or maybe a literal date like Jan 1, 1900, and the actual dates should be transformed to DATETIME.

Should not be that hard. Thanks in advance for help.

Can FTP Task FTPS?

$
0
0

I need to FTP-SSL.  Can I use FTP Task do FTPS? and How?  

Thank you.


newbie

Is the API for programatically executing packages redistributable?

$
0
0
For applications created by an ISV that depend on "Microsoft.SQLServer.ManagedDTS.dll" to programatically execute packages: can this DLL legally be packaged with the application, rather than requiring it to be installed as a prerequisite?  I am unable to find any documentation that specifies either way.

gui product for generating dtsx

$
0
0
is there a product out there that understands ssis etl patterns for creating/modifying/loading/reloading stars and snowflakes is pretty standard and assists in generating ssis dtsx (sub) packages for us?

Access denied issue when executing .bat file through SQL job

$
0
0

Hi

I've a SQL agent job configured as Operating System (CmdExec) type, that executes a .bat file. The job has been set to run as "SQL Server Agent Service Account". The SQL service account is sysadmin and also member of the local administrators group of the SQL server.

The batch file just moves a text file from source to destination folder in the same server. The Administrators group have full permissions on the Source and destination folders. The job completes successfully but no files are moved. I can see the below message in the history:

Executed as User: Domain\Service account. Time Stamp 1226. Access is denied.  0 file(s)  moved. Process Exit Code 0. The step succeeded.

When I manually run the .bat file, the required files are moved perfectly.

Any suggestions on how to resolve this issue?

Thanks












How to read 835 files using ssis

$
0
0

Hello Everyone,

It is possible read 835 files using ssis.

Please share your suggestions on this.

Regards,


Vaishu

XML Source to ADO Query Execution

$
0
0

Hi,

I am very new to SSIS and struggling with a problem.  I want to read from an xml file which has some sql queries and execute them to extract data and update the destination db.  If I have to do it without the xml file I am able to create ADO NET Source and ADO NET Destination but the problem is the ADO NET Source query is coming from the xml file.  If I create a XML Source then I am unable to link it to ADO NET Source.  Can you pls help me understand how I can resolve this problem?

thanks

Vishnu


Is there no option to run in environment_name? "/Env" of SSIS 2012 is not a test.

$
0
0

I Created SSIS 2012 project and execute the package for dtexec.

I uesd "/env" option.

That option went well and I use the "reference_id" of "environment_references" table.
work fine at Development Machine. But error in Production machine.
Because reference_id is different in the Development and Production.

There is no option to run under the environment_name.

It is not a test that was run in a test environment because you can not run in a production environment.


I have already seen this information
ttp://www.biadmin.com/2012/08/ssis-2012-gotcha-dtexecexe-and.html

Is it no choice but to coding?

Error trying to run SSIS Package via SQL Server Agent: DTExec: Could not set \Package.Variables[User::VarObjectDataSet].Properties[Value] value to System.Object

$
0
0

Situation:

SSIS Package designed in SQL Server 2012 - SQL Server Data Tools

Windows 7 - 64 bit.

The package (32 bit) extracts data from a SQL Server db to an Excel Output file, via an OLE DB connection.

It uses 3 package variables:

*) SQLCommand (String) to specify the SQL Statement to be executed by the package

Property path: \Package.Variables[User::ExcelOutputFile].Properties[Value]
Value: f:\Output Data.xls

*) EXCELOutputFIle (String) to specify path and filename of the Excel output file

Property path: \Package.Variables[User::SQLCommand].Properties[Value]
Value: select * from CartOrder

*) VarObjectDataSet (Object) to hold the data returned by SQL Server)

Property path: \Package.Variables[User::VarObjectDataSet].Properties[Value]
Value: System.Object

It consists out of 2 components:

*) Execute SQL Task: executes the SQL Statement passed on via a package variable. The resultng rows are stored in the package variable VarObjectDataSet

*) Script Task: creates the physical output file and iterates VarObjectDataSet to populate the Excel file.

Outcome and issue:The package runs perfectly fine both in SQL Server Data Tools itself and in DTEXECUI.

However, whenever I run it via SQL Server Agent (with 32 bit runtime option set), it returns the errror message below.

This package contains 3 package variables but the error stating that a package variable can not be set, pops up for the VarObjectDataSet only.  This makes me wonder if it is uberhaupt possible to set the value of a package variable of type Object.

Can anybody help me on this please ?

Message
Executed as user: NT Service\SQLSERVERAGENT. Microsoft (R) SQL Server Execute Package Utility  Version 11.0.2100.60 for 32-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  6:40:20 PM  DTExec: Could
 not set \Package.Variables[User::VarObjectDataSet].Properties[Value] value to System.Object.  Started:  6:40:20 PM  Finished: 6:40:21 PM  Elapsed:  0.281 seconds.  The package execution failed.  The step failed.

Thank you very much in advance

Jurgen


SQL 2012 SSIS log provider. The connection "" is not found. This error is thrown by Connections collection when the specific connection element is not found.

$
0
0

SQL 2012 SSIS log provider. The connection "" is not found. This error is thrown by Connections collection when the specific connection element is not found.


Create SSIS 2012 project.
Create connection manager in "Package" for setting SSIS log provider.
[Start Debugging] is work fine.

Create "Project" connection manager.
And change "Project" connection manager from "Package" connection manager on SSIS log provider.
[Start Debugging] is looks fine. But there is error in [Execution Result] Tab.

--------
The connection "" is not found. This error is thrown by Connections collection when the specific connection element is not found.
--------

Error has occurred, but logging is done.

「The connection "" is not found.」are saying what not find?

Multicast Transformation Programmatically

$
0
0

Hi,

I have created an SSIS package programmatically that transfer data from a Flatfile source to Oledb destination (single table), along with a derived column transformation. Now I want to Multicast the output of derived column transformation to multiple tables programmatically. How will I do it? Thanks in advance.


Migrate From Progress DB to SQL Server 2008 R2 or Any Version

$
0
0

Hi All,

I want to migrate database from progress database to sql server database.

The problem I didn't found any free or evaluation product that can I use or even buy to migrate this database.

 

Please Help


Elmozamil Elamir Hamid
http://elmozamil.blogspot.com

graphic problem with moving tasks inside a sequence container

$
0
0

Hi,

Is there a problem with the graphical size of a sequence container ?

I have a container with around 10 tasks in it and when I am trying to move the lowest task I am getting the error:

"Cannot move task with precedence constraint out of the container" - although I am not moving it out of the container.

It seems that the boundary of the container is not recognized correctly.

How can it be solved - I need all these tasks to be inside one container - as there are variables with its scope.


Failed to retrieve long data for column

$
0
0

Hi,

I am using SSDT 2010 to load Excel 2010 spreadsheets to a 2012 SQL DB. In my package I have a foreach loop and loading a couple of thousand spreadsheets. Issue I'm facing, is that about 30 or so of these spreadsheets are failing with message above.

My connection string is set as follows: Provider=Microsoft.ACE.OLEDB.12.0;Data Source=<filepath>.xlsx;Extended Properties="EXCEL 12.0 XML;HDR=YES;IMEX=1";

I tried changing TypeGuessRows registry setting to 1 and to 0, but with no success.

BLOBTempStoragePath and BufferTempStoragPath have more than enough space.

The Excel spreadsheets (contain about 1000 rows) are being created through an XML process. What we've also tried,  is force the first 11 rows through the XML process to contain at least 256 characters to ensure it converts to DT_NTEXT.

Does anyone have any idea what might cause this?


SSIS import flat file source problem

$
0
0

Hi ALL

I am importing an .csv file. it's unicode saved. I use SSIS package to import that CSV to a sql table.

however I found some rows are not going imported. and have some error code:

actually, I use T-sql directly to import, the data are ok . (insert table tablename values (.....) )...

there are about 20000 similar rows, only 750 rows has the following problem.

How to get Success(0) or Failure(1) from Executable in Execute Process Task

$
0
0

I have one SSIS Package where I need to execute one JS File by passing Arguments. I have succeeded to do that.

Here, I need to know if it was executed successfully and need to return 0 esle 1 from that JS file to SSIS Package so that SSIS Package can know if that was executed successfully then go ahead.

I tried adding "Execute Process Task" but could not understand how to return Value from that JS file to SSIS either failure /success.  I could not find how to read success or failure value from that executable(JS).

Appreciate your help!!!

Regards,

rmudigonda

SSDT package errors when running from non SSIS server

$
0
0

I am trying to run a 2012 SSIS package on a server that doesn't have Integration services installed and I keep getting the following error:

"To run a SSIS package outside of SQL Server Data Tools you must install SharePoint List Source 1 of Integration Services or higher."

It is on a cluster and I was under the understanding that I could run a package without having SSIS engine installed?

Thanks!

Foreachloop container Does not Load full data

$
0
0

I have a scenario where I am loading 16 files into one single table with same num of fields in all the files.

When I I run the package there are no issues, it shows like all the records are loaded succesfully from the file, but when I go to individual files and cehck I am missing few records from one of the files:

Eg: File 1 normally have 15 records but during foreach loop execution it loads only 10 records, I tried to load it seperately and its loading all 15 rows.

issue is when I am loading the data through Foreach Loop.

Please Help

Thanks


Thanks, Please Help People When they need..!!! Mark as answered if your problem is solved.

The parameter 'CM.DW-Ole.ConnectionString' does not exist or you do not have sufficient permissions

$
0
0

Hi,

I have an SSIS Package that I made. I continue to get an error that says

The parameter 'CM.DW-Ole.ConnectionString' does not exist or you do not have sufficient permissions

But the thing is that I don't have a connection with that name in the package. I do have a connection with the name 'CM.DW-OLE.ConnectionString' but I don't think that they are the same connection.

Does anyone have any idea how an extra connection could get into a package? It isn't in the code (the XML) when I search for it either.

Thanks,

Croix


g

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>