Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS execute perfectly but not insert/update in destination table?

$
0
0

Hi,

I am using SSIS integration between two database. Both databases are sql server 2008.  using many integration but getting problem in two only

only two integration giving problem, both are executing perfectly and out put also not showing any error.

but destination table not inserted/updated anything.

first issue integration is using data flow task with oledb source and destination. 

second one is using execute task with for-eachloop container.

Please how to find the issue. i cant able to find any error or issue in these two.

Thanks


Jaffer


Deploying SSIS project on local development machine failed with error 27203

$
0
0

When deploying a project from within a SSIS project in Visual Studio 2012 to SQL Server 2012 Integration services server I get the follwoing error message:

Failed to deploy project. For more information, query the operation_messages view for the operation identifier '10'.  (Microsoft SQL Server, Error: 27203)

For the given operation id there is no entry in view catalog.operation_messages.

Any idea about possible reasons?

Thx a lot and kind regards

Dieter

Help with running SSIS Packages using SQL Agent Jobs

$
0
0

Hi there,

I was wondering if anyone could help with an infuriating issue! I have an SSIS package, loading into Sql Server Integration Services under MSDB\Data_Loading (using the File Import option DTSX file).

This package has several steps, but most notably:

Load Data from CSV files, Store them in tables, Move the files, write to an 'event' table with the number of files loaded.

When I run this package, everything works well.

But when I try and call it from a SQL Agent Job (the only step is to run this package) - it runs but doesnt actually do any of the data loading or file moving - almost as if it cant see the actual files! The event table is written to, but zero files loaded is recorded.

No errors are returned.

Does anyone know of any permissions issues, file system access etc. that the agent needs to be able to find these files and load them? 

PLEASE PLEASE PLEASE help!!!!

Overflow the disk I/O buffer on migrated SSIS package

$
0
0

I have migrated a DTS package from SQL 2000 into SQL 2008R2.

The package imports a CSV files generated from CSDVE.exe from AD.

It has been working fine in SQL 200 since 2006 but now I'm getting a buffer overflow on the member field. The field is set to ntext so there should be plenty space for the long field. I've seen the is a maximum of 4000 chars with SSIS. Is this correct? What about SQL 2014? What are the options to get round this problem?

SSIS Script Task C# code not working after deployment.

$
0
0

I have created SSIS package which unzip the .gz files using script task. This is working perfect on my development environment and gives me expected result. But when I deploy the same onto my test environment, script talk shows success but the c# code is not working. I write a code for logging as well, but no log written.

I created one simple code to write a file on drive, but again same result. On development environment this is working fine, but after deployment, no error at the same to no result.

I am using SQL Server 2014 on both instances. Please help!!

Visual Studio 2015 - SSIS Development - Backward Compatibility - Can we develop 2008, 2012, 2014 packages?

$
0
0

Hello and good day to all

I'm trying to determine if Visual Studio 2015 (VS2015) Ultimate or any other version VS2015 will allow for SSIS packages for 2008, 2012, 2014 environments.

Any direction is appreciated

Thank You Forum


Mark Covian

The external columns for component "Excel Source" (2347) are out of synchronization with the data source columns.

$
0
0

SSIS drives me insane. I have a report file (Excel .xlsx format) that I need to import into a database.  I have a job running once per hour that runs the package. The package checks for the existence of the file and if present, it imports it into a temporary table in MS SQL Server, then runs a stored procedure to put the data into the destination table.  This process is done for about 3 months of the year, then shut off again until next year.

Since the data in the file can vary somewhat depending on how people answer the questionnaire that is the source of the report file, SSIS's "handy feature" of analyzing the first few rows of data to determine the datatype doesn't work very well for me.  E.g. one of the questions is "What class of driver's license do you hold" and people might type "5" or "Class 5" or leave it blank.

Yesterday, the report file imported great and I thought we were set for this year.  Today's report file refuses to import.  I've got the package set up to print all warnings to the job history, so this is what it is complaining about:

Date		2015-11-25 9:00:00 AM
Log		Job History (SQL1 CrewRecruiting Import PSA Report)

Step ID		1
Server		JUMBLESQL1\STAG1
Job Name		SQL1 CrewRecruiting Import PSA Report
Step Name		CrewRecImport
Duration		00:00:01
Sql Severity		0
Sql Message ID		0
Operator Emailed
Operator Net sent
Operator Paged
Retries Attempted		0

Message
Microsoft (R) SQL Server Execute Package Utility
Version 10.50.2500.0 for 32-bit
Copyright (C) Microsoft Corporation 2010. All rights reserved.

Started:  9:00:00 AM
Warning: 2015-11-25 09:00:01.16
   Code: 0x00000000
   Source: Check if input file exists  - Progress
   Description: Starting public void main
End Warning
Warning: 2015-11-25 09:00:01.19
   Code: 0x00000000
   Source: Check if input file exists  - Value of FullPath
   Description: \\server\CrewRecImport_Test$\CrewRecImport.xlsx
End Warning
Warning: 2015-11-25 09:00:01.19
   Code: 0x00000000
   Source: Check if input file exists  - Value of IsFilePresent
   Description: True
End Warning
Warning: 2015-11-25 09:00:01.19
   Code: 0x00000000
   Source: Check if input file exists  - Value of FullPathOutput
   Description: \\server\CrewRecImport_Test$\CrewRecImport_done.xlsx
End Warning
Warning: 2015-11-25 09:00:01.19
   Code: 0x00000000
   Source: Check if input file exists  - Progress
   Description: Done public void main
End WarningWarning: 2015-11-25 09:00:01.57
   Code: 0x800470C8
   Source: Import data from Excel into temporary table Excel Source [2347]
   Description: The external columns for component "Excel Source" (2347) are out of synchronization with the data source columns. The external column "If the answer is yes to the question above, what class? Enter ?N" needs to be updated.
End Warning
Error: 2015-11-25 09:00:01.68
   Code: 0xC020901C
   Source: Import data from Excel into temporary table Excel Source [2347]
   Description: There was an error with output column "If the answer is yes to the question above, what class? Enter ?N" (2535) on output "Excel Source Output" (2355). The column status returned was: "The value could not be converted because of a potential loss of data.".
End Error
Error: 2015-11-25 09:00:01.68
   Code: 0xC0209029
   Source: Import data from Excel into temporary table Excel Source [2347]
   Description: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "output column "If the answer is yes to the question above, what class? Enter ?N" (2535)" failed because error code 0xC0209072 occurred, and the error row disposition on "output column "If the answer is yes to the question above, what class? Enter ?N" (2535)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.
End Error
Error: 2015-11-25 09:00:01.68
   Code: 0xC0047038
   Source: Import data from Excel into temporary table SSIS.Pipeline
   Description: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "Excel Source" (2347) returned error code 0xC0209029.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.
End Error
Warning: 2015-11-25 09:00:01.72
   Code: 0x80019002
   Source: Import the file
   Description: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED.  The Execution method succeeded, but the number of errors raised (3) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
End Warning
Warning: 2015-11-25 09:00:01.72
   Code: 0x80019002
   Source: SQL1 CrewRecruiting Import_PSA_Report
   Description: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED.  The Execution method succeeded, but the number of errors raised (3) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
End Warning
DTExec: The package execution returned DTSER_FAILURE (1).

For comparison, this is what it looks like when it finds a file and successfully imports it:

Date		2015-11-24 12:00:00 PM
Log		Job History (SQL1 CrewRecruiting Import PSA Report)

Step ID		1
Server		JUMBLESQL1\STAG1
Job Name		SQL1 CrewRecruiting Import PSA Report
Step Name		CrewRecImport
Duration		00:00:01
Sql Severity		0
Sql Message ID		0
Operator Emailed
Operator Net sent
Operator Paged
Retries Attempted		0

Message
Microsoft (R) SQL Server Execute Package Utility
Version 10.50.2500.0 for 32-bit
Copyright (C) Microsoft Corporation 2010. All rights reserved.

Started:  12:00:00 PM
Warning: 2015-11-24 12:00:00.72
   Code: 0x00000000
   Source: Check if input file exists  - Progress
   Description: Starting public void main
End Warning
Warning: 2015-11-24 12:00:00.75
   Code: 0x00000000
   Source: Check if input file exists  - Value of FullPath
   Description: \\server\CrewRecImport_Test$\CrewRecImport.xlsx
End Warning
Warning: 2015-11-24 12:00:00.75
   Code: 0x00000000
   Source: Check if input file exists  - Value of IsFilePresent
   Description: True
End Warning
Warning: 2015-11-24 12:00:00.75
   Code: 0x00000000
   Source: Check if input file exists  - Value of FullPathOutput
   Description: \\server\CrewRecImport_Test$\CrewRecImport_done.xlsx
End Warning
Warning: 2015-11-24 12:00:00.75
   Code: 0x00000000
   Source: Check if input file exists  - Progress
   Description: Done public void main
End Warning
DTExec: The package execution returned DTSER_SUCCESS (0).
Started:  12:00:00 PM
Finished: 12:00:01 PM
Elapsed:  1.357 seconds

In the report that succeeded, the column in question has these 6 rows including the header, and you can see it is a mixture of numbers and strings:

If the   answer is yes to the question above, what class? Enter ?N/A? if you do not   have a Canadian driver?s licence.
5
5
class: 7
Class 4   Unrestricted
5

In the report that failed, it has 19 rows including the header, and it similarly has a mixture of numbers and strings:

If the   answer is yes to the question above, what class? Enter ?N/A? if you do not   have a Canadian driver?s licence.
Class 3 and 4 with Air Brake   Endorsement
Class 7
5
Class 5
5
class: 7
5
5
Class 4 Unrestricted
5
4, 5, 6
G
5
5,6
Class 3 with Q(air brake)   endorsement
N/A
4 with air brake
5

So I am at a loss.  I have fought and fought with this import process last year and I thought I had it straightened out, but now it's acting up again.  (We're just beginning the new round of annual hiring.)

In the import step, I have three boxes: Excel Source, Data Conversion, and OLE DB Destination. In Data Conversion, I have it transforming every value into a Unicode String [DT_WSTR] of length 1000 (except for a few longer columns which are set to 4000) to try to avoid truncation or data conversion errors.

I have everything set to Fail Component because I don't want it to seem like it is importing the data but missing a column or a few columns in a few rows and seem like everything is fine.

Any advice? 

REST Export to import data into my Database

$
0
0

Hi,

Till now I have only using FTP Task to download data from another server.  But in this case, there is a url which connects to a webservice to download data from there using the REST Export method.

As there are not so clear instructions in the Internet about this method and how to use it in SSIS, I would like to have your comments / instructions on how to export the data from the webservice with URL and import it in my databse using SSIS.

The URL which I try to use in SSIS is meant for a excel download using REST URI




SSIS package - tabletransfergenerator error

$
0
0

Hi all. would like get some expertise advice here. I have an SSIS packge that run on sql server 2005. and recently i migrate the package from 2005 to 2012. when run the package, it show the error as below, appreciate your advice 

error message: the task has failed to load. the contact information for this task is  "TableTransferGenerator Task"

Column "A" cannot convert between unicode and non-unicode string data types

$
0
0
I am following the SSIS overview video-
https://secure.cbtnuggets.com/it-training-videos/series/microsoft-sql-server-2008-business-development/6143?autostart=true
I have a flat file that i want to import the contents onto a SQL database.
I created a Dataflow task, source file and oledb destination.
I am getting the folliwung error -
"column "A" cannot convert between unicode and non-unicode string data types"
in the origin file the data type is coming as string[DT_STR] and in the destination object it is coming as "Unicode string [DT_WSTR]"
I used a data conversion object in between, dosent works very well
Please help what to do

Memory Issues - system and Heap.

$
0
0

Hi,

I have started experiencing the following errors

"Unable to allocate memory for a hash node heap"

"The system reports 99 percent memory load. There are 8584744960 bytes of physical memory
with 5799936 bytes free. There are 8796092891136 bytes of virtual memory with 8794956038144 bytes free.
The paging file has 7447801856 bytes with 5201920 bytes free."

The packages running have been running for the last year with no issues.  Admintidley they were the only jobs running against the Instance.  
I have now introduced additional databases and packages. 

The package do not over lap when they run so there is currently no contention for resource.

I have no idea where to start looking to identify the culprit.

I have observed the available pagefile being completely consumed and physical memory.  The only way I can get it released si by bouncing the instance.

the only thing that has changed is pagefile.    The system has 8GB RAM and was configured with a 4GB pagefile.  I have recently created a second pagefile on
an alternative disk of 12GB and reduced the 4GB pagefile to 100MB and left it on the root drive.   When I view the pagefile size in properties, it says that there
is only 100MB even though it creates a 12GB pagefile.

Can anyone shed some light on my problem?

I appreciate your help

Regards

Marcus

Error while inserting rows into Oledb destination using OpenRowSet Access Mode

$
0
0

My Source in Flat file.

i am using Multicast to insert data to 6 sql tables using OLEDB destination.

I selected OpenRowSet access mode  for destination tables.

while executing the package with the same source different number of rows are getting inserted in each table for each execution.

I am saving error rows with error code and description where it shows error description as "NO Status available" and ErrorCode as -1071607685.

Ex: Suppose in the first time execution, Number of rows inserted to first table is 150 

For second execution  Number of rows inserted to same table  is 145 for the same source file ,

and for your information before each execution I m deleting the complete data from table.

Sybase OLE DB Destination - Not committing rows

$
0
0

Hey everyone,

I have a fairly simple data flow setup in SSIS 2008 R2 that performs the following:

1. OLE DB Source (using ODBC) from a Sybase 9 database

2. Script transformation that generates new primary keys

3. OLE DB Destination (using ODBC) to a Sybase 16 database

It executes fine and each process is picking up data (confirmed by data viewers and actually selecting data from the destination table while it's running). However, when the data flow is complete, the rows that were written to the Sybase 16 database are removed. I setup an error redirect to a row count to see if anything was happening, but it looks OK. Here's the log:

Information: 0x4004300A at Generate Keys, SSIS.Pipeline: Validation phase is beginning.
Information: 0x4004300A at Generate Keys, SSIS.Pipeline: Validation phase is beginning.
Information: 0x40043006 at Generate Keys, SSIS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at Generate Keys, SSIS.Pipeline: Pre-Execute phase is beginning.
Information: 0x4004300C at Generate Keys, SSIS.Pipeline: Execute phase is beginning.
Information: 0x40043008 at Generate Keys, SSIS.Pipeline: Post Execute phase is beginning.
Information: 0x4004300B at Generate Keys, SSIS.Pipeline: "component "OLE DB Destination" (2633)" wrote 10 rows.
Information: 0x40043009 at Generate Keys, SSIS.Pipeline: Cleanup phase is beginning.

I've also tried using an ADO .NET destination, and it works great but the performance is unacceptable for the amount of data we'll be moving over.

Is the OLE DB Provider not recommended for Sybase? Or is there something silly that I may have missed?


Variables and Date Formats Between Servers

$
0
0

Hi

How is the date format determined in an SSIS variable?

I have a package deployed to one server and when switched to the other server I am getting a conversion error.

Thanks

Dynamic SQL in 'Variable' in OLEDB source not working. Please help!

$
0
0

Hi,

I am using a dynamic sql in a variable and that variable is used in the OLE DB source. But it is not working and getting the error as 

Description: "The metadata could not be determined because statement 'EXEC @SQL1' contains dynamic SQL.  Consider using the WITH RESULT SETS clause to explicitly describe the result set.

My dynamic sql is something like

Declare @var1 varchar(100)

Declare @sql1 nvarchar(4000)

IF var1<from another variable from for each ado enumerator> then

begin

set @sql1= 'select col1,col2,col3 from table1'

end

else

begin

set @sql1='select col1,col2,col3 from table2'

end

exec @sql1

Can you please help me to solve this?


SQLDumper pop up error during Data flow Task execution

$
0
0

Hi all,

I am finding a strange issue when executing a DFT which imports log file using a Flat File connection manager. The issue is that when I start executing the Data Flow Task, a SQLdumper.exe pop up appears immediately and the DFT just hangs. When I run the DFT in debug mode it is stuck at the initial Flat file connection itself  which does not proceed further but the task completes.

Interestingly the same DFT executes successfully in another machine(Windows 7) without any issues. But I want to make it to work in the former environment(Windows Server 2008) as it is the deployment server and has to be deployed and tested there.

Any help in this regard is highly appreciated

SSIS service failed to start

$
0
0

Server 2012 R2

SQL 2014 SP1 CU3

SSIS service will not start. 

App Log "Microsoft SSIS Service Failed to start.

Error: Access is denied. (Exception from HRESULT: 0x80070005 (E_ACCESSDENIED))

It had worked in the past but we cannot seem to narrow down exactly what has changed.

SSIS proj for import txt

$
0
0

I would like to create an integration service project to import some txt into SQL Server. The line inside the txt are like this

{"Column1":"value","column2":"value"}}.

I tried to open the txt files in order to erase {}: but unfortunately I have a txt of 2GB that I can't open any suggestions?



Error when Saving Package - Saving Fails when I try to Sign the Assembly - BIDS 2008

$
0
0

Hello,

When I attempt to sign an assembly in a Script Task, the package will not save. I receive an error:


TITLE: Microsoft Visual Studio
------------------------------

Failure saving package.

------------------------------
ADDITIONAL INFORMATION:

'', hexadecimal value 0x07, is an invalid character. Line 2, position 10. (Microsoft.SqlServer.ManagedDTS)

------------------------------
BUTTONS:

OK
------------------------------

===================================

Failure saving package. (Microsoft Visual Studio)

------------------------------
Program Location:

   at Microsoft.DataTransformationServices.Design.Serialization.DtrDesignerSerializer.SerializePackage(IDesignerSerializationManager manager, Package package, TextWriter textWriter)
   at Microsoft.DataTransformationServices.Design.Serialization.DtrDesignerSerializer.SerializeComponent(IDesignerSerializationManager manager, IComponent component, Object serializationStream)
   at Microsoft.DataWarehouse.Serialization.DesignerComponentSerializer.Serialize(IDesignerSerializationManager manager, Object value)
   at Microsoft.DataWarehouse.VsIntegration.Designer.Serialization.DataWarehouseDesignerLoader.Serialize()
   at Microsoft.DataWarehouse.VsIntegration.Designer.Serialization.BaseDesignerLoader.Flush(Boolean forceful)
   at Microsoft.DataWarehouse.VsIntegration.Designer.Serialization.BaseDesignerLoader.Flush()
   at Microsoft.DataWarehouse.VsIntegration.Designer.Serialization.DataWarehouseContainerManager.OnBeforeSave(UInt32 docCookie)

===================================

'', hexadecimal value 0x07, is an invalid character. Line 2, position 10. (Microsoft.SqlServer.ManagedDTS)

------------------------------
Program Location:

   at System.Xml.XmlTextReaderImpl.Throw(Exception e)
   at System.Xml.XmlTextReaderImpl.Throw(String res, String[] args)
   at System.Xml.XmlTextReaderImpl.Throw(Int32 pos, String res, String[] args)
   at System.Xml.XmlTextReaderImpl.ThrowInvalidChar(Int32 pos, Char invChar)
   at System.Xml.XmlTextReaderImpl.ParseCDataOrComment(XmlNodeType type, Int32& outStartPos, Int32& outEndPos)
   at System.Xml.XmlTextReaderImpl.ParseCDataOrComment(XmlNodeType type)
   at System.Xml.XmlTextReaderImpl.ParseDocumentContent()
   at System.Xml.XmlTextReaderImpl.Read()
   at System.Xml.XmlLoader.ParsePartialContent(XmlNode parentNode, String innerxmltext, XmlNodeType nt)
   at System.Xml.XmlLoader.LoadInnerXmlElement(XmlElement node, String innerxmltext)
   at System.Xml.XmlElement.set_InnerXml(String value)
   at Microsoft.SqlServer.Dts.Tasks.ScriptTask.ScriptTask.SaveToXML(XmlDocument doc, IDTSInfoEvents events)
   at Microsoft.SqlServer.Dts.Runtime.ManagedWrapper.SaveToXML(Object doc, IDTSInfoEvents100 events)
   at Microsoft.SqlServer.Dts.Runtime.Package.SaveToXML(String& packageXml, IDTSEvents events)
   at Microsoft.DataTransformationServices.Design.Serialization.DtrDesignerSerializer.SerializePackage(IDesignerSerializationManager manager, Package package, TextWriter textWriter)

I have verified I have .NET 4.5 installed.  I uninstalled it, then reinstalled the current release.  The error only occurs when I try to sign the assembly, with or without a password.  In addition, I've uninstalled SQL Server 2008 r2 (along with BIDS and everything else) and have reinstalled.  I still receive the same error.  The steps to recreate this error are:

Create a completely brand new SSIS project  

Add a script task

Sign the assembly

Try to save the package, it fails.

Is anyone able to point me in the right direction? Thanks

ssis properties window does not display correctly

$
0
0

Hello,

Attached is the options window in my ssis 2012.
Do you know why I get this and it does not display correctly?

Could it be to do with the resolution settings? I tried changing the resolution but did not make a difference.

thanks

Viewing all 24688 articles
Browse latest View live




Latest Images