Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Value of date from Excel changes only when run via agent

0
0

Hi everyone. I'm a bit of an SSIS newbie, and I'm stumped on something that should probably be really easy. I'm hoping someone has seen something like this before.

I am importing an excel file into a SQL Server table. There is one date column that is formatted as m/d/yyyy in Excel, and as yyyy-mm-dd in the SQL Server table. I handle that format change by adding a derived column.

If I execute the package manually, either locally during debugging or from the SSIS package store on SQL Server, it works perfectly. If I execute the package via SQL agent, I get no errors, but the value of the date changes. It consistently subtracts 4 years and 1 day. Some examples are below.

Excel source:

SQL server destination table:

Any suggestions are much appreciated! I'm out of ideas. :-/

Thank you!



WeeLass


Automation of transaferring Excel data to table in Database

0
0

Hi,

       I am new to SSIS. I need to do automation process to transfer data from excel to table in database. I will get the report daily. So how to make the automation process without manually placing the excel table into excel source everyday?

1. The excel names changes everyday.

2. Everyday the excel must be load into same table.

3. while loading the excel I need to get rid of some rows in excel. Is it is possible in automation process?

4. Will automation process can form a column with current date as a new column while transferring the data? 

Thanks in advance....


BALUSUSRIHARSHA

Generate SSRS PDF from SSIS

0
0

I am trying to write a SSIS package to auto generate a SSRS PDF. I have tried several threads on the net but all seem to require a web service.

I am using VS2012 and SQL2014

The report accepts one parameter @Licence

can anyone suggest any examples I can look at


Dont ask me .. i dont know

How to UPDATE multiple rows in T1 with unique value from T2

0
0

Hi,

having on mind update query with where clause:

WHERE (SELECT LEFT(ColumnName,7) FROM tblName) = emp2.ColumnName

error:

Subquery returned more than 1 value. This is not permitted when the subquery follows =, !=, <, <= , >, >= or when the subquery is used as an expression.
The statement has been terminated.

What am I suppose to change in WHERE clause....

Note: there is always unique value in T2 while, in T1, there could be both, only one value to be updated or number of them that all need to be updated with that unique value from T2 (alias emp2)

T1                                             T2

colimn1          column2               column3        column4

001A001A       string1                001A001       string10

001A001B        string2                001A005      string20

001B005A        string3               

001B005B        string4

001B005C        string5      

should become:

T1                                           

colimn1          column2            

001A001A       string10               

001A001B        string10               

001B005A        string20               

001B005B        string20

001B005C        string20      


UPDATET1

SET column2  = emp2.column4
FROM  T2  as emp2
    WHERE (SELECT LEFT(column1,7) FROM T1 = emp2.column3                      

Convert Q&A database (symantec) to SSIS supported database?

0
0

Hi Guys,

What are the possible ways of converting Q&A  database (symantec) to SSIS supported database?

Any clue will be of great help


~Technology Analyst~

How to install SSIS on SQL Server Developer

0
0
I have SQL Server Developer.  I know I can add in SSIS.  Can you tell me the steps to install SSIS on my machine?

Knowledge is the only thing that I can give you, and still retain, and we are both better off for it.

Execute Package Task Not Working After New Installation VS2012

0
0

After installing VS2012 Update 4, the execute package task runs the child package out of order.

The same version of VS is being used as the old computer (same everything, SQL 2012, OS...).  The solution works correctly on machines where VS2012 was installed prior to July 2014.  I've downloaded the BIDS, SSDT.

Anyone else have the same problem?  I have yet to find anywhere on the internet where someone has reported the same issue.  It has happened on multiple computers since August 2014.

C# Script Task string variable replace wont replace

0
0

The code below ought to replace "A" with "B" but it doesnt.

Please tell me how to make this work. Thanks!


SSDT locks up when opeing SSIS project

0
0

I receive the following error when I open a particular SSIS Project on my newly installed Windows 7

development machine:

TITLE: Microsoft Visual Studio
------------------------------
Unable to cast COM object of type 'System.__ComObject' to interface type

'Microsoft.SqlServer.Dts.Pipeline.Wrapper.IDTSObject100'. This operation failed because the

QueryInterface call on the COM component for the interface with IID '{203E24BD-5203-4C76-AFC7-

7C8545EBA1A0}' failed due to the following error: The application called an interface that was

marshalled for a different thread. (Exception from HRESULT: 0x8001010E (RPC_E_WRONG_THREAD)).
------------------------------
BUTTONS: OK
------------------------------

This error message locks up SSDT 2012 (Visual Studio 2010 shell) It must be killed with Task Manager

because the "OK" button or the "X" in the top right corner of the message is unresponsive.

Here is the order in which I have installed development tools on this machine;
 1.) SSDT (SQL Server 2012 with SP2) (which installs Visual Studion 2010 shell)
 2.) SharePointListAdapterSetup_x64.msi <required for SharePoint List ETL
 3.) Visual Studio Professional 2012 <required on another machine to get scripting components to work

With the above installed I can open some SSIS projects but not the offending one.

With some research I found and followed the recommendations to perform the following two tasks. After

each the behavior described above is the same

 4.) Registered "regsvr32 dts.dll"
 5.) Installed Viusal Studio Update 4

Please, what remedy will fix this?

=== More...

Facts surrounding the offending SSIS project and other projects
 * I use the SSDT open the projects
 * The offending package performs an ETL from SharePoint lists to a SQL Server database
 * Another projects performs the same task on a smaller scale and does it successfully
 * The offending projects work successfully on another system.

Facts surrounding the newly installed Windows 7 computer
 * Windows 7 Enterprise SP1
 * 64-bit
 * 8 GB RAM
 * 2.6 GHz processor

Details of SharePointListAdapterSetup_x64.msi installation
 * The adpater has been

Details of SSDT installation (SQL Server 2012 with SP2)
 * Engine
 * SSDT
 * Client Tools Connectivity
 * Integration Services
 * Client Tools Backwards Compatibility
 * Client Tools SDK
 * Management Tools - Basic & Complete

Details of Visual Studio installation
 * Microsoft Foundation Classes for C++
 * Microsoft Office Developer Tools
 * Microsoft SharePoint Developer Tools
 * Microsoft SQL Sercer Data Tools

Facts surrounding the other computer where the prject works.
 * Project opens and works on SQL Server server where SSDT is installed. Should not work on the server.

ssis transction isolation levels : Dirty read

0
0

Step 1 : I set the Isolation level property as ReadCommitted at the Data Flow Task (Please check the below image 1). Still I can read data in SQL server.

Step 2 :  I set the Isolation level property as ReadCommitted at the Package level (Please check the below image 2). Still I can read data in SQL server.

Please help me. How to set it up and lock the Dirty read.


Maheswaran Jayaraman

How can you add data from a variable into a column in a data flow?

0
0

I need to populate a table with data from a variable. The data type of the variable is String. I'm running into issues doing it the way I am. I have variable

User:VariableName = "Some moderately sized string of data"

When I try to use a Derived Column Transformation Editor to insert the variable into the data flow as a new column, SSIS forces the Data Type to be Unicode String[DT_WSTR] and I can't change it. Additionally the length is 0 and I also can't change that. When I run the package it errors with a truncation error. If the length is 0 then that makes sense but then why can't I change it to something that makes more sense?

What is the correct way to go about this?

Help parsing CSV and deleting (or not processing) duplicate records using c# script task

0
0

I have to import a CSV that is posted by a source system that is hosted and outside of my control.  Ocassionally, this CSV will contain duplicate records.  My task is to recognize the duplicate records and remove them from the CSV before importing the file.

Here is a simple example of how the CSV may look:

"Account Id", "Purchase Amount"
123, 5000
456, 4000
"Account Id", "Purchase Amount"
123, 5000
456, 4000

Notice how the header row (Row 1), and detailed records (Rows 2-3) are duplicated (Rows 4-6). 

Via a script task in SSIS, in C#, I would like to recognize the first column of the header record ("Account Id" in Row 1), then find any additional records (Row 3) that start with that same value ("Account Id") and delete that duplicate header record (Row 3) and all subsequent records (Row 5-6).

Any suggestions on how to do this?

How to convert decimal to datetime

0
0

I have to convert the column [LastNonMon] [decimal](19, 4) NULL, to datetime.

My manager adviced me to convert the decimal to int and then to datetime using cast and convert. Please help me with the syntax .

Multiple runs of same stored procedure

0
0

I am an SSIS newbie so please excuse how little I know.

We have a manual job that I would like to automate in SSIS.

We run the same stored procedure six times with different parameters. Each run creates a csv file that we load into excel and then mail the attachments to the user. Can SSIS run the SP, and in a send mail task, send the six outputs?

SSDT 2014 An OLE DB error has occurred. Error code: 0x80040E14. An OLE DB record is available. Source: "Microsoft DB2 OLE DB Provider" Hresult: 0x80040E14

0
0

SSDT 2014 (SSIS 2014) running in Visual Studio 2013 against a SQL Server 2014 Enterprise Edition db.

We are converting by hand a Business Intelligence site from SQL Server 2008 R2 databases (Data Warehouse, SharePoint databases and SSAS cubes), SharePoint 2010 Portal Site, and BIDS 2008 to SQL Server 2014 databases, SharePoint 2013, and SSDT 2014 for Visual Studio 2013.  This SSIS Package runs fine in the BIDS/SQL 2008 R2 environment.  The Variable Expression in this Data Flow Task is:

"SELECT [ORDER_ID]

,[ORDER_NUMBER]

,[TRACKING_PREFIX_ID]

,[TRACKING_NUMBER]

,[REVISION_NUM]

,[ORDER_TYPE]

,[STATUS]

,[WEIGHT]

,[PLACEMENT_DATE]

,[REQUESTED_DELIVERY]

,[OUTLET_ID]

,[DEV_LOC_ID]

,[TSR_ID]

,[LAST_LINE_ITEM]

,[PARTIALS]

,[WAREHOUSE_ID]

,[COURIER_ID]

,[ALT_ADDRESS_ID]

,[ROUTE_CRITERION]

,[SHIPMENT_ID]

,[MANIFEST_NOTE_ID]

,[COURIER_NOTE_ID]

,[CONFIRM_DATE]

,[LINE_NO]

,[FILL_DATE]

,[LAUNCH_ID]

,[CDC_DK]

,[ORDER_SIZE]

,[PICK_PACK_USER]

,[LAST_DATE_MODIFIED]

,[USER_MODIFIED]

,[IA_INSERT_DT]

,[IA_UPDATE_DT]

,[SOURCE_ID]

FROM [DB2ADMIN].[IA_ORDERS]

WHERE [CDC_DK]  = "

+(DT_STR,5,1252)@[User::CurrentDateKey]

This is the ERROR:

An OLE DB error has occurred. 
Error code: 0x80040E14. 
An OLE DB record is available. 
Source: "Microsoft DB2 OLE DB Provider" 
Hresult: 0x80040E14 
Description: "An unexpected token "SELECTBEGIN-OF-STATEMENT<value" was found following "". 
              Expected tokens may include:  "". SQLSTATE: 42601, SQLCODE: -104".


How do I import a SPSS .sav file into SQL 2008 r2 using SSIS

0
0

Hi there,

Like the title says, I'm trying to import an SPSS .SAV file into an SQL 2008 R2 database using SSIS.
I've tried a few things, but i cant seem to get it to work properly. I'm hoping there's someone out there who could point me in the right direction.

I've tried the following:

  • Tried the IBM step by step manual (http://pic.dhe.ibm.com/infocenter/spssdc/v6r0m1/index.jsp?topic=%2Fcom.spss.ddl%2Faccess_odbc.htm)
    --Couldnt folow this guide because I didnt have the SPSS MR DM-2 OLE DB Provider.
  • Tried installing the provider using (http://pic.dhe.ibm.com/infocenter/spssdc/v7r0m0/index.jsp?topic=%2Fcom.spss.ddl%2Fdts_troubleshooting.htm) as a guide to download the provider listed (www-03.ibm.com/software/products/nl/spss-data-model).
    --This didnt work, I still could not see the provider listed after install and rebooting the server.
  • Tried to get the file as CSV (Company couldnt provide it in CSV or another format)

The server is a Windows Server 2008 R2 Enterprise 64-bit, has the Data Collection Data Model installed on it with SQL Server 2008 R2.

If anyone could point me in the right direction they could make my day!

Thanks in advance!

Ronny




Data flow tasks faills while loading from database to excel

0
0

Hello,

I am getting error while loading from oledb source to excel and the error as shown below.

Error: 0xC0202009 at DFT - Company EX, OLE DB Destination [198]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.

Error: 0xC0209029 at DFT - Company EX, OLE DB Destination [198]: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "input "OLE DB Destination Input" (211)" failed because error code 0xC020907B occurred, and the error row disposition on "input "OLE DB Destination Input" (211)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.

Error: 0xC0047022 at DFT - Company EX: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "OLE DB Destination" (198) failed with error code 0xC0209029. The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

Error: 0xC02020C4 at DFT - Company EX, OLE DB Source 1 [1]: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.

Error: 0xC0047021 at DFT - Company EX: SSIS Error Code DTS_E_THREADFAILED.  Thread "WorkThread0" has exited with error code 0xC0209029.  There may be error messages posted before this with more information on why the thread has exited.

Error: 0xC0047038 at DFT - Company EX: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "OLE DB Source 1" (1) returned error code 0xC02020C4.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.

Error: 0xC0047021 at DFT - Company EX: SSIS Error Code DTS_E_THREADFAILED.  Thread "SourceThread0" has exited with error code 0xC0047038.  There may be error messages posted before this with more information on why the thread has exited.

Any help would be appreciated ASAP.

Thanks,

Vinay s


SSIS Job creating error message.

0
0

Hi All,

I have a ssis job which is already running in production and our client has created a same job in the new server for our testing purposes. which is pointing to the correct config file in the new server and file paths are mentioned in the table for picking the files, till now I don't have any issue it is performing as expected. but when you go to the job history and see it is saying the message similar to the below. but the path which I am getting in the below message is not in the config or the table defined for the respective table to pick, but I observed on this thing that path is it is in the package at one of the tasks but that path is  replaced while the package is running(I kept break points in the package for debug purpose and checked). but still I am getting this message.... any thoughts guys


Message
Executed as user: URBANLSB\svc_TSsisProxy. Microsoft (R) SQL Server Execute Package Utility  Version 10.50.4000.0 for 64-bit  Copyright (C) Microsoft Corporation 2010. All rights reserved.    Started:  10:43:59 AM  Error: 2014-10-02 10:44:03.23     Code: 0xC001401E     Source: FedexFeed Connection manager "FedexFeedExceptionFile"     Description: The file name "\\Database Uploads\Test\FedexFeed\FedexFeedException\\FedexFeedErrorRecords_10022014_104400.txt" specified in the connection was not valid.  End Error  Error: 2014-10-02 10:44:03.24     Code: 0xC001401E     Source: FedexFeed Connection manager "FedexFeedExceptionFile"     Description: The file name "\\Database Uploads\Test\FedexFeed\FedexFeedException\\FedexFeedErrorRecords_10022014_104400.txt" specified in the connection was not valid.  End Error  Error: 2014-10-02 10:44:03.25     Code: 0xC001401E     Source: FedexFeed Connection manager "FedexFeedExceptionFile"     Description: The file name "\\Database Uploads\Test\FedexFeed\FedexFeedException\\FedexFeedErrorRecords_10022014_104400.txt" specified in the connection was not valid.  End Error  DTExec: The package execution returned DTSER_SUCCESS (0).  Started:  10:43:59 AM  Finished: 10:44:38 AM  Elapsed:  39.109 seconds.  The package executed successfully.  The step succeeded.

how to get data from a column with datatype sbyte in mysql to a table in sqlserver2012 using ssis

0
0

HI All,

We are trying to load data from mysql table to sqlserver 2012.

The source column is of data type SBYTE(mysql).

Destinaltion output column is of data type numeric.

But we are getting the following error while trying to load data using ssis 2012.

Error

The data type of "Test.Outputs[ADO NET Source Output].Columns[col1]" does not match the data type "System.SByte" of the source column "col2".

PLease share your views on this.      Thanks in advance

Description: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.

0
0
Hi All,

I am facing below error. Please help.

Thanks in advance.

Error: 2014-10-03 08:30:10.00
   Code: 0xC0202009
   Source: DFT Load LU_PRODUCT from STG_Prod OLE Insert LU_PRODUCT [2804]
   Description: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Microsoft SQL Native Client"  Hresult: 0x80004005  Description: "Could not complete cursor operation because the table schema changed after the cursor was declared.".
End Error
Error: 2014-10-03 08:30:14.00
   Code: 0xC0209029
   Source: DFT Load LU_PRODUCT from STG_Prod OLE Insert LU_PRODUCT [2804]
   Description: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "input "OLE DB Destination Input" (2817)" failed because error code 0xC020907B occurred, and the error row disposition on "input "OLE DB Destination Input" (2817)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.
End Error
Error: 2014-10-03 08:30:17.00
   Code: 0xC0047022
   Source: DFT Load LU_PRODUCT from STG_Prod 
   Description: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "OLE Insert LU_PRODUCT" (2804) failed with error code 0xC0209029. The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.
Viewing all 24688 articles
Browse latest View live




Latest Images