Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Failed to retrieve long data for column

March 5, 2010, 11:33 am
$
0
0
Hi,

      I am calling an SSIS package inside a SQL Server Agent job step. Almost half the time, the package fails with the following error and it works fine other times. The column that it complains about is a nvarchar(max) column and the maximum data length for the records we have in that column is around 3600.

Message

Executed as user: abcdef. Microsoft (R) SQL Server Execute Package Utility  Version 10.0.2531.0 for 64-bit  Copyright (C) Microsoft Corp 1984-2005. All rights reserved.    Started:  4:30:00 PM  Error: 2010-03-03 16:30:02.84     Code: 0xC0047070     Source: Data Flow Task 1      Description:   End Error  Error: 2010-03-03 16:30:02.84     Code: 0x80004005     Source: Data Flow Task 1      Description:   End Error  Error: 2010-03-03 16:30:02.84     Code: 0xC0208266     Source: Data Flow Task 1      Description:   End Error  Error: 2010-03-03 16:30:02.84     Code: 0xC0208265     Source: Data Flow Task 1 Source - Query [1]     Description: Failed to retrieve long data for column "Response".  End Error  Error: 2010-03-03 16:30:02.84     Code: 0xC020901C     Source: Data Flow Task 1 Source - Query [1]     Description: There was an error with output "OLE DB Source Output" (11) on component "Source - Query" (1). The column status returned was: "DBSTATUS_UNAVAILABLE".  End Error  Error: 2010-03-03 16:30:02.84     Code: 0xC0209029     Source: Data Flow Task 1 Source - Query [1]     Description: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "output "OLE DB Source Output" (11)" failed because error code 0xC0209071 occurred, and the error row disposition on "component "Source - Query" (1)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.  End Error  Error: 2010-03-03 16:30:02.84     Code: 0xC0047038     Source: Data Flow Task 1 SSIS.Pipeline     Description: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "Source - Query" (1) returned error code 0xC0209029.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  4:30:00 PM  Finished: 4:30:02 PM  Elapsed:  2.012 seconds.  The package execution failed.  The step failed.

 Could you please let me know why this error is happening randomly and how I could avoid this error?

Thanks,
JayaMS

↧
Search

SSIS Google AdWorlds c#

February 17, 2014, 1:03 am
$
0
0

Hi,

I'm trying to extract data from Google AdWords, using their API. I've successfully got this working in a C#, just by using the google samples etc that I got from:

https://github.com/googleads/googleads-adwords-dotnet-lib/releases/tag/v16.6.0

I'm now trying to get this working in SSIS, via a script task initially, and I can't get it working. I think this stems from the fact that the SSIS script tasks don't have an app.config.

I've tried to bypass the need for an app.config by specifying the various settings manually in the code, but the SSIS script is crashing every time I include the code:

AdWordsUser user = new AdWordsUser(customDictionary);

I doesn't even let me step into the code when the above line is active - it just crashes.

Has anyone managed to get a Google AdWords extract working in an SSIS script task?

Thank you


↧
↧

reorganization of SSIS

June 20, 2016, 7:22 am
$
0
0

HI,

SSIS is able to organize the data after the data is transformed and loaded into database? 

regards

zak

↧

Database Profiling results back to a DB

June 17, 2016, 5:17 am
$
0
0

Was wondering if anyone has set up data profiling to process an entire DB of tables and store the results back into a DB repository for analysis?

I'm hoping there is either a sample package to start with or at least some instructions to set this up.  I know it should be possible to do, was hoping to not start completely from scratch.

Thx

↧

SSIS MDX Truncation Error

June 20, 2016, 8:17 am
$
0
0

Hello, 

With SSIS we have a straight forward MDX QUERY that writes the result set to a flat file.  The problem we are experiencing is a truncation error at the OLE DB Source step.  We tried to ignore the error and do a Data Conversion from DT_WSTR to DT_STR 8000.  However, the result set only contains 255 characters.  

It appears that the truncation is happening before our Data Conversion.  Has anyone found a workaround for this truncation at the OLE DB Source with an MDX query? 

SELECT NON EMPTY { [Measures].[Count of Orders] } ON COLUMNS,
 NON EMPTY {
	([D_ORDER_DETAILS].[Order Number].[Order Number].ALLMEMBERS *
	 [D_LEVELS].[Level 1].[Level 1].ALLMEMBERS *
	 [D_LEVELS].[Level 2].[Level 2].ALLMEMBERS *
	 [D_LEVELS].[Level 3].[Level 3].ALLMEMBERS *
	 [D_LEVELS].[Level 4].[Level 4].ALLMEMBERS *
	 [D_LEVELS].[Level 5].[Level 5].ALLMEMBERS *
	 [D_MEMBER].[Member HICN].[Member HICN].ALLMEMBERS *
	 [D_MEMBER].[Member First Name].[Member First Name].ALLMEMBERS *
	 [D_MEMBER].[Member Last Name].[Member Last Name].ALLMEMBERS *
	 [D_MEMBER].[Member Enrollment Date].[Member Enrollment Date].ALLMEMBERS *
	 [D_MEMBER].[Member Number].[Member Number].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Created Date Time].[Order Created Date Time].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Issue Determination].[Order Issue Determination].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Issue Description].[Order Issue Description].ALLMEMBERS *
	 [D_DRUG_MASTER].[Drug Master NDC].[Drug Master NDC].ALLMEMBERS *
	 [D_DRUG_MASTER].[Drug Master Full Name].[Drug Master Full Name].ALLMEMBERS *
	 [D_COV_DTRMN_TYPES].[Coverage Determination Description].[Coverage Determination Description].ALLMEMBERS *
	 [D_COV_DTRMN_TYPES].[Coverage Determination].[Coverage Determination].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order PRI0 Status].[Order PRI0 Status].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Coverage Exception Dose End Date Time].[Order Coverage Exception Dose End Date Time].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Prescribers Supporting Statement Date and Time].[Order Prescribers Supporting Statement Date and Time].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order QA Response Date].[Order QA Response Date].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order QA Response Date Time].[Order QA Response Date Time].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Plan Decision Date and Time].[Order Plan Decision Date and Time].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Oral Notification Date and Time].[Order Oral Notification Date and Time].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Written Notification Date].[Order Written Notification Date].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Written Notification Date Time].[Order Written Notification Date Time].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order IRE Notification Date].[Order IRE Notification Date].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order IRE Notification Date Time].[Order IRE Notification Date Time].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Decision Tree Name].[Order Decision Tree Name].ALLMEMBERS *
	 [D_MEMBER].[Member Birth Date].[Member Birth Date].ALLMEMBERS *
	 [D_DRUG_MASTER].[Drug Master GCN].[Drug Master GCN].ALLMEMBERS *
	 [D_PHYSICIAN].[Physician Full Name].[Physician Full Name].ALLMEMBERS *
	 [D_PHYSICIAN].[Physician NPI Number].[Physician NPI Number].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Request for Information].[Order Request for Information].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Close Date Time].[Order Close Date Time].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order RPH Response Date].[Order RPH Response Date].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order RPH Response Date Time].[Order RPH Response Date Time].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order TECH Response Date].[Order TECH Response Date].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order TECH Response Date Time].[Order TECH Response Date Time].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Mail Print Process Date].[Order Mail Print Process Date].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Mail Print Process Date Time].[Order Mail Print Process Date Time].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Oral Notification Status].[Order Oral Notification Status].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Request for Information Date Time].[Order Request for Information Date Time].ALLMEMBERS *
	 [D_ORDER_DETAILS].[Order Priority].[Order Priority].ALLMEMBERS
	 )
}

DIMENSION PROPERTIES MEMBER_CAPTION,

MEMBER_UNIQUE_NAME ON ROWS
FROM ( SELECT ( [D_DATE_ORDER_DETAILS].[Date].&[2016-06-01T00:00:00] : [D_DATE_ORDER_DETAILS].[Date].&[2016-07-01T00:00:00] ) ON COLUMNS
FROM ( SELECT ( { [D_ORDER_DETAILS].[Order Applicable].&[True] } ) ON COLUMNS
FROM [PALogic]))

CELL PROPERTIES VALUE,BACK_COLOR, FORE_COLOR, FORMATTED_VALUE, FORMAT_STRING, FONT_NAME, FONT_SIZE, FONT_FLAGS

↧
↧

[SSISDB].[internal].[operations] vs [SSISDB].[catalog].[executions]

March 11, 2013, 9:24 am
$
0
0

This is on SSIS 2012. What is the difference between these two? I see that one is a table and the other is a view. But not sure how the contents are different.

They both seem to be a log of some sort for each exectution of a package in the SSIS catalog, but I have slightly more entries in [internal].[operations].

If I wanted to check the status of an execution_id immediately after executing

EXEC [SSISDB].[catalog].[start_execution] @execution_id = @exec_id
which would be the appropriate object to check. I think it is [internal].[operations] but wanted to confirm.

EDIT: I did look at the view definition, but was hoping for a quick confirmation on my last statement above.
↧

PGP/SSIS Agent

June 16, 2016, 3:36 pm
$
0
0

Greetings!

I am using GPG command line tool with SSIS to encrypt a file and post on FTP site.The issue i am facing is that package runs fine on the dev env but its not running on the Server Agent.I am aware from the doing several web searches that its a security issue but i just can't figure out where.

The server agent has a proxy account and it's used to run a couple of other jobs that run fine under that account.How do I check if my package just runs a cmd.exe that opens up the window that i can see then run a .bat file for a second step.

Thanks in advance....

↧

SSIS recursive update failure and error handling for the exception

June 20, 2016, 5:32 pm
$
0
0

I have a SSIS package which contains a sequence container holding 2 tasks

1. Execute sql task 

Which executes a sql script loading child and parent in a o/p table .Whenever child =parent it goes up and gets the next parent using recursive update

2. Create csv file task using the o/p table created in the above task.The o/p table is truncated before every load 

In the Execute sql task ,I have a recursive update .

3.There is no file archiving in place for the CSV file

4.There is no audit history of the output table

5.No error notification

The problem right now I am having is the recursive update is failing and we are not getting notified.When we have looked into the issue with more detail we have found the issue happens when the lookup condition in recursive update doesnt get any value.

i.e when it expected a value during lookup it didnt get a value and it completes  with a error message .

(136 row(s) affected)

Msg 245, Level 16, State 1, Line 333
Conversion failed when converting the varchar value 'kv1234' to data type int.

When we digged furhter in we found the source table for the look up condition was not having the required value.

The execute sql task completes with no failures recorded in the job and the output table and csv file are populated with whatever data it got till the failure.

So my expert friends please suggest me a solution which  you think I should implement.

The solution should notify the failure and pick the column or record which is the cause for the failure.

The file which generated with no issues must be archived at the end of the load.






↧
Search

Excel to SQL data import- Order of rows is not correct

June 4, 2013, 5:34 am
$
0
0

Hi,

I am loading the data from EXCEL to SQL.

I have created a simple data flow task to do this.

But SSIS is not loading the data in the same order as in the EXCEL sheet.

Is there any way to do this with out changing the structure of the Source Excel sheet.

Thanks

↧
↧

SSIS package - Error: 0x1 at Script Task: Cannot load script for execution.

June 17, 2016, 4:51 am
$
0
0

I have a Script Task in my SSIS project that is failing with the following error - 0x1 at Script Task: Cannot load script for execution.

When I originally added the task and wrote the code it had the following message - Target Of Invocation on Scrip Task. I have read few forums and followed suggested fixes:

- Replaced Microsoft.SQLServer.ManagedDTS.dll from version 11 to version 12

- Replaced Microsoft.SQLServer.ScriptTask.dll from version 11 to version 12

- changed .NET Framework from 4 to 4.5

After all those changes I do have now cannot load script for execution.

The code inside the scrip task:

	public void Main()
		{
            try
            {
                String RemoteFileName = "/folderx/export_new.csv";

                SessionOptions sessionOptions = new SessionOptions
                {
                    Protocol = Protocol.Sftp,
                    HostName = "xyz.example.testing.com",
                    UserName = "username1",
                    Password = "password1",
                    PortNumber = 22,
                    SshHostKeyFingerprint = "ssh-rsa 4096 xx:xx:xx:xx:xx:xx..."
                };

                using (Session session = new Session())
                {
                    session.Open(sessionOptions); //Attempts to connect to your sFtp site

                    if (session.FileExists(RemoteFileName) == true)
                    {
                        Dts.Variables["FileExists"].Value = true;
                    }
                    else
                    {
                        Dts.Variables["FileExists"].Value = false;
                    }

                    session.Close();
                }

                Dts.TaskResult = (int)ScriptResults.Success;

            }
            catch
            {
                Dts.TaskResult = (int)ScriptResults.Failure;
            }
		}

Any ideas?

↧

Pulling Data from DB2 ODBC Setup

June 20, 2016, 1:23 pm
$
0
0


In ODBC Source i have set the  the batch size to 1000000 to speed up the data pull from DB2 iseries . Can anyone advise what else i can change to speed up the process. What can i change lobchunksize to ? 

↧

Looping Excel files in a folder, finding where a particular text string occurs and importing the CurrentRegion associated with the string's location.

June 21, 2016, 3:37 am
$
0
0

Hi,

I am using SQL server 2012, Visual Studio 2010 and Excel 2013 (32 bit). I am looking for a way to:

1) loop .xlsx files in a folder,

2) find the location of a text string ("Admissions") in each file and select the CurrentRegion,

3) collate the CurrentRegions together, trim to left 8 columns, and insert them into a SQL table. There is a date column (Column B of source) of format "dd/mm/yyyy", where there are duplicate dates I want to keep the latest imported.

I am looking for a step by step example that would show me hopefully with a worked example how to do this? I can loop files but haven't found a way to write the script task that would find the specified text string in each file and return the CurrentRegion associated with the string's cell location. 

Any help gratefully received,

Q

QHarri

↧

Storing Data in single column with semicolon in CSV file

June 21, 2016, 4:56 am
$
0
0

Hi All,

How to store the data in single column with semicolon for csv file destination. For more information please find the below images.

Source:

Destination:

CSV File

Thanks,

Madhava Ganji

Madhava Ganji

↧
↧

Multiple values in PivotKeyValue properties in Pivot transformation

June 20, 2016, 8:46 am
$
0
0

Hi,

Based on the incoming field values, I am loading data into pvt_CLosePrice if Pivot Key value = C. I want to load the data into pvt_CLosePrice if PivotKeyvalue = C or D. i was trying to use pipe like C|D but it didn't work. Can we put multiple values in PivotKeyValue to load the data.

Thanks

↧

Dynamically creating table and changing column datatype

June 20, 2016, 11:38 pm
$
0
0

Hi All,

I have a requirement where we get excel files with different columns and datatypes(column placement also changes).

Currently I am loading the excel files into different tables with nvarchar datatypes, but these tables are getting used for reporting and nvarchar is creating problem in numeric calculation.

So, how to dynamically identify the columns as numeric and convert it to Numeric datatype and then load to table?

Thanks

Anky

↧
Search

Moving files from A to B where the files name begins with todays date and ends in another prefix

June 20, 2016, 7:48 am
$
0
0

Hi 

Hopefully someone can help. 

I need to create an SSIS package that picks up files from A and moves them to B where the file names have todays dates at the start and at the end, a file name, for example: 20160620*TestingFile.txt 

The date would be dynamic and change daily to todays date. 

The '*' is just a loads of numbers.

TestingFile - is the file name that doesn't change. 

So basically the process just needs to read the date for todays date, and the rest will be the same every day. 

I am guessing use a Variable to do that, but i am unsure of the rest. 
Please help! 

Thanks in advance. 

↧

Installation of SSDT BI 2012 fails - Attempted to perform an unauthorized operation

June 21, 2016, 6:23 am
$
0
0

I receive the 'Attempted to perform an unauthorized operation' when trying to install. Looking at the setup log file I see the below text. Any ideas?

(01) 2016-06-21 08:34:55 Slp: Received request to add the following file to Watson reporting: C:\Users\username\AppData\Local\Temp\tmp2994.tmp
(01) 2016-06-21 08:34:55 Slp: The following is an exception stack listing the exceptions in outermost to innermost order
(01) 2016-06-21 08:34:55 Slp: Inner exceptions are being indented
(01) 2016-06-21 08:34:55 Slp: 
(01) 2016-06-21 08:34:55 Slp: Exception type: Microsoft.SqlServer.Configuration.Sco.ScoException
(01) 2016-06-21 08:34:55 Slp:     Message: 
(01) 2016-06-21 08:34:55 Slp:         Attempted to perform an unauthorized operation.
(01) 2016-06-21 08:34:55 Slp:     HResult : 0x84bb0001
(01) 2016-06-21 08:34:55 Slp:         FacilityCode : 1211 (4bb)
(01) 2016-06-21 08:34:55 Slp:         ErrorCode : 1 (0001)
(01) 2016-06-21 08:34:55 Slp:     Data: 
(01) 2016-06-21 08:34:55 Slp:       WatsonData = Uninstall@{E7183FEB-170E-4614-A0AB-325C565FC11D}
(01) 2016-06-21 08:34:55 Slp:       DisableRetry = true
(01) 2016-06-21 08:34:55 Slp:       HelpLink.EvtType = 0xEF814B06@0x92D13C14
(01) 2016-06-21 08:34:55 Slp:       EMBResult = Cancel
(01) 2016-06-21 08:34:55 Slp:     Stack: 
(01) 2016-06-21 08:34:55 Slp:         at Microsoft.SqlServer.Configuration.Sco.InternalRegistryKey.OpenSubKey(String subkey, RegistryAccess requestedAccess)
(01) 2016-06-21 08:34:55 Slp:         at Microsoft.SqlServer.Configuration.Sco.SqlRegistryKey.OpenSubKey(String subkey, RegistryAccess requestedAccess)
(01) 2016-06-21 08:34:55 Slp:         at Microsoft.SqlServer.Configuration.MsiExtension.ArpRegKey.CleanupPatchedProductRegistryInfo()
(01) 2016-06-21 08:34:55 Slp:         at Microsoft.SqlServer.Configuration.MsiExtension.SetPatchInstallStateAction.ExecuteAction(String actionId)
(01) 2016-06-21 08:34:55 Slp:         at Microsoft.SqlServer.Chainer.Infrastructure.Action.Execute(String actionId, TextWriter errorStream)
(01) 2016-06-21 08:34:55 Slp:         at Microsoft.SqlServer.Setup.Chainer.Workflow.ActionInvocation.ExecuteActionHelper(TextWriter statusStream, ISequencedAction actionToRun, ServiceContainer context)
(01) 2016-06-21 08:34:55 Slp:     Inner exception type: System.UnauthorizedAccessException
(01) 2016-06-21 08:34:55 Slp:         Message: 
(01) 2016-06-21 08:34:55 Slp:                 Attempted to perform an unauthorized operation.
(01) 2016-06-21 08:34:55 Slp:         HResult : 0x80070005
(01) 2016-06-21 08:34:55 Slp:         Stack: 
(01) 2016-06-21 08:34:55 Slp:                 at Microsoft.SqlServer.Configuration.Sco.InternalRegistryKey.OpenSubKey(String subkey, RegistryAccess requestedAccess)

↧
↧

How to cancel SSIS package on fail, and also get the failing row and column

June 21, 2016, 8:36 am
$
0
0
I'm extremely new to SSIS. I have a package set up with a Flat File Source, and it also includes a Derived Column Transformation step. At either of those steps, if there is an error, I would like the package to immediately fail, and I also want to retrieve the error row and column. I have not been able to figure out how to accomplish this. Any help getting me started on the right path would be greatly appreciated. I'm using MSQL SSIS Designer 12.0.2430.0.

B+

↧

SMS Via GSM

June 21, 2016, 8:45 pm
$
0
0

Hi,

I have to develop an SSIS project with an output in form of an SMS via GSM modem to members of the group as well. Plz see if an of you experts can help in this regard.

Thanks

↧

Cannot Acquire Connection manager

June 21, 2016, 12:03 pm
$
0
0

Hi 

I have an informix OLEDB Source and parameterized the connection as Project parameter and deployed the package to server. 

The Execution was going good when i run manually, but when i run from SSMS the execution getting failed with Error as below 

SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager “MyServer.MyDatabase” failed with error code 0xC0202009.

Can you please how to overcome this and i need to schedule this package from SQL Server Agent as a next step.

Thanks,

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>