Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS Job fail (Basic error details)

$
0
0
Timeout expired.  The timeout period elapsed prior to completion of the operation or the server is not responding. ---> System.ComponentModel.Win32Exception (0x80004005): The wait operation timed out

I see my SSIS package getting timeout, i try to trace but can not get any details, there are no blocking or any deadlock. I can see that the issue is caused by a lock time out. but to get which query is blocking mine? profiler did not help here
Please guide

Best Regards Moug


Copying files from one folder to another folder by given modified date

$
0
0

Hi all ,

I am having one requirement to create a script task using c# which copy file from one folder to another folder.

Suppose in source folder 1000 of files are there with multiple modified date . There are txt, csv, xml  and xls files in source folder.

I have to create one script task where i have to use two variable one for file pattern and another for Modified date .

so if I pass .txt file pattern and modified date is 01-01-2017 , then all the txt file of given date should move to target folder from source folder.

Thanks in Advance


Thankx & regards, Vipin jha MCP

How can I use Row Count SSIS task by using filters?

$
0
0

Hi there, according this pic you get the total number of rows. so far so good. how can we get a partial row count based on criteria?

select count(*) from <table> where legalentity = 'A1' 

select count(*) from <table> where legalentity = 'B1' 

thanks for your help,

MCSA EXAM for BI

$
0
0

where can i get the material or dumps for MSCA 70-767,768 exams. when i tried to register for 767 exam..it shows"THIS EXAM IS IN BETA".What does it mean, does this beta determines it doesn't have retake?

768 exam registration is normal,its not beta. Please tell me what is beta ? 

below images are what i tried.....

Please any one can provide me the link where i can i prepare for these 2 exams or do i need to use any exam training kit ..

pls help..


lucky

SQL Server job is failing with error "Text was truncated or one or more characters had no match in the target code page.".

$
0
0

Hi All,

In my package, i have one data flow task. Inside the data flow is like below image. In my excel source, one of the column text was more than 255 characters which would be in last row. Due to this SSIS reading that column as DT_WSTR instead of DT_NTEXT. 

i have added the Dummy task to redirect the rows which has truncation or error records. My package is working fine in debugging mode. But when i moved this package to msdb and created a job with this package was giving error when i run that job. 

Please let me know how to resolve this issue. 


------------------------------------------------------------------------ Please mark it as complete, if you get the solution with this reply. TQ.

Insert procedure using multiple split variable in sql server

$
0
0

We run the below procedure using split type of two input variable .

Exec Sp_insert_Procedure '1','Mode1|Mode2|Mode3','Answer1|Answer2|Answer3;Answer1|Answer2|Answer3;Answer1|Answer2|Answer3'

I need the Result like below format 

ID ANSMODE  ANSWERLIST
1  Mode1    Answer1|Answer2|Answer3
1  Mode2    Answer1|Answer2|Answer3
1  Mode3    Answer1|Answer2|Answer3

Kindly help me how to query for the above insert procedure .

Transfere file with unknown filename

$
0
0

dear all I have a back up file each Sunday with the name XXXX_170129_032205.bak.gz i.e name_YYMMDD_HHMMSS.bak.gz the date and the time obviously changes and i need to create a package that runs each week to transfer this to server and for it to be restored to MS SQL. i have done this using one file and its working. My issue is the connection to the file because it wont be known the next time this will run unless i manually point to the filename, which i am trying to avoid and automate. 

Could you please give me some advise on this??

I am using SSIS 2008 R2


How to populate random values from existing PDW table values in SSRS based on parameter?

$
0
0

Hi,



I would like to fetch random column values based on text parameter n Dropdown selected value given in SSRS from PDW Table.

Let's say If I give 3 in textbox n select date and select type from dropdown in SSRS report n based on that 3 random values(rows) from PDW sql table should show  in SSRS report n at same time would like to save random valueS(ROWS)  in new PDW table.

Pls advice.

Can not edit a "Script task" with error message

$
0
0

TITLE: Microsoft Visual Studio
------------------------------

I try to edit the vb.net script in script task that I developed and get this message.

Any idea what happen and how to fix this.

Cannot show Visual Studio 2008 Tools for Applications editor.

------------------------------
ADDITIONAL INFORMATION:

Failed to create project at location "C:\Documents and Settings\pchen\Local Settings\Temp\2\SSIS\78a8360ded6b4c719c8aae52ac7483bb"! (Microsoft.SqlServer.VSTAScriptingLib)

------------------------------

The given path's format is not supported. (mscorlib)

 

.Xlsx file - unable to process through SSIS VS 2015

$
0
0

I daily receive a .xlsx file from a client that I need to load into a DW environment.  In attempt to automate the process I chose SSIS to do the job though unsuccessfully. I get the error below in SSIS VS 2015 when I attempt to query (SELECT * FROM [Sheet1$a1:d5]) the file:

Exception fromHRESULT: 0xC020801C

Error at DepositDetail [Connection manager "Excel Connection Manager"]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.

An OLE DB record is available.  Source:"Microsoft Access Database Engine"  Hresult: 0x80004005  Description:"External table is not in the expected format.".

 

Error at Data Flow Task [Excel Source [44]]: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.

If I open and save the file and try to connect to it, it works with no problem.

I have already installed Microsoft Access database engine 2010 (and set Run64BitRuntime to False in VS) and was able to connect to a test Excel file I created.   

Any help is greatly appreciated!







SSDT 2015 testing with VS 2015

$
0
0

I have migrated some SSIS packages from 2008 to 2015. These packages use relative addressing to determine the location of child packages and the .dtsConfig file.  When I open up the solution in VS 2015 it can not find the .dtsConfig file and when I jury rig it by defaulting the variables it can not find the child packages.

Can someone please advise me on how to get this to work?

Currency Exchanges rate values return -1 instead of orginal values using ssis webservice task

$
0
0

Hi ,I have doubt in ssis,

get usd to gbp  exchange rates conversation information for daily basis

here I Done current live values for ssis package ran day information values using webservice task.

 get currency
 exchange rates  for  USD to GBP.
 to run ssis ETL package daily,pull the data from webservice on the web and insert into the stage table.
step 1 : open new project of integration services and rename the default package name as webservice
step 2 : drag and drop the webservic task in package and  a variables (GBP_value)
step3 : create new HTTP connection by right clink in connnection manager and select http connection and enter the server url as
 http://www.webservicex.net/CurrencyConvertor.asmx?WSDL and testthe test connection.
step 4: open the new notepad and save it as currencyconvertor.wsdlfor required location .
step 5 : Double click on the web service task and confiure like belowin 
general tab: Httpconnection .....>http connection manager which we create earlywsdl file .....> browse and select the currencyconvertor.wsdl 
fileoverwritewsdlfile.....> set as truedownload the wsl file and overwrite to empty wsdl fileinput tab:in input tab 
we have to configurservice .....>currecconvertormethod.....>convesionrateand also 
I need to select the from currency value and tocurrencyvalueFromCurrency as usd(us dollar) 
and Tocurrency(GBP uk)output:in output tab i have to configur the output type : variable : GBP_value

step 6 : from the datafow to insert the stagein oledb source select data access mode : sql command

select getdate()as daterun ,convert(nvarchar(4000),NULL)as viewxml ,convert(nvarchar(3),'GBP')as currencytype

then fields list like daterun,viewxml,currencytypederievd column to expression : @[user::GBP_value]insert to stage dimcurrencystage.
after that take another dft and drag and drop oledb source and dataaccess is sql command and write query like 

SELECT [Currencytype] = [CurrencyAbbr] [DateSK] = convert(int,convert(varchar(8),Convert(date,[DateRun]),112)) 
,[ExchangeRate] = CONVERT(Decimal(18,2),CAST(CAST(ViewXML AS XML).query('data(/double)') AS varchar(4000))) FROM
[dbo].[DimCurrency_Stage]

then this data load in to final table.its working fine some times.but 

when I ran websrvice package some time its returning -1 as usd to GBP conversion.

<?xml version="1.0" encoding="utf-16"?>
<double>-1</double>

can you please tell  me why its returning -1 instead of orginal values.

when -1 values return how to handle that case .please tell me how to achive this task in ssis. 

Error : The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020

$
0
0

 Hi All,

I have a package that transform data from OLEDB Source TableA to OLEDBDestination TableB.
The count of records in TableA is around 7.500.000 records.
When I run that package, the package run well, but after around 200.000 records have been inserted to TableB, the package got error, and TableA become Red. This is the summary of the error messages :

Unspecified error

SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component "Union All 11" (16989) failed with error code 0xC0047020 while processing input "Union All Input 2" (17111). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running. There may be error messages posted before this with more information about the failure.

The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020

I've tried to search that problem, and I read in forum that someone suggest to change the Data Access Mode for OLEDB Destination From "Table/View Fast Load" to "Table/View". I've tried that, but the performance become very slow, and I still got the same error after around 300.000 records have been inserted to TableB.

Does anybody know what reason that might cause that error?

Thank you

CDC for EDW Logic

$
0
0

An architecture discussion.

 In you experience and contacts, do you know of a company using SQL Change Data Capture (CDC) for Enterprise Data Warehouse (EDW) ETL Logic? Use CDC to create Facts and Dimensions for Cubes.

 Please note I am not asking for ETL Incremental. CDC is perfect for ETL Incremental.

 Cheers, Toraj


Toraj toraj.khavari@a-dec.com

SSIS Dataflow task error

$
0
0

Hi All,

I am upgrading SSIS Packages from 2005 to 2014.After upgrading I executed a package it is getting stuck at DFT and keeps on running forever until I stop the package.

The DFT transfers data from OLEDB Source(SQL Command) to OLE DB Destination. The count of records from source query is around 21,952,057.When I run the that package it is working fine, but after inserting 133,654 records in destination table, the package is getting stuck and keeps on running forever and the oledbsource become red.Here is the summary of the error thrown.

"[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on LO Join W_OTLCHNSUP_A  and OTLCHNSUP_A returned error code 0xC02020C4.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.

[LO Join W_OTLCHNSUP_A  and OTLCHNSUP_A [14]] Error: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020."

I am not sure whether table lock used inside oledb destination is the issue because, the source query is  using same table used in destination.For eg.

SELECT
   col1,col2,col3..,col9
FROM  stagingtable AS wocs LEFT OUTER JOIN 
      destinationtable AS ocs ON 
      wocs.col1 = ocs.col1 AND
      wocs.col2= ocs.col2.

So If I disable the table lock in oledb destination it is working fine. But as per the requirement table lock should be enabled.Also in old version 2005 this package is working fine with table lock enabled inside oledb destination but it is not working in 2014 version.

If table lock is not an issue then what is making this package to stuck at that DFT? 

Its tough for me to figure out the exact issue.Please help.

Thanks in Advance.


How to browse a Flat File from the different server?

$
0
0

Hi Experts,

I have some packages on my old server (SSMS 2008 and VSO 2008) and I need to migrate them to the new development server (SSMS 2016, VSO 2015). I started adding every package by "Add existing package" from the new server using SSDT and started changing the connection managers for some tasks that are failing. Previously these packages source and destinations are on the old server. Now I am changing the destination to the new server keeping the source on the old server itself. My question is, how to configure Flat file connection manager, since the path of that flat file is on the old server. I don't want to copy that file to the new development server rather I have to browse (import) that file from the old server, but I cannot able to do so. Can anyone help me out from this issue.

Please correct me if I am wrong.

Thanks



What is the Maximum size of XML for Execute SQL Task Result set in SSIS?

$
0
0

An Execute SQL Task in SSIS package is defined with the following properties.

1) OleDB connection provider

2) return result set is XML

3) SQL statement with just SQL query with XML output clause

4) Result set is stored into a String variable

When we execute the task and if no.of rows in the query result is less than 9000 records (around 20 columns), the task execute successfully, but if the no.of rows are more than 9k records, the task is failed. Is this problem caused by memory issue/XML maximum size limitation/String variable limitation? It'll be great if anyone gives some hint on this. Thanks!

Package in Job failing, No Clear Visible error, Errors logs clear, Unsure How to Approach for Fix

$
0
0

Hello, taken over where a contractor left off. He created a series of multi-step processes broken down to jobs that run packages in a certain order. This process runs once a year, makes changes to changed static dim over the year, and then loads new static dims, reloads dyn dims, geography data, and then after clearing out data from cubes (other stepped processes), and readying a back-loading a several years of data, it all gets reprocessed into the cube new for 2017 year. This is a Tabular data model, and it's using partitions tables. Server Windows 2012R2, SQL Server 2016.

The issue now is a job that has three packages in it, first package ran fine backing up, truncing and loading in new dim values, ran fine, Then it rolled to the second package in the Solution where it failed. Below the screenshots I have more details.
From The error messages here is a screen shot of that error:

‌Here is a screenshot of the entire package in question, as to the basics of design:

Based on the error message, the first Execute SQL Task in the Container is failing, executing this: SELECT [PartitionName] FROM [BLAH_Partitions].[dbo].[SSASPartitionDimsStatic] WHERE DatabaseID = ?

Seems that it's  not getting what is was expecting from one Execute SQL Task outside the container feeding the Sequence Container. In it is: Select 'DataBaseID'  <-- real database name
And it is as if its populated with NULL, based on the above screenshot error.
If I try to step though running the package in VS, It immediately errors on that first outside the loop Execute SQL task, here is that screenshot:


I'm unsure on where or how to edit or what to change to rectify this error and to satisfy getting the correct value.
‌Please let me know what other details I can track down and share in helping resolve this issue.
Thank you,

JQ


Dynamics NAV Toolkit

$
0
0

Hi, We're planning to move away from using Scribe and use SSIS instead as a tool for importing into Dynamics NAV. But we noticed there are a number of different third-party toolkits and/or enhancements for SSIS.  Can you, at least, identify for us which ones are legitimate and actually works? If you can recommend your top 3 (or 5) that would be great. Thank you very much.

The For Each File enumerator is empty

$
0
0

Hi,

I am using Sql server 2012. In my project whenever I run the Package individually, it run successfully. But while executing the package through SSIS task, I get the following warning and not able to transfer the data from flat file to DB.

Foreach Loop Container:Warning: The For Each File enumerator is empty. The For Each File enumerator did not find any files that matched the file pattern, or the specified directory was empty.

kindly help.


.Net

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>