Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Linked Server Failed created by DataFeed Publishing Wizard

$
0
0

I have Created Linked Server by running the   DataFeed Publishing Wizard  and used Select Query from the View  in my another SSIS Package.   When i  run the SSIS Package manually it's working fine. 

But   when running through SQL Agent Job..  linked server failed ERROR :can not fetch the rows from Linkedserver..


Getting random LCK_M_SCH_M on convert and bulk insert task

$
0
0

I starting getting random LCK_M_SCH_M locks with huge wait time, which hung my etl proccess.

The ssis package runs like this:

I have 4 containers that run in parallel and do the same thing:

-Convert a tab delimited file from unicode->utf8
-Truncate the table (within a foreach loop)
-Bulk insert the data



Also transactionoption is set to NotSupported.

What could be causing the lock?

All foreach loops do not overlap ragarding tables/files.

Do they contest somehow?

 

Elias

Data Flow from TXT to a table error

$
0
0

Hello,

I am trying to fill in the data from a .txt file I have into a table in a DB. Previously this worked fine in DTS and I can still do it when I import the DTS command but I want to update this to a data flow because the DTS commands needs to be run on 32 bit and I'm using 64 bit. 

I'm getting 3 errors:

[OLE DB Destination [322]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E21.
An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 10.0"  Hresult: 0x80040E21  Description: "Multiple-step OLE DB operation generated errors. Check each OLE DB status value, if available. No work was done.".

[OLE DB Destination [322]] Error: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "input "OLE DB Destination Input" (335)" failed because error code 0xC020907B occurred, and the error row disposition on "input "OLE DB Destination Input" (335)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "OLE DB Destination" (322) failed with error code 0xC0209029 while processing input "OLE DB Destination Input" (335). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

Before I changed the Flat File Source input advanced editor input and output properties to text stream [DT_TEXT] because the table has VarChar I also had an other error but this seems to be resolved. The only problem is if I look at the mappings the input is text stream [DT_TEXT] but the output is a string and I am unable to change this in the advanced editor of the OLE DB destination. I can change it but it changes back on it's own.

Could I please get some help on these errors?

Thanks


SSIS Excel to sql import : First 10 rows in excel have column names

$
0
0

Hi,

I am loading one excel file into sql table, Here i am facing problem with the excel source file. 

My excel file contains column names in first 10 rows and next to that cell have rows info.

Starting from 'TableName' to 'Partition column' are column names in sql table and next to that cells are values for those col's.

Now i need to export this data into sql tables : Rows as col's and respective values as rows from Excel.

Also, this file have multiples sheets , i want to load 3rd sheet and save the sheet name in variable 

Can anyone help me on this??

Reading .dtsx file using XPath.

$
0
0

Hi Experts,

I found an article here http://sqlblog.com/blogs/jamie_thomson/archive/2009/10/18/collecting-information-about-your-ssis-packages-ssis-nugget.aspx?CommentPosted=true#commentmessage

.But the same is not working Sqlserver 2012/Sql2008 r2 packages.Could you please help with the query the gives me the information on

1) All Connections.

2) All Variables

3) All COnfigration.

4) Logging info

I hope this is clear..I am fresher in Xpath

Best Regards

Chintu


Chinnu

Variable Name Could Not Be Found in List of Variables Error

$
0
0

I have an SSIS task that has run fine for at least the last 2 years. IT has moved the tasks to a new server and now it is throwing a "The variable name "User::obEmailBody" could not be found in the list of variables" error.

I copied the task back to my desktop (test machine) and it ran fine. It only fails on the server. I've verified the variable is there and is getting populated in my test environment. I am at a loss as to why it is failing on the server but not my desktop. The variable is a System.Object.

Is there a setting on the server that would prevent the creation of a System.Object variable?



Text was truncated

$
0
0

Hello,

I trying to import data from Oracle to SQL Server , and I have an issue with decimal places.

In Oracle I have a number with 36 decimal places, when I trying to bring it to SQL(load to the table) , SQL thinks that it's a nvarchar(38) and still have an error:

Text was truncated or one or more characters had no match in the target code page.

Number looks like that:

73.865092402464065708418891170431211499

Please advise , what I should do in SSIS so it going to work

Thanks

Warning: The For Each File enumerator is empty. The For Each File enumerator did not find any files that matched the file pattern, or the specified directory was empty.

$
0
0

I know the message is self explanatory

my source folder : C:\Dataloads is mapped in For each loop container and pick up file(s) for my package.

I do see the files in the folder and I`m using "*.*" in the enumerator configrator and also my folder path is there as well still when i run the package I get the same error message.

One important thing to know in my case is my package was created when I had WinXP pn my local machine and we got migrated to Win 7 over the weekend. Do I need to take that in account?

Can someone point in right direction to figure out whats going on ?


FM


SSIS 2008R2 Data Flow is partially successful but does not display an error.

$
0
0

Has anyone run into an issue where 95%+ a dataflow writing to a flat file destination is successful. But once in a while it would drop one or more records while writing. However, if the record is reprocessed, it is written successfull.  This wasn't a major concern before, but the package in question is being used more and more heavily now in production, the situation is becoming more noticeable. As it is dropping correspondly an ever growing number of records.

Thanks.

Integration service catlog

$
0
0

Hi 

i am maintaining ssis packages in Integration service catlog.to check it just i executed same package 3 times (before its completed)

it kept on going and i disabled table lock in destination of dataflow task

if dead lock occurred how much time it will stay like that

How to solv with this...?

Thanks in advance


ADKR

SSIS and moving files from multiple location

$
0
0

Hi to all,
I need some help and guidance about this task. I need to process multiple Access db to load information into SQL table.
I have tried a for Each loop container but ended up with drivers errors and other major errors I was unable to fix. Another solution just came across my mind and it might work  but I am not sure I am thinking of moving the access db from 1 folder ( total of 30 different folder ) into another folder, process with the db, delete the db and move the database from the next folder in the directory.

I do not want to create 30 different connection to process them, so moving them should solve my problem. Can anyone help me thru the step on this one. I am almost sure it will involve variables and this is where I am not good at all

Thanks  

It's time for the TechNet Wiki SSIS "Great Guru Love-in"! You too can get some loving!

$
0
0

February at TechNet Wiki usually involves a lot of love...

 

We love to read.

We love to learn.

We love our gurus, for they love to give.

 

Computer Geek Love Story Stock Photos

 

We love to make friends and promote great content.

We love to meet the community, and get closer to you.

  

 

We love to interview our winners, and bestow much love and honor upon them.

We love to tell the world of your achievements, and we promote those most active to inner circles!

All you have to do is add an article to TechNet Wiki from your own specialist field. Something that fits into one of the categories listed on the submissions page. Copy in your own blog posts, a forum solution, a white paper, or just something you had to solve for your own day's work today.

Drop us some nifty knowledge, or superb snippets, and become MICROSOFT TECHNOLOGY GURU OF THE MONTH!

This is an official Microsoft TechNet recognition, where people such as yourselves can truly get noticed!

HOW TO WIN

1) Please copy over your Microsoft technical solutions and revelations toTechNet Wiki.

2) Add a link to it on THIS WIKI COMPETITION PAGE (so we know you've contributed)

3) Every month, we will highlight your contributions, and select a "Guru of the Month" in each technology.

If you win, we will sing your praises in blogs and forums, similar to the weekly contributor awards. Once "on our radar" and making your mark, you will probably be interviewed for your greatness, and maybe eventually even invited into other inner TechNet/MSDN circles!

Winning this award in your favoured technology will help us learn the active members in each community.

Feel free to ask any questions below.

More about TechNet Guru Awards

Thanks in advance!
Pete Laker


#PEJL
Got any nice code? If you invest time in coding an elegant, novel or impressive answer on MSDN forums, why not copy it over toTechNet Wiki, for future generations to benefit from! You'll never get archived again, and you could win weekly awards!

Have you got what it takes o become this month's TechNet Technical Guru? Join a long list of well known community big hitters, show your knowledge and prowess in your favoured technologies!



#PEJL
Got any nice code? If you invest time in coding an elegant, novel or impressive answer on MSDN forums, why not copy it over toTechNet Wiki, for future generations to benefit from! You'll never get archived again, and you could win weekly awards!

Have you got what it takes o become this month's TechNet Technical Guru? Join a long list of well known community big hitters, show your knowledge and prowess in your favoured technologies!

"Persistent (high performance) lookups" in Enterprise Edition

$
0
0

Hello everybody,

the Enterprise Edition of SQL Server 2014 has a SSIS feature "Persistent (high performance) lookups".
https://msdn.microsoft.com/en-us/library/cc645993.aspx#SSIS_AT

Does anybody know what this actually means? Is this the Full/Partial cache mode of normal data flow lookups? Hopefully not. Because making this an "enterprise" feature makes SSIS with Business Intelligence/Standard editions pretty useless.

SCD T2

$
0
0

Hello experts....!

I have 20 m records Result by a join script and i am using it as source in data flow

my Requirement is to maintain History records 

Here is the approaches i followed.

1.enables SCD type 2----failed

2.Used lookup with catche---failed

3.Used merge t sql statement---fine but i am failed to trace error rows,inserted count etc

ANy suggestions is really appreciable

Very much thanks in advance


ADKR

Excel to CRM 2011 using ssis script component(c#)

$
0
0

Hi, 

i have two tables A and B. A is parent and B is child in excel. I have loaded A's data into CRM using ssis Script component.For each record, a GUID will be created right? that should be populated into Child B table A's ID field in CRM for each record of B table.This should be done using ssis script component.How can i acheive this??Please help me.


SSIS Changing Column Order during Transformation

$
0
0

First let me say, I really can't believe this chain of events myself--and they are happening to me.

I am upgrading several DTS packages to SSIS on what will be my new production server.  These packages create tables, export them to a flat file, and ftp them off to other locations.

What is happening (on the SSIS side) is that the OLE DB Source is reordering some of the columns on its own (moving them to the end of the table/file.  Then when my pickup/load routines run, the data is out of place and they fail.

Can anyone please explain what is happening here with the mapping.  I have evaluated the table and the columns are in the order that I expect.  When I preview the source table in the OLE DB Source Editor the columns are in the correct order/alignment, but when them in the OLE DB Source Editor --Columns section within BIDS the order is changed arbitrarily.

I have been somewhat successful (2 out of 3) in being able to re-map the data, but this last table just doesn't want to change. 

Thanks in advance for any help and/or information you can provide

 

Import wizard doesn't come up! (DTSWizard.exe faults in dbgtrace.dll)

$
0
0

This has been happening intermittently for a few weeks, but now it seems pretty constant. When I click on the "Tasks -> Import Data..." option for my databases, no wizard window pops up. When I look in my Application event log, I see entries like this:

Application Error 1000

Faulting application name: DTSWizard.exe, version: 2011.110.5058.0, time stamp: 0x5373fe54
Faulting module name: dbgtrace.dll_unloaded, version: 9.0.1404.0, time stamp: 0x52949283
Exception code: 0xc0000005
Fault offset: 0x00002b09
Faulting process id: 0x998
Faulting application start time: 0x01d0462a28ed3ffb
Faulting application path: C:\Program Files\Microsoft SQL Server\110\DTS\Binn\DTSWizard.exe
Faulting module path: dbgtrace.dll
Report Id: 6846f3d4-b21d-11e4-9797-00219b02078a
Faulting package full name:
Faulting package-relative application ID:

Perflib 1008

The Open Procedure for service "BITS" in DLL "C:\Windows\System32\bitsperf.dll" failed. Performance data for this service will not be available. The first four bytes (DWORD) of the Data section contains the error code.

The Open Procedure for service "Lsa" in DLL "C:\Windows\System32\Secur32.dll" failed. Performance data for this service will not be available. The first four bytes (DWORD) of the Data section contains the error code.

The Open Procedure for service "msdrda" in DLL "C:\Program Files\Microsoft OLE DB Provider for DB2\system\MSEIDPM.dll" failed. Performance data for this service will not be available. The first four bytes (DWORD) of the Data section contains the error code.

The Open Procedure for service "MSDTC" in DLL "C:\Windows\system32\msdtcuiu.DLL" failed. Performance data for this service will not be available. The first four bytes (DWORD) of the Data section contains the error code.

.Net Runtime 1026

Application: DTSWizard.exe
Framework Version: v4.0.30319
Description: The process was terminated due to an unhandled exception.
Exception Info: exception code c0000005, exception address 60025357

Have tried my best Google-fu, but can't find any leads on what is going wrong or how to fix it. I'm using SQL server 2012 service pack 2 on Windows 8.1 Pro, a 32-bit system.

Much appreciations in advance for any assistance.

Compare DATETIMES from AS400 to SQL Server via SSIS Variable

$
0
0

I have an AS400 table where the DATE (YYYY-MM-DD)  is separate from the TIME (HH24:MM:SS).    I pull into a work file with the two fields still separate.

 I concatenate the two fields from the work file into one DATETIME field before I insert into the final destination SQL table. I use this statement to do this:

cast(cast(WF.BT_TRAN_DATEasdatetime)+ WF.BT_TRAN_TIMEasdatetime)as TransactionDatetime

When I go back to the AS400 table to get new records, I want to find the MAX TransactionDatetime on my final destination SQL table, assign it to a variable, and then use that variable in my query against the AS400 table (again, keep in mind that the fields are broken out on that table).

I was thinking the best approach might be to convert both sides of the comparison to the string format YYYYMMDDHHMMSS and then convert this to an BIGINT

 So in my variable assignment SQL task, I have this code:

 SELECTCAST(REPLACE(REPLACE(REPLACE(convert(varchar,max(TransactionDatetime),120),'-', ''),' ',''), ':','')asbigint)

FROM table 

Then, in my DB2 query in the data flow task, I have this:

WHEREBIGINT(VARCHAR_FORMAT(timestamp(char(BT_TRAN_DATE)||' ' ||char(BT_TRAN_TIME)),'YYYYMMDDHH24MISS'))> ?

 But I am having all sorts of issues with this and any other method I can think of.

 Can anyone help?

SSIS 2008 R2 - Script task fails when run as job

$
0
0

Hi 

I have a script task which opens a csv file using excel and save it as Excel File. I chose this method after a long struggle to use it as flat file source (too many issues I had). It jsut become so much reliable to work with after converting it as Excel.

The issue I have is when I run the script as a job, it fails. It works fine in BID. 

1. I am using Proxy (admin) account to register it as a job. 

2. in Execution options, 'Use 32 bit' runtime is ticked 

I have other SSIS packages scheduled as jobs and they are all running fine (including 32 bit runtime). 

It's just this script this causing me a lot of headaches. 

The error message I got is 

System.Reflection.TargetInvocationException: Exception has been thrown by the targetof an invocation.---> System.Runtime.InteropServices.COMException (0x800A03EC): Microsoft Excel cannot access the file 'G:\ReadingEggFTP\AU\20130619\readingeggs_3pau_school_marketing_customer_list_20130619.csv'. There are several possible reasons: • The file name or path does not exist. • The file is being used by another program. • The workbook you are trying to save has the same name as a currently open workbook.     at Microsoft.Office.Interop.Excel.Workbooks.Open(String Filename, Object UpdateLinks, Object ReadOnly, Object Format, Object Password, Object WriteResPassword, Object IgnoreReadOnlyRecommended, Object Origin, Object Delimiter, Object Editable, Object Notify, Object Converter, Object AddToMru, Object Local, Object CorruptLoad)     at ST_a340a727a31942219e1e112705df885a.vbproj.ScriptMain.Main()     --- End of inner exception stack trace ---     at System.RuntimeMethodHandle._InvokeMethodFast(Object target, Object[] arguments, SignatureStruct& sig, MethodAttributes methodAttributes, RuntimeTypeHandle typeOwner)     at System.RuntimeMethodHandle.InvokeMethodFast(Object target, Object[] arguments, Signature sig, MethodAttributes methodAttributes, RuntimeTypeHandle typeOwner)     at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture, Boolean skipVisibilityChecks)     at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)     at System.RuntimeType.InvokeMember(String name, BindingFlags bindingFlags, Binder binder, Object target, Object[] providedArgs, ParameterModifier[] modifiers, CultureInfo culture, String[] namedParams)     at System.Type.InvokeMember(String name, BindingFlags invokeAttr, Binder binder, Object target, Object[] args, CultureInfo culture)     at Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTATaskScriptingEngine.ExecuteScript()

• The file name or path does not exist - Yes it does. Otherwise I couldn't do it in BID. 

• The file is being used by another program - I am just running the script only (Testing by each object)

• The workbook you are trying to save has the same name as a currently open workbook - It is the same name but the extension is differe

nt). Again, it works in BIDS.


The following is the script code (I got it from a web)


Imports System
Imports System.Data
Imports System.Math
Imports Microsoft.SqlServer.Dts.Runtime
Imports Microsoft.Office.Interop.Excel

Enum ScriptResults
Success = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Success
Failure = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Failure
End Enum


Public Sub Main()
        Dim excel As New Microsoft.Office.Interop.Excel.Application
        Dim wb As Microsoft.Office.Interop.Excel.Workbook
        Dim FiletoOpen As String
        '  Dim ws As Microsoft.Office.Interop.Excel.Worksheet

        FiletoOpen = Dts.Variables("User::FTPAUFileDestinationPath").Value.ToString + "\" + Dts.Variables("User::FTPFileAUDownloaded").Value.ToString

        wb = excel.Workbooks.Open(FiletoOpen)
        ''  ws = wb.Worksheets(1)

        wb.SaveAs((Dts.Variables("User::AUUploadFile").Value.ToString), FileFormat:=Microsoft.Office.Interop.Excel.XlFileFormat.xlExcel8)

        wb.Close()
        excel.Quit()

        Runtime.InteropServices.Marshal.ReleaseComObject(excel)

        Dts.TaskResult = ScriptResults.Success
End Sub

End Class


Thanks!

Derived column expression

$
0
0

Hello fellow developers,

I need help determining the meaning of an expression in SSIS using the Derived Column tool. I am trying to fix an error in a SSIS package that was created by a previous developer. I need help understanding what the following expression is accomplishing and to create the expression is SQL.

(LEN(TRNFC#) == 10) ? (DT_WSTR,8)((DT_WSTR,4)((DT_I4)SUBSTRING(TRNFC#,7,4)) + "_" + (DT_WSTR,3)TRNVSEQ) : (DT_WSTR,8)"0-0"

A sample of the data in field TRNFC# before being altered looks like this: 3579000017

A sample of the data in field TRNVSEQ before being altered looks like this: 0

A sample of the result data is 17_0

What would be this expression in a SQL select statement?

Thanks in advance!

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>