Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

How to edit Data Flow Task based on a dynamic connection manager more efficiently

January 10, 2013, 3:35 pm
$
0
0

I've created a dynamic OLE connection manager and it works fine now.  And I've also created a DFT based on this connection manger.

So far , it works fine. However, the problem is when I was trying to modify the OLE DB source inside the DFT. 

Because the connectionString property is populated by a variable during run time, I have to literally remove the expression on the connection manger and hard coded the connection manger in order to edit OLE DB source which is a sql query. It involves quite a few clicks ...

I am wondering if someone here knows a better way to deal with it?

Thanks

 Hui 

--Currently using Reporting Service 2000; Visual Studio .NET 2003; Visual Source Safe SSIS 2008 SSAS 2008, SVN --

↧
Search

Metamodel SSIS packages and components

January 11, 2013, 2:08 am
$
0
0

Hi,

I've a question about a metamodel of SSIS components. For example, I could image that there is a Derived column entity with mulitple column transformations entity in this metamodel. Currently analyzing generation of SSIS packages with BIML for a DWH solution.

Is anyone familiar with such a metamodel? Can someone point me to this?!

Gr,

Hennie

↧
↧

Best way to create package looping through folders and selecting File Name

January 11, 2013, 12:13 pm
$
0
0

Hi all

Please help me

I have 60 FOLDERs,  each has 1 file.

I need to Populate into 60 different tables (each has different Format) based on File Name 

Thanks In Advance

↧

Question related to FTP task in SSIS

January 11, 2013, 7:41 am
$
0
0

Hey,

I'll be getting some files from FTP folder which has been set like this: There is a main folder (Processed), then there is a subfolder(2012), and then there are further subfolders which have files for the entire year of 2012. For e.g. In the January Folder, we have files like this:

File1.xls

File2.xls

HicnFileJan.txt

Similarly for the Feb folder:

File1.xls

File2.xls

HicnFileFeb.txt

What I envision doing is, I can have my FTP task, in the local path, I can set up my local directory where I want to get these files and then have my dataflow to process these tasks. But, my question is, How can I loop through these folders and just get HicnFileJan.txt, HicnFileFeb.txt....HicnFileDec.txt.

Do, I definitely need to have a For-Each Loop container? Can't the FTP task directly process these files?

↧

The connection "" is not found. This error is thrown by Connections collection when the specific connection element is not found

May 1, 2007, 8:43 am
↧
↧

Deleting records from SHARE POINT list using SSIS packages.

January 11, 2013, 11:42 am
$
0
0

Hello,

I have to pull data from one share point list and then push it into other share point list. I am doing this using SSIS packages. But the catch is that I have to delete the destination previous record before I push the data.

I learnt if I can make the “BATCH TYPE = DELETION” in share point list destination then it will delete previous data before pushing the fresh one. But the package is not running. However the same package runs fine if I change the “BATCH-TYPE = Modification”.

Can anyone help me with this?

Thanks,

Amit

↧

SSIS package accessing 2 shares with different credentials

January 11, 2013, 12:57 pm
$
0
0

I am in need of a little advice. I can't quite wrap my mind around the issue I'm having. I'm using SSIS to do some simple file manipulation tasks and it works great when I run it manually via file system. However, when I run it with SQL Agent it says the package ran as successful, but does not move any files. 

I know the issue lies around the fact that I have a share drive mapped to a different domain on my machine. Here is the proverbial monkey wrench. I am running proxy credentials so that the package can manipulate files on the current domain. Now, since the package doesn't have access to the mapped drive, how can I allow the package to log into and use the share drive on the other domain?

Here is the basic rundown of the package:

Check Foreign domain (domainX) share for File (done.txt)
If File Exists then copy files to local domain (domainY) share
Move file on foreign domain share to foreign domain archive folder

If file doesn't exist, end package. 

I've tried it with a File System Task and Execute Process Task w/ Batch File. Both do not work. 

Thanks in advance for any help,

A.

↧

Weird SSIS recordset issue

January 11, 2013, 2:41 am
$
0
0
I have a weird SSIS recordset issue.  In my first data flow, I am summing and outputing some data (Only 2 colums, a count coulmn and a sum column) to a SSIS recordset.  This is mainly for reuse purposes.  In my second data flow task, I load the recordset into a .net datatable object and use the data in that task.  In a third dataflow task when I attempt to use the data again (the same way) from the recordset object it crashes.  I went back and checked the third data flow task and there were no records. 

So my question is this: can the SSIS recordset be used more than once?  Does it get cleared after first use of it?

Note: I have a work around in which I basically reloaded the recordset object with the same data after the first use of it in the second data flow task.  But was just curious.  If the recordset gets emptied after use
↧
Search

SSIS For Loop Question

January 10, 2013, 11:10 pm
$
0
0

I have a for loop container which runs with no problems. Outside the loop I have another SQL Task that needs to run after the for loop process has completed. I have a Precedence Contraint set to run the SQL Task when the loop container has successfully completed. However, it never runs. The processes in the loop container is working with no errors/problems. Can someone point me in the right direction? Please...

Thanks!

Susan

↧
↧

take Backup Of MYSQL database

January 12, 2013, 1:15 am
$
0
0

Hi

I need to take Backup Of MYSQL database on weekly basis using SSIS.

I have taken backup of SqlServer but have no experience with MYSQL

Kindly help me.

Thanks

↧

MMC 0x800706be The remote procedure call failed

January 12, 2013, 3:59 am
$
0
0
hi everyone, I've this problem: I installed SQL 2012 Evaluation in my local pc ( Vista SP2). Bera in mind, I already have SQLEXPRESS and SQLSERVER2008 ( but it doesn't work). So far I used SqlManagement to use SQLEXPRESS. How? Before I used MMC, so put start the service (SQLEXPRESS) manually. Now after I installed SQL2012 I have this error when I open MMC 0x800706be The remote procedure call failed. I went in SSManagement and I can connect to SQL2012 but not in SQLExpress and more, I can take the table from SQLEXPRESS, like Express is disabled. I need to start it manually but WMI doesn't start. Do you have some advice? Thank you
↧

SSIS Store the FileName With Data In Database

January 11, 2013, 1:00 pm
$
0
0

I have an SSIS package that loops through a list of Excel files and imports all the data; easy stuff.  Works perfectly.

The addition to this is that I need to store the filename of the Excel file with the data; so that I can run queries against this additional column and input it into the main table.  These files may have hundreds of rows of data, and when inputted into the main table, I need the name of the file in an additional column entered with them. 

Example: 25 Excel file names with names like EUROMMYYYY, USDMMYYYY, CNYMMYYY, etc; the columns in the Excel files are Day, Percent Move, Exchange, etc - I would have an additional column in my database that had "FileName" so that all the Excel data would be entered and the filename would be entered as well.  The database result would look like

Day     Percent     Exchange     FileName (this comes from the file name and isn't in the file)
1         12%          DXC             EUROMMYYYY
2          9%           DXC             EUROMMYYYY
3          4%           DXC             EUROMMYYYY

My immediate thought was to run a C# script to grab the filename of Excel, add an additional row to the Excel file, and then import that additional row as well.  However, the code just to do that turned into a nightmare of complexity, as Excel and C# don't play nice with each other.

Anyone done something similar this: Google searches only yield people who need this code for a loop (which means they're doing it wrong, as you don't have to grab the file name for that - just set up the appropriate variable).  This case differs because I need the file name to be inserted into the database along with the other data.

↧

Arithmetic overflow error converting expression to data type date time.

January 11, 2013, 7:13 pm
$
0
0

Hi

I'm getting error during package execution.

Data comes from MYSQL and Store in SQL SERVER.

in package i have one variable that set date.

and i'm getting this error during execution.

Error: Arithmetic overflow error converting expression to data type date time.
user log deletion

[Execute SQL Task] Error: Executing the query "DELETE FROM dbo.vicidial_user_log
 WHERE
(even..." failed with the following error: "The statement has been terminated.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.

I see some differnce in sql in date time varaible.

Kindly help .

↧
↧

SSIS - How to use the Breakpoints and show the error message in package

January 11, 2013, 4:21 am
$
0
0

Hi,

i have import the data from excel sheet to table using ssis package.

but i want checking some conditions after extract the excel sheets. i have month,date,and other fields in excel sheet

i want if month field is null, data is not import to table that means package is not working, package shout be failed.

How to show the error or warning message. if month is not null package will be worked on success otherwise that means month is null show the error message.

message- month field is null please enter the month field dnt put empty or null for month column.

Regards,

Abdul Khadir.

↧

Execute Task Prompt Hangs Job

January 11, 2013, 7:13 am
$
0
0

In SSIS I am executing a .NET exe (NOT a cmd file) located on a network server.  All access permissions have been granted successfully to the SQLAgent.

The first error encountered was the infamous "Unknown Publisher" error.  Of course, this hung the job since no human was available to answer the prompt.  After much Googling and with the help of our IT security organization, I had the code propely signed and eagerly tried again.

Now when executed a new error appears: "Do you want to run this software?", even though the popup correctly shows the publisher.

How do I get rid of this?

(By the way, with the "Unknown Publisher" I tried both the execute process task, and a launch from within a script.  Made no difference.  Will it help with this error?  Also, I myself never get an error when I execute the package, only when the DBA does or it's scheduled.)

Pulling my hair and implementation schedule slipping!!  Thanks very much.

↧
Search

SSIS API - Possibility of generating a package without actual connections

January 12, 2013, 1:22 am
$
0
0

Hi,

Is it possible to generate a package with the API without the actual connections to the data sources existing at package creation time? I.e. creating the package at a workstation with no SQL Server and then moving it to the actual site. This could be worked around using dummy connections but it would be much simpler if the package could be generated anywhere without any tricks.

↧

Transactions and errors management

January 11, 2013, 9:22 am
$
0
0

I have two different problems, both related to transactions. Although the use-cases are basic, I can't find simple solutions.

Before somebody suggests using RetainSameConnection = true and manual BEGIN TRAN / COMMIT / ROLLBACK, this is NOT a solution because my data flow requires multiple connections and SSIS will NOT satisfy my RetainSameConnection demand.

[1] Is it possible to exclude a read-only connection manager from transactions?
I ask because I have a connection manager that cannot enlist into DTC -- and doesn't need to. But it makes make package fail.
Current solution is to use two data flows, one for reading (no tx), one for writing (inside a tx) and pass the data around into a raw file. This is ugly and inefficient.

[2] Inside my transactional flow, I would like to log error rows into a special table for further error analysis. This seems a basic requirement to me but it turns out to be hard to do. The DTC seem to be all-or-nothing, so if I redirect error rows to a DB destination, they are enlisted into the transaction and rolled back after the failure of the data flow.
Possible solutions could be: use another connection manager outside the DTC if possible (same as [1], seems impossible); or exclude a destination task from the DTC (also seems impossible).
Only solution I see: write the errors into a non-transactional destination (i.e. raw file) and save them later after the rollback. Like one [1] this is ugly and inefficient.

What is the recommended/right way of doing this?

↧
↧

Dealing with multiple Excel sheets and different SELECT Stmts. [Script component]?

January 13, 2013, 1:07 am
$
0
0

Hello everyone,

I'm looking for advice on how to deal with the import of several excel sheets to a MSSQL DB.

I have a parent-child setup where I pass the Excel ConnString to the child package to use it in the Excel source.

Now I need to set up a new package to import multiple Excel worksheets to the DB. The file can contain up to 20 sheets but I only need to get 10 of which I know the sheetnames, however some sheets are hidden.

For those 10 sheets I need two different select statements to specify the proper range import.

So I was thinking I could use a script task to get the desired sheets and put them in a object variable which I can then use inside a for-each loop with a dataflow task. 

And this is where questions arise:

What happens inside the dataflow task? I guess I can't use the Excel source component nor the OLEDB-target. I also need to add some derived columns of variables I get from the parent package. How would I assign the proper select statement to the according sheet? Looks like the script component is what I need. But how?

Feel free to post links with examples and let me know if I'm on the right track here.

thank you.

 

↧

Missing last row when package is run as a job from SQL 2008 R2

May 27, 2011, 1:50 am
$
0
0

I have one package which reads a CSV and fills a table. This is a simple extraction. When i add the package to the server storage (SQL 2008), make a job en run it from that job, there is no problem.   

When I make the same job at our SQL 2008 R2 server and i run it, i'm missing the last row. It happens with all CSV's. When i run the package directly from the storage, there is no problem. So it only happens when its started as a job.

Is this a bug? Or am i missing something?

 

Thanks in advance!

J2.0

 

 

↧

Strange package run error SQL Server 2008

January 13, 2013, 8:37 pm
$
0
0

Hi All,

I have managed to fix my SSIS XML connection config issue and run successfully the package by itself / reployed.
Now when I run my schedule I am getting the following error, whereas before i didnt.

I have done some searching and checked the versions between my client computer and the server they are the same..

Date        14/01/2013 3:24:35 PM
Log        Job History (MI Refresh - Initial Load)

Step ID        3
Server        WNAB612287\AWD_DATAMART
Job Name        MI Refresh - Initial Load
Step Name        SharePointToDatamartUpdates
Duration        00:00:01
Sql Severity        0
Sql Message ID        0
Operator Emailed        
Operator Net sent        
Operator Paged        
Retries Attempted        0

Message
Executed as user: WNAB612287\SYSTEM. Microsoft (R) SQL Server Execute Package Utility  Version 10.0.2531.0 for 32-bit  Copyright (C) Microsoft Corp 1984-2005. All rights reserved.    Started:  3:24:35 PM  Error: 2013-01-14 15:24:36.17     Code: 0xC0047062     Source: SP to Temp SharePoint List Source 1 [108]     Description: System.IO.FileNotFoundException: Could not load file or assembly 'System.Xml.Linq, Version=3.5.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089' or one of its dependencies. The system cannot find the file specified.  File name: 'System.Xml.Linq, Version=3.5.0.0, Culture=neutral, PublicKeyToken=b77a5c561934e089'     at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListSource.Validate()     at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostValidate(IDTSManagedComponentWrapper100 wrapper)    WRN: Assembly binding logging is turned OFF.  To enable assembly bind failure logging, set the registry value [HKLM\Software\Microsoft\Fusion!EnableLog] (DWORD) to 1.  Note: There is some performance penalty associated with assembly bind failure logging.  To turn this feature off, remove the registry value [HKLM\Software\Microsoft\Fusion!EnableLog].  End Error  Error: 2013-01-14 15:24:36.17     Code: 0xC0047017     Source: SP to Temp SSIS.Pipeline     Description: component "SharePoint List Source 1" (108) failed validation and returned error code 0x80070002.  End Error  Error: 2013-01-14 15:24:36.17     Code: 0xC004700C     Source: SP to Temp SSIS.Pipeline     Description: One or more component failed validation.  End Error  Error: 2013-01-14 15:24:36.17     Code: 0xC0024107     Source: SP to Temp      Description: There were errors during task validation.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  3:24:35 PM  Finished: 3:24:36 PM  Elapsed:  0.983 seconds.  The package execution failed.  The step failed.

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>