Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Pulling dinstinct rows in SSIS from Excel

$
0
0

im getting multiple rows for each fld_Id column from Excel sheet

i want to pull only one row for each of the fld_Id and keep in a master table.

can some one give me any idea to acheive this using which transformation and how.


SSIS Lookup vs IN Clause in T-SQL

$
0
0

I have below query

select * from table A where A.ID in (select ID from table B )

If I use lookup transformation  in SSIS package with table A as source and do lookup on table B for ID column , will it be  equivalent to above query?

Execute SQL Not Working

$
0
0

All - 

I have an execute sql task set up as follows:

ResultSet = Single Row

Connection Type = OLE DB

SQL Source Type = Direct Input

SQL Statement = execute dbo.StoredProcedure @FileName = ? @FileCount = ? OUTPUT

(The sp queries a table with @FileName to see if the supplied file name already exists, and outputs 1 if true and 0 if false)

Parameter Mapping:

Variable Name = User::FileName, Input, Long, 0, -1

Variable Name = User::FileCount, Output, Long, 1, -1

It is returning the following error: "Executing the following query...failed with the following error: "Invalid Parameter Number." Possible failure reasons : problems with the query, "ResultSet" not set properly...etc

Any ideas?

Thank you!


Bonediggler

SSIS Data Flow Task -- Multiple destinations??

$
0
0

 

I have a Data Flow Task that uses an OLE DB Source to call a SQL 2005 stored proc, and sends the results to a Flat File Destination. Very simple, works great.

 

My question is: What's the best way (i.e., without creating the Data Flow or OLE DB Source objects multiple times) to send the results from that OLE DB Source to multiple Flat File Destinations? In other words, using one OLE DB Source, create a c:\Users.txt file, a c:\Archive\Users.txt file, and an h:\FTP\Users.txt file, all containing the exact same data?

 

Thanks!

Problem in loading data from SQL table to CSV file

$
0
0

Hi,

I am trying to export the data from SQL table to CSV file.

I have a column "Message" of length 2048 in SQL table.

When loading the data, the data in "Message" column is splitting and is loading into the next row.

Please give me the solution.

Thanks

SSIS- ADO .Net data source issue with huge data

$
0
0

Hi All,

I am getting below after fetching millions of records. the error occurred in ADO .Net data source.

Started:  2:09:20 PM  Error: 2013-05-04 15:39:56.96     Code: 0xC0209029     Source: Data Flow Task - ADO .NET Data Source [1]     Description: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "component "ADO .NET Data Source" (1)" failed because error code 0x80131904 occurred<c/> and the error row disposition on "output column "<column name>" (1978)" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.  End Error  Error: 2013-05-04 15:39:57.18     Code: 0xC02090F5     Source: Data Flow Task [1]     Description: The component "ADO .NET Data Source" (1) was unable to process the data. Pipeline component has returned HRESULT error code 0xC0209029 from a method call.  End Error  Error: 2013-05-04 15:39:57.26     Code: 0xC0047038     Source: Data Flow Task SSIS.Pipeline     Description: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "ADO .NET Data Source" (1) returned error code 0xC02090F5.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component<c/> but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).

thanks in advance.


Creating and accessing temp tables in SSIS package

$
0
0

Hi,

 

I want to create a local temporary table in execute sql task and and want to use the same in Data flow task as source table.

 

I follow the following steps to achieve this:

 

01. Created a new SSIS package

02. Create a connection string to "(local)/." server, "tempdb" database

03. Set the "RetainSameConnection" property value to "TRUE"

04. Set the "DelayValidation" to "TRUE", where ever I found this property

04. In Control Flow I added to items

      a. Execute SQL Task

      b. Data Flow Task

05. For "Execute SQL task" I set the connection to "tempdb"

06. I written the following query

       Create table #transfer_CompaniesToProcess_tbl
       (
          companyID int not null 
       )
       GO
07. In Data Flow task I added "OLE DB Source" and "OLE DB Destination"

08. In "OLE DB Source" I changed the "Data access mode:" to "SQL command"

09. In "SQL command text:" I entered "select * from #transfer_CompaniesToProcess_tbl"

10. When I clicked on the "OK" button; I ended with following error:

 

TITLE: Microsoft Visual Studio
------------------------------

Error at Data Flow Task [OLE DB Source [1]]: An OLE DB error has occurred. Error code: 0x80040E14.
An OLE DB record is available.  Source: "Microsoft SQL Native Client"  Hresult: 0x80040E14  Description: "Statement(s) could not be prepared.".
An OLE DB record is available.  Source: "Microsoft SQL Native Client"  Hresult: 0x80040E14  Description: "Invalid object name '#transfer_CompaniesToProcess_tbl'.".

 

------------------------------
ADDITIONAL INFORMATION:

Exception from HRESULT: 0xC0202009 (Microsoft.SqlServer.DTSPipelineWrap)

------------------------------
BUTTONS:

OK
------------------------------

 

I gone through the following article and it seems I missed some thing.

http://blogs.conchango.com/jamiethomson/archive/2006/11/19/SSIS_3A00_-Using-temporary-tables.aspx

 

Can any one have any idea where I am doing wrong?

 

Thanks

Sreekanth

Creating and accessing temp table under For each Loop in SSIS

$
0
0

Hi All,

I have created a global temp table in Execute SQL Task and joining that table in Data Flow Task to get some result set and insert into a table which is located on different server. I have set the RtainSameConnection as True and Delay Validation as True. But the requirement is that, I need to do same activity on multiple Databases using For Each Loop. But, due to RetainSameConnection is true so that I am getting data into Temp Table only from first database. I don't know Script. Is there any existing functionality to achive this task.

Please help me.......

Regards,

Sanjay.


SSIS - Passing a date parameter to a SQL Query question again....

$
0
0

I need to pass a date string to my sqlcommand inside of my "datareader source".  I read some of the questions about setting expression variables but I can't seem to figure out how to do it.  I pasted the query below.  The table name contains a date in it so I need to pass that date as a string into my sqlcommand at runtime.  Do I create a variable with the entire SQL command in it or can I just create a single variable that holds the date and just reference that in my datasource reader sqlcommand property?  Can someone assist me with the syntax for creating the expression?

SELECT
     pages_20101006.`date` AS full_date,
     pages_20101006.`cat` AS category_no,
FROM
     pages_20101006

Thanks very much,

 

Chris

AddIn deprecated for SSIS Script task

$
0
0
I'm trying to use this code which compiles on vs2008 in vs2010:
// C# code
// Fill SSIS variables with file properties using System; using System.Data; using System.IO;                       
// Added to get file properties using System.Security.Principal;       
// Added to get file owner
using System.Security.AccessControl;
// Added to get file owner
using Microsoft.SqlServer.Dts.Runtime;
using System.Windows.Forms;
using System.IO;
using System;
using System.Data;
using System.Security.Principal;
//using System.Security.AccessControl;
namespace ST_9ef66c631df646e08e4184e34887da16.csproj
{
    [System.AddIn.AddIn("ScriptMain", Version = "1.0", Publisher = "", Description = "")]
    public partial class ScriptMain : Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTARTScriptObjectModelBase
    {
        #region VSTA generated code
        enum ScriptResults
        {
            Success = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Success,
            Failure = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Failure
        };
        #endregion
        public void Main()
        {
            // Variable for file information            
            FileInfo fileInfo;

            // Fill fileInfo variable with file information            
            fileInfo = new FileInfo(Dts.Variables["User::FilePath"].Value.ToString());

            // Check if file exists            
            Dts.Variables["User::FileExists"].Value = fileInfo.Exists;
            // Get the rest of the file properties if the file exists            
            if (fileInfo.Exists)
            {
                // Get file creation date                
                Dts.Variables["User::FileCreationDate"].Value = fileInfo.CreationTime;

                // Get last modified date                
                Dts.Variables["User::FileLastModifiedDate"].Value = fileInfo.LastWriteTime;

                // Get last accessed date                
                Dts.Variables["User::FileLastAccessedDate"].Value = fileInfo.LastAccessTime;

                // Get size of the file in bytes                
                Dts.Variables["User::FileSize"].Value = fileInfo.Length;

                // Get file attributes                
                Dts.Variables["User::FileAttributes"].Value = fileInfo.Attributes.ToString();
                Dts.Variables["User::FileIsReadOnly"].Value = fileInfo.IsReadOnly;

                //////////////////////////////////////////////////////                
                // Check if the file isn't locked by an other process                
                try
                {
                    // Try to open the file. If it succeeds, set variable to false and close stream
                    FileStream fs = new FileStream(Dts.Variables["User::FilePath"].Value.ToString(), FileMode.Open);
                    Dts.Variables["User::FileInUse"].Value = false;
                    fs.Close();
                }
                catch (Exception ex)
                {
                    // If opening fails, it's probably locked by an other process                    
                    Dts.Variables["User::FileInUse"].Value = true;

                    // Log actual error to SSIS to be sure                     
                    Dts.Events.FireWarning(0, "Get File Properties", ex.Message, string.Empty, 0);
                }
                //////////////////////////////////////////////////////                
                // Get the Windows domain user name of the file owner                
                FileSecurity fileSecurity = fileInfo.GetAccessControl();
                IdentityReference identityReference = fileSecurity.GetOwner(typeof(NTAccount));
                Dts.Variables["User::FileOwner"].Value = identityReference.Value;
            }
            Dts.TaskResult = (int)ScriptResults.Success;
        }
    }
}

The "AddIn" method shows not found by the 2010 compiler.   AddIn seems like the component that gets SSIS to talk to vs2010/c#.  So what replaces AddIn or is there a new template for finding file properties for SSIS 2012?

SQL Server agent job will not retain package password (encrypt sensitive with password)

$
0
0

I have a package protected by a password - I am already unhappy that to get it to use the configuration file to change connection strings for the production servers I have had to hardcode the password into the config file - very insecure!

However, the package now deploys correctly to the production server and will run from there OK, but NOT if scheduled as a SQL Server Agent Job.  Thus is because however often I edit the command line to include the password after the DECRYPT switch (which it has prompted me for when I click on the command line tab), the Job Step will not retain it.

If I open it up after I have edited it and closed it, the password has disappeared.

 

I know that if I run dtexec plus the code in the Command Line tab (with the password), the package runs OK.

 

This is driving me insane! 

I have read all the other posts and so I tried replacing the SSIS package step with a CmdExec step and pasting that code into there - then I get an OLEDB error..

 

The code I use is:

DTEXEC /SQL "\ImportRateMonitoringTables" /SERVER servername /DECRYPT password /CONFIGFILE "D:\Microsoft SQL Server\SSIS\Deployments\RateMonitoringImportTasks\Deployment\ImportRateMonitoringTables_Production.dtsConfig"  /MAXCONCURRENT " -1 " /CHECKPOINTING OFF  /REPORTING E

 

and I get

SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x8000FFFF

 

although the same code executes perfectly from a command prompt.

 

Please does anyone have any experience with a similar problem and if so, how did you get round it?

 

Thank you

dataprofiler task

$
0
0

Hi

  i try to learn data profile task in ssis , so i just search in bing i got some idea and i used in my package but i m having 1 doubt in that Column statistics profile, its giving detail about min,max,mean,standard deviation ..i cant understand what is  standard deviation will give,can anybody explain abt this


Different databases supported by SSIS

$
0
0

Hi All,

Thanks in advance.

Please let me know the types of databases supported by Sql Server Integration Services. Whether we can move data from all the database like sybase,teradata etc .... into SQL Server or some other databases using SSIS.

Thanks

Rajan.S

Remove all special characters from a string..

$
0
0

Hi 

how to remove all the special characters from a string like,

Kumar, Hi.

Ram$ siddig.

ftp,unzip and script task

$
0
0

hi all,

I am having ZIP files in FTP folder, the file names will be like file_2013_04_25, file_2013_04_26. We need to pick the appropriate file, as new file will be dropped every day morning 7:00 am and we need to pick that according to the date appended to the file name, that particular file needs to be moved to the local and that zip file should be unzipped , after unzip the files related to that zip file should be in a folder with the name as file_2012_04_26. please can some one help me.

Thanks,

Anilkumar 


saving data from sql table into an ssis variable to be used by ado.net data source in ssis 2012

$
0
0

i have an ado.net data source connecting to mysql db on unix

i have a table called setting with two columns and 1 row of data .

using an execute sql task , i am able to get data from the settings table in mssql server and pass it to an ole data source using ?

example select * from  user where enddate > ?

but in ado.net source of mysql it does not like that syntax .

i have used expression , and this works but it gives the defaut value of the variable fields startdate and enddate from the ssis package it does not seem to capture of pass save the dates passed in from the mssql db setting table with i use the above execute SQL task step to do .

"select *  from mt4_user_info_load where insert_date >= cast('" + (DT_WSTR,30)@[User::dtmStartDate] + "'as datetime)  and insert_date <  cast('" + (DT_WSTR,30) @[User::dtmEndDate] + "'as datetime)"

any idea how i can save the value from the table and pass it to the above expression or pass the value from the db to the ado.net work flow source

Is there any way to access SSAS instance via office lan

$
0
0

Hi All,

The SSAS instance be installed on one WIN7 machines, and I want to access the instance with Office PIVOTTABLE onanother WIN7 machine, but when I choose Analysis Service as the datasource, connect the datasouce with windows authentication, and then it shows"error occurs on transportation level".

Two WIN7 machines are at the same workgroup, but not quite sure windows authentcation can work in such scenario. If not, is there any workaround?


Microsoft Online Community Support Please remember to mark the replies as answers if they help and unmark them if they provide no help.

Import /export or synchronize workitem data from tfspreview site into sql server database?

$
0
0

Hi All,

I want to synchronize the workitem data from tfspreview site to sql server database.

Is there any way to complete  bidirectional synchronization process?

Please let me know if you have any queries.


Thanks, Pranil Yambal |Pranil.Yambal@hotmail.com

SSIS Back Up Database Task Failed in Winform Only

$
0
0

Hello guys

I have this weird problem with my SSIS package, it works fine in BIDS, works fine as a SQL Agent Job, but as soon as I run in within my winform using Package.LoadPackage, the "Back Up DataBase Task" magically failed. I put a data flow task before and after the back up task to see if the package was excuted at all and it did, the first data flow task was executed successfully however it stops when trying to back up the database. I have add users to Local DCOM Group and I have given permissions to the user under security tab in MsDtsServer100, but nothing helps. Does any1 know what could cause the problem? btw. no error messages were given at any time during this process.

========================In my winform i have====================

string pkgLocation;Package pkg;Microsoft.SqlServer.Dts.Runtime.Application app;DTSExecResult pkgResults;

pkgLocation =@"C:\Integration Services Project1\obj\Development\Package.dtsx";

app =newMicrosoft.SqlServer.Dts.Runtime.Application();

pkg = app.LoadPackage(pkgLocation,null);

pkgResults = pkg.Execute();foreach(DtsWarning w in pkg.Warnings){MessageBox.Show(w.Description);}MessageBox.Show(pkgResults.ToString());

================================================================

Microsoft SQL Server 2012 Service Pack 1 SSIS Error

$
0
0
Hi,

I installed Microsoft SQL Server 2012 Service Pack 1 (KB2674319) on our server and my Integration Services 2012 package started failing on a Source Script Component with one Output Buffer. I debugged the code by using a breakpoint and...found that the code fails when I call the base method AddNew() (e.g. Output0Buffer.AddNew()). I get the dreadful "Object reference not set to an instance of an object" error with some more details like "use New to instantiate an object." I then installed two hotfixes, but still I got the same error.
I then resorted to uninstalling the service pack and let you know about this. I also tested this on my workstation by installing the service pack 1 and it broke the code. Please assist. See attached.
Viewing all 24688 articles
Browse latest View live