im getting multiple rows for each fld_Id column from Excel sheet
i want to pull only one row for each of the fld_Id and keep in a master table.
can some one give me any idea to acheive this using which transformation and how.
↧
Pulling dinstinct rows in SSIS from Excel
↧
SSIS Lookup vs IN Clause in T-SQL
I have below query
select * from table A where A.ID in (select ID from table B )
If I use lookup transformation in SSIS package with table A as source and do lookup on table B for ID column , will it be equivalent to above query?
↧
↧
Execute SQL Not Working
All -
I have an execute sql task set up as follows:
ResultSet = Single Row
Connection Type = OLE DB
SQL Source Type = Direct Input
SQL Statement = execute dbo.StoredProcedure @FileName = ? @FileCount = ? OUTPUT
(The sp queries a table with @FileName to see if the supplied file name already exists, and outputs 1 if true and 0 if false)
Parameter Mapping:
Variable Name = User::FileName, Input, Long, 0, -1
Variable Name = User::FileCount, Output, Long, 1, -1
It is returning the following error: "Executing the following query...failed with the following error: "Invalid Parameter Number." Possible failure reasons : problems with the query, "ResultSet" not set properly...etc
Any ideas?
Thank you!
Bonediggler
↧
SSIS Data Flow Task -- Multiple destinations??
I have a Data Flow Task that uses an OLE DB Source to call a SQL 2005 stored proc, and sends the results to a Flat File Destination. Very simple, works great.
My question is: What's the best way (i.e., without creating the Data Flow or OLE DB Source objects multiple times) to send the results from that OLE DB Source to multiple Flat File Destinations? In other words, using one OLE DB Source, create a c:\Users.txt file, a c:\Archive\Users.txt file, and an h:\FTP\Users.txt file, all containing the exact same data?
Thanks!
↧
Problem in loading data from SQL table to CSV file
Hi,
I am trying to export the data from SQL table to CSV file.
I have a column "Message" of length 2048 in SQL table.
When loading the data, the data in "Message" column is splitting and is loading into the next row.
Please give me the solution.
Thanks
↧
↧
SSIS- ADO .Net data source issue with huge data
Hi All,
I am getting below after fetching millions of records. the error occurred in ADO .Net data source.
Started: 2:09:20 PM Error: 2013-05-04 15:39:56.96 Code: 0xC0209029 Source: Data Flow Task - ADO .NET Data Source [1] Description: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR. The "component "ADO .NET Data Source" (1)" failed because error code 0x80131904 occurred<c/> and the error row disposition on "output column "<column name>" (1978)" specifies failure on error. An error occurred on the specified object of the specified component. There may be error messages posted before this with more information about the failure. End Error Error: 2013-05-04 15:39:57.18 Code: 0xC02090F5 Source: Data Flow Task [1] Description: The component "ADO .NET Data Source" (1) was unable to process the data. Pipeline component has returned HRESULT error code 0xC0209029 from a method call. End Error Error: 2013-05-04 15:39:57.26 Code: 0xC0047038 Source: Data Flow Task SSIS.Pipeline Description: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on component "ADO .NET Data Source" (1) returned error code 0xC02090F5. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component<c/> but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure. End Error DTExec: The package execution returned DTSER_FAILURE (1).
thanks in advance.
↧
Creating and accessing temp tables in SSIS package
Hi,
I want to create a local temporary table in execute sql task and and want to use the same in Data flow task as source table.
I follow the following steps to achieve this:
01. Created a new SSIS package
02. Create a connection string to "(local)/." server, "tempdb" database
03. Set the "RetainSameConnection" property value to "TRUE"
04. Set the "DelayValidation" to "TRUE", where ever I found this property
04. In Control Flow I added to items
a. Execute SQL Task
b. Data Flow Task
05. For "Execute SQL task" I set the connection to "tempdb"
06. I written the following query
Create table #transfer_CompaniesToProcess_tbl
(
companyID int not null
)
GO
07. In Data Flow task I added "OLE DB Source" and "OLE DB Destination"
08. In "OLE DB Source" I changed the "Data access mode:" to "SQL command"
09. In "SQL command text:" I entered "select * from #transfer_CompaniesToProcess_tbl"
10. When I clicked on the "OK" button; I ended with following error:
TITLE: Microsoft Visual Studio
------------------------------Error at Data Flow Task [OLE DB Source [1]]: An OLE DB error has occurred. Error code: 0x80040E14.
An OLE DB record is available. Source: "Microsoft SQL Native Client" Hresult: 0x80040E14 Description: "Statement(s) could not be prepared.".
An OLE DB record is available. Source: "Microsoft SQL Native Client" Hresult: 0x80040E14 Description: "Invalid object name '#transfer_CompaniesToProcess_tbl'.".
------------------------------
ADDITIONAL INFORMATION:Exception from HRESULT: 0xC0202009 (Microsoft.SqlServer.DTSPipelineWrap)
------------------------------
BUTTONS:OK
------------------------------
I gone through the following article and it seems I missed some thing.
http://blogs.conchango.com/jamiethomson/archive/2006/11/19/SSIS_3A00_-Using-temporary-tables.aspx
Can any one have any idea where I am doing wrong?
Thanks
Sreekanth
↧
Creating and accessing temp table under For each Loop in SSIS
Hi All,
I have created a global temp table in Execute SQL Task and joining that table in Data Flow Task to get some result set and insert into a table which is located on different server. I have set the RtainSameConnection as True and Delay Validation as True. But the requirement is that, I need to do same activity on multiple Databases using For Each Loop. But, due to RetainSameConnection is true so that I am getting data into Temp Table only from first database. I don't know Script. Is there any existing functionality to achive this task.
Please help me.......
Regards,
Sanjay.
↧
SSIS - Passing a date parameter to a SQL Query question again....
I need to pass a date string to my sqlcommand inside of my "datareader source". I read some of the questions about setting expression variables but I can't seem to figure out how to do it. I pasted the query below. The table name contains a date in it so I need to pass that date as a string into my sqlcommand at runtime. Do I create a variable with the entire SQL command in it or can I just create a single variable that holds the date and just reference that in my datasource reader sqlcommand property? Can someone assist me with the syntax for creating the expression?
SELECT
pages_20101006.`date` AS full_date,
pages_20101006.`cat` AS category_no,
FROM
pages_20101006
Thanks very much,
Chris
↧
↧
AddIn deprecated for SSIS Script task
I'm trying to use this code which compiles on vs2008 in vs2010:
The "AddIn" method shows not found by the 2010 compiler. AddIn seems like the component that gets SSIS to talk to vs2010/c#. So what replaces AddIn or is there a new template for finding file properties for SSIS 2012?
// C# code
// Fill SSIS variables with file properties using System; using System.Data; using System.IO;
// Added to get file properties using System.Security.Principal;
// Added to get file owner
using System.Security.AccessControl;
// Added to get file owner
using Microsoft.SqlServer.Dts.Runtime;
using System.Windows.Forms;
using System.IO;
using System;
using System.Data;
using System.Security.Principal;
//using System.Security.AccessControl;
namespace ST_9ef66c631df646e08e4184e34887da16.csproj
{
[System.AddIn.AddIn("ScriptMain", Version = "1.0", Publisher = "", Description = "")]
public partial class ScriptMain : Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTARTScriptObjectModelBase
{
#region VSTA generated code
enum ScriptResults
{
Success = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Success,
Failure = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Failure
};
#endregion
public void Main()
{
// Variable for file information
FileInfo fileInfo;
// Fill fileInfo variable with file information
fileInfo = new FileInfo(Dts.Variables["User::FilePath"].Value.ToString());
// Check if file exists
Dts.Variables["User::FileExists"].Value = fileInfo.Exists;
// Get the rest of the file properties if the file exists
if (fileInfo.Exists)
{
// Get file creation date
Dts.Variables["User::FileCreationDate"].Value = fileInfo.CreationTime;
// Get last modified date
Dts.Variables["User::FileLastModifiedDate"].Value = fileInfo.LastWriteTime;
// Get last accessed date
Dts.Variables["User::FileLastAccessedDate"].Value = fileInfo.LastAccessTime;
// Get size of the file in bytes
Dts.Variables["User::FileSize"].Value = fileInfo.Length;
// Get file attributes
Dts.Variables["User::FileAttributes"].Value = fileInfo.Attributes.ToString();
Dts.Variables["User::FileIsReadOnly"].Value = fileInfo.IsReadOnly;
//////////////////////////////////////////////////////
// Check if the file isn't locked by an other process
try
{
// Try to open the file. If it succeeds, set variable to false and close stream
FileStream fs = new FileStream(Dts.Variables["User::FilePath"].Value.ToString(), FileMode.Open);
Dts.Variables["User::FileInUse"].Value = false;
fs.Close();
}
catch (Exception ex)
{
// If opening fails, it's probably locked by an other process
Dts.Variables["User::FileInUse"].Value = true;
// Log actual error to SSIS to be sure
Dts.Events.FireWarning(0, "Get File Properties", ex.Message, string.Empty, 0);
}
//////////////////////////////////////////////////////
// Get the Windows domain user name of the file owner
FileSecurity fileSecurity = fileInfo.GetAccessControl();
IdentityReference identityReference = fileSecurity.GetOwner(typeof(NTAccount));
Dts.Variables["User::FileOwner"].Value = identityReference.Value;
}
Dts.TaskResult = (int)ScriptResults.Success;
}
}
}The "AddIn" method shows not found by the 2010 compiler. AddIn seems like the component that gets SSIS to talk to vs2010/c#. So what replaces AddIn or is there a new template for finding file properties for SSIS 2012?
↧
SQL Server agent job will not retain package password (encrypt sensitive with password)
I have a package protected by a password - I am already unhappy that to get it to use the configuration file to change connection strings for the production servers I have had to hardcode the password into the config file - very insecure!
However, the package now deploys correctly to the production server and will run from there OK, but NOT if scheduled as a SQL Server Agent Job. Thus is because however often I edit the command line to include the password after the DECRYPT switch (which it has prompted me for when I click on the command line tab), the Job Step will not retain it.
If I open it up after I have edited it and closed it, the password has disappeared.
I know that if I run dtexec plus the code in the Command Line tab (with the password), the package runs OK.
This is driving me insane!
I have read all the other posts and so I tried replacing the SSIS package step with a CmdExec step and pasting that code into there - then I get an OLEDB error..
The code I use is:
DTEXEC /SQL "\ImportRateMonitoringTables" /SERVER servername /DECRYPT password /CONFIGFILE "D:\Microsoft SQL Server\SSIS\Deployments\RateMonitoringImportTasks\Deployment\ImportRateMonitoringTables_Production.dtsConfig" /MAXCONCURRENT " -1 " /CHECKPOINTING OFF /REPORTING E
and I get
SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x8000FFFF
although the same code executes perfectly from a command prompt.
Please does anyone have any experience with a similar problem and if so, how did you get round it?
Thank you
↧
dataprofiler task
Hi
i try to learn data profile task in ssis , so i just search in bing i got some idea and i used in my package but i m having 1 doubt in that Column statistics profile, its giving detail about min,max,mean,standard deviation ..i cant understand what is standard deviation will give,can anybody explain abt this
↧
Different databases supported by SSIS
Hi All,
Thanks in advance.
Please let me know the types of databases supported by Sql Server Integration Services. Whether we can move data from all the database like sybase,teradata etc .... into SQL Server or some other databases using SSIS.
Thanks
Rajan.S
↧
↧
Remove all special characters from a string..
Hi
how to remove all the special characters from a string like,
Kumar, Hi.
Ram$ siddig.
↧
ftp,unzip and script task
hi all,
I am having ZIP files in FTP folder, the file names will be like file_2013_04_25, file_2013_04_26. We need to pick the appropriate file, as new file will be dropped every day morning 7:00 am and we need to pick that according to the date appended to the file name, that particular file needs to be moved to the local and that zip file should be unzipped , after unzip the files related to that zip file should be in a folder with the name as file_2012_04_26. please can some one help me.
Thanks,
Anilkumar
↧
saving data from sql table into an ssis variable to be used by ado.net data source in ssis 2012
i have an ado.net data source connecting to mysql db on unix
i have a table called setting with two columns and 1 row of data .
using an execute sql task , i am able to get data from the settings table in mssql server and pass it to an ole data source using ?
example select * from user where enddate > ?
but in ado.net source of mysql it does not like that syntax .
i have used expression , and this works but it gives the defaut value of the variable fields startdate and enddate from the ssis package it does not seem to capture of pass save the dates passed in from the mssql db setting table with i use the above execute SQL task step to do .
"select * from mt4_user_info_load where insert_date >= cast('" + (DT_WSTR,30)@[User::dtmStartDate] + "'as datetime) and insert_date < cast('" + (DT_WSTR,30) @[User::dtmEndDate] + "'as datetime)"
any idea how i can save the value from the table and pass it to the above expression or pass the value from the db to the ado.net work flow source
↧
Is there any way to access SSAS instance via office lan
Hi All,
The SSAS instance be installed on one WIN7 machines, and I want to access the instance with Office PIVOTTABLE onanother WIN7 machine, but when I choose Analysis Service as the datasource, connect the datasouce with windows authentication, and then it shows"error occurs on transportation level".
Two WIN7 machines are at the same workgroup, but not quite sure windows authentcation can work in such scenario. If not, is there any workaround?
Microsoft Online Community Support Please remember to mark the replies as answers if they help and unmark them if they provide no help.
↧
↧
Import /export or synchronize workitem data from tfspreview site into sql server database?
Hi All,
I want to synchronize the workitem data from tfspreview site to sql server database.
Is there any way to complete bidirectional synchronization process?
Please let me know if you have any queries.
Thanks, Pranil Yambal |Pranil.Yambal@hotmail.com
↧
SSIS Back Up Database Task Failed in Winform Only
Hello guys
I have this weird problem with my SSIS package, it works fine in BIDS, works fine as a SQL Agent Job, but as soon as I run in within my winform using Package.LoadPackage, the "Back Up DataBase Task" magically failed. I put a data flow task before and after the back up task to see if the package was excuted at all and it did, the first data flow task was executed successfully however it stops when trying to back up the database. I have add users to Local DCOM Group and I have given permissions to the user under security tab in MsDtsServer100, but nothing helps. Does any1 know what could cause the problem? btw. no error messages were given at any time during this process.
========================In my winform i have====================
string pkgLocation;Package pkg;Microsoft.SqlServer.Dts.Runtime.Application app;DTSExecResult pkgResults;
pkgLocation =@"C:\Integration Services Project1\obj\Development\Package.dtsx";
app =newMicrosoft.SqlServer.Dts.Runtime.Application();
pkg = app.LoadPackage(pkgLocation,null);
pkgResults = pkg.Execute();foreach(DtsWarning w in pkg.Warnings){MessageBox.Show(w.Description);}MessageBox.Show(pkgResults.ToString());================================================================
↧
Microsoft SQL Server 2012 Service Pack 1 SSIS Error
Hi,
I installed Microsoft SQL Server 2012 Service Pack 1 (KB2674319) on our server and my Integration Services 2012 package started failing on a Source Script Component with one Output Buffer. I debugged the code by using a breakpoint and...found that the code fails when I call the base method AddNew() (e.g. Output0Buffer.AddNew()). I get the dreadful "Object reference not set to an instance of an object" error with some more details like "use New to instantiate an object." I then installed two hotfixes, but still I got the same error.
I then resorted to uninstalling the service pack and let you know about this. I also tested this on my workstation by installing the service pack 1 and it broke the code. Please assist. See attached.![]()
I installed Microsoft SQL Server 2012 Service Pack 1 (KB2674319) on our server and my Integration Services 2012 package started failing on a Source Script Component with one Output Buffer. I debugged the code by using a breakpoint and...found that the code fails when I call the base method AddNew() (e.g. Output0Buffer.AddNew()). I get the dreadful "Object reference not set to an instance of an object" error with some more details like "use New to instantiate an object." I then installed two hotfixes, but still I got the same error.
I then resorted to uninstalling the service pack and let you know about this. I also tested this on my workstation by installing the service pack 1 and it broke the code. Please assist. See attached.
↧