hi
i am creating text file from my ssis package ,but when i am trying op open it getting error" too large for text file"
what other files i can use in SSIS to handle millions of rows and how to do it.
↧
large amount data in text file ssis
↧
SSIS 2012 -Not Executing file from other server.
Hi Experts ,
I am working on SQL 2012
I have a SSIS Package -
1) Execute SQL Task - calling Storeprocedure
my StoreProcesdure contain OpenRowser Query which Pull Data from Excel and Load into SQL Table.
Scenario 1
On Development Server example IP: (10.11.12.13)- File is present in D\ExcelSource\ folder of dev server
1)My SP Run/execute successfuly on SSMS
2)MY SSIS package execute successfuly which contain above SP
Scenario 2
I have deployed SP and SSIS to production server
On Production server example IP: (10.11.12.100)- File is Still Present in D\ExcelSource\ folder of dev server
1) MY SP Execute successful on SSMS Picking file from '\\10.11.12.13\D\ExcelSource\' folder
2) SSIS Package Fails where SP is picking file from '\\10.11.12.13\D\ExcelSource\' folder
"exec [dbo].[spLoadexcelEMPdata]" failed with the following error: "Cannot initialize the data source object of OLE DB provider "Microsoft.ACE.OLEDB.12.0" for linked server "(null)".".
Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.
3)When I copy excel file from dev to prod server and Give prod server path ,then SSIS package execute Successfully
NOTE :
a)ACE.OLEDB 64 bit (2010 )driver is installed on prod server
b)Same SP execute successful in Prod SSMS
c) SSIS and SP execute successful in Dev server
I have even Share development server Folder with everyOne so that File in it is accessible
Also given Read Write permission to excel file and folder
WHY my SSIS package with SP FAIL when Picking file from dev server ??? where as same SP runs fine on SSMS
HOW to resolve this.... ?? Please assist
↧
↧
ssis agent job
i have one vaiable date my package ,i am using 2012 to make sql sever agent job
can i pass parameter from sql server agent job without config file , just after deploying package while creating job
where i need to specify
↧
How to improve the updating a sql server table with another table in Oracle
Hi there.
I am trying to do the next updating in SSIS
UPDATE S
SET
S.COLUMN_A = OT.COLUMN_A,
S.COLUMN_B = OT.COLUMN_B
FROM
SQLT1 S INNER JOIN ORACLET1 OT ON
S. COLUMN_C = OT.COLUMN_C
This is what I am doing:
I am taking the Oracle data with the ODBC Source like this.
Select column_A, column_B, column_C
from OracleT1
The thing is, the Oracle table has millions of registers and this updating is taking a lot. But I am not sure if it is maybe because of the design of the update query.
I wonder is if there is another way to design this query or improve the performance of this task.
Thanks a lot.
↧
Script Task to apply styling to Excel Sheet
Hi Everyone,
I have a "Execute SQL Task" writing full result set to a variable. I have to export this data to Excel sheet(destination) and the excel sheet needs to have styling (Medium 2).
So far I was able to exported data to a template (Using OLE DB source and Excel Destination) but I am not getting the designated results.
Please Help.
↧
↧
SSIS The parameterized sql statement yields metadata which does not match the main SQL statement
Hi all,
I'm getting the above error when trying to execute a custom lookup. What I'm trying to do is lookup the minimum promotional price between date ranges. The SQL executes fine in SSMS
SELECT refTable.PRICEFROM(SELECT MIN(PRICE)AS PRICE ,
NAME ,
ITEMRELATION ,
FROMDATE ,
TODATEFROM[dbo].[AllCustPrices]GROUPBY NAME ,
ITEMRELATION ,
FROMDATE ,
TODATE)[refTable]WHERE[refTable].[NAME]=?AND[refTable].[ITEMRELATION]=?AND?BETWEEN[refTable].[FROMDATE]AND[refTable].[TODATE]but errors in SSIS?
↧
Parallelization in SSIS package
Hello,
I have created a data warehouse and I have like 40 (dim & fact) packages so far. I'm trying to create a package which executes all of them in parallel, I would use this package to set up as SQL server agent job. Can anyone help me doing this, I have never used parallelization so a detail explanation will be very helpful.
I have Some more questions on parallelization
->how many packages can be executed parallel through one package
-> I want dim packages to be executed first before any fact packages
Thanks,
Sree
↧
how to continue through error : Script Task and Web Client.(SSIS 2014)
Hi
I have ForEach Loop which passes a number of url to download files. I have a script with Webclient to download the files from the url inside the loop.
What I am trying to achieve is to let the script task successful even if the download fails. I want to let the script task always successful and handle the error using a variable'Download status' by setting value True or False . Below is the code I have right now.
I set a breakpoint and learnt that it goes through the catch section. It went to the last statment in catch block
Dts.TaskResult = (int)ScriptResults.Success;
I thought this statement would make the script task not to fail but obviously it is something else I need to do.
(I tried to set maxium error count but I had to set it not at the script task but for the package level. It looks like error count increase as the download fails)
Can anyone help me please? Is there a better solution? What am i missing?
public void Main()
{
try
{
Dts.Connections["Course.xml"].ConnectionString = "";
// Logging start of download
bool fireAgain = true;
Dts.Events.FireInformation(0, "Download File", "Start downloading " + Dts.Variables["CourseURL"].Value.ToString(), string.Empty, 0, ref fireAgain);
// Create a webclient to download a file
WebClient mySSISWebClient = new WebClient();
// Set Connection striong
Dts.Connections["Course.xml"].ConnectionString = Dts.Variables["User::eDestinationConnectionString"].Value.ToString();
// Downloal xml
mySSISWebClient.DownloadString(Dts.Variables["CourseURL"].Value.ToString());
// Logging end of download
Dts.Events.FireInformation(0, "Download File", "Finished downloading " + Dts.Connections["Course.xml"].ConnectionString, string.Empty, 0, ref fireAgain);
Dts.Variables["User::DownloadStatus"].Value = true;
// Quit Script Task succesful
Dts.TaskResult = (int)ScriptResults.Success;
}
catch (Exception ex)
{
// Logging why download failed
Dts.Events.FireError(0, "Download File", "Download failed: " + ex.Message, string.Empty, 0);
Dts.Variables["User::DownloadStatus"].Value = false;
// Quit Script Task succesful
Dts.TaskResult = (int)ScriptResults.Success;
}
↧
Excel Sheet Looping: For each loop from variable Enumerator
Hi,
Is it possible to do excel sheets looping using For each loop Enumerator as "For Each loop from Variable enumerator" ? If yes, please help.
Also,
I have an excel file with 10 sheets, but want to loop only 5 sheets. Please help..how can i achieve this.
Actually i tried with
1> stored the 5 sheets name into a variable (say 'SheetsName') of type string using script task
2> For each loop container
enumerator - 'For each ADO Schema Rowset enumerator'
connection: ADO
schema: 'Tables'
variable mapping: 'User::SheetsName'
3> Within For each loop container added a data flow task
4> Inside DFT - excel source -
Data access Mode: 'Table Name or view name variable'
Variable Name: 'SheetsName'
but this loops through all the 10 sheets irrespective of only 5 sheets names stored in the variable "SheetsName".
Please help...
Please Mark as Answer if my post solved your problem or Vote As Helpful if this helps. Blogs: www.sqlserver2005forum.blogspot.com
↧
↧
error in script
I'm trying to set up a script task in SSIS (my first attempt at doing so, so bear with me). Part of this is code I have pulled from other examples I found on the internet.
Dts.TaskResult = Dts.Results.Success
on the above line, I'm getting error
'Results' is not a member of 'Microsoft.SqlServer.Dts.Tasks.ScriptTask.ScriptObjectModel'
Can you tell me what's wrong?
----------------------------------------------------------------------------------------------
Imports System
Imports System.Data
Imports System.Math
Imports Microsoft.SqlServer.Dts.Runtime
<System.AddIn.AddIn("ScriptMain", Version:="1.0", Publisher:="", Description:="")> _
<System.CLSCompliantAttribute(False)> _
Partial Public Class ScriptMain
Inherits Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTARTScriptObjectModelBase
Enum ScriptResults
Success = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Success
Failure = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Failure
End Enum
Public Sub Main()
Dim mgr As ConnectionManager
mgr = Dts.Connections("FTP_Connect")
Dim conn As FtpClientConnection
conn = New FtpClientConnection(mgr.AcquireConnection(DBNull.Value))
Dim fileNames(0) As String
fileNames(0) = "LEVEL01.TESTFILE" 'user can avoid using / in file name here
Try
conn.Connect()
conn.ReceiveFiles(fileNames, "c:\holddata", True, True)
Catch ex As Exception
Finally
conn.Close()
End Try
Dts.TaskResult = Dts.Results.Success
End Sub
End Class
↧
SSIS and SAP HANA
I am trying to Load data from Sql server 2012 using SSIS 2010 into an HANA Instance and this seems impossible. I have managed to connect up using ODBC but it runs without error and inserts nothing.
SAP Just recommend there Data services application as expected but on this occasion I would like to make use of SSIS.
Firstly is it possible to do this ? and How is this achieved can anyone please advise?
I have considered and looked for adapters if an upgrade of SSIS might help ?
↧
SSISDB catalog project logging
Hi All,
I'm missing SSIS project deployment (SSISDB) catalog Projects. Don't know how it happen. Is there any internal logging to track what event triggered to drop those Projects. I've seen restore projects using built-in stored procedures but not on any logging at project level. Any feedback greatly appreciated!.
Thanks,
sam
sam
↧
INFORMATICA TOOL WITH SQL SERVER ERROR HANDLING
Hi ,
I am not able to log the failure error messages in ETL informatical tool.This ETL pulls data from SQL server 2000 and putting another database which also sql 2000.Both data base created same instance.
While pulling data from database by using stored procedure not logged any error if this fails.While insert data into final database is logged error if fails.
Please do the needfull.
INSERT FAILS then ERROR is LOGGED as FnName: ExecuteSP -- [Informatica][ODBC SQL Server Legacy Driver][SQL Server]***
BUT pulling fails no error log logged.Both stored procedure having raise error with print statement.
Cheers,
↧
↧
Installed 14 dev edition to local machine, Can nt see the visial studio icon to launch SSIS
Hi All,
I have installed the dev edition of 2014 to my local machine, and it got installed successfully. The time when I installed I selected all features so I am not sure why I am not seeing the visual studio icon under the SSIS folder ? Do I have to install the visual studio separately ?
and thanks for reading my question.
↧
How to use RowCount with conditional split?
Hi Everyone,
Can anyone please help me with the following scenario?
- There is a table from which I am pulling the dataset. As per the row count in the dataset, I want to update other table in the database (i.e if rowcount=0; update table1 and if rowcount>0; update table1).
To achieve it, I used the below flow but it is not working as expected. Am I doing anything wrong? If yes, please guide me with proper solution.
Conditional Split cases:
Case1: If @rowcount ==0
Case2: If @rowcount>0
↧
How to handle Error Log in SSIS?
Hi All,
Can anyone please suggest me a best way to handle the below scenario?
- I have an SSIS package which reads data from XML files, validate the business scenarios and process the data to database.
- If any data from the source file (XML File) has invalid data/format errors/any errors which stops my package to run, package gives the error messages with the failure reasons.
- How can I get the failure reasons given by the package to show it to end user rather handling in a custom way? so that they can correct the file and re-submit?
Thanks & Regards,
Sri
↧
Executing SSIS Package using C# problem
Hey,
I developed an WinForms App and SSIS package which I want to run using this App.\
I'm using folliwng script to run it:
using Microsoft.SqlServer.Dts.Runtime;
class PackageExecutor { public string PackageFolder = ConfigurationManager.AppSettings["PackageFolder"]; Logger _logger = new Logger(); public void ExecutePackage(string location, string packagename) { Package pckg; Microsoft.SqlServer.Dts.Runtime.Application app; DTSExecResult pckgResult; Variables vars; app = new Microsoft.SqlServer.Dts.Runtime.Application(); pckg = app.LoadPackage(location, null); vars = pckg.Variables; vars["User::PckgConnection"].Value = ConfigurationManager.ConnectionStrings["SSIS"].ConnectionString; pckgResult = pckg.Execute(null, vars, null, null, null); if (pckgResult == DTSExecResult.Success) { MessageBox.Show("Wykonano poprawnie"); string msg = DateTime.Now.ToString() + " " + ExtensionMethods.LoginData.strUserName + " " + packagename + " Success"; _logger.WritePackageLog(msg); } else { string err = ""; foreach (Microsoft.SqlServer.Dts.Runtime.DtsError local_DtsError in pckg.Errors) { string error = local_DtsError.Description.ToString(); err = err + error; } MessageBox.Show("Wystąpił błąd więcej informacji w logu."); string msg = DateTime.Now.ToString() + " " + ExtensionMethods.LoginData.strUserName + " " + packagename + " Failure with error: " + err; _logger.WritePackageLog(msg); } } }
This one works perfectly on my PC which have SSIS installed, however a client is reciving an error:
"An Integration Services class cannot be found. Make sure that Integration Services is correctly installed on the computer that is running the application. Also, make sure that the 64-bit version of Integration Services is installed if you are running a 64-bit application".
Inside SSIS project I turned of "Run64BitRuntime".
I'm running on x64 bit windows with x32 SSIS installed, can't tell on what Windows (x32/x64) is client running. I can get that info if necessary.
Any idea how may I solve this? Point of everything was to run SSIS package placed on server on any machine without installing any additional software there.
↧
↧
SP_WH0
I have a job that takes 7 hrs to run when running the SSIS Package as a SQL Job. When i ran sp_who it shows unde rthe "PROGRAMNAME " Column... Does this mean this job is pointing to the PLADEV,15001Server? Or is that just a label, and job is not referening to PLADEV,15001 server?
Program name in so_who is below:
SSIS-DailyGraphs-{75FDE0DD-FDE0-437C-B9B6-72B453B13861}PLADEV,15001.Billing.
|
↧
Debugging problem with break points not being picked up
I have Team suite VS2005 sp1 installed and I can't debug my SSIS packages. If I put any break points in the Script code when I try to debug I get the message.
"SQL Server Integration Services Script Task has encountered a problem and needs to close. We are sorry for the inconvenience."
I click on close and it runs the package but doesn't stop at any break point. If I take out all break points it will run without this error. A couple of times I have managed to put in a single break point early in the package within a different script component which causes it to break... but at a completely different point within a completely different script component. It's so weird. Any help would be appreciated.
Hoots.
"SQL Server Integration Services Script Task has encountered a problem and needs to close. We are sorry for the inconvenience."
I click on close and it runs the package but doesn't stop at any break point. If I take out all break points it will run without this error. A couple of times I have managed to put in a single break point early in the package within a different script component which causes it to break... but at a completely different point within a completely different script component. It's so weird. Any help would be appreciated.
Hoots.
↧
Fastest way to load 1 billion rows of data into MSSQL using SSIS
Hi guys,
Please I need your assistance, I am trying to load over 1 billions rows of data from MSSQL 2000 database into an MSSQL 2012 database using SSIS and this is taking forever to load.
Please can someone assist me on how best to make the ETL to run faster.
Thanks
me
↧