I have a need to spit out data from a sql table to an excel spreadsheet using the SSIS data flow, and then use an email task to send it out. Is there a way I can encrypt the data in the spreadsheet before sending? Thanks.
↧
How to encrypt excel destination data?
↧
Use Package Config DB Connection string in Script Task
I tried way 1 below but connection returned was null.
So I got the ConnectionString as Way 2 below and tried to create new connection
Way 1:
connection = new SqlConnection(); connection = (SqlConnection)(Dts.Connections["Restrc_dbconn"].AcquireConnection(Dts.Transaction) as SqlConnection);
Way 2:
string connString = Dts.Connections["Restrc_dbconn"].ConnectionString;
connection = new SqlConnection(connString);
This gives me error saying "Keyword not supported :Provider"
The steps I tried above does not use Package Config. Can someone please help me how to use it. And i f I use Package Config, the connection string in that also would have Provider so how can we overcome the Provider keyword error.
Thanks In Advance!!
↧
↧
SSIS execution using dtexec fails
Hi
We have both SQL Server 2005 & 2008 and I have an SSIS package created in BIDS 2008.
I also have a stored procedure where i execute the SSIS package from SQL2008.
Code:
dtexec /sql "FinancialCalendar" /ser SERVERNAME\sql2008 /MAXCONCURRENT " -1" /set \package.variables[User::StartDt].Properties[Value];20110501 /set \package.variables[User::EndDt].Properties[Value];20110601
When I execute this stored procedure with the above code these are the results I get:
Microsoft (R) SQL Server Execute Package Utility
Version 9.00.3042.00 for 32-bit <------ The ssis package is version 10 but its showing version 9
Copyright (C) Microsoft Corp 1984-2005. All rights reserved.
NULL
Started: 9:06:47 AM
Could not load package "FinancialCalendar" because of error 0xC0014062.
Description: The LoadFromSQLServer method has encountered OLE DB error code 0x80040E14 (Could not find stored procedure 'msdb.dbo.sp_dts_getpackage'.). The SQL statement that was issued has failed.
Source:
Started: 9:06:47 AM
Finished: 9:06:47 AM
Elapsed: 0.265 seconds
When I execute the dtexec command from command prompt it runs correctly anf it shows version 10. How do I resolve this?
Any help would be appreciated.
Thanks.
Wendy B
We have both SQL Server 2005 & 2008 and I have an SSIS package created in BIDS 2008.
I also have a stored procedure where i execute the SSIS package from SQL2008.
Code:
dtexec /sql "FinancialCalendar" /ser SERVERNAME\sql2008 /MAXCONCURRENT " -1" /set \package.variables[User::StartDt].Properties[Value];20110501 /set \package.variables[User::EndDt].Properties[Value];20110601
When I execute this stored procedure with the above code these are the results I get:
Microsoft (R) SQL Server Execute Package Utility
Version 9.00.3042.00 for 32-bit <------ The ssis package is version 10 but its showing version 9
Copyright (C) Microsoft Corp 1984-2005. All rights reserved.
NULL
Started: 9:06:47 AM
Could not load package "FinancialCalendar" because of error 0xC0014062.
Description: The LoadFromSQLServer method has encountered OLE DB error code 0x80040E14 (Could not find stored procedure 'msdb.dbo.sp_dts_getpackage'.). The SQL statement that was issued has failed.
Source:
Started: 9:06:47 AM
Finished: 9:06:47 AM
Elapsed: 0.265 seconds
When I execute the dtexec command from command prompt it runs correctly anf it shows version 10. How do I resolve this?
Any help would be appreciated.
Thanks.
Wendy B
↧
Optimal deployment option for SSIS package to invoke it from WCF.
I am new in SSIS.I have a WCF service that will load a SSIS package and execute.This package will import bulk from Excel to sql server data base.As of now this package is in the File System of the server where WCF service is deployed. We can have different deployment options for SSIS package( File System, MSDB or dts server). I want to know which is the optimal deployment option to execute this SSIS package. This should work seamless way with WCF service.Anybody can give me the comparison for this with reason.
↧
Excel destination column max number of characters
Hi All,
I am trying to export data from a SQL DB to excel 2007 file and one of the columns sometimes has data more than 255 characters long. I can change the source to be Unicode string [DT_WSTR] 500, but the excel destination won't let me increase the column width to more 255.
Is this a limitation of excel 2007 and I just have to accept it? from what I have read i think this might be the case. I can't change it to csv.
↧
↧
How to see the output to a video grid
I would like to know if there is way to see my data outputs on a "Video Grid". So far I have seen some destination as the flat files and son but I dindn't notice a video output.
Can you help me?
Thanks in advance
↧
SSIS - Buffer memory warning
Hi
I have package that I was running last week without any problems.
The package has 1 source component (attunity oracle connector) that loads into a table in SQL Server (OLE destination). I have the SQL server (in a Virtualised environment) all to myself which has 12GB of RAM on it. From what I can tell in Performance Monitor 9GB of that is allocated to SQL Server and 3GB to Integration Services. Set up of the data flow task for this are below -
Maxbufferrows set to - 50000,
Maxbuffer size set to 104857600 (which is the maximum SSIS will allow),
Engine Threads set to - 2
When I executed the package today the package is running a bit slower but more concerning I am receiving an Information error containing -
Information: The buffer manager failed a memory allocation call for 104857160 bytes, but was unable to swap out any buffers to relieve memory pressure. 2 buffers were considered and 2 were locked. Either not enough memory is available to the pipeline because not enough are installed, other processes were using it, or too many buffers are locked.
Looking at perfmon when I executed the package I can see the following -
SSIS pipeline counter values:
Buffers in use - 76
Buffer memory - 7,549,710,024
Buffers spooled - 0
Process counters:
DTExecUI Private Bytes - 69,312,512
DTExecUI Working Set - 3,608,576
It appears as though that everytime I run the package the number of buffers is increasing for the package? Any ideas why I seem to having memory issues? Is there some type of memory house keeping that needs to be done for SSIS?
For the package I have designed I would imagine only 2 buffers to be created one from the source component - 1 for the good records (green arrow) and 1 for the bad records (red arrow for error handling). Please can you correct me if my understanding is incorrect on this one.
The source table contains approx 300million records.
Thanks
↧
SSIS The requested OLE DB provider Microsoft.ACE.OLEDB.12.0 is not registered
Hi All,
In my SSIS package am reading data from .xlsx file and loading it into a database table. Am using "Provider=Microsoft.ACE.OLEDB.12.0;Data Source=" + @[User::FullPath] + ";Extended Properties=\"Excel 12.0;HDR=YES\";"
as the connection string. It works fine when I run from BIDS but when I put it inside job it fails saying OLE DB provider Microsoft.ACE.OLEDB.12.0 is not registered . I checked the checkbox Use32 it runtime inside job and in SSIS project property I have made Run64BitRunTime as False. Nothing seems to be working out.
Any help is appreciated.
Thanks
↧
Cannot upgrade SSIS 2005 packages to SSIS 2012
Hi,
I have installed SQL 2012 on a server os 2008r2. I placed a folder with my 2005 packages along with all extra files such as .sin and dtproj files on that same server (no previous versions of SQL Servers exist on that machine) And so I happily follow the instructions of upgrading by:
Starting VS2010 (with BI settings)
Select File - Open - Project/Solution and select my .sln file and the wizard starts but it does notupgrade packages as that wizard never starts. If I state to create a BUP I get a list of ssis packages but no indication of them being upgraded. However the .sln file is stated as upgraded but the project file is not and in the solution explorer it only states the project name and (Unavailable) and underneith it says the project file was unloaded.
I have tried to do same actions but selecting the .dtproj file and same behaviour. The ssis packages I cannot see in the solution explorer nor does the wizard for converting them ever start.
Am I doing something wrong? Version of SQL 2012 is 11.0.2100.60, the RTM version. How am I to go about?
Thank you for any help :)
HS
↧
↧
ssis runtime error "TXN_DATA_FEED/DP_TXN_MEASUREMENTS/TXN_MEASUREMENT/TXN_ERROR" has changed. Please re-initialize the metadata for this component and review column mappings.
I have an SSIS package that loads data from an xml file to sql server database. A new xml file is downloaded each time the package runs. I am using XMLSource to get my xml data. When I run the package from a SQL Server Agent Job, I get the following error
Code: 0xC0209318 Source: Data Flow Task 1 XML Source 1 [1] Description: The XML schema data type information for "code" on element "TXN_DATA_FEED/DP_TXN_MEASUREMENTS/TXN_MEASUREMENT/TXN_ERROR" has changed. Please re-initialize the metadata for this component and review column mappings. End Error Error: 2012-08-03 13:32:25.70 Code: 0xC004706B Source: Data Flow Task 1 SSIS.Pipeline Description: "component "XML Source 1" (1)" failed validation and returned validation status "VS_NEEDSNEWMETADATA". End Error Error: 2012-08-03 13:32:25.70 Code: 0xC004700C Source: Data Flow Task 1 SSIS.Pipeline Description: One or more component failed validation. End Error Error: 2012-08-03 13:32:25.70 Code: 0xC0024107 Source: Data Flow Task 1 Description: There were errors during task validation. End Error DTExec: The package execution returned DTSER_FAILURE (1). Started: 1:32:14 PM Finished: 1:32:25 PM Elapsed: 11.5 seconds. The package execution failed. The step failed.
How do I reinitialize the metadata automatically within my package?
↧
Issues converting from SQL 2005 to SQL 2012
I have been working on converting our packages from SQL 2005 to SQL 2012. I went through the wizard and got all the packages converted, but now am running into an issue that has me stumped.
On the packages that uses a stored procedure (with temp tables in the SP) are giving me a validation error on the data flow task.
This is the error:
_____________________________________________________________
Exception from HRESULT: 0xC020204A
Error at Create Extract[OLE DB Source [193]]: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005. An OLE DB record is available. Source: "Microsoft SQL Server Native Client 11.0" Hresult: 0x80004005: "The metadata could not be determined because statement 'select client_no, total_assets' in procedure 'usp_get_assets' uses a temp table.".
Error at Create Extract [OLE DB Source [193]]: Unable to retrieve column information from the data source. Make sure your target table in the database is available.
___________________________________________________________
This package ran fine in SQL 2005 and it ran fine. A lot of our packages use Stored Procs that have temp tables in them. Any help or pointers will be appreciated!
Thanks,
↧
scheduling ssis package fails to post file to unc sharepoint path
- I have created SSIS package where it copy files from my local drive (c:) & post it to SharePoint path(\\sharepoint.corp.*******.com\DavWWWRoot\sites\sitename....)
SSIS package works FINE no issue,but when i try to SCHEDULE the same package it throws the following error:
DTExec: Signature verification failed. The signature status is not present. The package could not be loaded. The step failed.
- sql server and sql server agent SERVICES running my account(DOMAIN\username).
- i have an access to SharePoint path.
- i have created PROXY and ran it didn't workout.
- From DOS command also it works.when i schedule it it will not work.
I am using
- WINDOWS server 2008 service pack1 64 bit
- sql server 2008 r2 64 bit
please help me..I'm waiting for the respond...:(
↧
Updating field in Table using SSIS
Hello!
I have just drawn a complete blank. If someone could help guide me in the right direction I can implement this. What I have is a very large Table with a County field. An example of one field would be "Schenectady County". What I need to do is take out of ALL the rows the space and the word "County" so that it will just read "Schenectady". How can this be done using SSIS components?
Thanks!!
Mike
Mike Kiser
↧
↧
CDC for oracle Network requirements
Dear,
I would like to inform about the requirements, specially related to the network. What
if Oracle and SQL Server or on separated locations across the world, will an
ISDN connection be enough or do we need fibernet. Will this be sufficient for
the connection & datatransfer between CDC services and LogMiner? we expect around 10 millions (changed) records a day.
What if there are more transactions than we can process, could be related to the slow network connection?
Is there a kind of buffer for when transactions are comming in, while we are processing them?
Thanks,
Bram
↧
how to change file attributes for all files in the folder using ssis.
Hi,
I am trying to copy files and folders from one location to another.This is a repeatitive process and runs everyday. I am using file system task for this.
The problem I am having is in setting the attributes on the destination files,folders.
The package runs fine for the first time where it copies all the files and folders to the destination for the first time and sets some of the destination files to readonly (like.bat file).So,When the package runs the second time, it fails because it cannot overwrite the files.
I used a script that would set the ISreadonly option to false. This does it only for the files under main directory.
the input variable is the path of the main directory (example c:\test\
)
So, I am trying to figure out a way to set the attributes of all files including the ones under subfolders to False.
Thank you in advance.
↧
Using XML Source with "XML from variable"
I'm keen to use an XML Source in a data flow with the XML provided in a variable. Can someone point me to an example?
If it's necessary to know in order to answer this question, I'll happily give full chapter and verse about what I'm trying to do and why, but for now I belive an example of using the XML Source with Data Access Mode = XML data from variable should suffice.
I'm using an SQL server 2008 R2 database and VisualStudio 2008 with SSIS designer 10.50.2500.0
Many thanks,
Alan
↧
Error Code = 0xC0010026 (DTS_E_TASKISEMPTY = The task has failed to load.)
Hi All,
I am facing one wiered error when I am trying to import a package into the MSDB database.
Please not that -
1) the package does contain any script task and builds properly.
2)Also the package has a add on task - File properties task for which I have installed the add- on, on server.
3)I have sys.admin rights on the server.
Please help me with this..!
Error details-
Exception from HRESULT: 0xC0010026 (Microsoft.SqlServer.DTSRuntimeWrap)
------------------------------
Program Location:
at Microsoft.SqlServer.Dts.Runtime.Package.SaveToXML(String& packageXml, IDTSEvents events)
at Microsoft.DataTransformationServices.Controls.PackageLocationControl.SavePackage(Package package)
at Microsoft.SqlServer.Dts.ObjectExplorerUI.ExportPackageAction.OnSavePackage(Object sender, CancelEventArgs e)
Exception from HRESULT: 0xC0010026 (Microsoft.SqlServer.DTSRuntimeWrap)
------------------------------
Program Location:
at Microsoft.SqlServer.Dts.Runtime.Wrapper.IDTSPackagePersist100.SavePackageToXML(Object& pvDestination, Boolean vbReturnDOM, IDTSEvents100 pEvents)
at Microsoft.SqlServer.Dts.Runtime.Package.SaveToXML(String& packageXml, IDTSEvents events)
at Microsoft.SqlServer.Dts.Runtime.Wrapper.IDTSPackagePersist100.SavePackageToXML(Object& pvDestination, Boolean vbReturnDOM, IDTSEvents100 pEvents)
at Microsoft.SqlServer.Dts.Runtime.Package.SaveToXML(String& packageXml, IDTSEvents events)
madhur_ms
↧
↧
SSIS Bug when handling CSV Files with commas embedded in quoted strings
My group and I have been wrangling with this for a couple of days, and we're stumped.
Is the csv snippet "This string", 1234, "This, another string", "thatstring" has been throwing errors that look like it is using the comma inside the quoted string "This, another string" as a delimiter, and causing the row to grow by one field.
We've looked on the web, and apparently this is a common problem.
I just find it hard to believe that something so major is still a bug.
We're using SQL 2005 SP1 btw.
Help,
Doug
Is the csv snippet "This string", 1234, "This, another string", "thatstring" has been throwing errors that look like it is using the comma inside the quoted string "This, another string" as a delimiter, and causing the row to grow by one field.
We've looked on the web, and apparently this is a common problem.
I just find it hard to believe that something so major is still a bug.
We're using SQL 2005 SP1 btw.
Help,
Doug
↧
How to insert null for blob datatypes into pipelinebuffer
I am developing a custom data flow source component.
I need the ability to write blob data types into the output PipelineBuffer, including setting null values.
The Pipeline.PipelineBuffer.SetNull() method is not supported for the blob data types (DT_IMAGE, DT_TEXT, DT_NTEXT).
The Pipeline.BlobColumn class has the ability to SetNull, but I can find no connection between the PipelineBuffer class and a BlobColumn.
Neil Thomson
↧
How to Do compact and Repair via SSIS
Hi all,
Please help me how to repair compact and Repair Database before opening connection to access in SQL jobl
↧