My company uses SQL Server 2008 and we develop SSIS packages in VS 2008. I recently installed SQL Server 2014 since I got assigned to a new company project the uses it. So I needed both. Both seem to work. I use 2008 with the 2008 DBs and 2014 with the 2014 DBs’ But now when I open a package in VS 2008 I found that I lost a reverence to Microsoft.sqlServer.ManagedDTS in my script tasks and I can’t use DTS variables. I reinstall both SQL Server 2008 and VS 2008 and that didn’t fix the problem. I went to another computer that doesn’t have the problem to find the dll and I can’t get to the path where the reference is, C:\Windows\assembly\GAC_MSIL\Microsoft.SqlServer.ManagedDTS\10.0.0.0__89845dcd8080cc91\. How do I restore this dll so VS 2008 can find it?
↧
Lost reference to Microsoft.sqlServer.ManagedDTS
↧
XML Source errors when running from child package or SQL Agent
I have a package that calls an XML Source component and is running fine when I call the package directly from VS but if I call the package from another package I get the following error. I get the same error when calling the package directly from SQL Agent. The SSIS project is running under TargetServerVersion SQL Server 2012.
[XML Source [7448]] Error: System.ArgumentException: Value does not fall within the expected range.at Microsoft.SqlServer.Dts.Pipeline.Wrapper.IDTSBufferManager100.FindColumnByLineageID(Int32 hBufferType, Int32 nLineageID)
at Microsoft.SqlServer.Dts.Pipeline.DtsDataTable.SetupColumns(DtsDataTableCollection dtsDataTableCollection, IDTSOutput100 output, Int32 localeID, IDTSBufferManager100 bufferManager)
at Microsoft.SqlServer.Dts.Pipeline.DtsDataTableCollection.AssociateTablesWithBuffers(IDTSOutputCollection100 outputs, IDTSBufferManager100 bufferManager, Int32 localeID, DataSet dataSet)
at Microsoft.SqlServer.Dts.Pipeline.DtsDataTableCollection..ctor(XmlSourceAdapter xmlSourceAdapter, IDTSOutputCollection100 outputs, Int32 localeID, DataSet dataSet, IDTSBufferManager100 bufferManager)
at Microsoft.SqlServer.Dts.Pipeline.XmlSourceAdapter.PreExecute()
at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostPreExecute(IDTSManagedComponentWrapper100 wrapper)
↧
↧
How to Pass folder names from a sql table to file system task,to delete the Folders?
Actually I had a sql table which consists the folder names that to be deleted...
Now,I have to pass those folder names to File system task...
↧
Cannot Run SSIS Package from SQL Server Agent Job
We have two servers with the same specifications and configurations:
SSIS server | QA Server | |
RAM | 8.00 GB | 8.00 GB |
System Architecture | 64-bit | 64-bit |
Excel Driver | 32-bit | 32-bit |
Excel Driver Version | 14.0.6015.1000 | 14.0.6015.1000 |
Folder Structure | \Stored Packages\MSDB\Preprod Packages | \Stored Packages\MSDB\Preprod Packages |
Schedule of Job | Runs Every 5 mins | Runs Every 5 mins |
We recently installed 32-bit excel driver on the QA server and the job on the QA server is not working as expected even though it has the same specifications and configurations as that of the SSIS Server which is working as expected.
The job fails with the following error:
End Error Could not load package "\Preprod packages\pkg_xxxxx" because of error 0xC0010014. Description: One or more error occurred. This message is used as a return value from functions that encounter errors. Source: Started: 06:30:00 Finished: 06:30:02 Elapsed: 1.11 seconds. The package could not be loaded. The step failed.
We would like to understand the error better.
Thanks in advance.
↧
An OLE DB error has occurred. Error code: 0x80004005. An OLE DB record is available. Source: "Microsoft OLE DB Provider for SQL Server 2012 Analysis Services." Hresult: 0x80004005
I am using SSIS 2012 OLDDB source to execute MDX query , i get below errors at times. when i execute the package immediately after the error it is working. it became difficult to reproduce the same error and debug package.
I am using Microsoft OLEDB provider for analysis service 11.0 in the connection manager.
Provider MSOLAP.5 ,Integrated security =SSPI and Log in using Windows NT integrated security.
SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.An OLE DB record is available. Source: "Microsoft OLE DB Provider for SQL Server 2012 Analysis Services." Hresult: 0x80004005 Description: "Internal error: An unexpected error occurred (file 'pcxmlacommon.cpp', line 43, function 'PCFault::RaiseError').".failed the pre-execute phase and returned error code 0xC0202009.
SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.An OLE DB record is available. Source: "Microsoft
OLE DB Provider for SQL Server 2012 Analysis Services." Hresult: 0x80004005 Description: "Error Code = 0xC1000012, External Code = 0x00000000, Note: ".OLE DB Source failed
the pre-execute phase and returned error code 0xC0202009.
SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.An OLE DB record is available. Source: "Microsoft OLE DB Provider for SQL Server 2012 Analysis Services." Hresult: 0x80004005 Description: "An error was encountered in the transport layer.".An OLE DB record is available. Source: "Microsoft OLE DB Provider for SQL Server 2012 Analysis Services." Hresult: 0x80004005 Description: "The peer prematurely closed the connection.".OLE DB Source failed the pre-execute phase and returned error code 0xC0202009.
Could someone please help me, and let me know if more details required
↧
↧
Microsoft Connectors for Oracle (Attunity) with Windows 10
Hi,
I have recently upgraded to Windows 10. I use Visual Studio 2013, SQL Server Enterprise 2014 and Oracle 11g.
After the upgrade almost everything works (even the oracle client!) the only thing which doesn't is the Microsoft Connectors for Oracle (Attunity). I was using v3.0 before on Windows 8.1 and it was fine.
If I try and open a VS2013 SSIS project which calls for an Oracle source (MSORA), VS crashes. It seems to be when its trying to validate the connection.
This link shows there is no listed support for Windows 10 - has anybody else faced this and found a workaround? Or anybody from Microsoft know when there will be a version released?
Thanks,
Dominic
↧
Import a .xlsx (Microsoft 2007) file in SSIS package
I have created an Excel File connection as follow…
If I execute the data flow task by itself, it’s working.
Since the filename will always be different, I am changing the connection string in a script task editor as follow:
Dts.Connections["CriticalListExcelFile"].ConnectionString ="Provider=Microsoft.ACE.OLEDB.12.0;Data Source="+ FilePath +";Extended Properties=\""+"EXCEL 12.0 XML;HDR=YES"+ "\""+ ";";
When I execute de package, the value that is being passed looks like this:
Provider=Microsoft.ACE.OLEDB.12.0;Data Source=\\fld6filer\brd-redesign$\Solution_Development\4.Software development\Survey Interface Subsystem\MyleneTestingFiles\CriticalList\CriticalList_1bad.xlsx;Extended
Properties="EXCEL 12.0 XML;HDR=YES";
Which looks good to me !!
However, here is the error messages that I get under the process tab:
![]()
[Source - Excel File [1]] Error: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "CriticalListExcelFile"
failed with error code 0xC0202009. There may be error messages posted before this with more information on why the AcquireConnection method call failed.
[SSIS.Pipeline] Error: component "Source - Excel File" (1) failed validation and returned error code 0xC020801C.
[SSIS.Pipeline] Error: One or more component failed validation.
Error: There were errors during task validation.
[Connection manager "CriticalListExcelFile"] Error: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available. Source: "Microsoft Access Database Engine" Hresult: 0x80004005 Description: "External table is not in the expected format.".
Please note that I am doing the same thing with .xls file (version Microsoft Excel 97-2003) and it’s working.
So I've decided to try the OLEDB Connection. Same problem. It's working when I execute the Data Flow Task by itself, but same error when I execute the package.
I did changed the Run64BitRuntime option to False, and the Delay Validation has been set to True.
Any idea why?
Mylene Chalut
↧
Download the Latest file from FTP
Hello All,
Does anyone know what's the best way to download the latest file from FTP Site. for Ex lets say my files are named as below and i want to Pick the TV_20150316_1.zip
TV_20150310_1.zipTV_20150311_1.zip
TV_20150312_1.zip
TV_20150313_1.zip
TV_20150314_1.zip
TV_20150315_1.zip
TV_20150316_1.zip
↧
SSIS FileSystem task renames file in Debug but fails as Job Task
SSIS Newbie here.
I have a very simple SSIS package I created in VS2015 whose first step is a FileSystem task to rename a file from "testdata.txt" to "working.txt". It executes fine in debug mode. I deployed the project to the Integration Services catalog, tested it byright-clicking the dtsx and executing, and it was successful. I then created a SQL Agent Job to execute the package as a Job Step. But the SQL Job fails with the error "could not find file\\SCMISC\Bankname\testdata.txt". (And yes, I did change the file name back to testdata first).
What am I doing wrong?
Darrell H Burns
↧
↧
Merge Join [1311]: The comparison flags for the columns with SortKeyPosition value 1 do not match.
I have a
Source #1: OLE DB Source
SELECT *
FROM ABCDB.dbo.XYZ
WHERE (CRMTransOpport = 0)
ORDER BY EmailAddress
And Source Output “IsSort = True”
And Source output Column EmailAddress output sort =1
Source #2: From Microsoft CRM
fetch mapping='logical'>
<entity name='contact'>
<attribute name='emailaddress1'/>
<attribute name='contactid'/>
<order attribute="emailaddress1" />
</entity> </fetch>
The objective to into a Merge Join and ultimately into Microsoft CRM without email duplication.
So both are sorting and merge with just those setting…
However, to go into Microsoft CRM I need:
Source #1:
Source output Column:
emailaddress to have the comparison flag set to “ignore case”
So that capitalization of the email address is ignore – without this Merges that should happen are not happening:
ie myname@abd.com is not matching withMyName@abC.com
When I add this setting I get the following error:
Error 1 Validation error. Merge Join [1311]: The comparison flags for the columns with SortKeyPosition value 1 do not match.
I am on SQL 2014 Server SSIS.
Anyone have any ideas how to accomplish this? DO I need to do 2 different steps or am I missing something in this set up?
↧
How to update Metadata data types without editing XML code
SSIS seems to automatically set the metadata type and for "typed" sources like database and XML connections it seems to take whatever the source column datatype is. If you use a cast or convert in the your source SQL query, it will not change the datatype of the metadata. This becomes an issue when doing things like merge joins on data from different sources and the join columns are different types (e.g. a ZipCode in one system is a varchar and it is an int in another system). I've been working around the issue by editing the XML code and changing the datatype there. Is there any way to do this through the GUI?
↧
Is it possible to automatically load a filename and date into a SQL table
Hi, I've searched around and a few good answers but though I's stick with the best place I know on here. Here is the email from our developer and I'd like to offer a solution if it's possible (i just an analyst not a developer).
"As I haven’t looked at the second file yet, I haven’t decided how to determine what the primary key needs to be. With regard to using the filename, I haven’t seen an option in Data Academy for using the name of the file as a column in the resulting table. But even if there was such an option, the file that the data warehouse reads always has to have the same name, so the filename for every record would be the same. If I can’t come up with anything else, we may need to look at something like this but it would require further manual intervention by the user."
When I read this I assumed if it wasn't something the software (Data Acadamy) could do. The developers will be building a build routine that loads a flatfile into our datawarehouse but there is no identifier other then the filename which subsequently needs populating into the table we load the data into. Surely SQL could do this automated? I was thinking along the lines of importing filenames and dates into a small separate SQL table and then using the date criteria to start a Stored Procedure to populate the filenames and dates into the imported table.
Again I'm more used to writing reports than this part of it so just sounding out possible thoughts on different approaches.
↧
Download latest file from FTP server
Hi,
I’m connecting to a FTP site and downloading a zip file. A new .zip file is added every week. Here, I want to connect to the ftp site and download the .zip file which is recently added.
Please help me achieving this.
Thanks
↧
↧
Upgrade SSIS from 2014 to 2016 using SSDT for Visual Studio 2015 Enterprise
Trying to upgrade SSIS Packages that were created in VS 2013 SSDT for SQL Server 2014 to SQL Server 2016.
I installed Visual Studio 2015 and SSDT for VS 2015. When I open the Integration Project solution file and right click SSIS packages -> Upgrade Existing Package
there are no packages to select to upgrade. even though there are packages in the solution file. Any ideas ?
↧
Delete files older than 7 days old in a FTP
Hi,
I have a FTP and i have some files every day i send files with SSIS using FTP TASK what i want doing is if the files that i have in my FTP is OLD than 7 days i want to delete them .
Please can i help me how can i do it this using SSIS
Thanks for Help
Regards,
↧
OData - Service Document Location
Hi,
This my attempt at trying to use the Odata source in SSIS and need to specify the service documentation location. How do I create this from my SharePoint URL? There doesn't seem to be detailed anywhere in a clear fashion.
https://mycompany.sharepoint.com/sites/Lists/Portfolio%20Management%20Master/Portfolio%20Management%20Master%20%20Submitted%20By.aspx
Thanks
↧
Constraints in SSIS
Hi again!!!
This time I have problems with constraints!!
Part of my flow is going on a different path at one point to import an Excel .xls file or .xlsx file into SQL table, depending on what the user is selecting. Then the process continues the same way until the end.
My problem is with the constraint on both sides that point to the next common task. For some reason, the execution just stops...
The debug output is showing that the package finished successfully as if it was the end!
SSIS package "Load CriticalAndSRP.dtsx" starting.
Information: 0x4004300A at Load XLSX Data into StagingTable, SSIS.Pipeline: Validation phase is beginning.
Warning: 0x802092A7 at Load XLSX Data into StagingTable, Destination - tblStagingCriticalSRP [17]: Truncation may occur due to inserting data from data flow column "ENT-ID" with a length
of 255 to database column "OperatingEntityNumber" with a length of 9.
Warning: 0x80049304 at Load XLSX Data into StagingTable, SSIS.Pipeline: Warning: Could not open global shared memory to communicate with performance DLL; data flow performance counters are not
available. To resolve, run this package as an administrator, or on the system's console.
Information: 0x40043006 at Load XLSX Data into StagingTable, SSIS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at Load XLSX Data into StagingTable, SSIS.Pipeline: Pre-Execute phase is beginning.
Information: 0x4004300C at Load XLSX Data into StagingTable, SSIS.Pipeline: Execute phase is beginning.
Information: 0x402090DF at Load XLSX Data into StagingTable, Destination - tblStagingCriticalSRP [17]: The final commit for the data insertion in "component "Destination - tblStagingCriticalSRP"
(17)" has started.
Information: 0x402090E0 at Load XLSX Data into StagingTable, Destination - tblStagingCriticalSRP [17]: The final commit for the data insertion in "component "Destination - tblStagingCriticalSRP"
(17)" has ended.
Information: 0x40043008 at Load XLSX Data into StagingTable, SSIS.Pipeline: Post Execute phase is beginning.
Information: 0x4004300B at Load XLSX Data into StagingTable, SSIS.Pipeline: "component "Destination - tblStagingCriticalSRP" (17)" wrote 18 rows.
Information: 0x40043009 at Load XLSX Data into StagingTable, SSIS.Pipeline: Cleanup phase is beginning.
SSIS package "Load CriticalAndSRP.dtsx" finished: Success.
However, if I remove the same constraint on the other side, it's working!!!
Constraints:
Any idea why?
Mylene Chalut
↧
↧
Execute SQL Command vis SQL Task Editor with condition variable
This is so ridiculous... I am shy to ask!!!
I trying to call a SQL command using conditions. So I created a parameter mapping to map the variable that I will use as a condition:
I configured the properties as follow:
I tried the query without any parameter to test it and it was working fine:
Declare @LoadType
nvarchar(3)='CRI'
PRINT @LoadType
IF @LoadType ='CRI'
TRUNCATETABLE CriticalList.tblCriticalList
ELSEIF @LoadType='SRP'
TRUNCATE
TABLE CriticalList.tblStrategicResponseUnitList
Then I modified it to get the value of the variable mapped:
Declare @LoadType
nvarchar(3)= ?
PRINT @LoadType
IF @LoadType ='CRI'
TRUNCATETABLE CriticalList.tblCriticalList
ELSEIF @LoadType='SRP'
TRUNCATE
TABLE CriticalList.tblStrategicResponseUnitList
Error message:
Am I doing something wrong???
Mylene Chalut
↧
Pass Powershell Variable value to SSIS
Hi There.
I am new to SSIS and was wondering how I would pass a variable value used in the Powershell script to SSIS?
The folder path and filename of the variable $filename is already mapped within Powershell.
I need to use this variable in an Email which will be fired.
Please could someone guide me?
Many thanks in advance.
↧
Lookup with Dynamic
I have requirement where i have to look up using 7 input parameter . Out of 7 first for must match to the target but last 3 are more of a dynamic. If look up does not return with value requirement is to drop parameter and do another lookup and do this until you drop last three of below parameter and if not found conclude it not found. What would be the best way to do this in SSIS. Also this look up is in transnational table so when we do get a hit it may be multiple so we need ot order by ID and pick up the top one.
Input parameter
1. Event_Date
2. ProductCode
3. ProductInfoCode
4. Location ( May be available or may not)
5. InputParameter5 ( May be available or may not)
6. InputParameter6 ( May be available or may not)
7. InputParamter7 ( May be available or may not)
↧