Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS Package / Updating a Table with Dynamic Columns

$
0
0

Hi Everyone,

I have a SSIS Package that retrieves some tables from a SQL Server database and transfer it to a DB2/400 database.

However, there are two tables that I will need to handle a bit differently:

There will be certain fields, which I should use in case it is an "INSERT", but if it's an "UPDATE", few fields of that table should not be updated.

There's a table indicating to the SSIS Package which fields should not be updated.

Unfortunately I was not able to figure out a way how to do that. Do you have any advice for it?

I'm looking forward for your thoughts.

Thanks in advance, Rico


Scrubbing header data from Excel files

$
0
0

Hi
    I have an excel file with 10 columns of data which I want to transform into a table with 10 columns. But I want to skip the first 10 rows from the excel as it has the disclaimer. I can write a script which creates a new file from the source without the header, but does SSIS support loading of an excel while skipping some data?

Thanks

Mapping file to table does not set the default value in table

$
0
0

Hi,
     I am reading 5 columns from a file to 5 columns in a table. But the table also has a 6th column which is not null and default is set to Current_Timestamp. but the Transformation fails. Is there anyway I can achieve this?

If not, there is there a way I can add Current_Timestamp as the output of an imaginary column in the file?

Thanks

DTEXEC SQL Server 2012 in Solution Mode

$
0
0

I have a package that part of a SSIS 2012 Solution using the new solution model.

When I copy a single package to another location, or I try to execute a single package from the folder of the solution, I get many errors such as the connection manager cannot be found and variables using project parameters can not be found. Also, project connections can not be found.

At first I though I needed other files with the package such as the Project.params and the .conmgr files, but adding those to the same folder location does not stop the errors.

How do I execute a single package using DTExec or DTExecUI when using SSIS 2012 in Solution Mode?

Thanks,

Ryan


Ryan P. Casey • <a href="http://www.R-P-C-Group.com">www.R-P-C-Group.com</a>

did shared conn mgrs improve in 2012?

$
0
0

Hi.  As I recall under ssis 2008 shared connection mgrs across subpkgs in same project was a nightmare.  And we went back to adding them individually sub pkg by subpkg, of course passing config values down.

It looks like 2012 enterprise has a new look and I'm wondering if some of the old problems have been addressed and perhaps we should try using shared mgrs again.  My recollection is that a change in the previous release meant we had to visit each sub pkg individually unless we were ok without pre validation.  Does the new product offer any kind of incentive to try using shared mgrs again?  We already have a pretty good feel for the new project (etc) params and we like them.  We dont know how/if they'll play with conn mgrs.

where did my save button go

$
0
0
Hi.  I think I used to see a save icon in vs2010 ssis but must have accidentally made it disappear.  Right now I'm goin to file->save all.  How do i get it back?

component graphics no longer same size

$
0
0

Hi.  Is there a way under vs2010 /  ssis 2012 enterprise to have dragged component graphics show with the same size width and height.  Under 2008 dragged toolbox items all seemed to default to the same size visually.

Also, even after formatting them to same size etc, but then renaming them, they no linger stay same width even if new name is shorter.

Almost wishing one button that makes same width, aligns centers and makes vertical spacing equal was available.

Removing and readding package puts (1)

$
0
0

Hi,

How can we fix problem that anytime we remove a package from the project and we add it back, the solution puts            <packageName> (1).dtsx

What can we do that it doesn't add (1) everytime we remove and add package again?


IBM Signon Prompt

$
0
0

All,

I'm trying to troubleshoot connection issues with AS400 during the runtime by running the package (and not the job).

When I click on "Run Package" and execute it, I get the prompt "CWBSY0271 - No Password associated with the user profile". I would like to change this by chosing "Use Kerberos Principal Name, No Prompting".  But looks like this Runtime window does not show up once the choice is made the firsttime. Is there a way to invoke this window so that I could try different settings

-Rgn

IBM Singon Prompt

Cannot convert between unicode and non unicode string data type

$
0
0

Good Morning,

I have a simple sql query that gets the data from an ORACLE db and loads into the SQL Server db 2005. When i'm trying to validate the package i'm getting an error which says "Cannot convert between unicode and non unicode string datatype".

Solution: I used the data conversion transformation and i used the alias columns which are by default named as "copy_filed name". I changes the data types from DT_WSTR to DT_STR, but am still getting the same error message. Is there something that i'm doing wrong?

Thanks


SV

Pivoting Data: Unable to get Specific results using Pivot Task

$
0
0

Hi,

I am trying to pivot a table that looks like this: I am using Visual Studio 2012.



I need to pivot the record type into new columns. I tried using the Pivot Task but not getting the design results.

I am trying to get a result like this:



For Pivot Key I used the RecordType, Set Key UserID and Pivot Value:RecordName.

What am I doing wrong?

OG

multilingual text analytics

$
0
0

Could you please share me the good approach for doing multi-lingual text analytics,  In SSIS Term Extraction transformation works only on English language.

Thanks

Mayank 


Mayank Tripathi Sr Sql Developer


Bi directional MDS/ERP record updates

$
0
0

I am hoping someone can advise me on this.

I am working on synchronizing product information between Master Data Services and an ERP system using SSIS as the middleman. Products will primarily be added and modified in MDS, and this data will update the data in the ERP. I would, however, like to preserve the ability to update product records using the ERP interface when it is the most efficient means for the task. The updates made in the ERP system then need to update the corresponding records in MDS.  I was thinking of using Change Data Capture on the ERP tables to identify the record changes that need to be sent to MDS. What I am trying to figure out is, how do I keep updates originated from MDS and posted to the ERP tables from being flagged by Change Data Capture for update back to MDS?

Any advice would be appreciated.

 

Excel and Access import packages fail when running via job schedule Agent

$
0
0

I have a couple SSIS packages that run fine in SSIS development but fail due to ACE 12.0 issues when running as a scheduled job in the ss agent job scheduler. (Sql 2008 R2 - Windows 2008 64bit).

I am importing Excel data in one package and Access data in another package. I am considering moving to SS 2012. Will the issue go away? Suggestions?


Importing CSV Files using Microsoft SQL Management Studio into an SQL Server (2012 versions)

$
0
0

I have been trying to import very large CSV files onto an SQL Server using the Management Studio. I have tried using the flat file import, but this took 2 days to import approximately 7 million rows of data. I tried converting the csv files to .xls, but the Excel file import came back with an error saying that the file was not in the expected format. 

Is there something that I can do with the configuration of my SQL server or tools in the management studio to import data faster? 

*Note - The csv files are anywhere from 2.5 GB to 10 GB in size.

Thank you for any help you can provide


SSIS Date Conversion Failure regardles of validation methods

$
0
0

Hello my friends:

I have a column in a text-file with dates like this: 20131207. I and trying to convert the date like this but everything I have tried has failed.

Here is my code: I have modified it many times to fix this problem.

(LEN(TRIM(MyDate)) < 8) || (TRIM(MyDate) == " ") || 
(ISNULL(MyDate)) ? NULL(DT_DBDATE) : 
(DT_DBDATE)(SUBSTRING(TRIM(MyDate),1,4) + "-" + 
SUBSTRING(TRIM(MyDate),5,2) + "-" + SUBSTRING(TRIM(MyDate),7,2))
I checked Retain Null Values in the Flat Source Task.

Thanks!

Microsoft.ACE.OLEDB.12.0 is not registered error on SQLServer 2008

$
0
0

All,

We have a package that imports data from EXCEL File to SQLServer. The package by itself works fine when it is executed from the local workstation but fails from the server when it is executed from the job with the following error:

----------------------------------------------------------------------------------------------------------------------------

   Source: EvCanInterface Connection manager "Excel Connection Manager"
   Description: SSIS Error Code DTS_E_OLEDB_NOPROVIDER_ERROR.  The requested OLE DB provider Microsoft.ACE.OLEDB.12.0 is not registered. Error code: 0x00000000.
An OLE DB record is available.  Source: "Microsoft OLE DB Service Components"  Hresult: 0x80040154  Description: "Class not registered".

----------------------------------------------------------------------------------------------------------------------------

I inderstand why this is happening because the SQLServer Service and the Agent account runs off of a Windows Login that is not a domain admin and it might not have the necessary permissions. I checked the Temp folder and the login has access to this folder. The Service account is in the local Administrator's group (just as my id)

I also ran the following from SSMS with my id and it works fine.

SELECT * FROM OPENROWSET('Microsoft.ACE.OLEDB.12.0','Excel 12.0;Database=\C:\SourceFiles\Invest.xlsx', 'SELECT * FROM [SHEET1$]');

What am I missing?

How to neutralize default setting that directed to Dts config file

$
0
0

Hi All ,

I currently have a SSIS project , that uses SSIS package configuration directed to some dtsConfig file (C:\MyLocation ), default setting,

If i copy .dtsx file to test server, and execute it's dtsx package via Batch file contains (DTExec.exe util and /CONFIGFILE flag) that direct to new dtsConfig file located on server (T:\ServerLocation) , the executed package  still looking for old DtsConfig file located on C:\MyLocation.

How do I solve this, that Top priority will be for the /CONFIG flag setting of .bat file ?

Regards , Evgeniy.


vs 2010 cant find data provider for sql

$
0
0

Hi. We run 2012 enterprise with vs2010. I have inherited an hp elitebook w7 machine whose vs 2010 installation seems to have all the SSIS tool box items but complains when oledb connections are trying to be set up.  See  errors below.

I looked at the add in/macro security list and best I can tell is that its no surprise that add in files with the necessary info cant be found.  I see all the defaults in this list but when following them the best I can, dont see much in the way of addin files.

I tried a repair on vs 2010 only but that didnt help.  I used the original installer setup app that pc support used to set up my machine.  It appears to be a full blown sql server installer that includes vs 2010.

ERRORS:

When indicating conn mgr is new in edit mode on destination component in data
flow, "the new connection manager could not be created. Additional Information:
The DbProviderFactories section can only appear once per config
file".

When rt clicking in conn mgr tab and choosong new oledb conn, "The
new connection manager could not be created. Additional Information: Unable to
find the requested .Net Framework Data Provider. It may not be installed.
(System.Data)"

SSIS 2012 transfer child package variable values to parent package

$
0
0

Hi all, I have a master ETL package, where the first component in the control flow is a Execute Package task Get SFTP Files as below.


Get SFTP Files below

The variable mapping on the foreach container outputs ClientID.

I need to reference this ClientID in the rest of my package i.e. when this package finishes and goes back to ETL package

I want to reference it.  How do i import a variable/value from a CHILD package and use it in the PARENT package?  I have tried setting up a parent package variable in the CHILD package referencing ClientID but this doesn't seem to be transferring the value to the PARENT package.  Am i forgetting something?

*** UPDATE *** I'm using project deployment model so am unable to use Package Configuration.  How can you reference a globalID like a CompanyID between packages using the project deployment model?
Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>