Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

SSIS - Questions on Integration Service Catalog

July 27, 2015, 11:11 am
$
0
0

Hi All,

I have the following questions on Package Deployment using SSIS Catalog.

1. Can we deploy a single package in SSIS Catalog without affecting the other packages that are already deployed.

2. We created a package having lot of script tasks which was configured using SQL Server configuration table to pass the values from table to script variables. Now we need to use environment variable in place of Configuration table. If I do not use the Configuration from SSIS configuration table then I will not able to see any input parameters for the package to map them from environment variables.

Thanks,

Vishal Jharwade

↧
Search

Attunity CDC for Oracle dead tool replacemente

July 29, 2015, 9:30 am
$
0
0

As Attunity CDC for Oracle doesn't work with Oracle 12c PDB (pluggable data bases), and there are no plans AFAIK to update it, I think its a dead tool. So, does anybody know of a replacement tool to transfer changes from Oracle 12c PDB to SQL Server 2012 enterprise? As we bought Enterprise edition to use this Attunity external tool, are we tied to Oracle 10g and no pluggable databases?

Regards,
Pablo

↧
↧

Errors when running a package

December 19, 2013, 2:07 am
$
0
0

Hi,

I am deploying a very simple package to an MSSQL 2012 SP1 SSISDB catalog using an environment for the parameters. I got the package to run fine one time. After that I only get "Unexpected termination" errors while running the package.

In the eventlog of the server I see the following error:

Application: ISServerExec.exe
Framework Version: v4.0.30319
Description: The process was terminated due to an unhandled exception.
Exception Info: System.AccessViolationException
Stack:
   at Microsoft.SqlServer.Dts.Runtime.Wrapper.PackageClass.IDTSExecutable100_Execute(Microsoft.SqlServer.Dts.Runtime.Wrapper.IDTSConnections100, Microsoft.SqlServer.Dts.Runtime.Wrapper.IDTSVariables100, Microsoft.SqlServer.Dts.Runtime.Wrapper.IDTSEvents100, Microsoft.SqlServer.Dts.Runtime.Wrapper.IDTSLogging100, System.Object)
   at Microsoft.SqlServer.Dts.Runtime.Wrapper.PackageClass.IDTSExecutable100_Execute(Microsoft.SqlServer.Dts.Runtime.Wrapper.IDTSConnections100, Microsoft.SqlServer.Dts.Runtime.Wrapper.IDTSVariables100, Microsoft.SqlServer.Dts.Runtime.Wrapper.IDTSEvents100, Microsoft.SqlServer.Dts.Runtime.Wrapper.IDTSLogging100, System.Object)
   at Microsoft.SqlServer.Dts.Runtime.DtsContainer.Execute(Microsoft.SqlServer.Dts.Runtime.Connections, Microsoft.SqlServer.Dts.Runtime.Variables, Microsoft.SqlServer.Dts.Runtime.IDTSEvents, Microsoft.SqlServer.Dts.Runtime.IDTSLogging, System.Object)
   at Microsoft.SqlServer.IntegrationServices.Server.ISServerExec.ISServerExecutionEvents.StartPackage()
   at Microsoft.SqlServer.IntegrationServices.Server.ISServerExec.ProjectOperator.StartPackage()
   at Microsoft.SqlServer.IntegrationServices.Server.ISServerExec.ProjectOperator.PerformOperation()
   at Microsoft.SqlServer.IntegrationServices.Server.ISServerExec.ExecuteMain.Main(System.String[])

Anybody any idea what is causing this error? Another job on the same server (much more complex) is not experiencing these problems.

Regards,

Mark van Bree

↧

How to push data rows into third row of excel instead of first row

July 27, 2015, 12:32 pm
$
0
0

Hi,

I have data rows ( 7 rows and hundreds of colums) obtained by using execute sql task and i placed the output in CSV. Then I also moved this data in csv into excel (first row of excel)using simple data flow task with flat file source(CSV) and excel destination connections. However, I need to push data into 3rd row of excel sheet(I need to write some description and titles in  the first two rows) .I need to do this inorder to automate the process of producting the excel which has predefined pivot tables. I only need to update the excel sheet with raw data( 3rd row) which drives the pivot tables.How do I do this? How do i push into the third row instead of first?

Thanks in advance

↧

Resources to learn SSIS

July 29, 2015, 12:22 pm
$
0
0

Hello --

What are some best resources to learn SSIS ? I'm working as a dba but never worked on ssis in-depth, Im interested in becoming a BI developer/designer. I'm trying find some sort of gradual course (be that a book/online course/ streaming video)  to follow  rather than pick things up from different blogs/white papers etc and trying to avoid onsite training. Do you guys have any recommendations? thanks very much in advance.

Rezwan

↧
↧

SSIS lookup not working on nvarchar(4) column using FULL CACHE (SOLVED BUT REASON UNKNOWN)

July 30, 2015, 3:03 am
$
0
0

Hi all,

I'm currently loading a package that does a lookup on a column of data type nvarchar(4).

The values itself are (A+, A, B+, B, C, D, /). The strange lookup behaviour is happening for each of the cases, so it's not related to a specific value. 

After trying to put the cache on NO CACHE, the lookup works perfectly. When using the default FULL CACHE the strange behaviour happens. The information on google was somewhat helpful but I would like your opinion as well about this strange behaviour.

Has anyone had this before? Could it be related to the data type? I have not yet tried to use a CHAR instead of a NVARCHAR but it looks like people have similar issues using CHAR.

THanks for any tips!


↧

how to add rowcount in flat file header in SSIS

July 30, 2015, 3:17 am
$
0
0

Hi All,

I am facing a problem i just want total no row count and it should be show in header .So how can i do in SSIS

 Suppose 

eg. HeaderName , 3

data1

data2

data3

FooterName,3


↧

Dynamic SIS package changing source connection at run time

July 30, 2015, 3:13 am
$
0
0

Hi All,

I am in between of creating a dynamic SSSIS package which will run for multiple zones having different source connection.
My source is in Oracle.
I am having 3 DFT with the 3 different source tables.
I want to create a package with above DFT dynamically so that my single package can run for the entire zone with dynamically source connection change.
I have created a Master table which stores the zone source connection string and zone name.

As you can see that in above diagram for US I have 2 different connection , how to handle this 
so if in future any new zones come so only newly zone details need to be add in master table without opening the package.
Please suggest me the better approach to achieve the above scenario.

In attached file you can see the ETL package design


Thanks & Regards,
Vipin Jha 

Thankx & regards, Vipin jha MCP

↧
Search

Metadata auto-syncup in SSIS

July 30, 2015, 5:21 am
$
0
0

All,

We have developed a few SSIS packages using SSIS-2012 to load data into an OLTP system. This is basically a migration project. The problem over here is that, new fields are being added into OLTP system very frequently. So our ETL's are failing due to metadata issues: -

"TASK NAME" failed validation and returned validation status "VS_NEEDSNEWMETADATA".

This is quite obvious because the target's metadata is changed. Right now we are manually open each and every package and sync up (Open the destination, click on mappings and click OK on the mapping screen) the changes.

There are quite a few packages and its become an hectic task to manualy syncup these changes.

Is there any automated way to sync up the ETL's with metadata? Or is there any option in SSIS to choose only selected columns in target and map it to source?

For instance - lets say when we were developing the package, there were 10 fields and we have mapped these 10 fields. The ETL is working fine. Later two more new fields are added to target, now our ETL's will fail stating metadata issues. Until we open the package and sync with DB, this error wont be gone. Can we make the sync up automated so that the new fields are mapped to <ignore>?

Thanks.

↧
↧

build output of dtproj

July 28, 2015, 8:16 am
$
0
0

Hi,

I have a SSIS project (.dtproj) and I'm trying to build the .ispac file from the command file using Visual Studio 2012/2013. The VS output is something like this:

------ Build started: Project: testCmd2013, Configuration: Development ------
========== Build: 1 succeeded or up-to-date, 0 failed, 0 skipped ==========

But if I build the solution from the VS GUI the output window displays:

------ Build started: Project: testCmd2013, Configuration: Development ------
Build started: SQL Server Integration Services project: Incremental ...
Starting project consistency check ...
Project consistency check completed. The project is consistent.
File 'E:\Custom\testCmd2013\testCmd2013\obj\Development\testCmd2013.dtproj' get updated.
testCmd2013 -> E:\Custom\testCmd2013\testCmd2013\bin\Development\testCmd2013.ispac
Build complete -- 0 errors, 0 warnings
========== Build: 1 succeeded or up-to-date, 0 failed, 0 skipped ==========

As you can see the Visual Studio is removing a lot of information from the output when it's used from command line (VS2010 doesn't have this behavior).

Do you have any idea how to get all log information in the command line output?

VS2013 12.0.40629.00 Update 5

SSDT 12.0.50717.

SSIS Designer 12.0.2430.0

Daniel

↧

A very weird problem, SP runs fine in SSMS but failed in Execute SQL task, all parameters checked ok

July 29, 2015, 6:57 pm
$
0
0

hi folks:

 I ran into a very weird problem and I can't figure out where it went wrong. There is one SP with parameters varchar, int, varchar and int. It runs perfect in SSMS. Now, I've moved into a Execute SQL task with four IN parameters. In parameter mapping, data type is varchar, long, varchar, long and parameter name is 0,1,2,3. It worked before which is great. Today, I opened this pkg for another testing but failed with the following error:

failed with the following error: "Incorrect syntax near ';'.". Possible failure reasons: Problems with the query, "ResultSet" property not set correctly, parameters not set correctly, or connection not established correctly.

I know SP is fine as tested in SSMS.  I could not understand where it could go wrong in the ssis package. 

thanks

--Currently using Reporting Service 2000; Visual Studio .NET 2003; Visual Source Safe SSIS 2008 SSAS 2008, SVN --

↧

DB Server and SSIS Server on different machine

July 30, 2015, 6:28 am
$
0
0

Hi Experts,

After reading two links I am little confused and please clarify my doubt.

As per this link http://blogs.lessthandot.com/index.php/datamgmt/dbprogramming/mssqlserver/when-is-dtexec-installed/, we can execute packages only when we install Integration Services (DTEXEC works only after that).

As per this link https://msdn.microsoft.com/en-us/library/bb522532(v=sql.105).aspx, we can execute packages from DB Server if integration services is not present on same machine and packages will execute from server from which they were started (i.e. DB Server via job).

My scenario, I have DB server installed on machine A and SSIS server on machine B. I am creating sql agent job on machine A and pointing to packages stored in file system on SSIS server B. My confusion is since we did not install integration services on machine A (DB Server), how packages execute from here? Will the packages run from server A but use DTEXEC of server B? If I am not wrong SQL Agent Job also uses DTEXEC to execute the package so how does it work without integration services installed? 

Thank you in advance!

↧

Script Question

July 28, 2015, 10:32 am
$
0
0

I saved an SSIS package that was straight forward import a table from a local access database into a table with the same name in SQL Server using the Wizard in SSMS.  Is it possible to have that package drop the table if it exists before import?


↧
↧

Lookup with full cache warning

July 28, 2015, 6:50 pm
$
0
0

I am using a lookup and full cache, occasionally i get this warning:

[Lookup [150]] Warning: The component "Lookup" (150) encountered duplicate reference key values when caching reference data. This error occurs in Full Cache mode only. Either remove the duplicate key values, or change the cache mode to PARTIAL or NO_CACHE.

Now I know it is only a warning but it is highlighting a real issue.

Is there a way of capturing that this has happened?

↧

Excel 255 character limit - field already DT_NTEXT

July 30, 2015, 7:24 pm
$
0
0

Something you would have thought would be changed by 2015 but then we are talking Microsoft and their "do something and leave everyone to figure out workarounds for what we should have done in the first place"-ethos

Right, so I'm trying to import an Excel file with some columns > 255 characters. I have seen many posts on this but can't find the wheat from the chaff. By default, we have our driver set with "IMEX=1" which is one of the workarounds and I noted that my source Excel component was registering the "External Columns" as DT_NTEXT which is meant to be what setting the TypeGuessRows was to assist with resolving. I have also updated the "Output Columns" to be NTEXT and when running, these columns are marked as "<Long Text>" but after passing through a conversion, they are still truncated.

Although my fields were marked as DT_NTEXT, I gave the TypeGuessRows adjustment a go but to no avail, I also tried seeing what the import wizard in SSMS did but in its "wiseness" it marks the source columns as varchar(255) and I couldn't see a way to change that.

Does anyone know of any other option to try? I'm on the verge of saving to CSV files but that means a manual intervention required any time we get this feed so would prefer to be able to drop and run

↧
Search

Convert String DT_WSTR package level variable @User::FileNumber to Int (DT_I4)for arithmetic operations.

July 30, 2015, 8:30 pm
$
0
0

Problem:

Casting expression DT_WSTR to DT_I4 failed!

Bit of Background:

I have a string (DT_WSTR) user variable named @User::FileNumber at package level scope which in turn is used in a ForEach loop in Variable Mappings.This variable basically returns file number = 1,2,3,4….15. which I am using in a faltfile connection string variable to dynamically create the output file name: Test_Extract_File_1_20150731100000.txt

Here is the Flatfile Connection String assigned to the [GetDynamicFilename] variable:

@[User::Output_Path] + "\\Test_Extract_File_" +@[User::FileNumber]+"_"  + replace((DT_WSTR, 10) (DT_DBDATE) GETDATE(),"-","") + "100000" + ".txt"

What I would like to do is amend this connection string so that@User::FileNumber  is added to “100000” in the file name. i.e. new output file name format should be: Test_Extract_File_20150731100001.txtwhere we need file number returned via @User::FileNumber added with “100000” Eg: if @User::FileNumber =12 then “100000” + 12 = 100012 thus the new filename should beTest_Extract_File_20150731100012.txt.

Thought I could achieve this by creating another variable named:User::Derive_FileNumber of type int to perform the above addition and then update the flatfile connection string as follows:

@[User::Output_Path] + "\\Test_Extract_File_" + @[User::FileNumber] +"_" + replace((DT_WSTR, 10) (DT_DBDATE) GETDATE(),"-","") +(DT_WSTR, 10) @[User::Derive_FileName]  + ".txt"

But User::Derive_FileNumber of type int is not doing what I need!

Here is the expression for this variable where I want “100000” added with file number User::Derive_FileNumber

(DT_I4) "100000" +  @[User::FileNumber]  -- understandably fails because differing datatypes

Also tried variation of this by explicit casting but no good!

(DT_I4) "100000" + (DT_I4)  (ISNULL(  @[User::FileNumber]) ? "0" : @[User::FileNumber])

 it’s giving me casting error saying: Cast expression DT_WTSR to datatype DT_I4 failed.

Help, thanks.



↧

multiple flat flies create 1 zip file

July 23, 2015, 1:04 pm
$
0
0
I have a requirement where I will be receiving multiple flat files in a folder, I need to create 1 zip file and drop it into another folder. How can I achieve this using SSIS ?

MBH

↧
↧

SSIS: How to load 2 different excel files to 2 different tables?

July 28, 2015, 11:18 pm
$
0
0

Hi All,

I'm new to SSIS. I have 2 different excel files file1 and file2. file1 should be loaded to table1 and file2 should be loaded to table2. Both of the files will have 1 sheet inside. Do I need to create separate excel source for file1 and file2? I mean file1 in one excel source and that will be connecting to 1 execute sql task. file2 in other excel source and that will be connecting to another execute sql task. Is this the way I should proceed or is there any looping should be done?  I need to schedule this activity to run every week. So, I'll get new files every week with the same file names and sheet names. Do I need to consider anything for this requirement also?

I'm planning to do truncate and reload not an incremental load.

Please help me on this. It would be great if you can give me a step by step solution for this since I'm new to this.

Regards,

Julie

↧

Problems connecting SSIS package with MySQL

July 30, 2015, 9:04 pm
$
0
0

Hi,

  I'm having problems accessing MySQL from SSIS using SQLServer 2012 and Visual Studio 2012 for bids.

I have created both 64 bit and 32 bit ODBC drivers version 5.2 and I can make RDP calls to the MySQL Server through a linked server on the 64 bit ODBC connection successfully.  However when I use the 32 bit ODBC connection through BIDS while building a package I get MySQL meta data may be corrupt errors. and the package will not build.

Are there any known issues ?  I don't know the MySQL version, but being on an amazon cloud database I would expect it to be the current version.

Also how can I run a stored procedure on MySQL that returns a record set and use it as a data source in a BIDS data flow ?

Peter

↧

Source DB could be on Oracle or Sqlserver - which connection manager is suitable for this

July 30, 2015, 11:57 am
$
0
0

Hi,

Working on ETL for a source system that may be deployed in Oracle ,Sqlserver, H2 or Mysql. For now we are addressing Oracle and Sqlserver (since there are no customers yet on H2 and My SQL). OLE DB connection seems to perform better than ODBC, if there a way to use OLE DB connection and dynamically alter the connection string at run time to connect to Oracle or Sql. What is the best and simple way to achieve this.

Thanks,

lm

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>