Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Excel to SQL data import- Order of rows is not correct

$
0
0

Hi,

I am loading the data from EXCEL to SQL.

I have created a simple data flow task to do this.

But SSIS is not loading the data in the same order as in the EXCEL sheet.

Is there any way to do this with out changing the structure of the Source Excel sheet.

Thanks


Extract data from website?

$
0
0

Hi Experts,

I am wondering if there is a solution to extract data from a website?

I do have a website where I would need specific field values extracted from the website.

Can anyone please suggest where to start?

Thanks in advance.

file processing

$
0
0

Hello,
The ssis package is to process incoming .csv files.
In the package I start with a script task to read the file and one line at a time to insert into an initial table. At present I do not do any column value validations for correct datatype, missing values, etc. so I just insert one row at a time into initial table.
There are validation tables which hold the datatypes, isnull, etc. for the values of the files coming in...

I now would like to check the validity of the data coming in, i.e. is it good/bad data, check datatypes, missing columns, etc.

So at this stage I have the data into an initial table which has say columns 1-10...
This kind of task for validation, should it be done in the script as the data is coming in and compare to the validation tables or now that I have the data inside the initial table using a script, should I use t-sql to do validations on data and compare to the validation tables...

So to summarize my question:

1-
Should the validation of the data be done inside the script task or a stored proc (SP) to read the file datat which is now in an initial table? I feel a SP is a good place for this instead of script task...

2-
Is it a good idea to first do a bulk insert of the file contents into a one column varchar(max) table and then let script task to read the varchar(max) column and process each line and each column in the varchar(max) column against the validation tables and then insert into destination tables?

Thakn you

Convert Aug16 to 201608 in SSIS

$
0
0

Hi,

How can i convert Month Year combination like Aug16, Sep16 to 201608,201609 etc in SSIS?

Thanks

Syed Faiz

Error deploying SSIS package to SQL Server

$
0
0

I am getting strange error on deploying ssis package to SQL Server.

TITLE: Package Installation Wizard
----------------------------------------

Could not save the package "C:\Documents and Settings\Administrator\My Documents\Visual Studio 2005\Projects\Integration Services Project1\Integration Services Project1\bin\Deployment\DataTrans.dtsx" to SQL Server "(local)".

----------------------------------------
ADDITIONAL INFORMATION:

The SaveToSQLServer method has encountered OLE DB error code 0x80004005 ([DBNETLIB][ConnectionOpen (PreLoginHandshake()).]Encryption not supported on SQL Server.).  The SQL statement that was issued has failed.


----------------------------------------

The SaveToSQLServer method has encountered OLE DB error code 0x80004005 ([DBNETLIB][ConnectionOpen (PreLoginHandshake()).]Encryption not supported on SQL Server.).  The SQL statement that was issued has failed.


----------------------------------------
BUTTONS:

OK
----------------------------------------

=====================================================
=============================================

Could not save the package "C:\Documents and Settings\Administrator\My Documents\Visual Studio 2005\Projects\Integration Services Project1\Integration Services Project1\bin\Deployment\DataTrans.dtsx" to SQL Server "(local)".  (Package Installation Wizard)

=============================================

The SaveToSQLServer method has encountered OLE DB error code 0x80004005 ([DBNETLIB][ConnectionOpen (PreLoginHandshake()).]Encryption not supported on SQL Server.).  The SQL statement that was issued has failed.


----------------------------------------
Program Location:

   at Microsoft.SqlServer.Dts.Runtime.Application.SaveToSqlServer(Package package, IDTSEvents events, String serverName, String serverUserName, String serverPassword)
   at Microsoft.SqlServer.Dts.Deployment.DtsInstaller.SavePackageToSqlServer(WizardInputs wizardInputs, String packagePassword, Boolean bUseSeverEncryption, String serverName, String userName, String password, String packageFilePath, List`1 configFileNames)
   at Microsoft.SqlServer.Dts.Deployment.DtsInstaller.InstallPackagesToSqlServer(WizardInputs wizardInputs)

=============================================

The SaveToSQLServer method has encountered OLE DB error code 0x80004005 ([DBNETLIB][ConnectionOpen (PreLoginHandshake()).]Encryption not supported on SQL Server.).  The SQL statement that was issued has failed.


----------------------------------------
Program Location:

   at Microsoft.SqlServer.Dts.Runtime.Wrapper.ApplicationClass.SaveToSQLServer(IDTSPackage90 Package, IDTSEvents90 pEvents, String ServerName, String ServerUserName, String ServerPassword)
   at Microsoft.SqlServer.Dts.Runtime.Application.SaveToSqlServer(Package package, IDTSEvents events, String serverName, String serverUserName, String serverPassword)

Sql Server Agent

$
0
0

Hi guys, 

In sql server agent I am calling 6 ETL Packages in one job 

For each of the steps I have specified go to next step in case of Step successful andQuit the job in case of Step failure

In case my steps from 1-4 are succesful but my 5 step is a failure then will the data imported via step 1- 4 (ETL Packages)

be rolled back ?

If no, then how can I achive that all the steps taken from 1-4 should also roll back, if my next step is a failure?

Thanks in advance



Calling Web API through SSIS 2012

$
0
0

Hi,

I just like know if there's a way to call a Web API from an SSIS 2012 package?  I found a paid 3rd-party extension called ZappySys but I'm looking for a free one. 

If there is, would you mine sharing some examples.

Many thanks.

Issue with reading file from FTP with sql jobs

$
0
0

Hello Experts,

Warm greetings,

I have FTP server with some Excel files when i run them manually (By logging into agent account (with agent user id and agent password)),I can successfully run the package but when i run it from sql server jobs ( agent account which has same id and password) its being failed

how to over come this.I have all access set to agent account 

Thanks in advance


ADKR


Idiots Step by Step guide needed

$
0
0

I have been trying for ages to get a SSIS package to print a PDF report to the network server.

Creating the package in VS a simple script task

        Dim pdfFileName As String = "\\Server\Directory\Test.PDF"
        Dim PrintPDF As New ProcessStartInfo
        PrintPDF.UseShellExecute = True
        PrintPDF.Verb = "print"
        PrintPDF.WindowStyle = ProcessWindowStyle.Hidden
        PrintPDF.FileName = pdfFileName
        Process.Start(PrintPDF)

this works fine when running from vs. When I deploy it to the SQL server and execute it as a domain administrator, everything reports no errors .. but no print !

The domain administrator has access to the printer and directory where the PDF is located. I am a loss as what to do next with my limited experience. Looking in the SSIS Package history, it reports that the package was executes as the domain controller .. and all was successful .. but no print

Can anybody help, or give idiot instructions for a different way to achieve this.


Dont ask me .. i dont know

SSIS Connect to AS400 using OLE DB Provider for DB2

$
0
0

I am attempting to connect to DB2/AS400  using  MS Ole DB Provider for DB2.  Below are my settings but i am getting following error in quotes. Any one know what is the issue here ?  Do i need to setup anything on AS400 side before connecting to it ? i am able to connect with ODBC driver without any issue with same user name and password.   

"

Connecting...
Package creation failed:
An internal network library error has occurred. A network level syntax error has occurred.

"

Affiliate Application
Alternate TP Name
APPC Local LU Alias
APPC Mode Name              QPCSUPP
APPC Remote LU Alias
APPC Security Type          Program
Auth Encrypt    False
AutoCommit     True
Cache Authentication        False
Client Application Name 
Connection Pooling          False
Data Source                 IP of AS400 (1.1.1.1.)
DateTime As Char            False
DateTime as Date            False
DBMS Platform               DB2/AS400
Default Qualifier
Default Schema              (schema name ) Part one of two part table name form AS400.
Defer Prepare               False
Derive Parameters           False
Extended Properties  
Host CCSID                  37
Initial Catalog             Same as Data Source (1.1.1.1) 
Integrated Security
Mode                        ReadWrite
Network Address         Same as Data Source (1.1.1.1) 
Network Port                446
Network Transport Library   TCPIP
New Password
Package Collection          QGPL –Found this on the internet . Do I need to have AS400 admin have something done for this ? 
Password                    **********
PC Code Page                1252
Persist Security Info       False
Principle Name
Process Binary as Character True
Rowset Cache Size           0
Units of Work               RUW
Use Early Metadata          False
User ID                     MYSQLSA


MS DB2 Provider (DB2OLEDBv4) connect to IBM DB2 AS400 V7R1

$
0
0

I am trying to connect to IBM AS400 iSeries version 7.1 using DB2OLEDBv4 in SSIS2012 but i am getting below message.  Below are all my settings can someone help with this issue.  I am not sure what i am missing. I read the documentation for the DB2OLEDBv4 and it does support AS400 vs 7.1 . 

I have put "QGPL" in Package Collection property which i found on the net. Does anyone know what should go there.

Affiliate Application
Alternate TP Name
APPC Local LU Alias
APPC Mode Name              QPCSUPP
APPC Remote LU Alias
APPC Security Type          Program
Auth Encrypt    False
AutoCommit     True
Cache Authentication        False
Client Application Name 
Connection Pooling          False
Data Source                 IP of AS400 (1.1.1.1.)
DateTime As Char            False
DateTime as Date            False
DBMS Platform               DB2/AS400
Default Qualifier
Default Schema              (schema name ) Part one of two part table name form AS400.
Defer Prepare               False
Derive Parameters           False
Extended Properties  
Host CCSID                  37
Initial Catalog             Same as Data Source (1.1.1.1) 
Integrated Security
Mode                        ReadWrite
Network Address         Same as Data Source (1.1.1.1) 
Network Port                446
Network Transport Library   TCPIP
New Password
Package Collection          QGPL –Found this on the internet . Do I need to have AS400 admin setup something on AS400 FOR this ? 
Password                    **********
PC Code Page                1252
Persist Security Info       False
Principle Name
Process Binary as Character True
Rowset Cache Size           0
Units of Work               RUW
Use Early Metadata          False
User ID                     MYSQLSA


SSIS 2012 Flat File Source - Retain null values does not work for missing fields

$
0
0

I have a data flow task that imports a csv flat file to SQL Server and the option "Retain null values from the source as null values in the data flow" is checked.  The connection manager for the file defines 5 string fields.  If I process a file that has all fields defined, then any empty fields are imported as NULL, which I would expect.  But if I receive a file with the trailing fields not defined with comma placeholders, then those fields are loaded as empty strings.

Example:

File 1 has this record:

F1,F2,F3,,

Fields 4 and 5 are loaded as NULLs, which they should be.

File 2 has this record:

F1,F2,F3

In this case, fields 4 and 5 are loaded as empty strings even though Retain Null Values is checked.   To load the fields as NULL, I have to create derived columns that translate empty strings to NULLs, which defeats the purpose of the Retain Null Values option. 

I'm not sure if this is a known issue or if a fix is planned, but it would be nice.

Thanks,

Tom

Move SSIS packages for old server to old server

$
0
0
I am using SQL 2012. I am using SSIS DB catalog. I have so many SSIS packages. I need to move a few of them to the new server. What would be the best/easiest way to move SSIS packages from one server to another server.  

Data Driven Operational Data Store ETL ?

$
0
0

I'm just wondering if there's a feature in SQL Server or SSIS where we feed a list of Tables to from source into destination database.

It will create the table in the destination database base if it doesn't exist other wise it will just try to merge the data base on the last modified date  or the primary key specified.

So the only data needed for this process are below

  1. Source DB
  2. Destination dB
  3. Table
  4. Primary Key Name
  5. Modifed Datetime Name

It will be better it it has options for full change tracking and etc.

File System Task Editor closes when selecting DestinationVariable

$
0
0
I've set up a File System Task to move a file. I set IsDestinationPathVariable to True. When I click inside the DestinationVariable value column and either click the drop-down arrow or hit the up/down arrow keys on my keyboard, the File System Task Editor window closes immediately. In the same task, I have also set IsSourcePathVariable to True and am able to select SourceVariable without an issue. If I set IsDestinationPathVariable to False, the DestinationConnection drop-down appears to work fine. I've tried restarting Visual Studio, but it had no effect.

SSIS Package Installation Wizard Error

$
0
0

I created packages in BIDS 2008 and trying to deploy to Sql Server 2008 R2, i'm running into errors when selecting the folder for SSIS package dependencies.

Storing or modifying packages in SQL Server requires the SSIS runtime and database to be the same version. Storing packages in earlier versions is not supported.

I could deploy to File System but not to Sql Server. How to resolve this error?

Migrating DTS to SSIS

$
0
0

Hi

I want to migrate mt dts to ssis , what is equivalent for DPT in ssis?

thanks

Loading data from Oracle DB link

$
0
0

Dear Team,

We are doing a feasibility study of loading data from Oracle DB link as a source to push the data.

We are not familiar with DB link, can you pls give some idea. Or any example or articles which explains on this.

Br,

Shamsuddeen

How to copy multiple tables from ingres database to sqlserver database ?

$
0
0

I have an ingres (source) database from which multiple (300+) tables must be copied to sql server 2008 R2 (destination) database.

What is the best way to achieve this using SSIS or any other way ? and How ?

Please provide any code examples, if possible.


Thanks
Bhanu.

Can SSIS insert data into an Amazon Aurora instance?

$
0
0
I have been unsuccessfully trying to insert into an Aurora database. Is this supported?
Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>