Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

SSIS and SSDT

July 26, 2014, 2:41 pm
$
0
0

Hi to all,

I installed on my pc SQL Server 2012 express and Sql Server management studio.

I want use the Microsoft ETL tool for practice and learning purpose.

Googling on internet I read that the approaches for ETL development in SQL Server 2012 is SSDT (SQL Server Data Tool) which replaces the BIDS (Business Intelligence Development Studio).

What I understood reading on internet is that SSDT and BIDS are client side tool for develop/build  packages/etl processes and the Server side program to run them is SSIS (SQL Server Integration Services) integrated in SQL Server.

Now, what I want ask to you is if there exists an express edition of SSIS and SSDT to learn a Microsoft ETL tool.

thanks


↧
Search

How to convert string to integer datatype in SSIS Derrived Column

September 29, 2014, 7:05 am
$
0
0

Hi friends ,

my source table column is varchar(50) i need to convert this to integer datatype using derrived column inside expression .

Can you please help me foe expression.

Thanks.

↧
↧

How to Import Data from Twitter Using SSIS 2012

September 29, 2014, 7:21 am
$
0
0

I'm working on the social media project. I'm interested in getting data from Twitter & importing into SQL Server database. I've googled for a while; however, I've not found anything hands on. 

The closest solution can be found here;however, it uses old API.

Please advise.

↧

How do I import a SPSS .sav file into SQL 2008 r2 using SSIS

September 29, 2014, 4:31 am
$
0
0

Hi there,

Like the title says, I'm trying to import an SPSS .SAV file into an SQL 2008 R2 database using SSIS.
I've tried a few things, but i cant seem to get it to work properly. I'm hoping there's someone out there who could point me in the right direction.

I've tried the following:

  • Tried the IBM step by step manual (http://pic.dhe.ibm.com/infocenter/spssdc/v6r0m1/index.jsp?topic=%2Fcom.spss.ddl%2Faccess_odbc.htm)
    --Couldnt folow this guide because I didnt have the SPSS MR DM-2 OLE DB Provider.
  • Tried installing the provider using (http://pic.dhe.ibm.com/infocenter/spssdc/v7r0m0/index.jsp?topic=%2Fcom.spss.ddl%2Fdts_troubleshooting.htm) as a guide to download the provider listed (www-03.ibm.com/software/products/nl/spss-data-model).
    --This didnt work, I still could not see the provider listed after install and rebooting the server.
  • Tried to get the file as CSV (Company couldnt provide it in CSV or another format)

The server is a Windows Server 2008 R2 Enterprise 64-bit, has the Data Collection Data Model installed on it with SQL Server 2008 R2.

If anyone could point me in the right direction they could make my day!

Thanks in advance!

Ronny




↧

Connection Manager, variable scope problem

September 29, 2014, 5:45 am
$
0
0

Hello,

I'm editing an SSIS package to allow for parallel execution of child packages. It's implemented like explained here, but that's not so important. 

Everything is working well, except for one problem. 

We use the Execute Package Task to execute the child packages. It uses the File Connection Manager in the package. Which has variable "User::PackagePath" mapped to it'sConnectionString. That variable is scoped at package-level since the File Connection Manager needs it. Every parallel task overwrites that variable before executing the package.

That's the problem! Since the tasks run in parallel, they might overwrite that package-level scoped variable at the wrong moments. (for example: parallel task 1 is getting ready to execute so it set the "User::PackagePath" variable, but before it gets a chance to execute, parallel task 2 is also getting ready so it overwrites the "User::PackagePath" variable. This causes both tasks to execute the second package while the first one is skipped)

I figured: let's change the scope of the variable so that it's inside the parallel task. But then the File Connection Manager can't get to it. 

I hope my problem is clear. Anybody have any ideas?

One solution would be to add a Connection Manager for every parallel task. But I'm hoping that's not needed. 
Another solution would be, to forget about the Execute Package Task... and just execute the package from a script using the properly scoped variable. But this causes issues with child package configuration, since it gets values from the parent package. Also not sure what happens with logging in this case.

↧
↧

While getting the data from Excel Source

November 28, 2011, 6:50 pm
$
0
0

Hi,

I have source EXCEL with 15 columns, in this i need 7 columns only while extratcing data from excel file

how can we achieve this,plz help me

 

Regards

Mallis

 

↧

General Guidance Using SSIS Full Result Set

April 11, 2014, 8:21 am
$
0
0

New to SSIS & SQL and need guidance for:

1) Read SidMap table on server1 to full result set variable SidMap

2) Loop through rows of SIDMAP and set variables to be used in updating tables containing null SIDS on 5 servers

Steps I've taken:

1)  Create SQL Task (GetSidMap) to get SidMap rows from server1 and store in object type variable in Full Result Set (works)

2)  Create For Each Loop container with constraint from SQL Task GetSidMap and set ForEach ADO Enumerator to SidMap variable

3) Added 5 SQL Tasks to container, 1 for each server to be updated  (and now I'm stuck.  Don't know if I'm on the right track and if I am where to go with it)

The SQL code I use to perform this update uses a cursor that I execute on each of 5 servers to perform update.  I'm new to SQL too so it may not be most elegant code but here it is.  I want to populate these variables from columns in SidMap and perform update.

 SET NOCOUNT ON
DECLARE MyCursor CURSOR FOR
SELECT
       [MSchema]
      ,[MTable]
      ,[MSIDColumn]
      ,[MIENColumn]
      ,[SPVTable]
      ,[SPVIENColumn]
      ,[SPVSIDColumn]
  FROM Server1.Schema.SidMap C  -- Will actually be on 81 box ETL.R04_BislTeam.SidMap

OPEN MyCursor

DECLARE @MSchema VARCHAR(100), @MTable VARCHAR(100), @MSIDColumn VARCHAR(100), @MIENColumn nvarchar(max), @SPVTable nvarchar(max), @SPVIENColumn nvarchar(max), @SPVSIDColumn nvarchar(max)
DECLARE @sql NVARCHAR(MAX)='';

FETCH FROM MyCursor INTO @MSchema, @MTable, @MSIDColumn, @MIENColumn, @SPVTable, @SPVIENColumn, @SPVSIDColumn
WHILE @@FETCH_STATUS=0
BEGIN    
            SET @sql = 'while 1=1 '
            SET @sql = @sql +     ' begin '
            SET @sql = @sql +     ' Update top (10000) A '
            SET @sql = @sql +     ' Set A.' +@MSIDColumn +' = IsNull(B.'+@SPVSIDColumn + ', -1) '
            SET @sql = @sql +     ' From ' + @MSchema + '.' + @MTable +' A '
            SET @sql = @sql +     ' Left Join ' + @SPVTable + ' B on  '
            SET @sql = @sql +     ' A.Sta3n = B.Sta3n and A.' + @MIENColumn +'= B.' + @SPVIENColumn
            SET @sql = @sql +     '  where A.' + @MSIDColumn + '  Is Null'
            SET @sql = @sql +     ' IF @@ROWCOUNT = 0 BREAK'
            SET @sql = @sql +  '    end'
    
exec sp_executesql @sql
--print @sql    
    
    FETCH FROM MyCursor INTO @MSchema, @MTable, @MSIDColumn, @MIENColumn, @SPVTable, @SPVIENColumn, @SPVSIDColumn
END

CLOSE MyCursor
DEALLOCATE MyCursor

↧

SSIS: Change Code page UTF-8 65001 to 1252 ANSI

September 29, 2014, 12:30 pm
$
0
0

Hi,

I have created package to load data from csv file to SQL Server 2008.

Created flat file connection to csv file.

The flat file connection default code page is showing as 65001.

but I want code page 1252. so I changed it to 1252. but when again open flat file connection it is defaulting to 65001.

I don't to be like that.

Please help on this.

Thanks & Regards Prasad DVR

↧
Search

Sending an email from SSIS gets an error.

September 29, 2014, 12:50 pm
$
0
0

"Mailbox unavailable. The server response was: 5.7.1 Client does not have permissions to send as this sender".

How do I resolve this issue?

Thank you.
↧
↧

How to get the variable value in a flatfile

September 29, 2014, 12:43 pm
$
0
0

I have some 2 line string in a variable I wanted to see this value in a flat file.

Thanks,

Narthan

↧

Fail to start project

July 10, 2014, 8:37 am
$
0
0

Hi, everyone

When I click start to run the project, there is a error message: 

Failed to start project

------------------------------
ADDITIONAL INFORMATION:

Method not found: 'Boolean Microsoft.SqlServer.Dts.Design.VisualStudio2012Utils.IsVisualStudio2012ProInstalled()'. (Microsoft.DataTransformationServices.VsIntegration)

I installed vs2012 iso and integrated, my version is 11.0.5058.0.

Any help appreciate.

↧

Error while reading rows from Teradata using ADO.NET as data source

September 29, 2014, 5:07 am
$
0
0

I Get this error message when I try to run the ssis package. Can any body how to solve this error

[ADO NET Source [2]] Error: Teradata.Client.Provider.TdException (0x80004005): [.NET Data Provider for Teradata] [100038] Command did not complete within the time specified (timeout).
[Teradata Database] [3110] The transaction was aborted by the user.
[Socket Transport] [115003] The receive operation timed out. ---> System.Net.Sockets.SocketException (0x80004005): A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond
   at System.Net.Sockets.Socket.Receive(Byte[] buffer, Int32 offset, Int32 size, SocketFlags socketFlags)
   at Teradata.Client.Provider.WpTcpTransport.ReadLanHeader(Buffer buffer, Int32 timeout, Int32 readBytes)
   at Teradata.Client.Provider.WpTcpTransport.ReadLanHeader(Buffer buffer, Int32 timeout, Int32 readBytes)
   at Teradata.Client.Provider.WpTcpTransport.Receive(Buffer buffer, Int32 timeout)
   at Teradata.Client.Provider.WpSession.Receive(Buffer buffer, Int32 timeout)
   at Teradata.Client.Provider.WpMessageManager.Receive(Int32 timeout)
   at Teradata.Client.Provider.WpStartRequestManager.Action()
   at Teradata.Client.Provider.Request.ExecuteStartRequest(String commandText, TeraTypeBase[][] parameters, ExecutionMode executionMode, Boolean asynchronous, Boolean isTrustedRequest)
   at Teradata.Client.Provider.TdCommand.ExecuteRequest(CommandBehavior cmdBehavior, Boolean asynchronousCall)
   at Teradata.Client.Provider.TdCommand.ExecuteReader(CommandBehavior behavior)
   at Teradata.Client.Provider.TdCommand.ExecuteDbDataReader(CommandBehavior behavior)
   at System.Data.Common.DbCommand.System.Data.IDbCommand.ExecuteReader(CommandBehavior behavior)
   at Microsoft.SqlServer.Dts.Pipeline.DataReaderSourceAdapter.PreExecute()
   at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostPreExecute(IDTSManagedComponentWrapper100 wrapper)

Smash126

↧

How to create and Update of Accounts,User and Contacts in CRM 2013 using SSIS ScriptComponent?

September 29, 2014, 4:06 am
$
0
0

Hi all,

I was trying to create and update the records of Accounts, Users and Contacts in CRM 2013 using SSIS Scriptcomponent(using CRM 2013 SDK). Can any one please help me, how to proceed on this as I am new to this task?

Thanks & Regards, Anil

↧
↧

Getting error message when i am trying to update the excel file using script task in ssis package

September 25, 2014, 2:36 am
$
0
0

Hi Guys,

I am getting error message when I am trying to update the excel. Please find the error messages as below

Error at Update File [Update File]: Failed to compiled scripts contained in the package. Open the package in SSIS Designer and resolve the compilation errors.

Error at Update File [Update File]: BC30002 - Type 'Microsoft.Office.Interop.Excel.Application' is not defined., ScriptMain.vb, 32, 32

Error at Update File [Update File]: BC30002 - Type 'Microsoft.Office.Interop.Excel.Workbook' is not defined., ScriptMain.vb, 33, 25

Error at Update File [Update File]: The binary code for the script is not found. Please open the script in the designer by clicking Edit Script button and make sure it builds successfully.

Warning at Update File [Update File]: Found SQL Server Integration Services 2008 Script Task "ST_050fcae972904039b4f0fe59b7528ece" that requires migration!

and the code that   I am using is

Dell - Internal Use - Confidential

' Microsoft SQL Server Integration Services Script Task

' Write scripts using Microsoft Visual Basic

' The ScriptMain class is the entry point of the Script Task.

Imports System

Imports System.Data

Imports System.Math

Imports Microsoft.SqlServer.Dts.Runtime

Imports Microsoft.Office.Interop.Excel

<System.AddIn.AddIn("ScriptMain", Version:="1.0", Publisher:="", Description:="")> _

<System.CLSCompliantAttribute(False)> _

PartialPublicClass ScriptMain

     Inherits Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTARTScriptObjectModelBase

     Enum ScriptResults

            Success = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Success

           Failure = Microsoft.SqlServer.Dts.Runtime.DTSExecResult.Failure

     EndEnum

    PublicSub Main()

        Dts.TaskResult = ScriptResults.Success

       'Dim proc As System.Diagnostics.Process

       'kill all instances of excel

       'For Each proc In System.Diagnostics.Process.GetProcessesByName("EXCEL")

       ' proc.Kill()

       'Next

       Dim excelnacomm AsNew Microsoft.Office.Interop.Excel.Application

       Dim wbnacomm As Microsoft.Office.Interop.Excel.Workbook

        wbnacomm = excelnacomm.Workbooks.Open("http://test.xlsx")(renamed the excel)

        wbnacomm.RefreshAll()

        wbnacomm.Save()

        wbnacomm.Close()

        excelnacomm.Quit()

        Runtime.InteropServices.Marshal.ReleaseComObject(excelnacomm)

    EndSub

EndClass

Please let me know what could be the reason

Smash126

↧

Multiple runs of same stored procedure

September 22, 2014, 6:12 am
$
0
0

I am an SSIS newbie so please excuse how little I know.

We have a manual job that I would like to automate in SSIS.

We run the same stored procedure six times with different parameters. Each run creates a csv file that we load into excel and then mail the attachments to the user. Can SSIS run the SP, and in a send mail task, send the six outputs?

↧
Search

Import multiple csvs to multiple tables

September 30, 2014, 1:57 am
$
0
0

I'm really new to SQL in general and I've got a big task. I have a single database, and I need to import multiple csv files into their own individual tables which have the same name as the csv file (minus the extension).

These are basic csv files (2-5 columns) and I was thinking maybe go down the SSIS road to do it. I know it could be done with PowerShell. It would run once per month and there would be less than 300 files to import (at first).

The research I've done indicates differing results when importing into multiple tables, and again I'm completely new to this having only worked with a few tutorials on SSIS. I'm pretty up on PowerShell though but it seems like less of a robust solution in this case.

Any suggestions regarding how to go about this or even if it's possible using this method?
Thanks in advance
Adam

↧

how to create excel report from ssis package

September 30, 2014, 12:12 am
$
0
0

hi all,

i have a SSIS package with foreachloop Container and 2 exceute sql tasks and one sendmailtask in it. data comes from one of exceutesqltask as in table format with 2 cols

now my requirement is:

add the following mat numbers to  distro list of gmats that are emailed to particular email on the 5<sup>th</sup> of each month.

 

GMat Name

GMat Acct #

LOAN

22232

Ps

23138

PS -HOLD

21333

PPL

28976

GHK

28326

GAP

12381

USA

23133

AC

13312

how can i get an excel report for gmat account per spread sheet from package?

please help..thanx in advance..

lucky

↧
↧

Excel Connection Manager input only getting SALES$ and NOT SALES

September 30, 2014, 5:41 am
$
0
0

Hello, 

I am creating a SSIS package to import a Excel file to SQL server and create a table. 

On Excel connection manager once I've selected the Excel file, on the bottom Name of the Excel sheet I am getting SALES$ and NOT SALES. 

Could anybody advise?

To add I am getting error. 

[Excel Source [1]] Error: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Excel Connection Manager 1" failed with error code 0xC00F9304.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.

Best regards, 

Mohan


↧

SSSI logging ( Best technique)

September 30, 2014, 6:14 am
$
0
0

Hi All,

Good morning to everybody.

I hope this will be the best place to ask  my queries.

My company got new project and we have to implement ETL ( SSIS packages , transformations n all)

We need to work in SQL 2014.  My question is , to handle all logging activities what technique is preferable and effective.

1. SSIS internal logging feature

2. Enterprise library

or etc.

Please help me in detail whether with ssis logging 2014 , we can log many things or we should opt for other things.

Abhishek

↧

Microsoft enterprice library logging in ssis

September 30, 2014, 5:07 am
$
0
0

Hi All,

Could anybody help me and let me know if we can make use of microsoft enterprice library logging feature in SSIS.

I have to create a POC and submitt it to client if it is worth and possible.

I know we can handle ssis logging in no. of ways but their main concern is to use enterprice library.

I am totally new and know nothing about it.

Please help me with any link or solution or step by step guide from where i can test and learn about this.

I would really appreciate your help.

Abhishek

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>