Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

SSDT Package Creation

June 2, 2016, 2:25 am
$
0
0

Hi, 

Can anyone explain what is the difference between SSDT that is offered in MS SQL Server 2012 and the SSDT that is offered in Visual Studio? Please confirm which SSDT I should Use for my requirement described below: 

Establish a Bi-directional Data integration between Salesforce CRM and MS SQL Server , for which I have to create an SSIS Package.

Any specific software/system requirement needed for SSDT installation ?

Although it is said that, SSDT can be installed as stand alone application without the need of visual Studio , there are few reviews from the customers facing issues at the time of installation( error thrown asking for Visual Studio to be installed)

Please advise

↧
Search

data validation using crm metadata

June 2, 2016, 12:05 pm
$
0
0

hi all

i'm working with script component in ssis package for data migration for crm 2011.

i need to do data validations to the attributes in crm using crm metadata, and i'm stuck at option set and look up.

This is the piece of code that i'm using for option set values.

  OptionSetValue financialWarning = new OptionSetValue();
     switch (Row.FinancialWarning)
     {
         case "Collection":
             financialWarning.Value = 100000001;
             break;
         case "newfunds":
             financialWarning.Value = 100000002;
             break;
         case "Past Due":
             financialWarning.Value = 100000000;
             break;
     }
     newaccount.Attributes.Add("financialwarning", (OptionSetValue)financialWarning);

and i'm using the below code to get the properties of attributes from crm metadata.

RetrieveEntityRequest retrievesEntityRequest = new RetrieveEntityRequest
        {
            EntityFilters = EntityFilters.Attributes,
            LogicalName = "account"
        };
        //Execute Request
        RetrieveEntityResponse retrieveEntityResponse = (RetrieveEntityResponse)organizationservice.Execute(retrievesEntityRequest);

can some one help me with an example how to do data validation for option set.





↧
↧

Export data into new text file on daily basis

May 31, 2016, 6:04 am
$
0
0

Hi,

I want export data into new text file  from SQL on daily basis. Everyday new file has to generate and export the data into that text file.

Could you please suggest me how can I create a package to create new text file and export the data into that.

Thanks in advance.

--

With Regards,

KrishnaReddy.

↧

SSIS Project Deployment and NT AUTHORITY Issue

June 2, 2016, 12:55 pm
$
0
0

I've deployed several packages to an SSIS server using the project deployment method. I've gone ahead and created my three environments: DEV, TEST, and PROD. Now, these three environments reside on three different servers.

What I've come to find is that you can't just execute an SSIS package on one server and have that package access another server just out of the box. You apparently need to create a job that uses a proxy to run a package that accesses another server??

That just seems silly to me quite frankly! When I deploy packages, I'd like to be able to just execute them from SSMS without having to create a job.

From what I hear, this problem still exists in SQL 2016. 

Can anyone verify that is in fact true? And is there any way outside of having the I/T department set up delegation or me creating a job for every single package to get packages in a SSIS catalog to be able to access remote servers?

Thanks!

A. M. Robinson

↧

Microsoft.SqlServer.Dts.Runtime, set the connection of a package to become a project connection

June 2, 2016, 3:07 pm
$
0
0

Does anybody know how to programmatically create a Project Connection, and then add a package to the Project where you Reference the Project Connection in the package?

I'm using EzAPI, but still, I need to use the ConnectionManager, ConnectionManagerItem and Items to do this.

Any ideas?

-h

↧
↧

Issue in Deploying ssis packages to a folder in Integration Services Catalog

May 24, 2016, 2:57 pm
$
0
0

Issue in Deploying ssis packages to a folder in Integration Services Catalog


I am getting the below mentioned error message WHEN i tried to deploy SSIS package.

The Select Permission was denied on the Object 'projects',database 'SSISDB',schema 'catalog'. (Microsoft SQL Server ,Error :229).

I had given ssis permissions to deploy the SSIS package,  i have database owner, ssis_Admin role, sysadmin also. I don't see any db_denydatareader or db_denydatawriter roles also . I don't see any denied permissions . 

Can anyone give suggestions.

Environment:

Microsoft SQL Server 2014 - 12.0.4213.0 (X64) Jun  9 2015 12:06:16 
Copyright (c) Microsoft Corporation Enterprise Edition (64-bit) on Windows NT 6.3 <X64> (Build 9600: ) (Hypervisor)

Windows Server 2012 R2 Datacenter 64 bit edition

I had given select permissions on  Object 'projects',database 'SSISDB',schema 'catalog' . But that did not help either
↧

Loop through Excel workbooks and sheets.

May 27, 2016, 3:25 am
$
0
0

Hi

I've been working through the following link http://stackoverflow.com/questions/7411741/how-to-loop-through-excel-files-and-load-them-into-a-database-using-ssis-package so I can loop through excel workbooks and sheets.

My excel data that I want to use for all workbooks actually begins on row 6 so I changed the sheetname Variable to this

Hourly_Call_ALL_01_Apr_2016$A6:j

Now there is actually some text in the cells in A1 etc so when I run the package I get errors stating the External columns for the Excel source are out of syncrhonization.

When I manually delete the text from A1 etc so I am just left with the data from A6 onwards the package runs fine.

How can I get around this issue.

Regards

↧

Script Task Help getting Sum of Time Column

June 3, 2016, 12:03 am
$
0
0

Hi All,

I am using DataTable in my ScriptTask(C#) to catch the result of the query . DataTable contains the following data

Job_FetchIndiaData     00:00:19

Job_FetchAustraliaData     00:20:10

Job_FetchFranceData     00:15:00

Now i want to Sum up this timing to get total time required.I cannot do this in T-SQL because that would mean changing Package which i am not allowed to do.

In Script task i had till now used DataTable.Compute but that does not work as expected with Datetime as it sums it to integer i also tried doing that using foreach loop but that also returns the same as using DataTable.Compute.


↧
Search

Script task error when migrating packages from VS 2008 to VS 2015 "Exception has been thrown by the target of an invocation"

June 2, 2016, 1:14 pm
$
0
0

Hello,


I have multiple SSIS packages which needs to be migrated from visual studio 2008 (deployed to SQL 2008R2) to  visual studio 2015( deployed to SQL 2014). Since I am deploying to SQL 2014, I went to properties of solution to TargetServerVersion to SQL 2014. So after I did this, when I open a new script task, it gives me  Script language to Visual

Studio 2012. I tried opening and closing existing script task after upgrading but it didnt work, it said that Script task has to be migrated. So I opened a new script task and here is the picture  below.  It is a basic error logging script task. Nothing fancy.



Now the script inside is       

  Dim strSource As String = Dts.Variables("User::Source").Value.ToString
        Dim strPackage As String = Dts.Variables("System::PackageName").Value.ToString
        Dim EventID As Object = Dts.Variables("User::EventIDInformation").Value
        Dim strMessage As String = "Package Name = " + strPackage + " - Completed Successfully "

        EventLog.WriteEntry(strSource, strMessage, EventLogEntryType.Information, ctype(EventID,integer))

        Dts.TaskResult = ScriptResults.Success
I am declaring the following as Read variables

User::EventIDInformation,System::PackageName,User::Source

But it doesnt like it when I run the whole package, I get the following error:

It didnt work with .net framework 4 .
 I tried changing the .net framework from 4 to 4.5.

and looked into the references, everything seems fine to me. I am getting the same error.


Please advise.

Thanks


↧
↧

ssis parameter value.s

June 2, 2016, 9:00 am
$
0
0

Hi ,

I am working on a package which is already deployed to production ,i do not have solution file so i exported the file and copied to visual studio to see the logic .

the package is calling some parameters but i don't see any parameters declared on the package .

i check in dtsx file and in package parameters ,solution explorer but could not the value.

not in configurations also so to find parameter value where can we look into.

Thanks

↧

[SSIS 2008 R2] strange behavior

June 2, 2016, 4:52 am
$
0
0

Hi all,

I postthis messagetodaybecause Ican not find asolution to thisstrange problem.
I have ajobbased onan SSIS2008 R2packagethat worked very well so far.It loadsa text file on a database.

Recently,we noticedthat the number of rows of the filewas loadedrandomly.For example,on first job run, only 25rows are load, ifwe rerun, probably 80rows will be load, another run will load 12 rows... the fileis no longerfully load.

When running via BIDS, same issue (even if the green arrow indicate that all rows are load in base)

But if I add a DataViewer before the destination component, all rows are well integrated

Did you already encountered this kind of problem ?

Thanks in advance.

Regards,

↧

FindColumnByLineageId issue

June 3, 2016, 3:30 am
$
0
0

I'm trying to use the FindColumnByLineageId method and have lifted the code directly from MSDN but I'm having an issue resolving "BufferManager":

Can anyone advise which Namespace or project reference I am missing?

Thanks, Peter

↧

SSIS Task

June 3, 2016, 7:58 am
$
0
0

Hi All,

I`m new to SSIS so this may be something easy but I`ve created a package which fetches rows from SQL Table and delivers the results in a flat file. I also need to create another file based on every time the package is executed to give me the record count based on file it was created.

How can i create this ? The record count file needs to be in .rpt format

Thank you 

FM

↧
↧

mass export of dtsx files from catalog

June 3, 2016, 11:36 am
$
0
0
Hi. I'm running 2008 r2.  in analogous fashion to automatically scripting all of the engine objects in a database from ssms's wizard to separate files, I'd like to do the same with pkgs sitting in various folders on MSDB on my SSIS server instance.  Is there such a utility or feature that comes with sql server that I can use to export en masse a dtsx file for each pkg on msdb?
↧

failed validation with status VS_ISBROKEN

May 27, 2016, 1:29 pm
$
0
0

After completing development of a project, I ran is successfully on my development machine to test everything, before deploying it to our test environment. I then deployed the project, installed my customized assembly, and ran the package on the test server. One data flow task returns the "failed validation and returned validation status of VS_ISBROKEN."  When I run the all executions report and view the context details for the failure, there really isn't anything useful listed to help narrow down the troubleshooting.

So, I copied the solution to the test server and opened it up with VS, and below is a screenshot of the task executing.  As you can see, there was an OLEDB error, but the task executed and completed successfully.

I'm not certain, if the initial OLEDB error is causing the validation failure, and if it is, how do I resolve it because the task on its own completes successfully, when I execute it in VS.  I'm a little confused.

Any insight would be greatly appreciated.

Thanks,

Chris


↧
Search

load multiple different .csv files into their own tables in one package

June 3, 2016, 10:28 am
$
0
0

Hello,
How is it possible to have one ssis package which takes any .csv file and then loads it into its relevant table?
For example:
x.csv loads into tblx
y.csv loads into tbly,
etc...

Thank you

↧

ezAPI: how to add add package to project with a project oledb connection

June 2, 2016, 5:32 am
$
0
0

I'm using ezAPI to build a lot SSIS packages. However,   I have a hard time understanding how to properly create a project package db connection.

            EzProject pro = new EzProject();          
            ConnectionManager cm = new EzSqlOleDbCM(pro, "SSIS_Audit.conmgr");
            cm.Name = "SSIS_AuditParent";
            cm.ConnectionString = "Data Source=localhost;Initial Catalog=SSIS_Audit;Provider=SQLNCLI11.1;OLE DB Services=-2;Integrated Security=sspi;Connect Timeout=300;Auto Translate=False;";
            pro.AddConnectionManager(cm);

...but how do I make a package with a reference to the connection of the project (and not ref to a package connection)?

Thanks.

↧
↧

SSIS Source change from Ado.net to oracle Source

June 1, 2016, 9:34 pm
$
0
0

Hi All,

Currently we are using Ado.net source in our ETL but to improve performance of our ETLs we want to change Ado.net to Oracle Source in ETLs. we would like to confirm below points :--

1) what will be the impact if we will change ado.net to oracle source.

2)did we will get good result in terms of performance.

Please let me know if any other impact or suggestion.

Refer below link which I am  using for my reference.

https://blogs.msdn.microsoft.com/sqlperf/2009/08/14/using-ssis-to-get-data-out-of-oracle-a-big-surprise/

http://www.danielbowlin.com/ssis-optimization-techniques-part-10-ssis-oracle-source/

Thanks & Regards,

Akhil

↧

SSIS Automation

May 31, 2016, 1:20 pm
$
0
0

Experts,

We have Oracle database in Domain1\USER1
We want to copy some of the table to Sql Server in Domain2 via SSIS process.

We opened SSIS package as 
runas /netonly /user:DOMAIN2\USER1_ACCOUNT " path\devenv.exe"
We have windows authentication for Domain1\USER1

We created the package and the data transfer between the packages are happenning correctly.

Now we want to automate this process.

step 1: We deployed the package and when we right click on the package in SSMS integration services Catalogs( ssms opened as runas /netonly ) and execute package is working Fine.

step 2: When I create a agent job and run the same package its failing.

We tested the same with SQL authentication (I'm in Domain1) in SSIS package for Domain2, and working fine.

We want the same to be run with windows authentication, How can I achieve this?

Thanks 

Praveen

Praveen

↧

Difference Integer to Double (DTS) Column Copy and Integer to Double SSIS Data Coversion

June 3, 2016, 2:02 pm
$
0
0

Greetings, I am converting a DTS package to SSIS, and data from a SQL Server table is being column copied (no transformation) from SQL to a dbase III table. I am using a compare utility (WinMerge)  to compare the .dbf table/file from the DTS package result to the new SSIS package result and seeing differences in how an integer column is transformed and stored in the file. In the DTS package, the source  (SQL Server) is an Integer, the destination (dbase III table Jet oledb 4.0 provider) it is a Double. In the SSIS  package, the source (SQL Server) it is four byte signed integer (DT_I4), the destination(again Jet oledb 4.0 provider)  is a double preceision float (DT_R8).  The issue I am having, is the column result from DTS stores a 0 value for instance as 0.00000 but out of the SSIS package, it is storing the result as a 0 with no scale/decimals. Both the DTS and SSIS package delete and recreate the dbase III table, and the definition for the column is numeric(5,0).   Although the numeric values are the same, I would like the compare to be clean and was hoping someone could help me with how to resolve this if possible? How can I force SSIS to store the value in the same format as the original package? I would like to understand why this is happening. Thanks

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>