Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Visual Studio Development to Extract Data From Sharepoint

May 22, 2016, 7:00 am
$
0
0

Hi Guys,

We have a client who would like to extract data from sharepoint and send it into their data warehouse. Small volumes.

I found an adapter that should be able to fit into SSIS properly on this link.

http://sqlsrvintegrationsrv.codeplex.com/releases/view/17652

I have installed the adapters on a 2012 dev server and started up Visual Studio 2010 and tried to create a new SSIS project as per the documentation.

When I do that I get the message. 

"The following assemblies are installed SDK assembly but could not be shown in the customize tools dialog box because they are missing one or more components. 

Please make sure that all necessary libraries are available."

MySQL.Data.CF.dll
AspNetMMCxt.dll

I have been looking around to see if this message tells me to do anything specific but so far no luck.

So a couple of questions really.

1. Has anyone else tried this here and is there an easy fix for these sorts of messages? I am sure it is just installing something else that Visual Studio wants.

2. We have our own ETL tool that can execute anything that can run in batch mode on the ETL machine.

So I was wondering. Apart from going to the trouble of using this tool and creating an SSIS package and trying to integrate the execution of the package into our scheduler...someone must have used the APIs necessary to create a batch command that dumps data out of SSIS by now. I mean, surely I can not be the first man to want to do that a better way than unloading via spreadsheets etc. I have seen a few products on the market that are GUIs that replicate data from Sharepoint to SQL Server so it can't be too hard to do. 

If there is not something readily available it looks like us creating a tool to do this might be useful more widely.....

Thank you in advance for any suggestions or tips you have.

Best Regards 

Peter 

Peter Nolan

↧
Search

How can I grant one SQL login for Integration Services

May 23, 2016, 3:41 am
$
0
0

hi all of you, I want to grant some SQL logins for using IS by using SSMS.

I've read that it must be done throught DCOM. Any link related to would very useful.

TIA,

↧
↧

How to insert Null values to a float column in the database

November 9, 2011, 8:52 pm
$
0
0

Hi All,

 

I have a small problem. I have a csv file that i need to import to the database. In this file i have a column where it has the value "NULL". This is the 4 letter character word of NULL.

The database column which is mapped to this is float because although there is "NULL" string here majority is float values. I need to insert this column to the database.

What i did was in my Flat file source i allowed it to be string so that the null value and the float values will go through.
But when in the destination it gives errors saying type cast errors. I know this is because it cannot convert the value "NULL" to a float.

Any idea on how i can send this value to the database? I tried using a derived column transformation and using expressions to cast and convert but no luck.

 

Can anyone please let me know a expression of converting this or a method which i could send the "NULL" value to the database? I cannot send empty strings "" to the database.

 

Please help me on this.

 

Thanks

Lucki

 

 

 

 

 

↧

ETL / SSIS SharePoint 2013 and Project Server 2013

June 24, 2015, 2:34 pm
$
0
0

After we installed the Feb and Mar CU patches for project server 2013. I'm getting the following errors on my SSIS package create to extract list data from project server 2013 lists:

[OData SourceProject [2]] Error: The OData SourceProject was unable to process the data. An error occured when detect the document payloadkind.

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on OData SourceProject returned error code 0xC02090F5.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.


Thanks for any help

↧

SSIS access to Azure Key Vault

May 23, 2016, 9:36 am
$
0
0

I have an Azure SQL database with a table that has one field encrypted using Always Encrypted.  The column master key is store in Azure Key Vault.  Now I would like my on-premise SSIS application to be able to decrypt that column when retrieving data from Azure SQL database.  Can SSIS be configured to talk to Azure Key Vault for the master key?  If not, is there a way my SSIS application can decrypt the value?

↧
↧

SFTP Task in SSIS

May 23, 2016, 5:20 am
$
0
0

I am currently using Pageant(key holder) and PuTTy client from SSIS to connect to a unix server and place a few files. I am using a Script task(VB) to start putty. I have a batch script which connects to the UNIX server and places a file which is passed as parameter to the PuTTy client in the Script Task. The Script task does not fail if it does not place the file. I want the Script Task to Fail if the Files are not placed. More over the script task does not fail even when the connection fails because of an access problem, but i want it to fail.

This is the problem I am facing now. Please help me with this!!

↧

Export ispac file from SSISDB

May 23, 2016, 12:20 pm
$
0
0
We are migrating our servers and I would like to create ispac files for all the SSIS projects on a server. So I have them to deploy to other servers. If anyone has done this please let me know how it was done.

Roger Kemerling

↧

Send success email upon success of sequence containers execution in a package.

May 23, 2016, 10:34 am
$
0
0

Hi,

I have 3 sequence containers that run upon completion of other. After all these containers are executed successfully, I need to send an email that package ran successfully. Each sequence container exports data from a different file to the same table. I can't run them parallely. So, I made them to execute one after the other. They are independent. So, just used completion instead of success constraint. How do I keep track of container success and at the end send email about success ?

I thought of doing in control flow at the end, but at the end means 3rd sequence container success it looks.

In 'Event Hanlders' tab, I see event handler for 'On Error', 'On Progress' etc but not for success.

Thanks


↧
Search

Error while running SSIS package as a job

May 23, 2016, 5:35 pm
$
0
0

 I am trying to create a job for SSIS packages that is used to process excel files and upload them into database.I have a script task in the package that uses excel dll - Microsoft.Office.Interop.Excel to format the excel files that I get. The packages run fine when i run it locally in the server so I can assume all the assembles are installed correctly.. But when i create a job to run the package i get an error : " Microsoft (R) SQL Server Execute Package Utility  Version 13.0.1100.288 for 32-bit  Copyright (c) 2015 Microsoft. All rights reserved.    Started:  5:14:35 PM  Error: 2016-05-23 17:14:37.31     Code: 0x00000001     Source: Script Task      Description: Exception has been thrown by the target of an invocation.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  5:14:35 PM  Finished: 5:14:37 PM  Elapsed:  2.312 seconds.  The package execution failed.  The step failed." 

I have set the jobstep to use 32 bit runtime. It doen't give any more information on the error. I have logging enabled and it is working since I checked it running locally. I have added a log message at the main function of script task to know if the main function is getting executed. But The log files show the target of invocation error before the main function log message. 
What could be the reason for this?

↧
↧

how to launch a URL link in script task using C#

May 23, 2016, 7:50 am
$
0
0

I have a URL, for example, "https://www.google.com/" I have a http connection manager for the URL set up in a ssis package. 

Now I want to just launch the link, NOT downloading any data or saving any data in files from that link. In real scenario, the link I use is to clean the cache after processing... 

Anyway, I don't know how to write the C# code, or are there any other ways to call those links INSIDE a ssis package? 

PLEASE HELP!!

↧

Cannot import date values in SharePoint

May 19, 2016, 3:12 pm
$
0
0
I'm trying to copy excel data in sharepoint using SSIS package. I cannot copy date values in SharePoint. I tried single text and Date type in SharePoint but still i cannot see date values in the list.
↧

SSIS VB Script FTP issue - FTP successful but 553 error

January 24, 2012, 7:00 am
$
0
0

I am using VS 2008.  I have a VB script task that connects successfully for FTP, and then successfully FTPs 2 files BUT throws a '553 Could not create file' error.  This is the line of code throwing the error:

ftp.SendFiles(ftpFiles,

"/",True,False)

The odd thing, as I said, is that the files ARE being successfully FTPd to the destination.

Has anyone else ever run int this behavior?  Is there something I can do to get rid of this error? 

Thanks!!

 

 

.

↧

SSIS Error after package execution

May 24, 2016, 8:12 am
$
0
0

This package is scheduled to run daily - reads files from network drive and copies the data to sharepoint list, renames and moves file to different folder. After the package execution is see this error in data source.

Error at Data Flow Task [Excel Source [1]]: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E37.
Error at Data Flow Task [Excel Source [1]]: Opening a rowset for "Data$" failed. Check that the object exists in the database.



↧
↧

benefit(s) of SSIS "Execute T-SQL Statement Task" ?

May 24, 2016, 7:25 am
$
0
0

I've  read a lot about this SSIS 2012 task but am still confused as to why one would use it over the older "Execute SQL task". (For example, does it offer better performance?). Thoughts?

TIA,

edm2


↧

How to remove carriage return to unwrap flat file

May 24, 2016, 11:15 am
$
0
0

Hey yall,

So I am starting to create a process where I will be loading some info from a file to SQL tables. The problem is the vendor sends us wrapped files. Currently our process consists of manually doing a find and replace where we find '~clm' and replace it a blank. This is our way of unwrapping the file. 

Does anyone know of a way to unwrap this within an ssis package?

Here is a preview of some data. 



so when we do a  find '~clm' that we have to type in to remove the carriage return at the end of each line. 

Please let me know if you know of any ways to do this!

Thanks,

Lyndsey

Lyndsey Cupit


↧
Search

Connection Manager - Windows Authentication via Service Account

May 24, 2016, 12:44 pm
$
0
0

This might be an easy solution, but I cannot find how to accomplish this. 

Our DB Server has IS installed for us to do SSIS development.  Inside my SSIS Package, I need to make a connection to our SQL Server.  Not a big deal if using SQL Login accounts, or even windows authentication.  The problem I am having is as follows.  Access to our servers is only granted through a TPAM user account, so when on the server, Windows credentials are passed as the TPAM user, which does not have access to our databases.  All database access is granted through a different service account (domain/dbServiceAccount). In order for me to start building the SSIS package, I need to set a connection for SQL Server, which only has the options for "Windows Authentication" and "SQL Server Authentication". 

How can I get a connection inside my SSIS package when the logged in user is not the one with database access? 

↧

Running .NET 4.5 code from SSIS at NET 4?

May 24, 2016, 2:40 pm
$
0
0

I wrote some code that scanned directories for .zip files and unzipped them using ZipFile Class at .NET 4.5. I decided to put it into a job flow in SSIS. When I went to add references for System.IO.Compression and System.IO.Compression.FileSystem they weren't in the list, then I noticed that our version of SSIS was running .NET 4.

Is there a way to run the code with its references to 4.5 some other way than to run it in a Script Task limited to v4? Unfortunately we can't use CLRs or run "commands" from SQL where I work.

Thanks...

Jnana Sivananda

↧
↧

Issue in Deploying ssis packages to a folder in Integration Services Catalog

May 24, 2016, 2:57 pm
$
0
0

Issue in Deploying ssis packages to a folder in Integration Services Catalog


I am getting the below mentioned error message WHEN i tried to deploy SSIS package.

The Select Permission was denied on the Object 'projects',database 'SSISDB',schema 'catalog'. (Microsoft SQL Server ,Error :229).

I had given ssis permissions to deploy the SSIS package,  i have database owner, ssis_Admin role, sysadmin also. I don't see any db_denydatareader or db_denydatawriter roles also . I don't see any denied permissions . 

Can anyone give suggestions.

Environment:

Microsoft SQL Server 2014 - 12.0.4213.0 (X64) Jun  9 2015 12:06:16 
Copyright (c) Microsoft Corporation Enterprise Edition (64-bit) on Windows NT 6.3 <X64> (Build 9600: ) (Hypervisor)

Windows Server 2012 R2 Datacenter 64 bit edition

I had given select permissions on  Object 'projects',database 'SSISDB',schema 'catalog' . But that did not help either
↧

SSIS + check for variable value and create csv file using flat file destination in data flow

May 24, 2016, 8:46 pm
$
0
0

Hi,

I have an existing package that runs from batch file. batch file script loops thru different account numbers and executes package. Account Number is passed in to package variable. The package extracts data from file into database table and then it gets massaged and output csv file is generated for each account.

Output file to CSV happens in dataflow task (ole db source -> flat file destination)

I got new requirement to generate another CSV file with slight different data only if account number is 1111.

How to do using same oledbsource in data flow.

I need like this:

       OLEDB Source  -> flat file destination

          |

        If variable User::account is 1111 Then -> another flat file destination of csv file.

How to do this.

Thank You

↧

OLEDB Source + check for variable value and run flat file destination to create csv file

May 24, 2016, 8:51 pm
$
0
0

Hi,

I have an existing package that runs from batch file. batch file script loops thru different account numbers and executes package. Account Number is passed in to package variable. The package extracts data from file into database table and then it gets massaged and output csv file is generated for each account.

Output file to CSV happens in dataflow task (ole db source -> flat file destination)

I got new requirement to generate another CSV file with slight different data only if account number is 1111.

How to do using same oledbsource in data flow.

I need like this:

       OLEDB Source  -> flat file destination

          |

        If variable User::account is 1111 Then -> another flat file destination of csv file.

How to do this.

Thank You

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>