Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Unable to access Drive from SQL Server

$
0
0

Dear All,

When i am connecting to an excel file in side the folder on a Drive of the machine suppose G: drive, I am unable to extract the data.

Tried both SSIS and SQL (Open row set)

User has access to the Folder.

Pls suggest what else needs to be checked ?

Thanks


Anky


Derived Column Failing due to truncation

$
0
0

Good afternoon,

I have a derived column which performs a very simple task of checking if a value matches or not and inserts a 0 for match, and a 1 for no match. The purpose is to identify which fields will ultimately need to be updated.

Here is a sample of the expression:

ISNULL(SOMEDATE) ? 0 : SOMEDATE== REPLACENULL(origSOMEDATE,"<NULL>") ? 0 : 1

The dataype is DT_I4, and the result should either be a 0 or a 1, so I'm confused as to how value is being truncated. Both dates are in the same format. I used a convert to convert both dates to datetime2(7). When I set the column to ignore truncation warning, the package works as intended. Any ideas?

SSIS 2012 project deployed package remote execution

$
0
0

Hi! I'm new to SSIS 2012 Project Deployment approach, but I successfuly deploy my project and I'm am able to run the packages via SSMS on the server where the packages are deployed. However, if I connect to the server using SSMS on my computer, I'm able to see the SSISDB Catalog and Execute the packages, but the execution fail when trying to access some network resources (source files to load in SSIS package are located on other servers).

I think it's a security impersonation problem, since remote execution needs to pass my windows credentials to the remote server. Is it possible to configure this on the invocation? or I need to grant some permissions on the remote server?

Thanks in advance.

Import flat file which has changing column order using SSIS

$
0
0

I have a flat with few columns

FirstName, lastName, Address

f1,l1,a1

f2,l2,a2

I build my SSIS package based on the above file.

But now i receive files with different columns order 

let say

lastName,FirstNamr,Address

l1,f1,a1

L2,f2,a2

or

Address,FirstName,LastName

a1,f1,l1

a2,f2,l2

every time i receive multiple files in different order and i have to remap all my mappings. These are just a few columns and i have like 20 columns and the order can potentially change any time. so every time i have build new packages remap them etc. Is there a better way of doing it.

through normal c# code it pretty easy. I tried to add script here but the script also needs a source and mapping so there is also a mapping issue. Is there a better way to do this


SSISDB - Project Deployment T-SQL

$
0
0

While executing following command in an transaction

BEGIN TRAN TRAN1
DECLARE @ProjectBinary as varbinary(max)
DECLARE @operation_id as bigint
Set @ProjectBinary = (SELECT * FROM OPENROWSET(BULK 'C:\Test\Test.ispac', SINGLE_BLOB) as BinaryData)
Exec SSISDB.catalog.deploy_project @folder_name = 'test1', @project_name = 'ABC', @Project_Stream = @ProjectBinary, @operation_id = @operation_id out
COMMIT  TRAN TRAN1


I am getting following error

Msg 27203, Level 16, State 1, Procedure deploy_project, Line 139
Failed to deploy project. For more information, query the operation_messages view for the operation identifier '34726'. 

But querying catalog.operation_messages on given operation_id, doesn't show me anything. it doesn't return any row. 

And if I remove explicit transaction and execute above command and if error occurs. After querying I am able to find proper error message in view? 

Why error messages not getting logged while using Catalog.Deploy_projectin an transaction?

TIA

SSIS data flow task fails giving error : 0x8007000E Description: "Out of memory.".

$
0
0

I am trying to transfer data from SQL Server table to Oracle table using SSIS data flow task. My SQL server 2008 R2 and Oracle 11g databases are on the same system and both are 64-bit. My machine is Win 7 (64-bit) with 16 GB RAM and I am running the package in Development mode in BIDS.

The table structure in SQL server is:

[id] [char](20) NOT NULL,
[total_size] [decimal](15, 2) NOT NULL,
[attachment] [image] NULL,
[STORE_ID] [char](20) NOT NULL DEFAULT '00000000000000000000'

And table structure in Oracle is:

  ID          CHAR(20 BYTE),
  TOTAL_SIZE  FLOAT(126),
  ATTACHMENT  LONG RAW,
  STORE_ID    CHAR(20 BYTE)                     DEFAULT '00000000000000000000'

During execution of Data Flow task I am getting below errors:

[OLE DB Destination [28]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x8007000E.
An OLE DB record is available.  Source: "Microsoft Cursor Engine"  Hresult: 0x8007000E  Description: "Out of memory.".

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "OLE DB Destination" (28) failed with error code 0xC0202009 while processing input "OLE DB Destination Input" (41). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

[OLE DB Source [1]] Error: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "OLE DB Source" (1) returned error code 0xC02020C4.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.

I had tried with various combination of DefaultBufferMaxRows, DefaultBufferSize, and EngineThreads; but still I get the error after 189,877 rows are transferred in Oracle out of 233808 rows in SQL Server.

Has anyone overcome on this issue? Please provide your inputs on the errors.

Thanks and regards,

Neel

SSIS connection object update failing

$
0
0
I built a small package two years ago that uses Flat File Sources to copy in small text data files.  Each source connection object has a UNC path to flat text files on another server.  The source system changed, so I opened the package and updated the UNC path in one Connection Manager object, and clicked OK. The Flat File Source Editor that uses this source seemed to be able to see the new location when I clicked "Preview".  Then I went back to the file source, and the connection had reverted back to the original one.  it would not save the new UNC path.  

I am using SQL Server 2012 SP2 with SSDT (run as admin).  I closed the package in SSDT, edited the connection strings using XMLnotepad, and was then able to open, test, build and deploy the package.

It seems that the Source object will not let itself be changed.  The other option is to delete it and recreate it, but I didn't want to remap the fields.

Any idea why updating a connection object is not working?

Thank you for any help,
Alan

Data folder not loading with new project

$
0
0

Hello All,

Please assist if you can. Thank you in advance....When creating a new integration project, the data folder to create a new data source does not load.  Can someone tell me Please what I am missing?

Thanks in advance for any assistance.

Have a sunny day!


Error while updating data to Sharepoint

$
0
0

hi All,

Good Day!

There is a requirement to insert if there is a new record/update the existing record to Sharepoint. Am able to do Insert/Update to SharePoint if the data quantity is minimum, i.e, records in hundreds.

link: http://thechriskent.com/2012/06/19/merging-data-into-a-sharepoint-list-using-ssis/

if the records/data is more(in thousands), while updating to sharepoint, am getting below error. I tried to keep the minimal batch size, but still getting the same error.

Is there any setting on Sharepoint that can be set to increase updation capability?

Error details:

 System.ServiceModel.ProtocolException: The content type text/html; charset=utf-8 of the response message does not match the content type of the binding (text/xml; charset=utf-8). If using a custom encoder, be sure that the IsContentTypeSupported method is implemented properly. The first 1024 bytes of the response were: '
<!DOCTYPE html PUBLIC "-//W3C//DTD XHTML 1.0 Strict//EN"
"http://www.w3.org/TR/xhtml1/DTD/xhtml1-strict.dtd">
<html xmlns:o="urn:schemas-microsoft-com:office:office" lang="en-us" dir="ltr">
<head><meta name="GENERATOR" content="Microsoft SharePoint" /><meta http-equiv="Content-Type" content="text/html; charset=utf-8" /><meta http-equiv="Expires" content="0" /><meta http-equiv="X-UA-Compatible" content="IE=8"/><meta name="ROBOTS" content="NOHTMLINDEX" /><title>

Error

</title><link rel="stylesheet" type="text/css" href="/_layouts/15/1033/styles/corev15.css?rev=ox%2BqLd6WTqhn6d%2FMqf2BMw%3D%3D"/>
<link rel="stylesheet" type="text/css" href="/_layouts/15/1033/styles/error.css?rev=nc1850SZNy60qTAeQIRxsA%3D%3D"/>
<script type="text/javascript" src="/_layouts/15/init.js?rev=%2FWTxr8UesytJ8GB%2F5hOwZA%3D%3D"></script>
<script type="text/javascript" src="/ScriptResource.axd?d=Xk0NEdH2fPzV6iK_jX1QyxyIvX3d6qMyUR7g3X_pLj3803Il6KiE53vwcERQzD3Y0-q4UpveatXfBOG7tydAWu2111jN0cI3WJzgPH4-wITimoTuMbmI6xYdd85DKZebsn2'.

Server stack trace: 
   at System.ServiceModel.Channels.HttpChannelUtilities.ValidateRequestReplyResponse(HttpWebRequest request, HttpWebResponse response, HttpChannelFactory factory, WebException responseException, ChannelBinding channelBinding)
   at System.ServiceModel.Channels.HttpChannelFactory.HttpRequestChannel.HttpChannelRequest.WaitForReply(TimeSpan timeout)
   at System.ServiceModel.Channels.RequestChannel.Request(Message message, TimeSpan timeout)
   at System.ServiceModel.Dispatcher.RequestChannelBinder.Request(Message message, TimeSpan timeout)
   at System.ServiceModel.Channels.ServiceChannel.Call(String action, Boolean oneway, ProxyOperationRuntime operation, Object[] ins, Object[] outs, TimeSpan timeout)
   at System.ServiceModel.Channels.ServiceChannelProxy.InvokeService(IMethodCallMessage methodCall, ProxyOperationRuntime operation)
   at System.ServiceModel.Channels.ServiceChannelProxy.Invoke(IMessage message)

Exception rethrown at [0]: 
   at System.Runtime.Remoting.Proxies.RealProxy.HandleReturnMessage(IMessage reqMsg, IMessage retMsg)
   at System.Runtime.Remoting.Proxies.RealProxy.PrivateInvoke(MessageData& msgData, Int32 type)
   at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListsService.ListsSoap.UpdateListItems(UpdateListItemsRequest request)
   at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListsService.ListsSoapClient.ListsService_ListsSoap_UpdateListItems(UpdateListItemsRequest request)
   at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListsService.ListsSoapClient.UpdateListItems(String listName, XElement updates)
   at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.Adapter.ListsAdapter.ExecuteSharePointUpdateBatch(String listName, String viewId, XElement batchXml, Int16 batchSize)
   at Microsoft.Samples.SqlServer.SSIS.SharePointUtility.ListServiceUtility.UpdateListItems(Uri sharepointUri, NetworkCredential credentials, String listName, String viewName, IEnumerable`1 fieldValueList, Int16 batchSize)
   at Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.SharePointListDestination.ProcessInput(Int32 inputID, PipelineBuffer buffer)
   at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostProcessInput(IDTSManagedComponentWrapper100 wrapper, Int32 inputID, IDTSBuffer100 pDTSBuffer, IntPtr bufferWirePacket)

what is the cause of this error?

Please advise.

Thanks,

Raghavendra

SSIS Package Configuration option resets when collapsing / expanding options tree

$
0
0

On Visual Studio 2013 with SSDT for SQL Server 2014

I noticed something very strange.

I am viewing the package configuration selected option for a package:

Package configuration before collapsing / expanding

Now, i just click on the - sign and then on the plus sign on the "Properties" branch. And the option is cleared:

enter image description here

The ONLY way i found not to mess everything is just to have ALL the options FULL expanded and THEN to select what i want.

Is this a known bug?


Elias

What is the easiest way to export all tables data from Oracle to MS SQL Server?

$
0
0

Hello MS,

I would like to export all tables from Oracle 11.2 to MS SQL Server 2012 R1.

Using the tool "Microsoft SQL Server Migration Assistant v6.0 for Oracle" did not work for me because there are too many warnings and errors regarding the schema creation (MS cannot know it because they are not the schema designer). My idea is to leave/skip the schema creation to the application designer/supplier and instead concentrate on the Oracle data export and MS SQL data import.

What is the easiest way to export all tables data from Oracle to MS SQL Server quickly?

Is it:

- the „MS SQL Import and Export Data“ Tool
- the “MS SQL Integration Services” Tool
- not Oracle dump *.dmp format because it is a propritery binary format
- flat file *.csv (delimited format)

Thanks!





why are my log files getting generated with a space between every two characters?

$
0
0
Hi, we run std 2008 R2 and suddenly my last two packages are generating log text files (configured from logging option in ssis) with blanks between every two characters even if those characters are in the same word.  I'm using notepad to look.  Its happening on my local and on a remote server.  Does anybody know what causes this?

Urgent Please Help - Package Execution goes into Not Responding Mode

$
0
0

Hi All,

I have created a Master Package, in which I am calling multiple packages using ExecutePackageTask.

The Source and Destination are Oracle DB. In single package, I am using lookup and script component to perform incremental load. I am updating data if it exists in the table, by writing queries in script component.

After successfull execution of one ExecutePackageTask, the package shows TestingC Connectivity and goes to "Not Responding" mode. after that I have to explicitly close the package.

I have done the following things:

1. Installed oraMTS service in my machine.

2. ExecuteOutofProcess = false in ExecutePackageTask

Please Help.

Be Our July SSIS Guru! Supply a Sizzling "Sunny Season" Scoop!

$
0
0

Up here in the Northern Hemisphere, things are hotting up!

And in TechNet Guru land, hot is cool!

So once again, we ask you for your sizzling "Sunny Season" scoop.

Your blazing and boiling blurb, and your hot how-to's!

Step up Gurus and please provide us some engaging essays and exciting expositions!

Now is the season for your fascinating feature, your classic composition, or your tasty treatise!

Let the community warm to your write-up, industrial item, professional passage or specialized story.

We need high-tech high hitters!

It is your time in the sun my friends!

Enjoy it while it lasts! (the sun that is)

All you have to do is add an article to TechNet Wiki from your own specialist field. Something that fits into one of the categories listed on the submissions page. Copy in your own blog posts, a forum solution, a white paper, or just something you had to solve for your own day's work today.

Drop us some nifty knowledge, or superb snippets, and become MICROSOFT TECHNOLOGY GURU OF THE MONTH!

This is an official Microsoft TechNet recognition, where people such as yourselves can truly get noticed!

HOW TO WIN

1) Please copy over your Microsoft technical solutions and revelations toTechNet Wiki.

2) Add a link to it on THIS WIKI COMPETITION PAGE (so we know you've contributed)

3) Every month, we will highlight your contributions, and select a "Guru of the Month" in each technology.

If you win, we will sing your praises in blogs and forums, similar to the weekly contributor awards. Once "on our radar" and making your mark, you will probably be interviewed for your greatness, and maybe eventually even invited into other inner TechNet/MSDN circles!

Winning this award in your favoured technology will help us learn the active members in each community.

More about TechNet Guru Awards

Thanks in advance!
Pete Laker


#PEJL
Got any nice code? If you invest time in coding an elegant, novel or impressive answer on MSDN forums, why not copy it over toTechNet Wiki, for future generations to benefit from! You'll never get archived again, and you could win weekly awards!

Have you got what it takes o become this month's TechNet Technical Guru? Join a long list of well known community big hitters, show your knowledge and prowess in your favoured technologies!



SSIS Package execution in VS2013

$
0
0

Hi,

I am using SQL Server 2012R2 with below details of the SSDT.

Microsoft Visual Studio 2013 Shell (Integrated)
Version 12.0.21005.1 REL
Microsoft .NET Framework
Version 4.5.51641

Installed Version: IDE Standard

SQL Server Integration Services   
Microsoft SQL Server Integration Services Designer
Version 12.0.2430.0


The catch is the ssis package is still in running state while the message at bottom says "package execution completed".

When i checked in the SQL table, the data is fully loaded.

Where is the gap and how can the issue be addressed?

Regards,

Ayush


SSIS solution file is showing in white colour and not able to open the file

$
0
0

Hi,

I am working on Business Intelligence Development Studio(BIDS) on Visual Studio 2008 .

As part of that, i created on SSIS project , when i went back to the project path and try to open  solution

file there.

But i experienced very strange experience, .sln file is showing in white colour as below and i am not able to open it.

am i missing anything here? like service pack or any other.

Please guide me on this

Package failed after changing password in shared data source

$
0
0

Hi,

I'm using a shared data source to connect an Oracle server in my packages.  After changing the database user password in the shared data source, I noticed the package concerned would fail with the following description.

Source: "OraOLEDB"  Hresult: 0x80004005  Description: "ORA-01017: invalid username/password; logon denied".

Is there a way to ensure the packages will use the latest information in the shared data source?  I did do a Rebuild before executing the packages.

Thanks.


Best regards,

Jude.

Reading data file(txt) present in a file system from a package deployed in SSISDB

$
0
0

Hi,

I am trying to create and later read a data file from a package deployed in SSISDB, but it is not reading it while it is successfully creating the file. The same package when run from the file system package, runs successfully. Generating ispac and deploying in SSISDB is running for infinite time. Any idea? Is it a permission issue?

Thanks

Ayush

how to split excel workbook into individual sheets using SSIS 2008

$
0
0

how to split excel workbook into individual sheets using SSIS 2008 without using  " Microsoft.Office.Interop.Excel"

The Workbook need to be broken into multiple sheets available in the workbook.

the SSIS package will read the excel workbook and split into individual sheet  and rename the sheet with the name available in the workbook..

ssis practice

$
0
0

Hello,
Is there a way to install a free version of the latest SSIS and SSRS to practice in home PC?

Thank  you

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>