Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Problem with scheduling SSIS package which uses Windows & SQL Authentication

$
0
0

Hi all,

I hope someone can help me, I have hit a brick wall :( 

I have set up an SSIS package on one of my servers [Server A] which extracts data from a 3rd party server [Server B] (I have SQL authentication to that server as it isn't mine and it is all that it available), the package then does some work on the data itself then dumps that data on another one of my own servers [Server C] (Windows authentication, full admin rights etc). 

Because of existing processes and systems I have to use Server A to run the job to transfer the data between B & C.

The package runs fine when I run it from Server A, which I have done as running it as a plain file through Visual Studio, and I have also uploaded the package to the integration services of Server A and ran it from there manually no problem.

The issue I have is when I set the package up to run as a scheduled job within Server A. The job is set to run the package using a proxy account which has Admin access on Server C to dump the data, but for some reason it keeps failing and I am sure it is something to do with getting the data from Server B, (at a guess - it's like the job is trying to use Windows authentication instead of the SQL authentication which I have saved within the package?!).

I have read various other posts and tried changing the security level on the package to 'with password' then use the /DECRYPT extension on the job, but it makes no difference and I still get the same error (which is unfortunately very little as the job history tells me nothing apart from what step it failed on)

Have I missed some blindingly obvious option somewhere as to why it doesn't work using the proxy account? For testing purposes I wanted to use a process of elimination to find what the problem was and I created similar jobs that just dumped data onto server C using a job on Server A and this scheduled job worked fine.

I then did a scheduled job that did nothing apart from extract data from server B and it failed again, so it really does seem like the proxy account just isn't utilising the SQL authentication I have saved in the package but I don't know why.

If anyone has any advice I would appreciate it!

Thanks


OLEDB Destination SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER error code 0xC0202009

$
0
0

Hi Guys,

Please help me on this.

Source in my SSIS package: .csv file

Destination: OLE DB Destination

Whenever I test connection in OLEDB connection manager, connection is getting succeeds. But while executing package, giving this error. I referred solutions for this error from blogs and got the below suggestion:

Set property 'Run64bitRuntime' to false and tried the same

But still getting the error.

check for child directory under parent directory

$
0
0

I have Parent directory listed as C:\Main\

Using query result set im getting list of child folders that needs to be pulled from source to target and child directory's can be abc,def and so on

I need to check if abc or def exists under C:\Main\ . If it exists i need to copy from source to target if it doesnt exist i need to skip it.

How do we achieve this using SSIS.

Any help much appreciated.

import data from table to excel when column length >255

$
0
0

 import data from table to excel  when column length >255 ,

how to solve this ,i can't change register settings on server.

For each loop container is not picking up the .csv source file

$
0
0

Hi Everone,

Good morning.

My package is having .csv file as a source and I kept OLEDB destination to load it.

Stored the .csv file in a shared folder and the exact path is given in Enumerator configuration of the foreach loop container.

When I execute my package, it is giving the warning as below:

It is saying that file is not there in the specified path and directory is empty. I am running the SSIS package from TFS.

I am sure that I have read and write access for the shared folder for my userID. Is there any access there to pick up this

file from path.

Please suggest..Thank you

unzip files using execute process task

$
0
0

hi to all,

while i am trying to unzip files using execute process task ,getting below error

[Execute Process Task] Error: In Executing "C:\Program Files\7-Zip\7z.exe" "a -tzip D:\excel.zip D:\unzipfile\excel.xls" at "", The process exit code was "1" while the expected was "0".

Warning: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED.  The Execution method succeeded, but the number of errors raised (1) reached the maximum allowed (1); resulting in failure. This occurs when the number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.

i want to know more about unzip and zip files and folders using execute process task.

can anyone please give good instructions.

zip folder:  C:\Program Files\7-Zip\7z.exe

SQL version: SQL server 2008 R2

do not having win rar so please instruct using 7z.

its quite interest to work but i don't know to get desired result.


GVRSPK VENI


Use vbscript for ETL

$
0
0

Hi,

I know it is possible to use vbasic .NET in script for ETL but, is is possible to use vbscript (not .NET) in the script of the ETL?

Thanks in advance.

Regards.

SSIS data flow task fails giving error : 0x8007000E Description: "Out of memory.".

$
0
0

I am trying to transfer data from SQL Server table to Oracle table using SSIS data flow task. My SQL server 2008 R2 and Oracle 11g databases are on the same system and both are 64-bit. My machine is Win 7 (64-bit) with 16 GB RAM and I am running the package in Development mode in BIDS.

The table structure in SQL server is:

[id] [char](20) NOT NULL,
[total_size] [decimal](15, 2) NOT NULL,
[attachment] [image] NULL,
[STORE_ID] [char](20) NOT NULL DEFAULT '00000000000000000000'

And table structure in Oracle is:

  ID          CHAR(20 BYTE),
  TOTAL_SIZE  FLOAT(126),
  ATTACHMENT  LONG RAW,
  STORE_ID    CHAR(20 BYTE)                     DEFAULT '00000000000000000000'

During execution of Data Flow task I am getting below errors:

[OLE DB Destination [28]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x8007000E.
An OLE DB record is available.  Source: "Microsoft Cursor Engine"  Hresult: 0x8007000E  Description: "Out of memory.".

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "OLE DB Destination" (28) failed with error code 0xC0202009 while processing input "OLE DB Destination Input" (41). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

[OLE DB Source [1]] Error: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "OLE DB Source" (1) returned error code 0xC02020C4.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.

I had tried with various combination of DefaultBufferMaxRows, DefaultBufferSize, and EngineThreads; but still I get the error after 189,877 rows are transferred in Oracle out of 233808 rows in SQL Server.

Has anyone overcome on this issue? Please provide your inputs on the errors.

Thanks and regards,

Neel


Newbie in SQL Script Component

$
0
0

Hey guys,

I've been searching around numerous forums and I can't seem to get the response I fully understand. So I have a C Sharp Code which displays different active directory attributes for example username, account expiration date from a given domain name. I wrote and executed the code on Microsoft Visual Studio. Now I want to create a SSIS Package. So I'm using Script Component (as a source) to load the code. So I don't know how I can load the code to Script Component? I have absolutely no idea. Any Ideas? Should I be connecting a flat file source.But then how do I convert my C sharp to a csv file?

ETL / SSIS SharePoint 2013 and Project Server 2013

$
0
0

After we installed the Feb and Mar CU patches for project server 2013. I'm getting the following errors on my SSIS package create to extract list data from project server 2013 lists:

[OData SourceProject [2]] Error: The OData SourceProject was unable to process the data. An error occured when detect the document payloadkind.

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on OData SourceProject returned error code 0xC02090F5.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.


Thanks for any help

Bulk insert is locking a file delete task

$
0
0

Hello,

I have an SSIS package doing a bulk insert from a file. Then later on I'm trying to delete that file (in a file delete task), but I'm getting an error:

[File System Task] Error: An error occurred with the following error message: "The process cannot access the file 'xyz' because it is being used by another process.".

I'm wondering if there isn't some way to 'tweak' the bulk insert syntax so that it doesn't lock the file?

Thanks,

phil

Lookup Transformation

$
0
0

Hello All,

My source has 2.2 million of records. I'm performing the incremental load.
In the lookup transformation i used the destination table for the reference using Full cache mode.

For the first time package executed successfully but when i executed the package second time, Suddenly Package hangs while running.

Than i truncate the data from the destination table and restart the SQL Server Services.
After doing all this i executed package again and it worked but when i executed package second time, again package hangs up .

What is the problem??

I have 8GB RAM and i5 2.5 GHz Processor laptop.




Could not bulk load. The sorted column XYZ is not valid

$
0
0
Hi everyone,

I am trying to test a bulk load in a empty table with a clustered index, without dropping the index.

I have a single DFT with a OLE DB Source direct mapped to a OLE DB Target.

The records are sorted by the column, let's say XYZ. I edited the advance properties of the source to set it as sorted, and put a "1" in the XYZ column Sort Key Position property.

I set the target to use a "Table or view - fast load" with "0" as the Maximum insert commit size, table lock and the ORDER(XYZ Asc) in the Fast Load Options.

I want to use the same key as in the source in my target table.

The target table has no identity specified for the primary key.

The data type of the XYZ is big int. I am using SQL Server 2012.

I am getting this error message and I don't really know what else can I do:

Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80004005  Description: "Could not bulk load. The sorted column 'XYZ' is not valid. The ORDER hint is ignored.".

Could anyone help me? Any comment will be appreciated.

Kind Regards,

.dtsx file looks like gibberish any way to restore/ recover it?

$
0
0

My .dtsx file I belive got corrupted and it looks like this now

00000000 00 00 00 00  00 00 00 00 00 00 ...........................................

00000010 00 00 00 00 00 00 00 00 00 00 ............................................

00000020 00 00 00 00 00 00 00 00 00 00 ............................................

00000030 00 00 00 00 00 00 00 00 00 00 ............................................

Is there any way to recover this file or am I screwed ?

create the suggate key in ssis 2008 r2

$
0
0

Hi

 how  to create the surrogate  or row numbers in ssis 2008 r2 . give me with examples


Excel column turns to blank/NULL while import using SSIS Excel source 2008

$
0
0

While importing data from Excel source , some column is getting null value even though excel column has value.

To Resolve the issue we tried with

HKEY_LOCAL_MACHINE\SOFTWARE\Wow6432Node\Microsoft\Office\14.0\Access Connectivity Engine\Engines\Excel

1.Change the Value  of the Row TypeGuessRows from 8 (Default value) to 0  and ImportMixedType = text


• xls

HKEY_LOCAL_MACHINE\SOFTWARE\Microsoft\Jet\4.0\Engines\Excel\

1.Change the Value  of the Row TypeGuessRows from 8 (Default value) to 0  and ImportMixedType = text

the connection string of the excel

UPPER(REVERSE(SUBSTRING( REVERSE(@[User::VarInputExcelFile]), 1, 5) ) ) == ".XLSX" ? "Provider=Microsoft.ACE.OLEDB.12.0;Data Source=" + @[User::VarInputExcelFile] + ";Extended Properties=\"Excel 12.0;HDR=Yes;IMEX=1\";":"Provider=Microsoft.Jet.OLEDB.4.0;Data Source=" + @[User::VarInputExcelFile] + ";Extended Properties=\"EXCEL 8.0;HDR=Yes;IMEX=1\";"

by doing the above setting also , the column is coming as null from excel source even though there is data in excel..

 

Error installing SSDTBI_VS2012_x86_ENU.msi

$
0
0

Hello,

Please can you help me solve the below error when installing Microsoft SQL Server Data Tools - Business Intelligence for Visual Studio 2012.

Below is the exact error :-

---------------------------
Microsoft SQL Server Data Tools - Business Intelligence for Visual Studio 2012
---------------------------
An error was encountered.

Unspecified error
---------------------------
OK   
---------------------------

Softwares I have installed :-

1. OS : Windows 8 Pro 64 Bit

2. Microsoft SQL Server 2012 (SP1) - 11.0.3128.0 (X64)
    Dec 28 2012 20:23:12
    Copyright (c) Microsoft Corporation
    Enterprise Edition (64-bit) on Windows NT 6.2 <X64> (Build 9200: )

3. MS Visual Studio 2012 v11.0.50727.1 RTMREL

Note : Same setup works on Windows 7 OS meaning the msi is NOT corrupt.

Thanks,

Shirish

How to run ssis Package by SQL Server Agent JOB - using a chosen Envirment ( variables ) ?

$
0
0

Hi everybody ,

i know how to schedule a job and run ssis Package from the Catalog :

buti need to run it with a chosen configuration dev/prod :

the A parameter can be one of the tow :

can any one has the knolage to do it ? thanks.


yaniv012 from M.S.

SSIS - Choosing Input Flat File Via Dialog Box

$
0
0

Hi

I am a SSIS newbie and want to know:

  • If I can select an input flat file via a dialog box, or it is necessary to either hardcode the file name or change the filename everytime to a similar format; &
  • How can a query be run and processed in SQL right after input of a flat file to continue?

Thanx in advance, Best Regards, Faraz A Qureshi

delete txt file created through flat line connection

$
0
0

Hi all,

created a very basic flow in SSIS: extracted table data through ole db connection, added multicast and as end result i created a flat file destination (with .txt file) and a ole db destination.

My question is; how can i delete the .txt file before executing the flow again? Want to avoid that the .txt file has duplicated rows after a second execution of the flow. Is it possible to use scd component or is this way to complicated? A for each loop? There are several options, but i am looking for a simple solution to solve this....

Almost forgot: i need a similar solution for the data that will be transported through the ole db destination task....

Any ideas?
thnx

M



Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>