Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

What is the Estimated Row Size while using BLOB data?

$
0
0

The Buffer Size is calculated by calculating the Estimated Row Size. The Estimated Row Size is calculated by adding the maximum size of each output column from a Data Source Component.

The buffer size is calculated by multiplying estimated row size with default buffer max rows. We know that buffer size lies between 64KB and 100MB. After finding out the buffer size as per the above methods, the engine automatically adjusts the buffer size.

Bt my concern is related to blob data. The size of DT_NTEXT (blob data) is 2^30 bytes. I understand that while calculating the estimated row size 2^30 is not considered. But then what would be the estimated row size here and how the buffer size is getting calculated.

Thanks in Advance,

Regards,

Chhandak


SSIS 2012 Agent job errors with Excel data source - "The Microsoft Office Access database engine cannot open or write to the file 'C:\Users\Test.xlsx'. It is already opened exclusively by another user, or you need permission to view and write its data.

$
0
0

Hello, everyone,

I have a package that imports Excel (32 bit) spreadsheet into SQL Server 2012. In my SSDT, I set Run64BitRuntime to false. It works fine.

I then deployed the project to the Integration Services Catalogs and set up an agent job with 32 bit runtime checked. I first got this error:

Microsoft.ACE.OLEDB.12.0 is not registered on the local machine.

I then found the following link for this problem:

http://social.msdn.microsoft.com/Forums/en-US/1d5c04c7-157f-4955-a14b-41d912d50a64/how-to-fix-error-the-microsoftaceoledb120-provider-is-not-registered-on-the-local-machine?forum=vstsdb

Following the suggestions in the link I've installed the AccessDatabaseEngine.exe.

Ran the package again and this time  I got the following error:

mportDataDictionary:Error: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Microsoft Office Access Database Engine" Hresult: 0x80004005  Description: "The Microsoft Office Access database engine cannot open or write to the file 'C:\Users\Test.xlsx'. It is already opened exclusively by another user, or you need permission to view and write its data.".

I made sure that the file is not open anywhere and then shared the folder 'C:\Users\. I still get the same message.

Can any body help me on how to solve problem? Thank you in advance.

Regards



SSIS Find String in Path

$
0
0

Hello everyone

How can I get just"ozk" in the string below? 

C:\Users\ozk\Desktop\ozk.jpg  

Thanks in advance..


KAdir

Excel-Source outputs different date formats - leading to wrong DB values

$
0
0

Hello community,

I have Excel worksheets coming from different countries and Excel versions. My problem is a date column in the sheet.

Actually this date column causes two problems:
I know that Excel doesn't really convert cells to date values even if the cell formatting is set to it.

When I open any of the documents the date looks like this:

04.03.2014 - but in SSIS I sometimes also see this format: 3/4/2014

Those values will also convert to a date to insert into the DB but monthand day are swapped. So instead of the expected result of 04.03.2014 I'll get 03.04.2014 in the db.

Is there something I can do to handle this?

I would expect I have to use char as the Excel-source output and then do some transformation.
But how?

Thank you very much!


How to create dynamic variables with SSIS report ?

$
0
0

Hi everyone,

I want to create one dynamic SSIS report which  can show details when user input data into textbox . Example : Users will input app_id then report will show details of each this id ( name, phone,salary...) .

Pls help me solve it .

Many thanks,

Hong

Casting problem with UNION in OLE DB Source

$
0
0

I have SQL Server 2012 SSIS. There are 2 databases. Import and Analyses.
I have Data Flow Task. Inside it I have OLE DB Source and OLE DB Destination.

Data type is orginally nvarchar(100). Destination is nvarchar(100) as well.

I would like to use UNION statement for Data Source, but getting errors. This is mystery for me.

WHAT IS BEST PRACTISE WHEN I USE SQL STATEMENT AND UNION STATEMENTS IN OLE DB SOURCE?

Example value for CustomerAddress is "Union Street 5". Defitely less than 100 nvarchar.

[OLE DB Source [42]] Error: There was an error with OLE DB Source.Outputs[OLE DB Source Output].Columns[CustomerAddress] on OLE DB Source.Outputs[OLE DB Source Output].
The column status returned was: "The value could not be converted because of a potential loss of data."

[OLE DB Source [42]] Error: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR. 
The "OLE DB Source.Outputs[OLE DB Source Output].Columns[TimingValue]" failed because error code 0xC0209072 occurred,
and the error row disposition on "OLE DB Source.Outputs[OLE DB Source Output].Columns[CustomerAddress]" specifies failure on error.
An error occurred on the specified object of the specified component. 
There may be error messages posted before this with more information about the failure.

SELECT RowId,'Toyota' as 'CustomerName',CAST(CAddress AS nvarchar(100)) as 'CustomerAddress'
FROM [Integration].[dbo].[Import_A]
UNION
SELECT RowId,'Nissan' as 'CustomerName',CAST(CAddress AS nvarchar(100)) as 'CustomerAddress'
FROM [Integration].[dbo].[Import_B]


Kenny_I

Running a package created in SQL2005 on SQL2012

$
0
0

Hi,

A developer has moved a sqlagent job from 2005 to 2012. The job runs a SSIS package that is stored on a fileshare on another server.

Are you able to run 2005 Integration services packages on 2012 from the file system? Running it on the 2005 instance works fine but running it on 2012 gives the following error (I'm guessing the corrupt error message is because it's a sql 2005 package?

Any help would really be appreciated.

System.IO.FileNotFoundException: Could not load file or assembly 'Microsoft.VisualStudio.Tools.Applications.Core, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' or one of its dependencies. The system cannot find the file specified. File name: 'Microsoft.VisualStudio.Tools.Applications.Core, Version=10.0.0.0, Culture=neutral, PublicKeyToken=b03f5f7f11d50a3a' at Microsoft.SqlServer.IntegrationServices.VSTA.VstaHelper.<CleanUp>b__1a() at Microsoft.SqlServer.VSTAHosting.VSTAScriptingEngine.DisposeVstaHelper() at Microsoft.SqlServer.Dts.Tasks.ScriptTask.ScriptTask.MigrateVSAScriptTask(XmlElement elemProj, IDTSInfoEvents events) at Microsoft.SqlServer.Dts.Tasks.ScriptTask.ScriptTask.LoadFromXML(XmlElement elemProj, IDTSInfoEvents events) WRN: Assembly binding logging is turned OFF. To enable assembly bind failure logging, set the registry value [HKLM\Software\Microsoft\Fusion!EnableLog] (DWORD) to 1. Note: There is some performance penalty associated with assembly bind failure logging. To turn this feature off, remove the registry value [HKLM\Software\Microsoft\Fusion!EnableLog]. End Error Error: 2014-03-24 15:45:27.14 Code: 0x00000003 Source: Check For File Description: The Script Task is corrupted. End Error Error: 2014-03-24 15:45:27.14 Code: 0xC0024107 Source: Check For File Description: There were errors during task validation. End Error DTExec: The package execution returned DTSER_FAILURE (1). Started: 15:45:26 Finished: 15:45:27 Elapsed: 0.608 seconds. The package execution failed. The step failed.

Using Variables and Parameters as Expressions

$
0
0

Hi All

I'm stuck with one scenario and your help will be highly appreciated.

I did the following steps.

1- Drag Foreach Loop Container in Control Flow

 

2- Configure it like above attached picture.

3- Create parameter BankFileSourcePath,Datatypes =String, Value=c:\test

4- Create few variables see picture below.

5- Now I want to copy all source files into destination by using File System Task and I configure it like below :

Destination Connection

IsDestinationPathVariable = True

DestinationVariable =User::BankFileDestinationFile

Operation

Operation=Copy File

Source Connection

IsSourcePathVariable = True

SourceVariable               =User::BankFileName

But the problem is that I'm getting cross red sign on File System Task and it shows the following message .

"Variable BankFileName is used as source or destination is empty...

Your help in this regard will be highly appreciated. Thanks

Regards

Muz



converting nvarchar to char in ssis

$
0
0

I am getting data from Sql server db

i have one column 'validanswers' which is nvarchar(4000), but it was mapped to destination column which is char(18)

Source : nvarchar(4000)

Target  : char(18)

Here, i am facing the error in ssis like 'cannot convert between unicode and nonunicode'

i tried with converting source into 'DT_STR' but its not working, is it the right way to do?.

can anyone suggest me how to convert nvarchar(4000) into char(18)

Reading data from flatfile works local but not on server

$
0
0

I have some existing packages which I try to edit.

The packages load some data from flatfiles, which works great for the packages which are already on the server.

I edited the packages to load the data from the other flat files (same structure, just other name) and tested it in visual studio - works great.

Then I uploaded the edited packages to SQL Server and the flatfile import returned the following errorcode: 0xC020902A and a Message, that my column couldn't be converted because of truncation.
I did a data conversion to UTF-8 and this package worked on the server.

Then I opened the next package and I got a similar error 0xC0209029. I tried to convert this column as well but the it's an integer and I really can't find the problem.

It's a strange behavior anyway, as I can run the package locally without a problem and the final result in the database is correct.

Could this be some kind of setting or permission problem?

Thanks for your help! :-)

IS derived column

$
0
0

hi

In derived column how to get annual salary?

I tried this one sal*12 even i am getting the text in red colour(shows the error) even i am not able to use any operator,while i am using it is showing the red colour .help me out

thanks

SSIS Excel destination blank row

$
0
0

I have create an SSIS package in VS 2005 (because we are still in the stone age) where I have three Excel exports using the Excel Destination. One works fine but the other two have a blank first row each time (the second row of the sheet). I have reviewed other threads but cannot seem to find a solution.

I do not have extra data in my templates. I even tried creating new ones but that didn't help. Pressing <CTRL><END> takes me the the first line where the header is.

There was one that looked promising but the selected answer referred to dead Microsoft forum link (forums.microsoft.com/MSDN/ShowPost.aspx?PostID=2915256&SiteID=1).

Any suggestions to fix this?

Thanks for any help.


Move,Rename, Distribute and Process Files

$
0
0

Hey guys,

I got a task need to do but i am in mid of sea dont know how to implement... Here is my scenario..

1) I have 2 csv files in a folder A_3242014.csv and B_3242014.csv

2) Using SSIS i want to move the above files and rename them as A.csv and B.csv

3) Using Script Task or what ever other transformation i want to distribute this files to each of their DFT which process these files... I mean to say like if the File is A then DFT-1 should run, and if File is B then DFT-2 Should run.

4) The twist here is the file names coming from parent folder (A_3242014.csv and B_3242014.csv) are not constant. The files are dropped every month in one location with the date appended to them. So next month the file names changes i.e., from B_3242014.csv to B_4242014.csv.

To avoid all this i am trying to perform above 2 and 3 steps. Please let me know how to achieve this step by step.

Appreciate your time and help..


Thanks, Anji

SSIS Script task not executing macro through SQL Agent (but it does through bids)

$
0
0
<p>Hello everyone,</p><p>I am having an issue with SQL Agent when executing a macro contained in a script task component. The script task actually opens an excel file, runs the macro, save and closes the file. </p><p>When I execute the package via BIDS/Visual studio, it works like a charm. However, when i execute the package with SQL agent, the package runs successfully but it seems that the macro is not executed as the excel file has not been modified as it should have. Also, the history log does not show any error messages. </p><p>Could </p>

how to debug this error? trying to load excel file to Database

$
0
0
SSIS package "c:\users\asubedi\documents\visual studio 2012\Projects\Integration Services Project1\Integration Services Project1\PackageToLoadBuyerDedupe.dtsx" starting.
Information: 0x4004300A at BuyerDedupe, SSIS.Pipeline: Validation phase is beginning.
Error: 0xC0209303 at PackageToLoadBuyerDedupe, Connection manager "Excel Connection Manager": The requested OLE DB provider Microsoft.ACE.OLEDB.12.0 is not registered. If the 64-bit driver is not installed, run the package in 32-bit mode. Error code: 0x00000000.
An OLE DB record is available.  Source: "Microsoft OLE DB Service Components"  Hresult: 0x80040154  Description: "Class not registered".
Error: 0xC001002B at PackageToLoadBuyerDedupe, Connection manager "Excel Connection Manager": The 'Microsoft.ACE.OLEDB.12.0' provider is not registered on the local machine. For more information, see http://go.microsoft.com/fwlink/?LinkId=219816
Error: 0xC020801C at BuyerDedupe, Excel Source [2]: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC0209303.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.
Error: 0xC0047017 at BuyerDedupe, SSIS.Pipeline: Excel Source failed validation and returned error code 0xC020801C.
Error: 0xC004700C at BuyerDedupe, SSIS.Pipeline: One or more component failed validation.
Error: 0xC0024107 at BuyerDedupe: There were errors during task validation.
SSIS package "c:\users\asubedi\documents\visual studio 2012\Projects\Integration Services Project1\Integration Services Project1\PackageToLoadBuyerDedupe.dtsx" finished: Failure.
how to debug this issue?

2008 SSIS Designer stops working after installing VS11 Dev Preview

$
0
0

Immediately after installing the Visual Studio 11 Developer Preview, I was no longer able to open a SSIS package in VS 2008. I uninstalled it and all the .NET 4.5 associated packages, reinstalled both VS 2008 and SQL 2008, but still it refuses to work. 

This is the specific error I get when attempting to open one. 

 

===================================

An error prevented the view from loading. (Microsoft Visual Studio)

===================================

The specified module could not be found. (Exception from HRESULT: 0x8007007E) (System.Windows.Forms)

------------------------------

Program Location:

   at System.Windows.Forms.UnsafeNativeMethods.CoCreateInstance(Guid& clsid, Object punkOuter, Int32 context, Guid& iid)

   at System.Windows.Forms.AxHost.CreateWithoutLicense(Guid clsid)

   at System.Windows.Forms.AxHost.CreateWithLicense(String license, Guid clsid)

   at System.Windows.Forms.AxHost.CreateInstanceCore(Guid clsid)

   at System.Windows.Forms.AxHost.CreateInstance()

   at System.Windows.Forms.AxHost.GetOcxCreate()

   at System.Windows.Forms.AxHost.TransitionUpTo(Int32 state)

   at System.Windows.Forms.AxHost.CreateHandle()

   at System.Windows.Forms.Control.CreateControl(Boolean fIgnoreVisible)

   at System.Windows.Forms.Control.CreateControl()

   at Microsoft.DataWarehouse.Design.ComponentDiagram.CreateDdsView(Control parentControl)

   at Microsoft.DataTransformationServices.Design.DtsComponentDiagram.CreateDdsView(Control parentControl)

   at Microsoft.DataWarehouse.Controls.DdsDiagramHostControl.set_ComponentDiagram(ComponentDiagram value)

   at Microsoft.DataTransformationServices.Design.ControlFlowControl.set_ComponentDiagram(ComponentDiagram value)

   at Microsoft.DataTransformationServices.Design.DtsPackageView.CreateControlFlowEditor(VsStyleToolBar pageViewToolBar)

   at Microsoft.DataWarehouse.Design.EditorWindow.EnsureViewIsLoaded(EditorView view)

 

File System Task Editor closes when selecting DestinationVariable

$
0
0

I've set up a File System Task to move a file. I set
IsDestinationPathVariable to True. When I click inside the
DestinationVariable value column and either click the drop-down arrow or
hit the up/down arrow keys on my keyboard, the File System Task Editor
window closes immediately. In the same task, I have also set
IsSourcePathVariable to True and am able to select SourceVariable
without an issue. If I set IsDestinationPathVariable to False, the
DestinationConnection drop-down appears to work fine. I've tried
restarting Visual Studio, but it had no effect. i tried creating a new package within the same Project but the effect was the same.

BUT if i create a new Project than the task works!

Cannot acquired connection for Excel

$
0
0

I have a SSIS packages that save output to Excel file.  I configure the SQLAgent to use the 32 bit runtime in the Execution options tab.   Job ran and failed with the following message.  I am not sure what other options I need to include in the SQLAgent job step.  Please help.

Error: 

The AcquireConnection method call to the connection manager "Excel Connection Manager" failed with error code 0xC0202009.


W.E. Pan

What right do I need to run package via job on separate SSIS machine?

$
0
0

SQL/SSIS 2012

I have a Database Server with SQL Server Agent and I have separate SSIS server with packages in the SSIS catalog (same domain). The SSIS machine has a local db engine just for storing the SSISDB/Catalog.

I want to create a job on my Database Server that runs an SSIS package from that separate SSIS server. I'm using a domain user (credentials & proxy). What rights do I have to give that user on my SSIS machine to run that package.

The package is reading a local file and dropping the data in a database (via a SQL Server account).

Can any one suggest me how can I use relative path inside SSIS pacakge to access config file ?

$
0
0
Can any one suggest me how can I use relative path inside SSIS pacakge to access config file ? Please help me as its urgent.THanks for your help in advance.
Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>