Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Error Occured while skipping data rows

August 22, 2013, 3:47 am
$
0
0

Hello

I'm having a problem with a flat file source in that the package throws an error straight away. The error I get is as follows:

Information: 0x4004300C at Data Flow Task, SSIS.Pipeline: Execute phase is beginning.
Error: 0xC0202091 at Data Flow Task, Flat File Source [2]: An error occurred while skipping data rows.
Error: 0xC0047038 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on Flat File Source returned error code 0xC0202091.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.

I've tried multiple things to resolve this.. Changing the OutputColumnWidth in the flat file connection manager, checking the file for any irregularites in notepad++ (each line ends as it should with CRLF), the file is encoded in UTF-8 without BOM and now I'm stumped as to what the problem could be. Any help would be appreciated.

Thanks.

↧
Search

How to get the file names from a drive

June 10, 2019, 7:35 am
$
0
0

Hello All,

I have a shared drive folder which consists of hundred's of pdf files. I am not worried about the content. I want to load these pdf file names into an excel . Can someone please suggest me the best way to do it?

Thanks

↧
↧

OLE DB Destination

June 10, 2019, 6:06 am
$
0
0

Hi,

When view existing data for the table the following error I received : 

There was an error displaying the preview.
------------------------------
ADDITIONAL INFORMATION:
The system cannot find message text for message number 0x80040e51 in the message file for OraOLEDB. (OraOLEDB)

↧

Integration Services -- Error

June 10, 2019, 1:22 pm
$
0
0

I recently installed SQL Server 2016 in the company, and after a few days I noticed that I can not get into Integration Services, after checking the error, it seems to me that it is a problem in the SSMS version, the version I installed was V.18 (15.0 .18) 

For the error I had, and in searches on the internet, it seems that another version of SSMS needs to be installed, I would like to know which version would be the correct one? and if I need to uninstall this version I'm using now, because I do not know if it has any impact on the uninstallation.

Thank you

MCP - MCTS - MCTS AD

↧

Unable to create the type with the name 'PowerQuery'.

June 11, 2019, 12:27 am
$
0
0

Microsoft SQL Server, Error: 27203

I can't deploy Power query connection. When project connection, it fails in Visual Studio (log file below, SQL message in the subject line). When I convert it to package connection, it gets deployed,and I see it in the list of connections in SQL Studio, however the operation fails because it fails to find the connection with the unique ID.

Both me and the server account has access to the folder specified in the connection properties. I tried installing both visual studio 2017 and 2019 the same result. SQL server is 2017 developer edition.

There are other SSIS packages successfully deployed and working. The package with Power Query works fine in the Visual Studio. 

Please help and thank you in advance.

PS (The link in the error redirects to the main Microsoft page)

===================================

Failed to deploy project. For more information, query the operation_messages view for the operation identifier '11989'. (.Net SqlClient Data Provider)

------------------------------
For help, click: http://go.microsoft.com/fwlink?ProdName=Microsoft%20SQL%20Server&ProdVer=14.00.1000&EvtSrc=MSSQLServer&EvtID=27203&LinkId=20476

------------------------------
Server Name: server\instance
Error Number: 27203
Severity: 16
State: 1
Procedure: SSISDB.catalog.deploy_project
Line Number: 139


------------------------------
Program Location:

   at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)
   at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)
   at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)
   at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)
   at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString, Boolean isInternal, Boolean forDescribeParameterEncryption, Boolean shouldCacheForAlwaysEncrypted)
   at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async, Int32 timeout, Task& task, Boolean asyncWrite, Boolean inRetry, SqlDataReader ds, Boolean describeParameterEncryptionRequest)
   at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, TaskCompletionSource`1 completion, Int32 timeout, Task& task, Boolean& usedCache, Boolean asyncWrite, Boolean inRetry)
   at System.Data.SqlClient.SqlCommand.InternalExecuteNonQuery(TaskCompletionSource`1 completion, String methodName, Boolean sendToPipe, Int32 timeout, Boolean& usedCache, Boolean asyncWrite, Boolean inRetry)
   at System.Data.SqlClient.SqlCommand.ExecuteNonQuery()
   at Microsoft.SqlServer.IntegrationServices.Common.ObjectModel.SqlHelper.ExecuteSQLCommand(SqlStoreConnection storeConnection, CommandType cmdType, String cmdText, SqlParameter[] parameters, ExecuteType execType, Int32 commandTimeout)
   at Microsoft.SqlServer.Management.IntegrationServices.CatalogFolder.DeployProject(String projectName, Byte[] projectStream)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeployExportProjectHelper.DeployProject(CatalogFolder folder, Project project)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeploymentModel.Deploy(CatalogFolder folder, Project project)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeploymentModel.DeployProject()
   at Microsoft.SqlServer.IntegrationServices.Deployment.DeployProjectPage.DoWork(Object sender, DoWorkEventArgs e)
   at System.ComponentModel.BackgroundWorker.OnDoWork(DoWorkEventArgs e)
   at System.ComponentModel.BackgroundWorker.WorkerThreadStart(Object argument)



↧
↧

'System Versioned' table Vs. "History" table

June 10, 2019, 6:39 am
$
0
0

Hi,

Could any one explain to me please what is the difference between 'System Versioned' table to a "History" table as  different temporal table types in SQL Server?

Thanks.



↧

Environment reference Id: NULL. error while executing the job

June 10, 2019, 3:12 am
$
0
0

Hi 

i'm getting an error while executing the job in sql server :

nvironment reference Id: NULL.  Description: Execution Timeout Expired.  The timeout period elapsed prior to completion of the operation or the server is not responding.  Source: .Net SqlClient Data Provider  Started:  5:00:00 AM  Finished: 5:00:30 AM  Elapsed:  30.078 seconds.  The package execution failed.  The step failed.

The package is on the integration services catalog.

Can anyone please provide me the suggestions for the same. 

thanks in advance 



↧

Integrate from ODATA Source to ADO Net Destination

June 10, 2019, 1:28 am
$
0
0

Hello,

I am working on integrate SSIS from OData source to oracle database.

I have created ODATA source connected to ADO NET Destination, the package is executed successfully and I have received ADO Net Destination wrote 38 rows. 

But the destination table have no data.


↧
Search

All Dates being Mapped to a Single Year in multi excel file import

June 10, 2019, 11:42 pm
$
0
0

I am trying to import 3 xls files with ssis into a single db table. The three files are for the years 2009,2010,2011.  comprising in total 126k rows. All the rows import but all the dates are mapped to the dates of the first file year imported ie 2009.Just to be clear, the day/month part of the date for years 2010 and 2011 are importing ok, but the year part is being changed to 2009.

The package consists of a for each loop container inside of which is a data flow task consisting of an excel file import and a destination of an ole db table.  Can anyone help please. Thank you.

↧
↧

Unable to create the type with the name 'PowerQuery'

June 11, 2019, 4:31 am
$
0
0

Microsoft SQL Server, Error: 27203

I can't deploy Power query connection. When project connection, it fails in Visual Studio (log file below, SQL message in the subject line). When I convert it to package connection, it gets deployed, and I see it in the list of connections in SQL Studio, however the operation fails because it fails to find the connection with the unique ID.

Both me and the server account has access to the folder specified in the connection properties. I tried installing both visual studio 2017 and 2019 the same result. SQL server is 2017 developer edition.

There are other SSIS packages successfully deployed and working. The package with Power Query works fine in the Visual Studio. 

Please help and thank you in advance.

PS (The link in the error redirects to the main Microsoft page)

===================================

Failed to deploy project. For more information, query the operation_messages view for the operation identifier '11989'. (.Net SqlClient Data Provider)

------------------------------
For help, click: h.....
------------------------------
Server Name: server\instance
Error Number: 27203
Severity: 16
State: 1
Procedure: SSISDB.catalog.deploy_project
Line Number: 139


------------------------------
Program Location:

   at System.Data.SqlClient.SqlConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)
   at System.Data.SqlClient.SqlInternalConnection.OnError(SqlException exception, Boolean breakConnection, Action`1 wrapCloseInAction)
   at System.Data.SqlClient.TdsParser.ThrowExceptionAndWarning(TdsParserStateObject stateObj, Boolean callerHasConnectionLock, Boolean asyncClose)
   at System.Data.SqlClient.TdsParser.TryRun(RunBehavior runBehavior, SqlCommand cmdHandler, SqlDataReader dataStream, BulkCopySimpleResultSet bulkCopyHandler, TdsParserStateObject stateObj, Boolean& dataReady)
   at System.Data.SqlClient.SqlCommand.FinishExecuteReader(SqlDataReader ds, RunBehavior runBehavior, String resetOptionsString, Boolean isInternal, Boolean forDescribeParameterEncryption, Boolean shouldCacheForAlwaysEncrypted)
   at System.Data.SqlClient.SqlCommand.RunExecuteReaderTds(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, Boolean async, Int32 timeout, Task& task, Boolean asyncWrite, Boolean inRetry, SqlDataReader ds, Boolean describeParameterEncryptionRequest)
   at System.Data.SqlClient.SqlCommand.RunExecuteReader(CommandBehavior cmdBehavior, RunBehavior runBehavior, Boolean returnStream, String method, TaskCompletionSource`1 completion, Int32 timeout, Task& task, Boolean& usedCache, Boolean asyncWrite, Boolean inRetry)
   at System.Data.SqlClient.SqlCommand.InternalExecuteNonQuery(TaskCompletionSource`1 completion, String methodName, Boolean sendToPipe, Int32 timeout, Boolean& usedCache, Boolean asyncWrite, Boolean inRetry)
   at System.Data.SqlClient.SqlCommand.ExecuteNonQuery()
   at Microsoft.SqlServer.IntegrationServices.Common.ObjectModel.SqlHelper.ExecuteSQLCommand(SqlStoreConnection storeConnection, CommandType cmdType, String cmdText, SqlParameter[] parameters, ExecuteType execType, Int32 commandTimeout)
   at Microsoft.SqlServer.Management.IntegrationServices.CatalogFolder.DeployProject(String projectName, Byte[] projectStream)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeployExportProjectHelper.DeployProject(CatalogFolder folder, Project project)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeploymentModel.Deploy(CatalogFolder folder, Project project)
   at Microsoft.SqlServer.IntegrationServices.Wizard.Common.Model.DeploymentModel.DeployProject()
   at Microsoft.SqlServer.IntegrationServices.Deployment.DeployProjectPage.DoWork(Object sender, DoWorkEventArgs e)
   at System.ComponentModel.BackgroundWorker.OnDoWork(DoWorkEventArgs e)
   at System.ComponentModel.BackgroundWorker.WorkerThreadStart(Object argument)


↧

packages run fine in SSMS but once the package is complied it fails with Truncaition erros.

June 11, 2019, 5:13 am
$
0
0

 Packages ran fine at completion of processing had to move server to a new IP address,   packages run fine in SSMS but once the package is  complied it fails with Truncation errors.  if i by pass the truncation error the characters being pulled from an Oracle Database get changed.  Like "?"  is flipped.  all the packages ran fine from the old IP address.

i get the following  two errors

"Import GPS Table - AT_CIRCUIT_BASE:Error: There was an error with Source - AT_CIRCUIT_BASE.Outputs[OLE DB Source Output].Columns[ATCIRCUITNAME] on Source - AT_CIRCUIT_BASE.Outputs[OLE DB Source Output]. The column status returned was: ""Text was truncated or one or more characters had no match in the target code page."".
"

"Import GPS Table - AT_CIRCUIT_BASE:Error: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED. The PrimeOutput method on Source - AT_CIRCUIT_BASE returned error code 0xC020902A. The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing. There may be error messages posted before this with more information about the failure.
"

if i run the packages manually  it run fine.

↧

SSIS Flat File Connection Manager does not skips the invaid rows at bottom of the file

June 11, 2019, 5:13 am
$
0
0
My file has almost 10 columns which are delimited by a "|". At the end of the file I have 2 invalid rows with only one value and with out any delimiter. Problem is the bad rows also getting inserted into my destination table.
↧

Calling Oracle Procedure with Input and Output parameters in SSIS

June 11, 2019, 5:20 am
$
0
0

I have a oracle procedure like below.

create or replace PROCEDURE PRC_PKG 

(
  NAME IN VARCHAR2
, ID OUT VARCHAR2 
, ISACTVE OUT VARCHAR2
) AS 

V_SQL_CHK  VARCHAR2(200);

BEGIN


    V_SQL_CHK := 'SELECT ID,ISACTIVE FROM SSIS_PACKAGE WHERE PACKAGE_NAME=:NAME ';
    EXECUTE IMMEDIATE V_SQL_CHK INTO ID,ISACTVE USING NAME;

EXCEPTION
-- WILL ADD DIFFERENT EXCEPTION HANDELER BASED ON THE TEST CASES
    WHEN OTHERS THEN
        DBMS_OUTPUT.PUT_LINE(SQLERRM(SQLCODE)); 

END PRC_PKG;

How to call this procedure with input and output parameters in execute sql task of SSIS 

            

sardarbaji

↧
↧

SQL Job that runs SSIS Package suddenly never completes

June 11, 2019, 8:55 am
$
0
0

I have an SQL Job that basically runs an SSIS Package which imports data from a text file to a DB. At first, it was working and I was able to import around 15000 rows from 4 text files.

I did some more bulk importing, this time with a different SQL Jobs and Packages that does basically the same but just targets a different file. I encountered a scenario where I had to cancel that very long-running job.

Now, when I run the original SQL Job that successfully imported 15000 rows, it no longer works! Before, it could import 15000 rows in around 5-minutes. I've been running it at around 30-minutes and it still hasn't completed yet.

Is there a way for me to see if there are any blockers for why it suddenly stopped working? I've deleted all duplicate records from the DB, no changes were made to the package, no changes to SQL Server except for just stopping that one long-running job, and I've already tried restarting the server but it still can't complete.

↧

SSIS File system task Can not copy or move file

June 11, 2019, 11:09 am
$
0
0

Hi I get this error when try to copy or move file from one dirrectory to another 

[File System Task] Error: An error occurred with the following error message: "The filename, directory name, or volume label syntax is incorrect. ".

yoba

↧
Search

SSIS package hits “login failed for user” when simultaneous operations occur against the same target database

June 11, 2019, 12:30 pm
$
0
0

I am facing the following configuration in my 2014/2016 SSIS environment.

All the connections in my SSIS package are configured to use a project parameter such as connection string and another project parameter with the password (sensitive). Well, everything works perfectly, but if I put multiple tasks without precedence to run, the package starts to fail. I did an analysis on the SQL Server used in the OLEDB Source and checked that the failures occur due to the wrong password. The strange thing is that while at the same time that the task presents a password error, another task in parallel, using the same connection string, can connect to the database. I came to the conclusion that the problem is in the configuration via project parameter, since if I remove the connection variables and directly use the server and the password, all tasks are executed without problem.

Important. Connections are made via SQL Server Authentication.

I found in the site (https://dba.stackexchange.com/questions/102570/ssis-package-hits-login-failed-for-user-when-simultaneous-operations-occur-aga) a problem very similar to mine.

I made a simple example, I created a package with 5 identical loops that have a stript task and a data flow with oledb source, both with the SQL command "SELECT 1 TEST", connecting in the same base.

When I use the parameter in the connection string, several times the packet fails with the message:

[Connection manager "xxx"] Error: SSIS Error Code DTS_E_OLEDBERROR An OLE DB error has occured Error code: 0x80040E4D.

An OLE DB record is available. Source: "Microsoft SQL Server Native Client 11.0" Hresult: 0x80040E4D Description: "Login failed for user 'xxxxxx'."

When I do not use parameters in the connection string, and I directly inform the user and password in the connector, the message does not appear once.

What I would like to know is if anyone knows why this occurs?

In large environments, how do you use the connection manager settings directly on the connector or use design parameters?

Thank you.

Package test

Package test

Connection configuration

Connection configuration

↧

SSIS Package last modified/deployed date - SQL Server

June 11, 2019, 1:02 pm
$
0
0

how to find SSIS Package last modified/deployed date in SQL server ?


RH

↧
↧

Error 12038 from ODBC provider when inserting into Always Encrypted table using CMK in Azure Key Store

June 11, 2019, 3:11 pm
$
0
0

I'm trying to insert data into an Azure SQL table with a column that's encrypted via Always Encrypted, and a column master key stored in Azure Key Vault. Attempting so results in this error:

[ADO NET Destination [2]] Error: An exception has occurred during data insertion, the message returned from the provider is: ERROR [CE269] [Microsoft][ODBC Driver 17 for SQL Server][SQL Server]Error 12038 sending request to https://[keyvault].vault.azure.net:443
ERROR [CE263] [Microsoft][ODBC Driver 17 for SQL Server][SQL Server]Error verifying signature of ECEK.
ERROR [CE202] [Microsoft][ODBC Driver 17 for SQL Server][SQL Server]The keystore provider AZURE_KEY_VAULT failed to decrypt the ECEK https://[keyvault].vault.azure.net:443/keys/[cmk]/[version] with RSA_OAEP.

I'm using an ADO.NET destination with the ODBC data provider, using this connection string:

DRIVER=ODBC Driver 17 for SQL Server;SERVER=[dbs].database.windows.net;UID=[uid@example.com];PWD=[password];Authentication=ActiveDirectoryPassword;DATABASE=[database];ColumnEncryption=Enabled;KeyStoreAuthentication=KeyVaultPassword;KeyStorePrincipalId=[uid@example.com];KeyStoreSecret=[password]

[uid@example.com] is an Azure Active Directory user that's provisioned in the Azure SQL database so it's able to log in. It has all key privileges granted to it in the key vault's access policy.

I've confirmed the encryption keys work, as I can manually insert data into the table via SSMS and observe the column values are encrypted as expected.

Does anyone know how to resolve the above error?

↧

Add a Not Null expression in MDX

June 11, 2019, 10:42 pm
$
0
0

Hello,

I have a KPI with this expression:

IIF(([Measures].[Fact Service Request Count],[Fact Service Request].[Be In KPIS].&[1],[Fact Service Request].[Applicant].&[1],[Fact Service Request].[Valid Humanity].&[1], [Subscriber].[KInd].&[1],[Fact Service Request].[Be Control].&[1],[Fact Service Request].[Control Result].&[1])=Null,0,([Measures].[Fact Service Request Count],[Fact Service Request].[Be In KPIS].&[1],[Fact Service Request].[Applicant].&[1],[Fact Service Request].[Valid Humanity].&[1], [Subscriber].[KInd].&[1],[Fact Service Request].[Be Control].&[1],[Fact Service Request].[Control Result].&[1]))

I wanna add this expression that "[Fact Service Request].[Payment Date] is not null".

How could I write it?

Thanks in advanance.

↧

Excel destination - not accepting column of length 2500 (varchar (2500))

June 12, 2019, 12:40 am
$
0
0

Hi Team, 

In SSIS i'm exporting a sql table records to a excel. So, SQL is source and excel is destination. 

During this course, i'm fetching a variable length column which is having length as 2500 and inserting it into excel and getting below error. 

Any clues how to solve this. Please help. 

----ERROR--------------------------------------------------------------------------

[Excel Destination [60]] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x00040EDA.

An OLE DB record is available.  Source: "Microsoft Access Database Engine"  Hresult: 0x80040E21  Description: "The field is too small to accept the amount of data you attempted to add. Try inserting or pasting less data.".

[Excel Destination [60]] Error: There was an error with Excel Destination.Inputs[Excel Destination Input].Columns[Copy of definition] on Excel Destination.Inputs[Excel Destination Input]. The column status returned was: "The value violated the schema's constraint for the column.".

[Excel Destination [60]] Error: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR.  The "Excel Destination.Inputs[Excel Destination Input]" failed because error code 0xC0209076 occurred, and the error row disposition on "Excel Destination.Inputs[Excel Destination Input]" specifies failure on error. An error occurred on the specified object of the specified component.  There may be error messages posted before this with more information about the failure.

[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Excel Destination" (60) failed with error code 0xC0209029 while processing input "Excel Destination Input" (71). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

----ERROR--------------------------------------------------------------------------

Thanks,

Vikram 


↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>