Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Getting errors - not sure about them

May 2, 2020, 7:17 pm
$
0
0

Hi everybody,

I want to run a package that has for-loop container and data flow from a flat file into database table. I need to skip the second row in the file (the first row is the column names, the second - some garbage, the rest is data). In the Flat File Connection Manager I have set Data Rows to skip 1. The preview shows everything correctly, however when I try to run it I get this error

Warning: 0x80049304 at Data Flow Task, SSIS.Pipeline: Warning: Could not open global shared memory to communicate with performance DLL; data flow performance counters are not available.  To resolve, run this package as an administrator, or on the system's console.
Information: 0x40043006 at Data Flow Task, SSIS.Pipeline: Prepare for Execute phase is beginning.
Information: 0x40043007 at Data Flow Task, SSIS.Pipeline: Pre-Execute phase is beginning.
Information: 0x402090DC at Data Flow Task, Flat File Source [11]: The processing of file "file name here" has started.
Information: 0x4004300C at Data Flow Task, SSIS.Pipeline: Execute phase is beginning.
Error: 0xC0202091 at Data Flow Task, Flat File Source [11]: An error occurred while skipping data rows.
Error: 0xC0047038 at Data Flow Task, SSIS.Pipeline: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on Flat File Source returned error code 0xC0202091.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.
Information: 0x40043008 at Data Flow Task, SSIS.Pipeline: Post Execute phase is beginning.
Information: 0x402090DD at Data Flow Task, Flat File Source [11]: The processing of file "file name here" has ended.
Information: 0x4004300B at Data Flow Task, SSIS.Pipeline: "OLE DB Destination" wrote 0 rows.
Information: 0x40043009 at Data Flow Task, SSIS.Pipeline: Cleanup phase is beginning.

----------------

What does this error mean and how can I resolve it?

Also, I'm running this through RDP and I don't have admin password, I can only run every program as a user.

For every expert, there is an equal and opposite expert. - Becker's Law


My blog

My TechNet articles


↧
Search

Insert hardcoded varbinary value to a table

May 21, 2020, 5:26 am
$
0
0

Hi,

I am generating a varbinary value by using a function EncryptByPassPhrase.

I want to insert the value generate by this function later, so that I can get the exact value using DecryptByPassPhrase

But I am not able to insert the value to a table although the datatype of the column is declared as varbinary. I am getting an error :

Msg 257, Level 16, State 3, Line 15
Implicit conversion from data type varchar to varbinary is not allowed. Use the CONVERT function to run this query.

If I try to convert the value obtained from EncryptByPassPhrase to varbinary, value itself gets changed

Can you please let me know if we have any option to insert the actual varbinary value, so that it can be used later.

/*
declare @encrypt varbinary(200) 
select @encrypt = EncryptByPassPhrase('testEncrypted', 'test123' )
select @encrypt
--0x0200000044F112C1BDAB4BDD59C55FFEBEA2D39B140A1B458AB8EAE93153CDA153AD46B8
select convert(varchar(100),DecryptByPassPhrase('testEncrypted', @encrypt ))
*/
CREATE TABLE TestEncryptedKeys
(PhraseName varchar(50), EncryptedValue varbinary(200))

declare @encrypt varbinary(200) 
--select @encrypt = cast('0x02000000F68D569587F523DD2468200E88EEDA707C59087D20514F5BA1A1F7C11F9CAB46' as varbinary(200))
--select @encrypt = '0x02000000F68D569587F523DD2468200E88EEDA707C59087D20514F5BA1A1F7C11F9CAB46'
select @encrypt

--INSERT INTO EncryptedAzureKeys VALUES('testEncrypted', @encrypt)
INSERT INTO TestEncryptedKeys VALUES('testEncrypted', '0x02000000F68D569587F523DD2468200E88EEDA707C59087D20514F5BA1A1F7C11F9CAB46')

Raksha

↧
↧

Not able to see ODBC 64bit drivers in SSIS connection manager drop-down list.

May 21, 2020, 8:45 am
$
0
0
I am not able to see ODBC 64bit drivers in SSIS connection manager drop-down list? only 32bit drivers are appearing in Visual Studio 2017 SSIS project. Any solution to see list of available DSN 64bit ODBC drivers?
↧

Delete data in loop using values available in the table without PrimaryKey & ForeignKey violation errors

May 21, 2020, 10:23 am
$
0
0 
DROP TABLE #Temp

CREATE TABLE #Temp (ID int, ColumnName varchar(100), ValueToBeDeleted varchar(100), TableName varchar(100),ServerName varchar(100))
INSERT INTO #Temp
SELECT 1, 'CustomerID'	, '123'	, 'Database.dbo.Customer', 'tprd1' UNION ALL
SELECT 2, 'CustomerID'	, '142'	, 'Database.dbo.Customer', 'tprd1' UNION ALL
SELECT 3, 'OrderID'		, 'OR124'	, 'Database.dbo.Orders'	, 'tprd1' UNION ALL
SELECT 4, 'ProductID'	, '65655'	, 'Database.dbo.Product', 'tprd1' 

--SELECT * FROM #Temp t

I have kind of above table where i have values to be deleted from the sources. For example sake i am posting 4 rows here but there are millions of rows that i have to work on.  This table keeps on growing.
Within SSIS i need to loop through all the rows and construct a SQL like below and EXECUTE on the respective Server and DB found in the table.
But, am getting PrimaryKey foreign key violation errors WHILE running the package. How do we bypass Pkey and Fkeys to DELETE the data ? Or is there any way i can DELETE data without dropping the PrimaryKEy or ForeignKeys ? 

DELETE FROM Database.dbo.Customer WHERE CustomerID =123 
↧

SSIS for SQL Server 2017 Express, Instalation failure: Unknown error (0x80131500) (0x80131500)

May 21, 2020, 10:49 am
$
0
0
I am trying to install SSIS version 3.7, however I am receiving the following message:Unknown error (0x80131500) (0x80131500)

Can anyone tell me what the problem is?
↧
↧

db2 driver azure and laptop differences

May 21, 2020, 1:33 pm
$
0
0

Hi,

     Difficult problem here.  New to db2.  Just looking for places to start.  I installed a v 11.x db2 driver on my laptop, using vs 2015 enterprise and ssis ssdt 14.x .   i was able to login to the db2 server with both ssis and the native db2 tools if I overrode the port number to say 20000.  No one else in my group needs to override the port number to 20000.   Then I ran the job on azure with a completely different db2 driver and I still have to override my port number to get it to work and no one else in my group does.  I will grant that the db2 driver I have could have a different configuration than the people I work with but why would that carry over to a an azure server with just one db2 client install?  Can't promote this package forward in the azure sdlc chain if my db2 server reference has to be custom.


↧

Runnin batch file using Execute Process task

May 21, 2020, 1:32 pm
$
0
0


I am trying to execute a bacth file using cmd.exe as executable. The batch file takes two parameters. Everytime I run this, the task fails and there is no details error message anywhere. Except task failed with exit code 0. Can you help?

↧

How do we connect SMO Connection Manager thru variables/parameters?

May 21, 2020, 2:35 pm
$
0
0

Need to copy database AA from sql server instance A to remote SQL server instance B.

I use SSIS.

I use transfer database task. Use SMOserver to connect sql server instance A and instance B.

I have problem to connect when use parameters: 

under SMO server connection manger:

under expressions

SourceConnection =@[project::sqlservernamesource]

DestinationConnection = @[project::sqlservernamedestination]

under project parameters:

sqlservernamesource    type is string                value is sqlserverA

sqlservernamedestination  type is string             value is sqlserverB

I get error messages: The connection sqlserverA could not be found in the package

                               

                                 The connection sqlserverB could not be found in the package

If I don't use variable/parameter/expression, direct input sqlserverA and sqlserverB work.

How to fix this problem? thanks

↧
Search

SSIS scheduled job fails

May 16, 2020, 9:03 am
$
0
0

Hi,

I am running an SSIS scheduled job on an SQL Server 2012(SP3 11.0.6260.1) instance. This job is running on-premise and the target is Dynamics 365.  Starting from schedule the job always fail with an "Unexpected empty response". If i start the job manually it runs just fine. I use the same account as the proxy starting the job.

Error message:

"Copy CRM Data:Error: KingswaySoft.IntegrationToolkit.DynamicsCrm.WebAPI.WebApiServiceException: Unexpected empty response received from the resource URL: https://xyz.crm4.dynamics.com/api/data/v8.0/RetrieveVersion ---> System.Exception: Unexpected empty response received from the resource URL: https://xyx.crm4.dynamics.com/api/data/v8.0/RetrieveVersion
   at tzt.bcf(Uri mb, String& mc, String& md)
   at tzt.bce()
   at tzt.bcb()
   at uhk.iyn(String bdc, String bdd)
   at uhk.rlq.osq()
   at tzh.pfx[bz](Func`1 iq, Func`2 ir, Int32 is, PipelineComponent it)
   --- End of inner exception stack trace ---
   at tzh.pfx[bz](Func`1 iq, Func`2 ir, Int32 is, PipelineComponent it)
   at uhk.iyk(String bcx, String bcy, String bcz)
   at uhk.iyd(String bcs, String bct, String bcu, HttpStatusCode& bcv)
   at uhk.iyi()
   at uhn.tjs()
   at uhn.pye(String bir)
   at System.Collections.Concurrent.ConcurrentDictionary`2.GetOrAdd(TKey key, Func`2 valueFactory)
   at uhn.pxm(String bge)
   at uhj..ctor(uhn bbr, uaa bbs)
   at uhn.tjk(uaa hgj)
   at KingswaySoft.IntegrationToolkit.DynamicsCrm.CrmSourceComponent.PreExecute()
   at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostPreExecute(IDTSManagedComponentWrapper100 wrapper)"

Anyone have clue what can be the problem?

Best regards
Frode M

↧
↧

Google BigQuery's ODBC driver works EXCEPT when temp table in used in the query

May 21, 2020, 9:21 pm
$
0
0

Google provides this link with Simba ODBC driver:

https://cloud.google.com/bigquery/providers/simba-drivers

Installation and configuration is easy. SSIS can pull data from Big Query as would from Oracle and Cloudera. But I hit the issue. If I use temp tables in Biq Query queries SSIS ODBC Source Editor's Preview will still show the first 200 data rows but Columns will show blank. If Biq Query queries use plain select or CTEs SSIS ODBC Source will work fine.

Complex queries with CTEs will produce "exceeding resources" error in Big Query. Queries with temp tables will pass Big Query but not work in SSIS ODBC source as stated above.

The only solution left for me is to rewrite queries with nested sub queries making poor code readability.

I tested using Excel to pull data with Simba driver queries with both CTEs and temp tables work fine. So I think this is SSIS issues. Hope Microsoft team can help on this.

 

↧

specified provider not supported

March 24, 2020, 2:36 pm
$
0
0

Hi under vs 2013, for an ssis 2014 pkg, one of my connection managers is showing an error even though its is likely coded correctly as its gotten from source control.  the error is "the specified provider is not supported...".

the connection string in the xml code looks like this   

DTS:ConnectionString="Data Source=xxxxxxx;Initial Catalog=yyyyyyyyyy;Provider=SQLNCLI10.1;Integrated Security=SSPI;Auto Translate=False;" 

i'm looking up sqlncli10 and understand this isnt a vs forum, but what provider is missing and how does it is normally get onto someone's local?  i installed vs from msdn (ultimate with update 5, i have a subscription).  I added data tools from a sql 2014 install media update.  I believe a local instance of the 2014 engine was already uninstalled by the time i installed data tools.

↧

SSIS ODBC Source get char string truncated in middle when converting to unicode DT_WSTR

May 8, 2020, 5:54 pm
$
0
0

SSIS

In a simplified test, the SSIS package reads from an ODBC Source of MySQL, and writes to aFlat File Destination of text file.

The source contains columns of char(xx) and varchar(xx), and these columns get truncated at half of the length when reach destination. I noticed in Advanced Editor that these columns are DT_WSTR in both sections of External Columns and Output Columns, and the length equals to the source.

As a workaround, I changed ODBC Source to ADO NET Source, and the problem disappears.

I need some pointers to find out what was wrong when using ODBC Source.

It is on Windows with driver mysql-connector-odbc-8.0.12-winx64.msi, and please let me know if need more details. Thank you for your help.

↧

ssis help

May 22, 2020, 10:28 am
$
0
0
Hi I have one doubt in ssis
how to give performance while loading data from sql serve to postgres

sql server table : emp have 20 lakhs records with 20 fields

postgres server : emp  

I want load data from sql serve to postgres using ssis 
here no business logics  and no data conversion.its 
tasking more than  20 hours 

system ram is : 8 gb
odbc batch size : 1000


could you please tell me how to improve performance while loading data from sql serve to postgres using ssis package
↧
↧

error when run transfer database task

May 22, 2020, 10:41 am
$
0
0

Copy database from sql server A to SQL server B.

Use transfer database task

get the following error message when execute on visual studio

Error: The Execute method on the task returned error code 0x80131922 (A column named 'Name' already belongs to this DataTable.). The Execute method must succeed, and indicate the result using an "out" parameter.

What's the problem? How to fix it?

↧

How to update Connection string in SSIS package Configuration file stored in SQL Server table

May 22, 2020, 1:28 pm
$
0
0

I have created SSIS Package in visual studio 2017 and added package configuration file stored in sql server table using the default create table script. I have deployed the solution to SQL Server 2019 on my development machine.Now In my development machine everything works but I want to move it to production which is a different environment. I want to write a sql update script for another person to be able to update the connection setting on the production server. I have written an update script which successfully updates the connection string in the table but my package configuration manager is still not reflecting the changes. How can I update the table and let package Configuration manager show the new Connection string. Any help will be appreciated.

Ebenezer

↧
Search

restore database SSIS catalog

May 7, 2020, 9:44 am
$
0
0

One developer accidently deploy a SSIS project and overwrite an exisitng project with the same name.

I would  like to restore the SSIS database on the same server overwriting the existing SSISDB database.

I see online there is a need to restore the master key.

Do I need to do that step?

I use the backup of yesterday, I do this on same database on same server.

THanks

Thanks

↧

How to export share point page content dynamically to any file

May 22, 2020, 11:59 pm
$
0
0

Hello,

would be great if any one can help me to fetch the details automatically to any file from below share point url.

https://sharepoint.sun.com/sites/Orders/information/lists/order%20list%20tracker/current.aspx

in this page 3 tabs are there as below and i want to export data to file from current page only 

Please help me on this.

Thank You,

Avis


↧
↧

SSIS google-bigquery Simba ODBC - two scenarios

May 23, 2020, 7:26 am
$
0
0

SSIS ODBC source will show preview of the first 200 row for both scenarios. But it will pull in Columns for only scenario one NOT scenario two. It seems caused by metadata confusion of the query output. Please help.

Google BigQuery Scenarios one:

 

WITH Example as

(

  select 5 as x, 'foo' as y

  union all

  select 6 as x, 'bar' as y

)

 

SELECT * FROM Example;

Google BigQuery Scenarios two:

 

CREATE TEMP TABLE Example

(

 x INT64,

 y STRING

);

 

INSERT INTO Example

VALUES (5, 'foo');

 

INSERT INTO Example

VALUES (6, 'bar');

 

SELECT * FROM Example;



↧

Connect google bigquery to SQL Server with SSIS

July 13, 2015, 3:41 am
$
0
0

Hi All,

I need to load data to our SQL Server 2012 From google bigquery. I would like to do it with SSIS.

What is the best way to connect to google bigquery through SSIS?

Thanks!

↧

Config file in ssis - similar to web.config in web application or app.config in wpf

May 23, 2020, 8:23 pm
$
0
0

Hi,

Is there a way where I can have a config file in ssis where I can set the connection string and include dynamic variable values. 

Could someone point me to the right tutorial I can follow for this? Thank you.

↧
Viewing all 24688 articles
Browse latest View live
Search