Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Visual Studio Data Tools 17 and 19. hanged during package development and delay notification

March 10, 2020, 8:51 pm
$
0
0

I just wanted to discuss the specification of existing laptop :

Intel CORE i7 8750H

16G RAM

1TB HardDrive

I deployed almost 50 packages which is schedule on daily basis. My processor gives voice when the packages running.Always visual studio not working well. Aftersome time I'll have 100 or more packages which is run in my machine and data transfer into Azure. 

So, I need a suggestion from you guys. Would I need to go for good system specification or eigther a Workstation/Server . I don't know in terms of system specification. Highly appreciate your suggestions.

Thanks

↧
Search

SQLServer2005_DTS.msi

March 11, 2020, 12:58 am
$
0
0

Hi all,

Kindly help me,

Anybody have this file SQLServer2005_DTS.msi, because I need to migration DTS to SSIS package and this file have removed from Microsoft download center.

Thanks,

↧
↧

Text was truncated or one or more characters had no match in the target code page

May 13, 2008, 1:01 pm
$
0
0
Hi,

I am tryin to run an SSIS package from an Excel Spreadsheet to MS SQL Server 2005.

I receive the error: Text was truncated or one or more characters had no match in the target code page (full report is below).

I found this thread: http://forums.microsoft.com/MSDN/ShowPost.aspx?PostID=2562259&SiteID=1
and have set the destination column to nvarchar(max), and I have also set the TruncationRowDisposition = RD_IgnoreFailure on the destination column, with no luck.

Any ideas? Thanks!

Operation stopped...

- Initializing Data Flow Task (Success)

- Initializing Connections (Success)

- Setting SQL Command (Success)

- Setting Source Connection (Success)

- Setting Destination Connection (Success)

- Validating (Success)

- Prepare for Execute (Success)

- Pre-execute (Success)

- Executing (Success)

- Copying to [cisense_new].[dbo].[_Details] (Error)
Messages
Error 0xc020901c: Data Flow Task: There was an error with output column "Name" (66) on output "Excel Source Output" (60). The column status returned was: "Text was truncated or one or more characters had no match in the target code page.".
 (SQL Server Import and Export Wizard)
 
Error 0xc020902a: Data Flow Task: The "output column "Name" (66)" failed because truncation occurred, and the truncation row disposition on "output column "Name" (66)" specifies failure on truncation. A truncation error occurred on the specified object of the specified component.
 (SQL Server Import and Export Wizard)
 
Error 0xc0047038: Data Flow Task: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "Source 1 - owners$" (52) returned error code 0xC020902A.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.
 (SQL Server Import and Export Wizard)
 
Error 0xc0047021: Data Flow Task: SSIS Error Code DTS_E_THREADFAILED.  Thread "SourceThread1" has exited with error code 0xC0047038.  There may be error messages posted before this with more information on why the thread has exited.
 (SQL Server Import and Export Wizard)
 
Error 0xc0047039: Data Flow Task: SSIS Error Code DTS_E_THREADCANCELLED.  Thread "WorkThread0" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown.  There may be error messages posted before this with more information on why the thread was cancelled.
 (SQL Server Import and Export Wizard)
 
Error 0xc0047039: Data Flow Task: SSIS Error Code DTS_E_THREADCANCELLED.  Thread "WorkThread2" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown.  There may be error messages posted before this with more information on why the thread was cancelled.
 (SQL Server Import and Export Wizard)
 
Error 0xc0047039: Data Flow Task: SSIS Error Code DTS_E_THREADCANCELLED.  Thread "WorkThread1" received a shutdown signal and is terminating. The user requested a shutdown, or an error in another thread is causing the pipeline to shutdown.  There may be error messages posted before this with more information on why the thread was cancelled.
 (SQL Server Import and Export Wizard)
 
Error 0xc0047021: Data Flow Task: SSIS Error Code DTS_E_THREADFAILED.  Thread "WorkThread2" has exited with error code 0xC0047039.  There may be error messages posted before this with more information on why the thread has exited.
 (SQL Server Import and Export Wizard)
 
Error 0xc0047021: Data Flow Task: SSIS Error Code DTS_E_THREADFAILED.  Thread "WorkThread0" has exited with error code 0xC0047039.  There may be error messages posted before this with more information on why the thread has exited.
 (SQL Server Import and Export Wizard)
 
Error 0xc0047021: Data Flow Task: SSIS Error Code DTS_E_THREADFAILED.  Thread "WorkThread1" has exited with error code 0xC0047039.  There may be error messages posted before this with more information on why the thread has exited.
 (SQL Server Import and Export Wizard)
 
Error 0xc02020c4: Data Flow Task: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.
 (SQL Server Import and Export Wizard)
 
Error 0xc0047038: Data Flow Task: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "Source 2 - trademarks$" (128) returned error code 0xC02020C4.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.
 (SQL Server Import and Export Wizard)
 
Error 0xc0047021: Data Flow Task: SSIS Error Code DTS_E_THREADFAILED.  Thread "SourceThread2" has exited with error code 0xC0047038.  There may be error messages posted before this with more information on why the thread has exited.
 (SQL Server Import and Export Wizard)
 
Error 0xc02020c4: Data Flow Task: The attempt to add a row to the Data Flow task buffer failed with error code 0xC0047020.
 (SQL Server Import and Export Wizard)
 
Error 0xc0047038: Data Flow Task: SSIS Error Code DTS_E_PRIMEOUTPUTFAILED.  The PrimeOutput method on component "Source - details$" (1) returned error code 0xC02020C4.  The component returned a failure code when the pipeline engine called PrimeOutput(). The meaning of the failure code is defined by the component, but the error is fatal and the pipeline stopped executing.  There may be error messages posted before this with more information about the failure.
 (SQL Server Import and Export Wizard)
 
Error 0xc0047021: Data Flow Task: SSIS Error Code DTS_E_THREADFAILED.  Thread "SourceThread0" has exited with error code 0xC0047038.  There may be error messages posted before this with more information on why the thread has exited.
 (SQL Server Import and Export Wizard)
 

- Copying to [cisense_new].[dbo].[_Owners] (Stopped)

- Copying to [cisense_new].[dbo].[_Trademarks] (Stopped)

- Post-execute (Success)
Messages
Information 0x402090df: Data Flow Task: The final commit for the data insertion has started.
 (SQL Server Import and Export Wizard)
 
Information 0x402090e0: Data Flow Task: The final commit for the data insertion has ended.
 (SQL Server Import and Export Wizard)
 
Information 0x402090df: Data Flow Task: The final commit for the data insertion has started.
 (SQL Server Import and Export Wizard)
 
Information 0x402090e0: Data Flow Task: The final commit for the data insertion has ended.
 (SQL Server Import and Export Wizard)
 
Information 0x402090df: Data Flow Task: The final commit for the data insertion has started.
 (SQL Server Import and Export Wizard)
 
Information 0x402090e0: Data Flow Task: The final commit for the data insertion has ended.
 (SQL Server Import and Export Wizard)
 

- Cleanup (Success)
Messages
Information 0x4004300b: Data Flow Task: "component "Destination - _Details" (26)" wrote 14454 rows.
 (SQL Server Import and Export Wizard)
 
Information 0x4004300b: Data Flow Task: "component "Destination 1 - _Owners" (92)" wrote 13304 rows.
 (SQL Server Import and Export Wizard)
 
Information 0x4004300b: Data Flow Task: "component "Destination 2 - _Trademarks" (186)" wrote 10005 rows.
 (SQL Server Import and Export Wizard)
 



↧

Script task does not work after deployment but with no errors

March 11, 2020, 7:35 am
$
0
0

I have quite a basic SSIS package that clears down a directory, loads a list of stored procedures into an object variable, then using a script task executes them one by one. The script task outputs each of the results into a CSV file and also generates a log file should any of them fail.

When executing the package locally it runs fine. After I export it to production and execute it the report displays a successful run but the script execution takes 0 seconds and generates nothing (including the log file). I have enabled full logging for the package and again, this shows a successful execution but it appears the script task is not running.

My first thought was a version mismatch between dev and production, which is still a possibility. I have set the deployment target version to 2014 (matching to production) as I am running SQL 2017 and VS 2017 locally.

Dev: Microsoft SQL Server 2017 - 14.0.2027.2 (X64) Developer Edition (64-bit)
Prd:Microsoft SQL Server 2014 - 12.0.4100.1 (X64) Enterprise Edition (64-bit)

Despite no errors, I thought I would check the permissions to the output and log directory. When executing from the SSIS catlog it uses my admin account and from the agent job it uses the SQL agent service account. Both of these have full access to the output directory, so I don't think this is the problem.

Any ideas?

Control Flow

Thanks, Ben

↧

You Need Permission to perform this action.

March 11, 2020, 8:14 am
$
0
0

Hey,<o:p></o:p>

I have recently replace my x5 domain controllers with Server 2019 and raised my domain level to Server 2016. After this, I no longer have permission to make changes for Sysvol or Netlogon when trying to access from any of these servers. I just get "You Need Permission to perform this action". I've logged onto the PDC which is running all the FSMO roles with the default domain admin account but still say access denied. However, here is the catch. If I try to make changes logged on to one of my members servers running server 2012r2 I can make changes!!!! It looks like something on Server 2019 is over ringing my NTFS permissions!?<o:p></o:p>

Any advice would be appreciated. <o:p></o:p>

Cheers<o:p></o:p>

Mick<o:p></o:p>


Mikehawo

↧
↧

SSIS server/pkg upgrade from 2008 to 2017

March 11, 2020, 8:33 pm
$
0
0


As we are upgrading from 2008 to 2017, We need to upgrade existing packages to 2017. (we use file store deployment method.) We have 2017 SSDT installed as test environment setup. While directly opening existing package in 2017 ssdt as a part of upgrade, I am getting error message as consider changing provider in connection manager to sqlncli 11. All i want to know

1] In order to remove above error and upgrade pkg do i need to make provider changes in connection string and save the updated pkg? OR

2] Can we only change provider in config file only? OR

3] Do I have to make both the above changes to upgrade the pkgs?

↧

Connect Azure linked service in SSIS package

March 12, 2020, 7:08 am
$
0
0

Hello All,

I have only Azure Linked service as connection of on premise sql server. So, i have to use that connection as a source in SSIS package. How can i add that connection via SSIS connection manager.

↧

How to connect to a REST API with userid/password using SSIS

March 21, 2018, 12:35 pm
$
0
0

Hello Everyone! Today I was given a task where we will have to consume an REST API and load data into a table for further massaging. I tried to google and see how this can be done. But didn't find much material.

This API will be spitting out a JSON stream. And will need a userid/password to connect. I understand I will have to write a custom script to achieve this. 

I will really appreciate any help!!

Thank you,

Abhi

↧
Search

How to Close an Opened Package

March 12, 2020, 10:32 am
$
0
0

Good afternoon, all -

I have an SSIS package that opens several other packages via the Execute Package Task. When the last newly opened package completes, the entire job is done, but the several opened packages remain open. What I'd like is to have control return back to the original package and then have the original close each of the called packages, leaving me with a project that has only one opened package; the original.

Is there a task or a means to do this? I don't see any task in the toolbox to do it, but I might have not recognized it for what it is.

Thanx in advance for any assistance!

↧
↧

SSIS SCD2 Dataflow Object does not process changes on "Historical Data" column.

March 12, 2020, 11:12 am
$
0
0

I'm using the SSIS SCD Dataflow object and specified half a dozen columns as Change Type = "Historical Data". Currently investigating on one column (char(5)) in question, I'm not seeing the changes are detected and SCD2 is applied. Is there a limitation on Historical Data columns? I would assumed that for a record with match keys inbound matches a record in my dimension table and that ANY columns specified"Historical Data" is different, the existing dim record would be "expired" and a new record inserted for current? I'm looking at one particular column now but I would assumed that there could be other columns specified "Historical Data" is functioning the same way. I do see records expiring and new current record is inserted so SCD2 is running. We are using SQLServer version 13.0,5622.0 on NT Server 6.3 and developing with VS Pro 2017 (v 15.9.11).

We use a stored proc to pull latest source data to update our dim table.

... when you're a phan, be phanatix!


↧

SSIS Multicast - how to handle one server that becomes unavailable.

March 12, 2020, 11:33 am
$
0
0

I am using a Multicast to send a flat file to two servers.  Unfortunately if one of the servers becomes unavailable it causes the file distribution on the working server to not work properly as it puts a blank file on the good server with only the header.  

Is there any way around this other than trying to just copy the file from one server to the other?  In the example below, if I disable the NIC on server 1, the output file that is placed on server 2 is empty.  This would be a huge problem once the file is sent off.  Maybe I am missing the point of the Multicast but you would think there would be a way around this.

If both servers are available there is no issue.



↧

Load SQL table data which have multiple columns into Fixed width file using SSIS.

March 12, 2020, 10:01 pm
$
0
0
Hi Everyone,

I have a requirement where I need to load SQL table data which have multiple columns into Fixed width file. This fixed width file is a single column file So not able to map the table columns with file columns. Each column value should go to some specific positions () of file where we need to define the position where the column value should go. How can we achieve this using SSIS?

Thanks
↧

Getting connection error when rebuilding solution

March 13, 2020, 1:35 am
$
0
0

Whenever I rebuild a solution it gives me connection error. I tried rebuilding the connection in the offline mode but still getting the same below error. It will check the connection for all the packages which are under the solution and using the project connection.

How to make sure the connection is not check during rebuild during offline mode . Do i need to change each package Delay validation property to true

Severity    Code    Description    Project    File    Line    Suppression State
Error        An error has occurred while connecting  Exception from HRESULT: 0xC020200

↧
↧

With the advent of Spark and Microsoft adopting it in the latest version of SQL server is SSIS now outdated technology?

April 4, 2019, 11:59 am
$
0
0

With the advent of Spark and Microsoft adopting it in the latest version of SQL server is SSIS now outdated technology?

Can anyone confirm if this is true? I would like to know what is the future of SSIS . As per Microsoft there will be some ETL use cases but in general there will be a shift to new way of ingesting data with high data transmission speed.

I see in the cloud offering both Databricks( cloud spark) and Datafactory ( cloud ssis)

Also will you do ETL with SPARK or SSIS or any other popular ETL tool?




↧

An error has occurred while connectingOLEDB: Exception from HRESULT: 0xC0202009

March 13, 2020, 12:45 pm
$
0
0

I am just opening 2008 dtsx file in 2017 ssdt. I am able to upgrade the package to 2017 but with unexpected  error message An error has occurred while connecting xyz OLEDB: Exception from HRESULT: 0xC0202009.

Same error message I am getting in another pkg at excel source connection.

Please suggest solution on this ASAP


↧
Search

Will job scheduling work even if computers are off ?

March 13, 2020, 9:28 pm
$
0
0

Hi all

In SSIS, we learned scheduling job through SQL server agent, usually these updates scheduled at night time(after hours)
My question is if server is in NZ/Australia or in the same country where we are scheduling job and computers are off but server is ON then still SQL server agent will run?

Thanks

Sandeep

↧

Ignore escape character \ in string field SSIS Script

March 15, 2020, 6:18 pm
$
0
0

Hi Folks,

I have an SSIS 2017 job with a script to evaluate some string in a field in a table.  The field contains strings that include escape characters such as backslash \. As an example the string will be 2\LP12345 in the database but when I extract it with the script it adds another backslash so the string variable in the script shows 2\\LP12345.

///gets a row from the table
public override void Input0_ProcessInputRow(Input0Buffer Row)
{
///TablesField has string 2\12345 in database
string db_input = Row.TablesField
/// hover over Row.TablesField and it displays 2\\12345

}

I read where the @ symbol will read the string and ignore the \ so I tried string db_input = @Row.TablesField also tried db_input =Row.@TablesField but the value always returns with the additional backslash.  I have seen where this is usually associated with code reading directory paths and the developer puts in some additional backslash and double quotes or @ symbol which removes them but this also did not work for me.

Thanks

Binway

Binway

↧
↧

SSIS and CDC - Incorrect state at end of “Mark Processed Range”

June 3, 2014, 2:14 pm
$
0
0

The Problem

I currently have CDC running on a table named subscription_events.  The corresponding CT table is being populated with new inserts, updates, and deletes.

I have two SSIS flows that move data from subscription_events into another table in a different database.  The first flow is the initial flow and has the following layout:

enter image description here

The Import Rows Into Vertica step simply has a source and a destination and copies every row into another table.  As a note, the source table is currently active and has new rows flowing into it every few minutes.  TheMark Initial Load Start/End steps store the current state in a variable and that is stored in a separate table meant for storing CDC names and states.

The second flow is the incremental flow and has the following layout:

enter image description here

The Import Rows Into Vertica step uses a CDC source and should pull the latest inserts, updates, and deletes from the CT table and these should be applied to the destination.  Here is where the problem resides; Inever receive anything from the CDC source, even though there are new rows being inserted into thesubscription_events table and the corresponding CT table is growing in size with new change data.

To my understanding, this is how things should work:

  1. Mark Initial Load Start
    1. CDC State should be ILSTART
  2. Data Flow
  3. Mark Initial Load End
    1. CDC State should be ILEND
  4. Get Processing Range (First Run)
    1. CDC State should be ILUPDATE
  5. Data Flow
  6. Mark Processed Range (First Run)
    1. CDC State should be TFEND
  7. Get Processing Range (Subsequent Runs)
    1. CDC State should be TFSTART
  8. Data Flow
  9. Mark Processed Range (Subsequent Runs)
    1. CDC State should be TFEND
  10. Repeat the last three steps

This is not how my CDC states are being set, though... Here are my states along the same process.

  1. Mark Initial Load Start
    1. CDC State is ILSTART
  2. Data Flow
  3. Mark Initial Load End
    1. CDC State is ILEND
  4. Get Processing Range (First Run)
    1. CDC State is ILUPDATE
  5. Data Flow
  6. Mark Processed Range (First Run)
    1. CDC State is ILEND
  7. Get Processing Range (Subsequent Runs)
    1. CDC State is ILUPDATE
  8. Data Flow
  9. Mark Processed Range (Subsequent Runs)
    1. CDC State is ILEND
  10. Repeat the last three steps

I am never able to get out of the ILUPDATE/ILEND loop, so I am never able to get any new data from the CT table.  Why is this happening and what can I do to fix this?

Thank you so much, in advance, for your help!  :)

Edit 1

Here are a couple of articles that sort of describe my situation, though not exactly.  They also did not help me resolve this issue, but it might help you think of something I can try.

The second article includes this image, which shows the ILUPDATE/ILEND loop I am trapped in.

enter image description here

Edit 2

Last week (May 26, 2014) I disabled then re-enabled CDC on the subscription_events table.  This didn't change anything, so I then disabled CDC on the entire database, re-enabled CDC on the database, and then enabled CDC on thesubscription_events table.  This did make CDC work for a few days (and I thought the problem had been resolved by going through this process).  However, at the end of last week (May 30, 2014) I needed to re-load the entire table via this process, and I ran into the same problem again.  I'm still stuck in this loop and I'm not sure why or how to get out of it.

Edit 3

Before I was having this problem, I was having a separate issue which I posted about here:

CDC is enabled, but cdc.dbo<table-name>_CT table is not being populated

Could running these commands have created this problem for me on SQL Server?

↧

Execute Independent SQL Tasks

March 16, 2020, 10:57 am
$
0
0
In SSIS I have a package that executes several for each loops in sequence that sets user variables to true or false depending on whether files are found or not found on a shared drive. What I would like to do next in the package is evaluate each user variable and execute a stored procedure that will test if each file has been loaded previously into a table. I am not sure how to set-up the execution path so that SQL Tasks will be executed independently in sequence. For example, If I have 3 user varibles, after the last for each loop I would like to run 3 SQL Tasks independently depending on whether the user variable is true or false. The execution path would move from left to right with each path being used to execute one of the 3 SQL Tasks.
↧

FTP Send File Error "The remote server returned an error: (550) File unavailable (e.g., file not found, no access)."

March 17, 2020, 11:20 am
$
0
0

Hello there,

For the past few days we are running into a problem when using FTP Task in SSIS

Cannot able to send files to a FTP Server, while sending a file we receive an error "The remote server returned an error: (550) File unavailable (e.g., file not found, no access)."

After lots of searching, some suggest that it is not an error but an information as the file is not present in server. We tried switching to a different ftp server and the same code is fine and sends files without any problems.

So I decided to switch FTP Task to Script Task where I do upload using WebClient. Even after handling with FtpStatusCode.ActionNotTakenFileUnavailable, cannot able to send files (FTP Upload). Here is the code excerpt

            try
            {
                var files = new List<string>();
                foreach (var conn in Dts.Connections)
                {
                    if (conn.CreationName == "FLATFILE")
                    {
                        files.Add(conn.ConnectionString);
                        using (WebClient client = new WebClient())
                        {
                            //client.UploadDataCompleted
                            client.Credentials = new NetworkCredential("xxx", "xxx");
                            Uri input = new Uri(Path.Combine( @"ftp://xxx/Incoming/", Path.GetFileName(conn.ConnectionString)));
                            try
                            {
                                client.UploadFile(input, "STOR", conn.ConnectionString);
                            }
                            catch (WebException we)
                            {
                                var resp = (FtpWebResponse)we.Response;
                                if (resp.StatusCode != FtpStatusCode.ActionNotTakenFileUnavailable) throw;
                            }

                        }
                        //break;
                    }
                }
                Dts.Variables["User::FtpFilesCollection"].Value = files;
                Dts.TaskResult = (int)ScriptResults.Success;

            }
            catch (System.Exception e)
            {
                Dts.Events.FireError(0, "Shops", e.ToString(), string.Empty, 0);
            }

This is the WebException I receive after the WebClient.UploadFile

-{"The remote server returned an error: (550) File unavailable (e.g., file not found, no access)."}System.Net.WebException
-[System.Net.FtpWebResponse]{System.Net.FtpWebResponse}System.Net.FtpWebResponse
+base {System.Net.FtpWebResponse}System.Net.WebResponse {System.Net.FtpWebResponse}
BannerMessage"220 (vsFTPd 3.0.2)\r\n"string
ContentLength 0long
ExitMessage""string
+Headers {
}System.Net.WebHeaderCollection
+LastModified{01/01/0001 00:00:00}System.DateTime
+ResponseUri{ftp://xxxx/Incoming/NEGSERV2020031719.chk} System.Uri
StatusCode ActionNotTakenFileUnavailableSystem.Net.FtpStatusCode
StatusDescription"550 Permission denied.\r\n" string
SupportsHeaderstruebool
WelcomeMessage"230 Login successful.\r\n" string

I really appreciate your suggestions and tips

Stay safe and well,

Holy


↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>