Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

How to set timeout in a script task

0
0

We have a script that executes in a Script Task. The script is part of an API call.  the issue is we have to pull a large amount of data and it appears we are having timeout issues. T be exact, we can pull 30 days of data, but if we try to pull more the task crashes. Can we set a timeout in the script to allow more time to take in data? Here is the script:

        public void Main()
        {
            var webGet = new HtmlWeb();
            var document = webGet.Load(Dts.Variables["User::processUrl"].Value.ToString());
            var status = document.DocumentNode.SelectSingleNode("//div[@class='alert alert-success alert-dismissible']");
           // MessageBox.Show(status.InnerText.ToString(), "Error Title", MessageBoxButtons.OK, MessageBoxIcon.Exclamation);

            if (status.InnerText.Trim().Contains( Convert.ToString("Query ran successfully.")) )
            {
                Dts.TaskResult = (int)ScriptResults.Success;
            }
            else
            {
                Dts.TaskResult = (int)ScriptResults.Failure;
            }
        }

The Data flow for the task is here. The timeout in SQL Server Destination task is set to 0. I tried different settings ( 30 and 120) but it didn't help.

The error I receive is below:


"Connection is busy with results for another command"

0
0

Hi,

 

I have a SSIS package with 3 Data Flow Tasks in parallel.

The package seems to be working fine on my machine (development environment).

 

However, it "randomly" generates this error (at the first DFT) - "Connection is busy with results for another command" - when deployed on the server.

 

Any idea why this might be happening? Should I place the DFTs one after the other instead of the way they are currently placed (in parallel)?

 

Regards,

Avnip

We have connected oracle Instances through attunity drivers from SSIS then we got the error.I am attaching error msg. Could you please help on this

0
0

Hi Microsoft Team,

Please find the error MSG.

Error at pkg_Oracle_CVA_1Time_Load [Connection manager "src_ora_Oracle"]: OCI error encountered. ORA-01821: date format not recognized.


SSIS Send Mail Task To Multiple Recipients

0
0

I'm using an SSIS "Send Mail Task" in an attempt to send to multiple recipients. In the TO line of the editor, I have specified the value as follows:

test@domain.com;test2@domain.com.

Only the last email address in the semicolon seperated list receives the mail.

SMTP Server is Microsoft Exchange

I'm running SSIS 2008

I have confirmed that all individual address work when set as the sole value in the task editor settings.

The MSDN documentation states that multiple addresses in TO line is supported but I have not been able to get it to work as intended. Can someone help with what I am missing or is this a bug.

Thanks



Passing parent package configuration file to child packages

0
0

I have a Master parent package, which in turn executes 10 different child packages.

Currently, parent and child packages uses a configuration file which points to Sandbox server.

I want to point the parent package to QA environment now. In the SQL Agent job, while scheduling the parent package, I am passing the QA config file, but the settings from QA config files, does not get passed to the child packages.

How do I pass the parent package config file to child packages, even though they have their own config files??

Unique Name Check SSIS

0
0

Hello All,

We have SSIS Packages that move data from Staging Tables to Destination Tables.

The current design pattern generates a Unique Identifier for every Business Key in the Staging table, and this Business Key is used by the destination table as its Primary identifier (to track inserts/updates/deletes). The ETL as it takes the record from the Staging checks for the business rules and flags them as appropriate (Foreign Key Check, Required attribute checks, etc.)

A change in the User system, forces the data model to have unique Entity names (The Business Natural key and the Identifiers are not exposed and cannot be used by the end system)? Can you suggest a pattern that helps me check if the names are unique in a Initial Load Scenario (where the destination tables are empty) and also in a incremental load scenario? The ultimate goal would be to flag them in the Staging Database as Potential Duplicate records?


Regards, Dinesh

14-DEC-16 06.23.37.000 string is in .csv file and insert as datetime in SQL table using ssis.

0
0

Hi,

14-DEC-16 06.23.37.000 string is in .csv file and I would like to insert as datetime in SQL table using ssis.

Please help me to write expression for this.

Thanks & Regards,



Problem debugging Script Componant, when script has CRM early bound classes added

0
0

Hi

I am trying to debug a script component, the script component is to get data from Dynamics CRM online, using the Xrm objects provided in the CRMSDK, I have run the crmsvcutil to created the Xrm early bound classes.

The code works, but it has required some creative methods to debug the code. Any changes that I do will also require the same methods, it would be really nice if I could just debug the code in the usual way, but something in the early bound classes is causing the  is causing a proxy object to be created for the account entity instead of whatever the entity that is being called is

This only happens in SSIS, I have ported the code over to a console app, and it works fine, just when it is in SSIS script component it throws the exception, which is

A proxy type with the name account has been defined by another assembly. Current type: XXXX_OutSp.Account,

Any help much appreciated

Andy


CRM 4, SQL Server and .Net developer using C#


SSIS 2012 package data source – failed to deploy project

0
0

 I am trying to deploy my 2012 SSIS packages to the Integration Services catalog on the SSISDB on the sql server2012. I am getting the error below. I've checked that there is plenty of space in SSISDB and msdb databases as well as on the disk. Any ideas what might be causing this?

Failed to deploy project. For more information, query the operation_messages view for the operation identifier '7'.(Microsoft SQL Server, Error: 27203)


Additional Method tab in the error show :

Server Name: .
Error Number: 27203
Severity: 16
State: 1
Procedure: deploy_project
Line Number: 139

What should we use to generate excel like data ? Should the standard approach be SSIS or SSRS if it is SQL server 2014?

0
0

What should we use to generate excel like data?

I am using SQL server 2014

Should we use SSIS or SSRS?

I am basically trying to understand the clear reasons in the choice of tool to generate excel like data

SSIS can dump data using excel destination  and can deliver to anyplace.

SSRS can extract data into excel o/p and has delivery methods such as subscriptions?

If no formatting of data is required which should we use?

Also I guess it depends on datasets. If the datasets are larger then SSRS might not be great choice?

I see office driver issues with SSIS with 32 bit and 64 bit excels . SSRS doesnt have driver issues 

If we use script tasks in SSIS we can format the data but development time is large but SSRS can easily reduce formatting\dev time .

Also what are the challenges of using excel templates as source for dumping data in SSIS ? Are there known issues with excel interop ? 

Unless you have Excel installed on the Server/PC or use an external tool (which is possible without using Excel Interop, see Create Excel (.XLS and .XLSX) file from C#), it will fail. Using the interop requires Excel to be installed.

Also going forward at this point should we always dump data in .xlsx format ?

Looking forward for some clear answers .







SSIS 2012 to Sharepoint 2010 file upload with CosyROC Script Task Plus

0
0

Hi,

I am attempting to load files to Sharepoint 2010 with SSIS 2012 and have linked HttpUploadDownloadTask.2012.stx11 from http://www.cozyroc.com/script/http-upload-download-task into a Script Task Plus.The HttpUploadDownloadTask.2012.stx11 provides the following parameters -

Username – user name credential (optional).
Password – password credential (optional).
ProxyUrl – HTTP proxy URL (optional).
IgnoreServerCertificate – enable or disable server certificate validation.
Timeout
Action – task action (upload or download).
RemoteUrl – remote file location.
SourceFile – upload from source file. (TargetFile – download to target file.)
Method – method used to upload file. If not specified default is POST.
Headers – additional web request headers (optional). Syntax is [name]=[value]. Multiple headers are separated with newline.

RequirementUpload file roy.txt into Sharepoint as a new file and ultimately will upload multiple daily/dated Excel reporting files from SSIS

Settings/Results - I have a local file roy.txt and listed below what settings i've applied when attempting to upload the file roy.txt and the results i have.

Settings 1 - Result - No file uploaded - Upload file roy.txt to AllItems with default POST method

Username - roy
Password - royspassword
IgnoreServerCertificate - False
Timeout - 100
Action - Upload File
RemoteUrl - http://sharepoint/testing/ROY%20test%20SSIS/Process/Forms/AllItems.aspx 
SourceFile - roy.txt
Method -
Headers -

Setting 2 - Result - Replaced page http://sharepoint/testing/ROY%20test%20SSIS/Process/Forms/AllItems.aspx with roy.txt using PUT method

Username - roy
Password - royspassword
IgnoreServerCertificate - False
Timeout - 100
Action - Upload File
RemoteUrl - http://sharepoint/testing/ROY%20test%20SSIS/Process/Forms/AllItems.aspx 
SourceFile - roy.txt
Method - PUT
Headers -

I can manually upload a file fine but wondering if i shoudl use a different RemoteURL and / or Method to get the desired results. Does anyone have any experience or advice in using HttpUploadDownloadTask and/or Sharepoint URL settings to programmatically upload file successfully in this way?

Thanks

Roy

Missing Microsoft Excel as option in SQL Server data import tool

0
0
I'm running SQL Server 2012 on a 64bit Windows Server 2012 R2.
I have MS Office 2013 x64 installed.

I now notice that when I start Start->Program Files->Microsoft SQL Server 2012->Import and Export Data (64-bit) the MS Excel file option is missing from the data source dropdown.

and I tried installing Microsoft Access Database Engine 2010 Redistributable (64-bit) from the link below, but with no luck to solve the trouble

Need to fetch the 1st valid value

0
0

Gurus , I need your help with SSIS scenario !

I have 3 source tables from where I need to get a valid Phone Number value. Scenario is ,If the valid Phone number exists in a 1st table , I do not have to go to 2nd and 3rd , If it does nt exist to 1st souce table then I have to go 2nd and so.

I am not sure how can I achieve this , 

Fixed Width Flat File with comma delimited

0
0

Can anyone help with this,

I need to export a table from a SQL database table into aFixed Width Flat File,

but  I need a comma in between fields like a comma delimited file

for example the output should be:

Item Name 1                                      ,1,1                ,1,1,1 ,Item Name1         ,1,1,0,0,0

Item Name 2                                      ,1,2                ,0,0,1 ,Item Name2         ,1,0,1,1,0

Item Name 222                                  ,0,0                ,1,0,1, Item Name222      ,0,0,1,1,0

Item Name 66666                              ,1,102            ,1,1,1 ,Item Name222      ,0,0,1,1,1

I  can only get:

Item Name 1                                      1 1                1 1 1  Item Name1          1 1 0 0 0

Item Name 2                                      1 2                0 0 1  Item Name2          1 0 1 1 0

Item Name 222                                  1 23               0 0 1  Item Name222      0 0 1 1 0

Item Name 66666                              1 102            1 1 1  Item Name222        0 0 1 1 1

Or

Item Name 1,1,1,1,1,1 ,Item Name1 ,1,1,0,0,0

Item Name 2,1,2,0,0,1 ,Item Name2,1,0,1,1,0

Item Name 222 ,1,23  ,0,0,1 ,Item Name222 ,0,0,1,1,0

Item Name 66666,1,102,1,1,1 ,Item Name222 ,0,0,1,1,1

I need the fields to be a fixed with a comma separating them

I am using SSIS on SQL server 2012

Kind Regards


How to load the data from data table to SQL table, when columns have mixed data types ?

0
0

Hi All,

I have been trying to load the data from an Excel file to SQL Server table using script task in SSIS since my data header is at nth row.  This is the process I am following to load the data.

Excel --> Data table --> SQL Server table

My data in the file looks like this.


SAMPLE1 
SAMPLE2 
  
TESTDATE1TESTDATE2
  
  
06/07/201606/07/2016
06/28/201609/06/2016
  
08/11/201609/03/2016
07/18/201607/28/2016
  
  
  
08/07/201608/22/2016
  
  
  
  
  
  
  
08/29/201608/29/2016

When I am trying transfer data table to SQL Server table, It is returning data type conversion error as my destination column is of DateTime data type. I have tried with all the IMEX options, but no use. In the data table, I can see the data format is good as the date. I cannot directly map the column to the specific data type in script task as it is dynamic and looping through multiple sheets.

Can anyone help me and provide your valuable suggestions, please?

Thanks & Regards,

Naresh Bandi.





DFT - The buffer manager detected that the system was low on virtual memory

0
0

Hi All,

I am running a package which has 5 DFT's running in parallel. OLEDB source has a SQL command and it is loading data to SQL.

I see that the data load gets stuck or becomes slow for some DFT. Below is the Informational message I get in Progress Tab

[SSIS.Pipeline] Information: The buffer manager detected that the system was low on virtual memory,
but was unable to swap out any buffers. 14 buffers were considered and 14 were locked.
 not enough memory is available to the pipeline because not enough is installed,
 other processes are using it, or too many buffers are locked.

Question: Where can we track the virtual memory and what's the workaround to increase it?


Cheers
Vaibhav
MCSA (SQL Server 2012)

Flat File Format (Comma separated with Fixed Length)

0
0

I need to display the flat file with fixed width comma separated output

Like that

Thanks.


ZK

Multible output sources in sigle xml file

0
0

I have a SSIS package set up through Visual Studio that process a flattened XML file. When I process the XML file in the data flow, it creates 16 different outputs. None of these outputs has a foreign key that I can relate the tables with. Is there anyway to combine all these tables into one output, or a process that pulls all data from the XML file into one table?

Thanks in advance.


prabha

Package Validation Error in SSIS - Unicode and Non Unicode conversion error

0
0

Hi,

I am trying to transform sql table data to excel file using SSIS. But it gives me package validation error.

I googled this problem but as a solution many persons has written “convert between unicode and non-unicode string data types”. In the sql table all columns are varchar type so how we can they that data is Unicode. Unicode data always resides in nvarchar data type.

Below is the actual problem which I am facing. I am new to SSIS so kindly give the described solution.

TITLE: Package Validation Error

------------------------------

Package Validation Error

------------------------------

ADDITIONAL INFORMATION:

Error at Data Flow Task [Excel Destination [76]]: Column "centername" cannot convert between unicode and non-unicode string data types.

Error at Data Flow Task [SSIS.Pipeline]: "component "Excel Destination" (76)" failed validation and returned validation status "VS_ISBROKEN".

Error at Data Flow Task [SSIS.Pipeline]: One or more component failed validation.

Error at Data Flow Task: There were errors during task validation.

 (Microsoft.DataTransformationServices.VsIntegration)

------------------------------

BUTTONS:

OK

Any help is highly appreciated.

Thanks in advance.


Best Regards, vivek

SSIS - Breakpoint or Kill Current SSIS Process and Restart pkg at certain point (Modal dialog Powershell WASP issue)

0
0

Good day,

i have a realy difficult scenario. I have a powershell file executing powershell wasp commands that logs onto a website and select a file (modal dialog). In the powershell file i call another powershell job to bypass the modal dialog freeze issue where the next command does not execute and waits for an action. This i got pass in powershell (manual execute) but executing via ssis i get the same issue.

Please any ideas or perhaps when this point occurs, stop the pkg and rexecute at a certain command or any suggestions. not too keen on creating another package or i gues i can create a agent job that executes the same pkg with var but i think it will cause the same problem as it awaits an action on the modal select file window.

Regards



Viewing all 24688 articles
Browse latest View live




Latest Images