Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Memory consumption by SSIS process

January 14, 2016, 5:17 am
$
0
0

Hello,

Could anyone please give me an explanation how SSIS process (ISServerExec) consumes memory?

At the moment only one package is running started from SSDB catalog. Task manager shows that  ISServerExec.exe consumes 500 Mb. 

But query

select * from [catalog].[dm_execution_performance_counters] (NULL)

shows:

Buffers in use 35, Private buffers in use 21, Buffers spooled 0, Flat buffers in use 21, Buffer memory 2621240, Private buffer memory 1703928, Flat buffer memory 1703928


Buffer memory 2621240 means 2.6 Mb. Why SSIS process needs 500 Mb?

Thanks in advance!


↧
Search

Send Email Task within For Each Loop container

January 22, 2016, 1:29 am
$
0
0

Hello,

could somebody explain which is which in MSDN tutorial: https://technet.microsoft.com/en-us/library/ff793463%28v=sql.105%29.aspx in which it says:

7. Add a For Each Loop container to the package and add a Send Mail task to the container. Configure the SmtpConnection, From, To, and Attachment properties, and optionally other component properties, to email the generated reports to users. The Send Mail task picks up the email addresses from the Email field in the ReportConfig table and picks up the reports from the folder specified in the OutputPath field in the ReportConfig table.

Namely, it firstly says "Configure the SmtpConnection, From, To, and Attachment properties, and optionally other component properties" but, upon that, "The Send Mail task picks up the email addresses from the Email field in the ReportConfig table"

Send mail task is in error if the To field is empty, from one side while, from the other side, I need exactly what it says upon that i.e., I need Email addresses to be picked up from the ReportConfig table, Email field?

How to achieve this?

thanks for help

↧
↧

How To Open SQL Query File in Existing SQL Server Management Studio 2014

January 22, 2016, 12:59 am
$
0
0

Recently i have upgraded SQL Server from SQL 2008 to SQL2014 & after the up gradation, when i try to open directly SQL Query at that time SQL always open new Management Studio.

But i want query should open in existing opened SQL Management studio.

↧

SSIS 2012 transfer child package variable values to parent package

November 28, 2013, 6:25 am
$
0
0

Hi all, I have a master ETL package, where the first component in the control flow is a Execute Package task Get SFTP Files as below.


Get SFTP Files below

The variable mapping on the foreach container outputs ClientID.

I need to reference this ClientID in the rest of my package i.e. when this package finishes and goes back to ETL package

I want to reference it.  How do i import a variable/value from a CHILD package and use it in the PARENT package?  I have tried setting up a parent package variable in the CHILD package referencing ClientID but this doesn't seem to be transferring the value to the PARENT package.  Am i forgetting something?

*** UPDATE *** I'm using project deployment model so am unable to use Package Configuration.  How can you reference a globalID like a CompanyID between packages using the project deployment model?
↧

Managing project parameters during the SSIS project deployment - SSIS 2012

January 22, 2016, 3:26 am
$
0
0

Hi,

I'm creating a SSIS 2012 project having some project parameters. I've deployed the SSIS project in the SSIS catalog, but I've seen that it is necessary to create a second time the parameters in an environment.

If possible, I'd like to avoid to create again in the SSIS catalog the project parameters already defined inside the SSIS project.

Does it exist a manner to deploy also the project parameters during the project deployment? So I should have a minor administrative effort.

Thanks

↧
↧

Common package to import into database

January 22, 2016, 4:51 am
$
0
0

Hello All,

We have similar packages to import excel , word, txt , mdb files into SQL server

Can anyone help me from the scratch to create a common package to import any type of file into database without any extra much work.

Help must appreciated.

Thanks

Dilip Patil..

↧

format seconds to dd:hh:mm:ss in SSIS

January 22, 2016, 6:26 am
$
0
0

I have a duration value greater than 86400 and need to format the value to dd:hh:mm:ss in SSIS.

Currently if the duration value is < 86400, it formats correctly.

I am using vb script and I have the below code

        Row.durationformatted = Format(DateAdd("s", Row.durationseconds, #12:00:00 AM#), "HH:mm:ss")

For example - if the duration is greater than 86400, it formats it the below way

00:23:28 and I need to format it to 24:23:28.

Any help would be greatly appreciated.

Thanks

↧

SSIS 2014 - Error in task validation

January 5, 2016, 4:41 am
$
0
0

Hi,

I have a project in Integration Services (2014) with one master package that executes many tasks of type "Execute Package Task" that was recently upgraded from 2008 R2 to 2014.
This project is in SSISDB Catalog and I have a job in SQL Server Agent that executes the master package with a proxy account that have Administrator access in Windows Server.
The job execution in SQL Server Agent is intermittent, sometimes the execution fails and sometimes ends with success.
The error reported in the SSIS Catalog Reports are:

PS: I have already enable Verbose Logging and didn't helped trying to figured out the root cause of the problem. I also tried to enable DelayValidation in the SSIS master package and in the Package Execution Tasks and didn't solved the problem.

Thank you!


↧
Search

Unexpected Termination in Sqlserver Agent Job

January 12, 2016, 10:20 am
$
0
0

Hello ,

I have a SSIS package which executes successfully in visual studio. But, when I schedule this job in Agent through Catalog Database this throwing unexpected termination. I googled and installed some packs from msdn but still the error is same. what might be the case?  any inputs appreciated.

Thanks in advance.

↧
↧

Excel Destination in SSIS only accepts 255 chars per cell

January 22, 2016, 10:05 am
$
0
0

Problem: Excel only accepts 255 chars per cell when I attempt to use Excel Destination in SSIS (2008 R2) from a sql server table. SalesForce data loader would not accept CSV (with “” text qualifiers) created by
ssis flat file connection manager. SalesForce will only accept CSV (with “” text qualifiers). SalesForce will accept CSV as exported by Excel (2010).

Solution:
1. Create your excel connection manager, set name/path of the destination EXCEL file in your “Excel Destination Data Flow Competent” and map meta-data.

2. Open a new Excel file, remove all extra “sheets”, rename “sheet1” to <YourTargetSheetName> that was created in step#1, above, select all cells and format to “text”, add all the column header names to the first row of your template sheet. In the columns that need to hold more data than 255 limit, paste in any characters that exceed your limit by 50% (just in case). These columns are now configured to hold your large data. Save the file, naming it something like TEMPLATE_Excel_forLargeCellValues.xlsx

3. Copy this template into your DESTINATION connection:  Before your “Excel Destination Data Flow Competent” in the SSIS Control Flow, create a new “File System Task”. Create an ssis pkg level variable (Template_Excel) to hold the path/filename of your template excel file. In your “File System Task” set “IsSourcePathVariable” = TRUE, set “SourceVariable” to User::Template_Excel. Set “IsDestinationPathVariable” = FALSE, and set “DestinationConnection” = <your Excel Conn Mgr Name> from step #1 above. Set “Operation” =      Copy file. “OverwriteDestination”=TRUE. This will now copy your formatted Excel workbook/sheet into your destination folder with the file name you designated in step #1 above and because you put a larger amount of sample data in the columns that require more than 255 chars, all your data will fit.
Note: It is not necessary to delay validation on any components.


↧

Query that returns duration of SSIS tasks for a particular master package

January 22, 2016, 8:28 am
$
0
0

Anyone know a sql query that will return data similar to the Execution Overview report? (it is a link in all executions report).   My package time really increased and I would like to find out which tasks are taking so long.  I want to use a query to capture this info in a table and compare it to other runs in the future.

Thanks,

Mike


↧

Split a single column of data without any delimeters into multiple columns in SSIS

January 22, 2016, 11:44 am
$
0
0

Hello,

How to split a single column into multiple columns

data in .txt how to achieve in SSIS

below is the sample data

columnname

dbo.tablename.columnname

dbo.tablename.columnname

output needed 

columnname                                        tablename                        column

dbo.tablename.columnname               dbo.tablename                    columnname  

dbo.tablename.columnname                dbo.tablename                    columnname  

please let me know how to achieve this in SSIS

Thanks

↧

Can I make an import into File Maker Pro from SQL database using SSIS ?

January 22, 2016, 11:54 am
$
0
0

Hello,

 

I am completely new to File maker system and I need to make an import on daily basis from SQL server into File Maker Pro 11 data base.

I usually do my data migration using SSIS (Microsoft) . The business people export some data from SQL into an EXCEL sheet then they clean it up manually a little bit, before they do a manual import into File Maker. The problem is that they have to do this every single day and is a very tedious and annoying task. I was asked to automate this and make it run on its own every day.

 


Question: Is it possible to do this import into File maker by using SSIS and how do I connect to File Maker (I know File maker has ODBC driver but supports such import) ? 

(Need to mention that during data clean, I would have to create some look up transformations connecting to FileMaker database to compare some values with the SQL values, before I do the actual import)

Thank you,

Alin L.


↧
↧

Loop 10 SQL statement to insert data in Single Table

January 22, 2016, 6:14 am
$
0
0

Hi Friends 

I have 10-15 DFT (Data flow task) which is basically fetching data from Source and inserting to Destination table. Every query has its own Business Logic but Destination table is same.

Instead of this 15 Data Flow task I want use a single Data flow task which Pull loop from Query 1 to Query 10 and Insert data into destination table since table remains same for all 10 query.

Please Help me out to perform this task. 


Abhishek Parihar BI Consultant (Please mark the post as answered if it answers your question)





↧

How to extract lowest value from 1 item in 2 different warehouses with different statusses?

January 22, 2016, 5:34 am
$
0
0

Hi,

started in SSIS with an ole db soure editor to extract items with a status from 2 warehouses, it s a simple query =select item, warehouse, status from TABLE, where warehouse in (WHS, WHL).
 The next steps are lookups to extract additional info, but this is not relevant for this case. What is relevant and possible is that we can have the situation that 1 item in both warehouses (WHS, WHL) exists but with two different statuses.
In derived columns i want to redefine the field status=take the lowest status of the item regardless the warehouse.....
Example: Warehouses= WHS and WHL, item 12345 in WHS with status 20 and item 12345 with status 80 in WHL. In this case my derived field should have the value 20.

Btw, this is only 1 example for 1 item with 2 warehouses and statusses,  but there are thousands with the same situation.....

Any ideas how to do it???
grazie!



↧
Search

The process could not be created for step 2 of job 0xCE53EE444319DA4F8BA2243E9F1AF9A8 (reason: The filename or extension is too long). The step failed.

September 12, 2011, 10:12 am
$
0
0

Hi,

I got this error running the SQL Job which has series of SSIS PAckages coupled with SP's to RUN.

The Packages are stored in the Package Store of an APP Server and the Job is appropriately configured on TEST SQL Server to read it from the App Servers Package store and is being executed by a PROXY User.

Can someone please let me know why this wierd error is showing up stating File Name is too LONG

ERROR: "The process could not be created for step 2 of job 0xCE53EE444319DA4F8BA2243E9F1AF9A8 (reason: The filename or extension is too long).  The step failed."


Please let me know if further details are needed.

Thanks in Advance.

↧

SQL Job Runs Successfully but Files Generated by SSIS Packages are Not Being Delivered

January 22, 2016, 9:16 am
$
0
0

Hello,

I have a SQL job that contains 2 steps that execute 2 SSIS packages. The 2 packages simply pick up source files, populate SQL table(s) and then produce output files in a couple of network folders. When I run the SQL job either by schedule or manually the job runs successfully. But when I looked for the files in the locations of the output files it seemed like the files were not delivered. To verify this I went into the script task that is contained in both packages and added my initials onto the end of the file names. I saved the changes in the packages and manually ran the SQL job. I did not see the files with my initials on the end. I then manually ran each SSIS package using SSDT. After each package completed successfully the output files with my initials on the end of the filename were now present in the proper file locations. The connections managers in the packages and the SQL job are all pointing to the same server. Why is it that when I run the SQL job it seems like the files are not delivered and when I manually run the SSIS packages the files do get delivered? It makes no sense to me. Any help in resolving this issue will be greatly appreciated.

I’m using SQL Server 2012 SP3 Developer Edition.

PS – I’m not sure if this post belongs in a SQL forum or a SSIS forum.  My apologies if it belongs in a different forum.

Thank you,

Dave

David Young

↧
↧

How to connect mysql in SSIS?

January 23, 2016, 5:46 am
$
0
0

Hi,

I want to insert data from SQL server 2008 table to mysql table in SSIS. How to connect MYSQL database. Please guide. 

Thanks in advance

Jaffer

↧

Reference Dynamic File Names with date time expressions

January 23, 2016, 8:37 am
$
0
0
I had a question about file name expressions with SSIS. We use expressions to build out file names so that we can dynamically name the according to the Date and Time (including seconds). Here is the expression I have used so far:

REPLACE(REPLACE(REPLACE(LEFT((DT_WSTR,200)(DT_DBTIMESTAMP)GETUTCDATE(), FINDSTRING((DT_WSTR,200)(DT_DBTIMESTAMP)GETUTCDATE(), ".", 1) - 1), "-", ""), ":", ""), " ", "")

This creates a string such as: 20160121140411 for the date 2016-01-21 14:04:11

In many instances I create the file in one task, and then later need to move or transfer the file in another task later in the process. If I refer to the variable that contains the expression it “recalculates/reevaluates” the file name and the process crashes because the seconds changed due to the processing time. So the file is created with ‘20160121140411’ but then when I try to move the file and reference the variable later in the package it recalculates it to be ‘20160121140415’ which it won’t find. What I have done to work around it is that I us a ForEach loop to loop through the directory where they are stored, but I was hoping there was a cleaner way to do it. I just can’t seem to make the variable not recalculate when I reference it later in the step. 

Has anyone encountered this issue and found a work around? Do you know of any easier or cleaner way of handling this?
↧

Race condition - scope of Connection Manager name

January 23, 2016, 1:51 pm
$
0
0

Hi,

I had a problem, I solved it.  But, want to know why the problem came in the first place.

There are 2 branches in TFS. There are 2 solutions (.sln files), one in each of them. So, we are dealing with physically different objects. I copy pasted a connection manager from Package-A in Solution-A to Package-B in Solution B.

This resulted in the notorious error "Failed to lock variable "User::.......variable not found"

I changed the name of the copy pasted ConnectionManager and the error message vanished.

Is "scope" feature not working here?  Why there is a collision of ConnectionManager names' respective scope?

thank you

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>