Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SP execution from SSIS

$
0
0

Hi

I have a SP to execute from the SSIS package to and capture the o/p results into a flat file, the SP has simple select statement and nothing in it.

I when I try to use OLE DB source in DFT to execute this SP ( this SP has no parameter) I am getting error stating "procedure has no parameter and argument were supplied"

"Unable to retrieve column information from the data source make sure your target table in the database is available"

I thought I would be simple to run the SP containing the Select stm and put the result into file from DFT, can some one help me with the steps pls.

I've the option of running this pkg in 2008R2 or 2012 version


Neil



SSIS Transaction Management and row level error logging.

$
0
0

Hi,

How can we achieve a single all-or-nothing transaction that spans multiple DFTs and doesn't lose any row level log entries? Or is logging row level errors in a separate transaction possible in SSIS?
In all instead of "Hresult: 0x80004005  Description: "Violation of PRIMARY KEY constraint 'PK_PolicyDetails'. Cannot insert duplicate key in object 'dbo.PolicyDetails'.", I would like to log customized error "Error generated in PolicyDetails for PolicyDetailsPK:1447927463028" which would give error row details.

Regards,

Alpa.

Adding services features in SSMS

$
0
0

Hi All,

I have downloaded and installed the SQL server 2014 with management studio in my local machine for learning purpose. After installation I tried to add the services features like SSIS, SSAS and SSRS but could not find them listed in the features.

Initially I dowloaded the files SQLEXPR_x64_ENU and SQLManagementStudio_x64_ENU but that did not help. Later I downloaded SQLEXPRWT_x64_ENU but that did not help either.

Can anyone help me to find out where I went wrong? Is there any specific file that I need to download for adding these services?

Many Thanks,

Meera

How can we execute a task or container for every 30 minutes in ssis .

$
0
0

Can any body help..

How can we execute a task or container for every 30 minutes in ssis .


sunny

SSIS Import with DB in Full Recovery Model

$
0
0
I've been unable to find an answer to this, despite reading various conflicting articles.  I'll try to keep it simple:

Lets say need to import 1 million rows of data, totaling 10GB in size.
Use SSIS Fast load, with MICS as 100k (so 1GB)
This will then send off 10x 100K rows to log file
This still causes log file to grow to 10GB as per MSDN (stating that it treats it as Batch_Size as per BULK Load, and "Specifies the number of rows in a batch. Each batch is copied to the server as one transaction. If this fails, SQL Server commits or rolls back the transaction for every batch. By default, all data in the specified data file is one batch. For information about performance considerations, see "Remarks," later in this topic.")

So given that all transaction of 100k will be rolled back should a failure occur at any point (i've tested this and its true), is the only real way to stop the log file growing batch up the records using something like a FELC?

The number in the cell is formatted as Text or preceded by an apostrophe

$
0
0

I am having a excel destination to output some calculation. The whole job completes successfully but the format seems to be incorrect. The number fields are displayed as text with a leading apostrophe. As a result, i am not able to calculate the sum based on dragging of the cells on excel.

Is there any solution for this? 

Sample of the file now:

Any help will be greatly appreciated. Thank you!

Random long Run of SSIS packages

$
0
0

Hi,

We have SQL ETL processes that are scheduled to run every 30 minutes in our OLAP environment that we have cubes as well.

The ETLS run just fine most times but sometimes end up taking 2 hours or more. We have captured longer running process, it is different each time. Are indices and stats are good.

What I have done so far to troubleshoot:
1) gather the long running processes, verified the execution plans and they seem fine.

2) verified the windows memory, cpu - as been good.

3) verified and put a monitor to see blocks -- none

4) verified the data to see if huge chunks come in at that time - confirmed it isnt

5) we have had slowness when no maintenance jobs are running on the server.

6) MAXDOP per m/s recommendation

The situation is pretty random! am a little lost.

Is there anything else i can look at?

Also, if i see the long running spid, and have its details like what is running, the i/o details, cpu, is there anything i can do to see if it is actually writing /reading or is it just hung?



T-sql Join two tables. The join key are one word to one text, both string.

$
0
0

Hi,

I have two tables, the main table have one column with text. The additional table have a shorter text and in som cases a word.

Exampel: 

Table 1 
Text    Amount
Visa 7-eleven 20160101-100


Table 2
KeyCategory
elevenFood

I think i want to do something like this.

Select *, y.Category

From Table1 As x

Left Join Table 2 As y

On x.Text = y.Key

It is the last row, i don't know how to solv.

Thankful for any help.

Best regards

BadenSQL


Can we use SSIS to migrate reports

$
0
0

Greetings All,

I have never heard or came across something like this, but i have a question if there is a way to migrate reports from one server to another server ( or from one version to another version of SSRS)  by using a SSIS package? In SSRS we have a url for the Report Manager, which have different folders for REPORTS, DATA SOURCES . Since use "Transfer SQL Server Objects Task" to transfer tables, views , i'm wondering if there is something out there in SSIS that does a similar thing for the SSRS Reports. Please advice.

Thanks

hhmmss in filename

$
0
0

Hello,

My situation:

  • I create dynamically XLS files in a loop (one per company) with a date and I want a hhmmss (latter is causing troubles) in the filename.
  • I create a table in the XLS in the loop.
  • I fill the XLS with data.

The problem is this: The filename is an expression on the connection to the XLS. It seems that the expression is re-evaluated everytime (once for creating the table in the XLS and again when the filling the data in XLS ) and that causes an error "file not found" when hhmmss is a second further.

The one solution I have currently is filling the variable with in a script task (once) and use this in the tasks..

Anyone an other solution?

Hennie

SSIS Lookup error when comparing two float values

$
0
0

I have a flat file and a table which the flat file populates. I covert the data type of all of the columns except one to float [DT-R4] from DT_STR because the destination table has float columns. This mapping executes fine without any errors and uploads all of the data. But then I want to see whether there are duplicate columns being inserted and introduced a lookup transformation. But it does not let me compare the [DR-R4] column with the relevant float column in the table. When I change the data type of the flat file columns to DT_R8, it lets me proceed to the end of the lookup wizard but gives the error "Error 41  Validation error. Data Flow GL_HISTORY: Lookup [2505]: input column "gl-appropriation-amt" (2748) has a datatype which cannot be joined on.    Main_Package.dtsx " in the package design window.

 

Any help would be greatly appreciated. Thanks in advance. 

SSIS 2012, FTP task: password not saved after deployment

$
0
0

Hello @all,

I noticed following behaviour of the FTP task in SSIS 2012: when I deploy package to the server (SSISDB database), the password in connection manager gets lost, I have to re-enter it manually via management studio. Can anyone confifrm it?

Regards from Hamburg,

Andrey

Deleted column in source but derive column does not delete that row and getting error "Error in Mapping path"

$
0
0

Hi experts

i have source that contain column id,name,address,city,birthdate.

derived column use add new row  age and calculate age.

after i delete one column from source city. but in derived table transformation editer->column has still that address column and when i am mapping with destination i got error like error mapping  in path.

how to resolved it/

Opening SSIS 2013 pacakge using Microsoft Visual Studio 2015

$
0
0

Hi,

We are in the process of upgrading our project (.NET, SSRS and SSIS) packages from 2012 to 2015. I am very confused about the versions and tools available. I installed Visual Studio 2015 Enterprise Edition with update 1. We have rdlc reports in our asp.net application. When I opened 2013 project in 2015, I couldn't open rdlc report in report layout mode. So, forums suggested me to repair Visual Studio 2015 and choose Sql Server Data Tools and install it. I did that and I see SQL Server Data Tools - ENU (14.0.50616) getting installed and asp.net rdlc is working fine.

We are used to open all SSRS projects and SSIS projects in Visual Studio. When I tried to open SSIS 2013 project in Visual Studio 2015, I am getting warning saying they cannot be opened.

How to upgrade SSIS 2013 package to 2015?

Thanks

How to set the variable to argument in Execute process task?

$
0
0

In ssis,I have tried to pass the variable in argument (execute process task) .i read msdn article in that they told to pass like @variablename in argument.i tried @variablename,@[User::variablename] but couldn't achieve. any suggestions on how to pass variables to arguments.plz

How do you force a Merge to refresh its meta data?

$
0
0

I have a recurring problem that is a frustrating waste of time.   It happens at Merges within data flows where it is impossible to get a merge to update its meta data to reflect changes in other parts of the flow.

A simple example;

I create a Source in a data flow that gives me a column of VARCHAR(10).  Further down the data flow I have a Conditional Split, a following Merge, and then at the end a Destination.

At the point of Destination I discover that I actually need the column to be aNVARCHAR(20).   So I return to my source SQL SELECT and CAST the column.   This means I also have to modify the data type on the Output column to match this change.   Now if I view the metadata on the Path out of the Source it correctly shows my column to be DT_WSTR with length20.

However, at the destination at the end of my flow it is still DT_STR and length 10.  Tracing back through the flow I find the problem is the Merge, where the column enters as the newDT_WSTR 20 (in both inputs), but exits as the original DT_STR 10.

There appears to be nothing that will convince the Merge to update itself to the new values.  I've tried removing the column from the merge, ignoring it, re-adding it.  In all cases the column output from the Merge stubbornly remainsDT_STR 10.  The only solution is to delete the entire merge and recreate it, which can bring about a significant amount of reworking in the more complex flows.

Am I missing the easy way to do this?  Thanks.

SSRS report for the overall count of people who selected their prefered subject as 'primary' and second subject as choice(maths,physics,computers,commerce) based on acadamei

$
0
0

My tables are contacts,subjects,education

contacts table fields:            Subjects  table fields :            Education table fields:

year,region,created date         Prefsubject1,Prefsubject2            Degree class,qual type

common field in all tables is contact_id

i need to create the report for the below requirement from client,

1.The overall number registrants with year of 2015/16,2014/15,2013/14,2017/18 who selected 'primary' as their preferred teaching subject

2.The overall number of each of the above  groups who selected a second teaching subject choice(regardless of subject)

The overall number of each of the group who selected their second teaching subject choice as

Maths

Physics

Languages

Computing

Geography

Chemistry

This last set is required at individual subject level.

please someone can  help me out of this problem.Thank you very much in advance.


Midhuna

How to syn data between Oracle and SQL server

$
0
0

HI all.

I have many some other oracle Database, each of them have the own roles.Now I want to syn to my SQL server.

The table 1 from oracle 1 to the table 1 SQL server.

The view 1 ....

I don't want to syn all to my SQL server.

Is there any solution tu use SSIS.

Update column in the table through SSIS

$
0
0

Hi All,

I am trying to update the column Description in the table A which is from server B and Database C. I have codes in the table A which I am trying to lookup to a table D on different server E and Database F which contain codes & descriptions. I want to update the Description in table A without bringing Table D to server B and Database C. Please help

Thanks

Susheel


sush

How can I show default value for the empty column?

$
0
0
I am new to SSIS, please help me on this.
I have a flat file with data, and there are some column are empty. I have to load this data into my database, and for those empty data, I need it show default value. How can I do this?
Viewing all 24688 articles
Browse latest View live