Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Get File Properties Task and Precedence Constraints

August 27, 2013, 1:17 pm
$
0
0

I have an SSIS package which utilizes the File Properties task. I essentially need to check the size of a file. If the file is empty (size less than 1KB) then send an e-mail alerting to an empty file. If the file is greater than 1KB, then continue processing as usual.

I've created a user variable of type Int64 and assigned the name FileSize in Variables.

The Get File Size task needs to have twp precedence constraints - one for each condition. I've included a screen shot of the portion of the package containing the constraints:

I have two expressions. The first is for the Empty File alert: @[User::FileSize] <= 1000

The other is for the process as normal branch: @[User::FileSize] > 1000

Whenever I run the package, I get an error:

I have no idea why this would be failing with that type of error...??

I would think this would be the most basic expression, but I could be wrong

Any insights would be appreciated!!

A. M. Robinson

↧
Search

SSIS package runs in DtexecUI but fails in Dtexec

August 22, 2013, 2:12 pm
$
0
0

The same package (on the same machine) runs fine in DtexecUI but fails in Dtexec with the error message  DTS_E_PRODUCTLEVELTOLOW. We checked both 32 bit and 64 bit version of Dtexec, they both fail.

I was under impression that DtexecUI and Dtexec are powered by the same engine, is it wrong? Why their functionalities are so different?

↧
↧

Date Conversion Using Derived Column

August 20, 2013, 8:34 am
$
0
0

 I have the date in the format of (MM/DD/YYYY) format , i need to transform to (MM-DD-YYYY) format . I used the Derived column transformation to do it ,still its not transforming . My Source of date is from Access DataBase which is of type

date(DT_DATE) .

I used the below formats

Format 1:

(DT_DBDATE)(((RIGHT("0" + (DT_WSTR,2)DAY(ExpDate),2)) + "-" + RIGHT("0" + (DT_WSTR,2)MONTH(ExpDate),2) + "-" + (DT_WSTR,4)YEAR(ExpDate)))

Format 2:

(DT_DATE)((SUBSTRING([ExpDate],0,2) + "-" + SUBSTRING([ExpDate],1,2) + "-" + SUBSTRING([ExpDate],4,2))

        These are not transfroming the dates ,its displaying the same as source . My Destination is Excel File .

1234Transfor1Received3/5/2001
34535Transfor2InPending3/7/2009
343443Tranfor3InPending9/8/2008

I want my Dates to be transformed into format of (MM-DD-YYYY) format .  For instance (3/5/2001 needs to transfomed to 03-05-2001).

     Missing anything?

↧

Importing Access (.mdb) files into SQL Server using SSIS

January 26, 2010, 7:34 am
$
0
0
Hello,

I am trying to import a .mdb (Access) file into the SQL Server database using SSIS. But I can find the type of data source that i should use. It throwing error at every type that I tried. Can someone please guide me as to how can we import access files using SSIS?

Thanks,
KK
↧

how ms sql server 2012 or ms sql server 2012 features handles the BIG DATA

August 22, 2013, 6:50 pm
$
0
0

Dear all,

i'm newbie at MS SQL Server use, and i wonder does anyone can tell me or maybe give me an article or maybe can show me a quick demo how to handle BIG DATA with MS SQL Server 2012 ?

i have scenario problem like this :

i have to do ETL process from Flat file with csv file type and insert it into DB and create Data Mart from that DB that i have been created. so far, i got the picture and imagine the SSIS package that i will use, but the main issue were the flat files data that i have to Extract and process have minimum size about 100 - 500 GB per-files or it can be split into several files but the size from all that several files were 500 GB. so i imagine, how to handle this files and how the best practice to handle this process using SSIS ? how i handle this process, can i configure the threads manually or by automatically this threads already handle by MS SQL Server 2012 (i read that MS SQL Server 2012 can handle until 1 Pentabyte data right?). or i split the flat files into several data and process it with several package, if yes its a good solution, does anyone can give me a short demo or tutorial how supposed i can do that ? and last issue was, how to handle the error, especially if on the middle of the extract process has error,and it takes a time if the process was started from the beginning once again after the process remark or flag the error flat files.

thank you for the answer and support.

regards,

Bambang

↧
↧

Cannot fetch a row from OLE DB provider "BULK" for linked server

November 14, 2006, 11:01 pm
$
0
0
I have an SSIS job that is pumping to a SQL Server Destination, hundreds of gigabytes of raw text files.  Today I received this strange error - does anyone have insight?  Also, how would I make the data tasks more stable and robust so that this doesn't cause package failure (retries, or something?)

[SQL Server Destination [4076]] Error: An OLE DB error has occurred. Error code: 0x80040E14. An OLE DB record is available.  Source: "Microsoft SQL Native Client"  Hresult: 0x80040E14  Description: "Cannot fetch a row from OLE DB provider "BULK" for linked server "(null)".". An OLE DB record is available.  Source: "Microsoft SQL Native Client"  Hresult: 0x80040E14  Description: "The OLE DB provider "BULK" for linked server "(null)" reported an error. The provider did not give any information about the error.". An OLE DB record is available.  Source: "Microsoft SQL Native Client"  Hresult: 0x80040E14  Description: "Reading from DTS buffer timed out.".
↧

Salesforce Integration using SSIS

August 27, 2013, 10:27 am
$
0
0

Hello Everyone,
I was wondering if you had done any complex integration between SQL Server & Salesforce using SSIS.

1.) Which thirdy party connector did you use?
2.) How did you implement Salesforce lookup using the SQL source data?

Your response will be greatly appreciated. Thanks in advance!

Regards,

Sajid

↧

User sync with IBM SPSS Data Collection Server

August 27, 2013, 4:49 am
$
0
0

Hello all,

The first and most important thing I would like to do is to be able to import users tomrUserData then set some roles to these users.

I'm trying to find out any information about IBM Data Collection Interviewer Server Databases. The only reference I was able to find is "mrUserData. This database contains the following tables related to IBM® SPSS® Data Collection Interviewer Server Administration and Interviewer Server:" which is extremely insufficient.

Any help would be very appreciated if there is someone with experience with data integration with IBM SPSS Data Collection Server.

thanks in advance

↧
Search

SSIS foreach loop ADO enumerator (records from one table to another table after 10 records)

August 20, 2013, 10:54 am
$
0
0

I have a database source table and database destination table. I need to load data from first table to second table using a foreach loop.
The normal situation is that rows are loaded singly (is that true?), but I need to repeat loop after load by ten records. The reason why I want to use a loop is that I want to have overview over the course of loading the data.

This is what is done:

  • I have an sql task where I select all of the records from source table and save to full result set as an object variable.
  • Drag and drop foreach loop container and set ADO enumerator and set object variable.

Can someone help me with the next steps?

↧
↧

How to extract the attached data from JIRA API and upload to same at JIRA

August 28, 2013, 1:03 am
$
0
0

Hi All,

I have a assignment which need to be extract data from JIRA attachment and load into database. And after doing some ops again upload that data to JIRA.

Please anyone who have some idea please help me.

Thanks

Mohd Shams

↧

Execute web-based PHP script

August 28, 2013, 12:28 am
$
0
0

Hey guys,

I have a small issue with SSIS with executing a PHP script based on a webserver. Situation is as follows:

- I have a webserver, e.g. www.example.com

- On this webserver is a PHP script which generates 2 CSV files, e.g. www.example.com/generateCSV.php

- Now I need to import the CSV data into SQL Server with SSIS.

So the steps would be Execute PHP -> Transfer CSV files to local machine -> Import Data to MS SQL Server.

Here comes my question: How can I initiate the execution of the webbased PHP script within the SSIS package? Or can you think of a easier way to get the CSV data to my local database?

Thanks in advance for your support?

↧

Hashbytes

August 28, 2013, 1:44 am
$
0
0

Hi,

Currently investigating hashbytes for multiple column comparisons. The reason I want to investigate is storing the hash in a column and i'm currently determining  what data type would be best to store the data. We are using SHA1 algoritm and therefore hashbytes gives a varbinary(20) and therefore storing the data in a binary (20) would be a appropriate choice. Right?

Well, in our comparison scripts we've converted the hashbytes value to nvarchar and this gives a (data) length back of 20.. Should i use this as a base for storing the hashbytes results? Or should i store the binary and convert it to nvarchar? Or should the comparison made based on on binary instead of nvarchar?

Another thing that came to my mind is storing the value in a Nchar or char field because the length of the returnvalue of the function hashbytes is fixed. Is that an idea? A little performance gain?

Gr,

Hennie


↧

If i run an ssis package through bids will it apply ssis configurations

August 28, 2013, 1:48 am
$
0
0

Hi there,

I have a package that uses package configurations in a SQL table and uses an XML file to point it to that table. If I run the package in BIDS, does it apply the configurations? I cannot seem to find a way to test this as it is impossible to view any of the properties of the objects at run time.

Any thoughts?

Thanks,

Mark

↧
↧

Time In and TimeOut Records (very urgent Please)

August 28, 2013, 12:02 am
$
0
0

Dear All,

I Need to display Time In and Timeout Details in My Report...

Herewith i have attached table structure and Expected output...

Looking for a favorable reply...


VISITOR IN TABLE

EMPID           NAME    ACTION       visitorTime
1                  ASWIN    IN        2013-03-15:01:23
1                  ASWIN    IN        2013-03-15:15:17
1                  ASWIN    IN        2013-03-15:22:10
2                  ANJALI    IN        2013-03-15:05:23
3                  RINI        IN        2013-03-15:07:45
1                  ASWIN    OUT        2013-03-15:12:32
1                  ASWIN    OUT        2013-03-15:24:10
2                  ANJALI    OUT        2013-03-15:18:15
3                   RINI       OUT        2013-03-15:30:28



EXPECT OUTPUT

EMPID      NAME           INTIME             OUTTIME       
1           ASWIN     2013-03-15:01:23    2013-03-15:12:32
1           ASWIN     2013-03-15:15:17    NULL
1           ASWIN    2013-03-15:22:10    2013-03-15:24:10
2          ANJALI     2013-03-15:05:23    2013-03-15:18:15
3          RINI         2013-03-15:07:45    2013-03-15:30:28

Thx.
 

↧

When does a package open its connections to flat files?

August 28, 2013, 1:54 am
$
0
0

When does this occur? Does it open them all at the beginning of the package or when it first attempts to access them. I have a package which is unzipping some files and then importing the resulting CSV files. The CSV files won't exist at the start of package execution. Thanks,

Mark

↧
Search

SSIS Package creation

August 28, 2013, 3:24 am
$
0
0

Hello Team,

I got one requirement, There is one report which needs to run monthly. I have SQL Script ready and the source would be an excel file.

Some one can explain how to create the package on this requirement?

Regards,

Chinni

↧

Design Question- Dynamic Configuration of Metadata in Dataflow

March 20, 2007, 9:47 am
$
0
0

I have a design question that I'd like some input on.  I am trying to archive data from an extremely large production database.  The tables to be archived changes quite often.  It is currently along the lines of 80-100 tables with the possibility (likelihood) to grow from there. 

If at all possible, I'd like to avoid writing an individual dataflow transformation for each table.  I know that SSIS does not offer the same capabilities to change the metadata at runtime as DTS.  I am currently exploring the option of programmatically creating/modifying the packages through the .Net framework.  (using this link as a guide:  http://msdn2.microsoft.com/en-us/library/ms345167.aspx). 

I have concerns about the performance of this approach and was wondering if anyone had any feedback, or has implemented something similar, or has any other ideas on a different way to accomplish the same thing.

Thanks so much for your help,

Jessica

↧
↧

check if partition exists on Tabular ssas model

August 28, 2013, 10:20 am
$
0
0

Hi,

I have two issues.

  1. I have SSIS package reads partition name, table name, database name, server connection form variables from the table and creates partitions on SSASTABULAR Model Table.  I want to check if partition already exists it should not do anything, if doesn't exists then create partition. Remember is itsTabular model, not multidimensional cube.
  2. My SSIS package process partitions tabular model table, i want to read the size of the partition, how do i do that in SSIS?

Thanks in advance for the help!


↧

Ways to move data out of a table and then later bringing it back into the table

August 28, 2013, 12:15 pm
$
0
0

I'm creating an SSIS that is going to:

  1. Query some data from TableA and copy it to some other table or data store (call this TableB)
  2. Delete all the data in TableA
  3. Copy some data from TableC into TableA (by executing another SSIS package)
  4. Copy all the data from TableB back into TableA

What is a good way of doing this?  I have been looking into using temp tables, but it seems that using those with SSIS packages can get troublesome.  The most straight forward way seems to be to create an actual TableB in my database and optionally drop it when the SSIS is done.  Is there anything bad about using an actual table instead of a temp table?

The other part to this is that I want to make sure that if anything goes wrong copying data from TableC to TableA and from TableB (or the temp table) back into TableA that I can rollback the delete done to TableA.  Is this possible?

↧

SSIS Oracle Source only distinct rows

August 20, 2013, 10:56 am
$
0
0

I have a SSIS job that pulls from an oracle table and dumps into a SQL table. But the oracle table has 170 million rows.

What is the best way to only get the unique values from this table? I could run through a sort(and remove duplicates) but that would still have me waiting for the 170 million rows to come in then remove the duplicates and probably take an entire day if not hanging up mid way anyways.

Thanks in advance,


It would be ideal to just have a sql statement that does it right from the beginning if anyone knows where to point me for that.
↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>