Quantcast
Viewing all 24688 articles
Browse latest View live
↧

SQL Server 2012 with Visual Studio 2013 with SSIS/Integration services project?

January 22, 2015, 10:56 am
$
0
0

I wanted to build an integration services project to import data from multiple sources using a vendor's API.

I wish I could recall how I got to the point where I was able to build one and have it run successfully, but I had to install so many things that I honestly don't remember.

However, I noticed my PC booting really slowly after that, and I saw that I had components of VS 2010, VS 2012 and VS 2013 installed, along with SQL Server 2008 and 2012.  So I uninstalled a bunch of stuff, hoping to get to where I had only the most current versions of all, that were compatible with my corporate environment.  So I was aiming for Visual Studio 2013 (Premium, I think) and SQL Server 2012.

Took me 2 days.  Now I'm at the point where I think - and I'm here to learn if I'm correct - that I cannot get an oData Source component into my project and use VS 2013 IF I want to stick with Sql Server 2012.  Is that correct?  

I get very confused when trying to determine how the acronyms relate:  SSIS, SSDT, SSDT-BI, etc.

↧
Search

Corrupt Excel files

January 23, 2015, 6:42 am
$
0
0
I am extracting a lot of datawith SSIS 2005 ...  DB to excel, every time i try to pull a certain date range the file is corrupt.  I have even tried to go file open / repair and just Extract the data but the file is still corrupt.  I have pulled 50-60 files from the same database with out any problems and this file on extract does not throw any errors.  Any ideas to get this data, or what could be corrupting the file?  I am not receiving any errors on export
↧
↧

Script component Fail: System.IndexOutOfRangeException: Index was outside the bounds of the array

January 22, 2015, 9:39 pm
$
0
0

In SSIS package “script component” is failing due to the following exception. This exception is occurring sometimes only.  This script component contain Try/Catch, still it’s failing. What could be the reasons for this exception?

Error Message

**************

5246793 User:OnError Package1 2015-01-16 03:40:45.000 2015-01-16 03:40:45.000 00:00:00 System.IndexOutOfRangeException: Index was outside the bounds of the array.

   at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.HandleUserException(Exception e)

   at Microsoft.SqlServer.Dts.Pipeline.ScriptComponentHost.ProcessInput(Int32 inputID, PipelineBuffer buffer)

   at Microsoft.SqlServer.Dts.Pipeline.ManagedComponentHost.HostProcessInput(IDTSManagedComponentWrapper100 wrapper, Int32 inputID, IDTSBuffer100 pDTSBuffer, IntPtr bufferWirePacket)

5246800 OnError Package1 2015-01-16 03:40:45.000 2015-01-16 03:40:45.000 00:00:00 SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Script Component" (657) failed with error code 0x80131508 while processing input

input "Input 0" (666). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

↧

copying multiple tables from mysql to sqlserver along with the index using SSIS

January 23, 2015, 8:04 am
$
0
0
I have about 14 tables to copy from MySQL database to sql-server using SSIS, I have connected to it and can do it one after the other , but I will like to be able to do it at once and also copy the structures like indexes as well
↧

How can I use Selst Tsal statement inside the Derrivedcolumn

January 23, 2015, 8:42 am
$
0
0

Hi Friends,

I need to use below query for new column how can i use it this tsql stement inside the Derrived Column Transformation.

I am trying to use this query in Variable Expression. mapping that variable to new column, but doesnt working to me.

Select Casewhen Month(Getdate())in(1,2,3)ThenYear(GetDate())-1Elseyear(Getdate())EndAsFIN_Year

Can you please give me any idea for me.

Thanks.

↧
↧

Extract Data From Website

January 23, 2015, 9:57 am
$
0
0

Hello,

I have a task to extract data from a website, on the below website you can find a table "Performance Summary" and i need to extract that entire table which you see in the middle of the page.

http://www.tadawul.com.sa/wps/portal/!ut/p/c1/04_SB8K8xLLM9MSSzPy8xBz9CP0os3g_A-ewIE8TIwN3Q0tDA0_v4EDLUCNHIwMvc6B8JJK8QbCpgYGniU9YiLOPu7GBgQFJut0DwkxBuoONggO8jA08jQjo9vPIz03VJ-RmVDe5O5rqB6fm6RfkhkYYG1Q6AgCbZOXy/dl2/d1/L3dDb1ZBQSEhL3dHa0FKREFOZ0EhIS9ZQkpKdzQ1dy83X04wQ1ZSSTQyMEcxOTEwSUtTUTlVMkEyMEI1/?symbol=1330&tabOrder=2&chart_type=chart_oneDay&announcmentNumber=&isAnnual=

Extract and load the data into a table.

Can you please share what is the best approach to do this?

↧

Is it possible to load multiple .xlsx files into a SQL Server Table using SSIS and a Foreach Loop Container when each Excel spreadsheet is comprised of two different worksheets

January 23, 2015, 11:31 am
$
0
0

So we have an Invoice .xlsx File from a 3rd party vendor. It contains two worksheets..."Enrolled" and "Engaged". The data and data columns in each worksheet is different. Is it possible to loop through multiple .xlsx files using SSIS and a Foreach Loop Container for each spreadsheet, and then another Foreach Loop Container to control each worksheet, and pump the Excel data into a SQL Server Table first for "Enrolled" and then for "Engaged"? How can I control the Foreach Loop Container in SSIS to process ONLY the "Enrolled" worksheet first? And then the "Engaged" worksheet next?

I know I have multiples out here and I apologize for that...but right now it seems as though I take three steps forward and then two back.

Any help would be GREATLY appreciated!

Thanks in advance!

↧

invliad object ssis

January 23, 2015, 10:27 am
$
0
0

i am executiin sp in my oledb souce, i a using commnad hee.

but i am getting error invalid obejct name #member_we

i am using temp table in my stored proc and at the beginning i am dropping it

whats wrong with this one

↧
Search

Importing multiple .txt files with the same format (column names, length, etc.)

January 23, 2015, 1:31 pm
$
0
0

I have multiple .txt files with the same fields. There are no column headings in the .txt files.

Is there anything in SQL Server (2012) that I can use to import .txt files that have the exact same column specifications (name, length, data type, etc.), similar to the "Import Specifications" feature in Access?


↧
↧

SSIS Fuzzy Grouping creating different groups upon re-run

January 23, 2015, 3:27 pm
$
0
0

We have approximately ½ a million customer names we are trying to group together using fuzzy grouping in SSIS, SQL Server 2012 Enterprise Edition. We set the similarity score to 80%. When the fuzzy grouping is re-run, with the same customer names as input, some customers are placed into different groups.

Placing an order by on the source seems to reduce the issue during testing but not fix it 100%. Is there a way to guarantee the customers will placed in the same groups each time it's run?

Below is an example of what is happening. I refrain from using the actual data because it is not public information.

First run results:

customer name

fuzzy name group

name_1

name_1

name_2

name_3

name_3

name_3

name_4

name_3

Second run results: (same customers, different groups)

customer name

fuzzy name group

name_1

name_4

name_2

name_4

name_3

name_4

name_4

name_4

↧

SSIS for each loop container

January 21, 2015, 10:43 am
$
0
0

Hi to all,

I need to be able to open about 150 different MSAccess database to extract data from 1 specific table, the db name is bases on the date like 20150118.mdb, 20150718.mdb and so on...

I would like to use the for loop container to do this process but I do not know how exactly how to process, all the database are in the same directory like z:\DataFiles\Z\dbname.mdb

I already have a data flow task to proceed with 1 database only and it is working just fine.

Now I need to be able to do the same thing for all the db

I am fairly new to using SSIS 2008 and not sure on how to proceed

I seek help on this one

Thanks

↧

How do I access a value of a variable in SSIS and control the flow accordingly based on its value?

January 23, 2015, 1:05 pm
$
0
0

So I have a Foreach Loop Container that Enumerates a read Excel spreadsheet and this Foreach Loop get its User::SheetName. Can I change my flow accordingly based on the value of the User Variable User:SheetName that is dynamically valued by the Foreach Loop Container? So if the User::SheetName is "Enrolled", I want to load that worksheet to a certain SQL Server Table using an Excel Source and OLE DB Destination and if the User::SheetName is "Engaged", I want to load its worksheet contents to a different SQL Server Staging Table. What Task can I use to determine the value of User::SheetName or am I going to have to write a C# script to do this?

Any help and/or suggestions are GREATLY appreciated.

Thanks!

↧

How can I load a .xlsx File into a SQL Server Table using a Foreach Loop Container in SSIS?

January 23, 2015, 9:13 am
$
0
0

I know I've REALLY struggled with this before. I just don't understand why this has to be soooooo difficult.

I can very easily do a straight Data Pump of a .xlsX File into a SQL Server Table using a normal Excel Connection and a normal Excel Source...simply converting Unicode to DT_STR and then using an OLE DB Destination of the SQL Server Table.

If I want to make the SSIS Package a little more flexible by allowing multiple .xlsX spreadsheets to be pumped in by using a Foreach Loop Container, the whole SSIS Package seems to go to hell in a hand basket. I simply do the following...

  1. Put the Data Flow Task within the Foreach Loop Container
  2. Add the Variable Mapping Variable User::FilePath that I defined as a Variable and a string within the FOreach Loop Container
  3. I change the Excel Connection and its Expression to be ExcelFilePath ==> @[User::FilePath]
  4. I then try and change the Excel Source and its Data Access Mode to Table Name or view name variable and provide the Variable Name User::FilePath

And that's when I run into trouble...

Exception from HRESULT: 0xC02020E8

Error at Data Flow Task [Excel Source [56]]:SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occured. Error code: 0x80004005.

Error at Data Flow Task [Excel Source [56]]: Opening a rowset for "...(the EXACT Path and .xlsx File Name)...". Check that the object exists in the database. (And I know it's there!!!)

I don't understand by adding a Foreach Loop Container to try and make this as efficient as possible has caused such an error unless I'm overlooking something. I have even tried delaying my validations and that doesn't seem to help.

I have looked hard in Google and even YouTube to try and find a solution for this but for the life of me I cannot seem to find anything on pumping a .xlsX file into SQL Server using a Foreach Loop Container.

Can ANYONE please help me out here? I'm at the end of my rope trying to get this to work. I think the last time I was in this quandry, trying to pump a .xlsX File into a SQL Server Table using a Foreach Loop Container in SSIS, I actually wrote a C# Script to write the contents of the .xlsX File into a .csv File and then Actually used the .csv File to pump the data into a SQL Server Table.

Thanks for your review and am hoping and praying for a reply and solution.

↧
↧

How Do I get SSIS To Stop Looping Through Excel Rows After Last Populated Record?

January 23, 2015, 12:58 pm
$
0
0

I have a package that loops through many excel files. Each Excel File has about 5000 rows. My problem is that after the 5000th row SSIS keeps looping through all the rows after the last row. There are nothing in these rows. This is a complete bottleneck of my package because it takes forever when doing this. How do I stop this?

Thanks

↧

SQL Agent job running DTS package running in SQL 2005 is unable to run if job onwer is not logged onto server

January 26, 2015, 8:43 am
$
0
0

I am currently working on a SQL Server upgrade project for a a client where I am converting old dts packages to SSIS. However for a few of the packages no conversion is allowed to be done. For these few packages I have to use dts legacy components in SQL 2005 on a windows 2003 server to run them.

These packages use CAPICOM via an Active X script in the package to envelope connection string data for security within the package. Consequently I have to register the capicom.dll for the job owner (which will execute the job via proxy) and install private and public key files via internet explorer. I also do this when I am logged in with my account so i can test the package.

I have created a SQL Server Agent Job which is used to execute the package. We have a schedule account which is local admin on the server and sysadmin within SQL Server. This account is used to create a credential and then a proxy for the CmdExec subsystem is then created based on this credential. A CmdExec job step is then added to the job. The directory of  cmd file which calls the dts package is then entered in the command window.

Finally a recurring schedule is added to execute the job every 5 minutes. 

If i am logged in to the server using the scheduled account the schedule runs successfully. I am also able to run the command file manually by double clicking on it. The DTS package is run successfully. However once the schedule is set up and I log off the machine and log onto my development machine with my normal account and fire up  SQL Server. I connect to that instance with the schedule and see that the job is failing with and Active X error in the package. From experience with this package this Active X  error occurs when the user executing the package has not registered the capicom.dll. This has already been done for the scheduler account because the job runs when the scheduler account is logged in on the server. 

It almost seems as though the job will only run if the Scheduler account is logged on. If i log directly on to the server with own user account I am able to manually execute the package via the cmd file which indicates that the capciom.dll is registered under my account. Yet if I try an run the job in SQL Server when I am logged in under my account (using the scheduler account proxy) then the job fails.

Does anybody have any idea why this may be happening? Any ideas would be much appreciated

 

↧
Search

Trim in derived column doesn't seem to trim blank spaces

January 5, 2015, 10:06 am
$
0
0

Hello all. I am importing a text file into an existing SQL Server table, and the last column is giving me some trouble. It is a string field, and it looks like it has blank spaces instead of nulls for empty values. All other columns have true nulls for empty values, which is what I need this column to have as well.

My plan was to handle it in a derived column. Replace all blank spaces with null, using this code.

TRIM(UBPKE542) == "" ? (DT_STR,4,1252)NULL(DT_STR,4,1252) : UBPKE542

It's not working. It doesn't seem to trim at all. To test, I added a new derived column to just show me the length of this field after trimming. It shows 1 for all the blanks. Other values, such as 42, show 3 as the length.

Any idea what is happening? Is there any other character it could be that would show as a blank space? When I open the file in Excel, the cells are just empty.

Thanks for your help!

WeeLass

↧

How to send set of emails from SSIS

January 26, 2015, 12:31 am
$
0
0

Hi All,

I would like to send set of emails from SSIS.

For eg: I have to,from,Subject and mail body present in a table. I would like to go through the table 1 row at a time and send mails

Regards,

P M-S

↧
↧

Programmatically Rename ErrorCode column

January 26, 2015, 6:56 am
$
0
0

Hi,

One of my table has a column "ErrorCode" due to which SSIS is giving me an error 

SSIS The package contains two objects with the duplicate name of “output column “ErrorCode”

I am able to fix this issue from the UI following the instructions here http://bturnip.com/nerdalerts/archives/146.  The problem is that  I am generating the package from the code and I am not sure how I can programmatically change the SSIS OLE DB Source Error Output column name ErrorCode to something else.

Can someone pls help me with this issue

Venkat Sriramulu

↧

EX_SP_COLUMNS fails with Excel xlsb linked server using Microsoft.ACE.OLEDB.12.0

January 26, 2015, 6:11 am
$
0
0

Strange behaviour here.

I have a T-SQL routine that loops though a whole load of Excel files and loads sheets with a certain name. In order to work out the columns on the sheets it uses an EX_SP_COLUMNS to retrieve the column names and types. All has worked fine for years.

Today I test a new spreadsheet and it bombs out with:

Msg 7311, Level 16, State 2, Procedure sp_columns_ex, Line 177

Cannot obtain the schema rowset "DBSCHEMA_COLUMNS" for OLE DB provider "Microsoft.ACE.OLEDB.12.0" for linked server "LINKEDSERVERNAME". The provider supports the interface, but returns a failure code when it is used.

If I rename the sheet in the file so it is less than 8 characters the EX_SP_COLUMNS works! Longer than 8 characters generates the error. Cannot remember having this issue before and I cannot believe I've never had spreadsheet name longer than 8 characters before. EX_SP_TABLES provides a list of tables fine. Same error occurs if I try through SSMS GUI with right-clicks etc.

The behaviour is very similar to that shown here: https://social.msdn.microsoft.com/Forums/azure/en-US/d087fc72-dea3-493f-bfd8-de745db1084d/microsoftaceolebd120?forum=sqldataaccess

I'm using SQL2008R2 SP2 over Windows 7. In this instance I am using a 32 bit instance with appropriate ACE drivers etc installed. I also have 64bit instance but that has no ACE drivers installed.

Any ideas anyone?!

JCEH


↧

SSIS - "Insufficient Connection information was supplied" problem

January 26, 2015, 6:32 am
$
0
0

Hello,

I have connection problem with my SSIS package. Setup is as follows:

  • Package includes 150+ dataflows that pump data from Informix tables to MS SQL Server tables
  • Setup of each dataflow consists of ADO.NET source (newest driver version 4.10 for Windows x64) and OLEDB destination pointing to SQL Server 2012
  • Data components are linked to connection managers, which are parametrised. Connection string is set from one parameter and password from another (sensitive) parameter
  • All dataflows are in one big container to achieve maximal parallelism (parameter MaxConcurrentExecutables = -1) and highest performance.

Most of the time, it works correctly. But ca. 1 out of 10 runs, I get following error:

Error: ADO NET Source has

failed to acquire the connection {3DC4A80D-EC92-4551-

B607-B0D2E2652F43} with the following error message:

"ERROR [HY000] [Informix .NET provider][-11302]

Insufficient Connection information was supplied".

 

When I then re-run the package with identical configuration, it runs fine. Informix support told me, that from their point of view everything seems OK. They tried to simulate this error and ran test with ca. 50 dataflows (but with password supplied in connection string) and it ran correctly.

So they assume, that problem lies within SSIS, which sometimes simply fails to supply password to ADO.NET source and it fails. Do you have any suggestion where might be problem?

Thanks for cooperation

 


↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>