hi
I am trying to load a few XML files to a database. one of our proprietary systems load the file in 3-4 minutes however with ssis XML source file it takes over an hour.
can anyone know the reason/help with this?
I tried the delayValidation set to true with no success.
thanks
eddy
eddy.a
Hello,
having on mind that this is my Target server:
what is the way of creating shared folder in order to perform operation from the title (and, of course, to continue with installation of packages etc...)? SQL SERVER 2008 R2
thanks
G'day All, so far my searches are determining it isn't possible but just to be sure.
If in a SQL task, I populate an Object variable, can I access the first row of that variable by doing something like varname[0] and subsequently a column of that first row as varname[0][columnname]? Or is the only option to throw it through a For Each (or use a script)?
I ask as I run a SQL query that will only ever return one row but the number of columns is growing so rather than defining the hundreds of variables we're getting to, it would be nicer if we can query the Object for the column we're after knowing that once we add it to the SQL, it will be available.
Thanks
Hello People,
I'am trying to import data from SharePoint 2013 to SQL Server. For that I install a codeplex package to install some SharePoints features to have access to Data Flows from SharePoint:
I already create the connections and insert the URL from my SharePoint. But When a click 'Ok' I'm having the follwing error:
Can you help me solving that problem?
Thanks you!!!
Hi Guys,
I'm currently converting our SSIS 2005 packages to 2012 and I'm finding an odd difference on the Data Flow Output when it imports a txt file to a table.
We have a pipe delimited file ( contains a totals on the bottom row).
CATNO|Title|Total Stk Avail|Stk on Order|Rank|QOH|Allocated|Reserved|BackOrd|WIP|Cleared|Held CATNUM000067|Fast and Furious|9804|0||9804|0|0|0|0|0|0 CATNUM000068|Frozen|0|0||0|0|0|0|0|0|0 CATNUM000029|Brave|0|0||0|0|0|0|0|0|0 CATNUM000029|Brave with Kinect|0|0||0|0|0|0|0|0|0 CATNUM000029|Big Hero|0|0||0|0|0|0|0|0|0 CATNUM000057|Transformers|27376|0||27376|0|0|0|0|0|0 CATNUM000013|James Bond|121|0||121|0|0|0|0|0|0 ,Total Available Stock,524259
And these are the settings for the flat file connection
In SSIS 2005, the total rows are being omitted automatically by the data flow. Basically only 7 rows are inserted whereas in SSIS 2012. 8 rows were inserted including the totals.
if we think about it, SSIS 2012 is correct since we just feed what's ever in the file.
But on the conversion and testing perspective, it's now harder as there's discrepancies between those 2 version.
I just like to check if there's any other discrepancies in terms on results/output between SSIS 2005 and SSIS 2012
Many thanks.
Hi All,
I have a requirement where data of SQL query needs to be loaded to a CSV file.
The row delimiter of the CSV file has to be CR-LF.
In the flat file connection manager, I have mentioned Header Row delimiter as "{CR}{LF}" and under columns section, row delimiter is specified as "{CR}{LF}".
But when I open the detsnation CSV file using notepad++, I see only "LF" at the end of all rows.
Can you please let me know how can I get both CR & LF at the end of each row
Below is the screen shot of the flat file connection manager which I have used for CSV destination file:
.
Raksha
Hi Experts,
Consider, I restore a database of size 100GB in SQL Server 2008 R2 [1 Instance] --OS has [24GB RAM] and SQL Max memory setting is default/unlimited-
2147483647 MB,
Once i complete my database restoration to this instance - will there be a increase in memory conception for SQL server ?
hypothetical example.,
+before db restoration - Memory utilization is 5GB
+post db restoration -Memory utilization is 7GB
will this happen -or- not ?..
If yes..,
Do we have any statistics to figure out the growth rate -or- any calculation/metrics that no of databases in SQL server will utilize 'n' value -or- 'n'% of Memory in server ?
Hello People,
Can we create a "intermediate query" using SSIS? Imagine the follwing flow:
I need to use a T-SQL query before the Destination Table beacause I need to do some specific ETL to the business.
Hi
When will SSDT-BI for VS2013 support SSIS 2012?
Of a bit more elaborate: If you would like to develop packages for SSIS 2012 (that is SQL 2012) using VS 2013, when can you then expect an update to SSDT-BI for VS2013 that allow this?
Thanks
Michael
I use SQL Server 2012 and visual studio 2010.
I created SSIS Project with task "Execute Package". Control flow view as: Package1 (execute package) -> Package2 (data flow).Data flow in Package2 view as: ADO.NET source -> ADO.NET destination.
When I started Package2, it's work. I havn't errors.
But when I started Package 1 I have error "Unable to get managed connection from the Connection Manager runtime". In execution log I see that ADO.NET source produced this error on verification stage. Package failed on verification stage, not on execution stage.
Why when I started Package 2 it work, but when I started Package1 (and Package1 started Package2) it failed?
Hi,
I'm new to ETL and I'm experiencing something that I don't understand. I did a lot of research without success.
I have a MySQL source from which a use the following query to get data :
select d.ID, ifnull((select group_concat(SKU) from MyTable where TABLE_ID = d.ID group by TABLE_ID ),'') as SKU from MyTable d group by d.ID order by d.ID
When I used the query like that, to get every row from the table, the ETL succeed. BUT, the original data length is 559, but in the target column, in a MSSQL table, the data length is only 341. Becareful, I'm not talking about the column length. If a run the query on a mysql server, the result is fine and every data of the SKU column is there, so this is not a problem on the MySQL server side. Now, if a add a parameter to the query like that :
select d.ID, ifnull((select group_concat(SKU) from MyTable where TABLE_ID = d.ID group by TABLE_ID ),'') as SKU from MyTable dwhere d.ID = 1337212 group by d.ID order by d.ID
Like that, I'm targeting only one row, and now I'm having a full SKU of 559 length. I have to admit that I don't understand why I'm having this trouble. Is there some sort of buffer somewhere that need to be set ?
My column in MSSQL is of type varchar(4000) in the ETL I have an ADO.NET source + a Data conversion that convert my SKU to a DT_STR of 4000 + an ADO.NET destination. Everything run fine whitout even a warning.
Any help will be welcome :)
Thank you.
Daniel
Hi
when I was load the data OLEDB source to excel desination. but first time is executive proper way but when i was try run the package second type iam getting this type of error:
iam getting this type erros
errors..
1.
[Excel Destination [12]] Error: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available. Source: "Microsoft Access Database Engine" Hresult: 0x80004005 Description: "Cannot expand named range.".
2.
[Excel Destination [12]] Error: SSIS Error Code DTS_E_INDUCEDTRANSFORMFAILUREONERROR. The "Excel Destination.Inputs[Excel Destination Input]" failed because error code 0xC020907B occurred, and the error row disposition on "Excel Destination.Inputs[Excel
Destination Input]" specifies failure on error. An error occurred on the specified object of the specified component. There may be error messages posted before this with more information about the failure.
3.
[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED. The ProcessInput method on component "Excel Destination" (12) failed with error code 0xC0209029 while processing input "Excel Destination Input" (23). The identified
component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running. There may be error messages posted before this with more information about the
failure.
thanks for helping
I have an SSIS package that is hosted in MSDB database in SQL Server 2008.
There is another server that has SQL Server 2012 and has an exact replica of the databse as in SQL Server 2008, with all the user roles and permissions being same.
I am calling this package in my application using code written in C# 4.0.
The call is successful when calling the SQL 2008 database.
However, when I try calling the same SSIS package in SQL Server 2012 database, the call is unsuccessful.
Please suggest what could be the issue.
Hi,
I know how to pass package variables in SSIS using C#.net but in SSIS 2012 we have project parameters also and I am using that in my SSIS Package, now using C#.net code I want to assign the value in project parameter and execute the SSIS Package using C#.net code
Any help is greatly appreciated!!
Thanks & Regards
Shobhit
shobhit
Hi There
Long time SQL user but SSIS beginner. I have a text file from which I need to load only the first and last lines into 2 string variables vFirstLine and vLastLine.?
I presume the best way would be to use a simple script; please can anyone advise how I might achieve this in the simplest way?
Many thanks
Dom
Hi how to read multiple excel sheets in same excel file with different table schema.
Basically need to load data into tables from these excel sheet.
So I know how to dynamically read multiple excel sheets in same excel file with same table schema and load into one table.
But how to do this dynamically for multiple excel sheet with different table schema and load into different tables?
I am trying to run a SSIS Package from SQL Server BI Studio. I receive the error "The package failed to load due to error 0xC0011008". SQL Server 2008 R2 installed (32bit Win 7), along with Integration Services. The Package connects to a SQL Server DB.
Here is the full error taken from consol in BI Studio:
SSIS package "CreateDynSSIS_DB_RunDynSSiSDB.dtsx" starting.
Error: 0x1 at ST_Gen_Pkg_Src_SqlServ: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> Microsoft.SqlServer.Dts.Runtime.DtsRuntimeException: The package failed to load due to error 0xC0011008"Error loading from XML. No further detailed error information can be specified for this problem because no Events object was passed where detailed error information can be stored.". This occurs when CPackage::LoadFromXML fails.
---> System.Runtime.InteropServices.COMException (0xC0011008): The package failed to load due to error 0xC0011008 "Error loading from XML. No further detailed error information can be specified for this problem because no Events object was
passed where detailed error information can be stored.". This occurs when CPackage::LoadFromXML fails.
at Microsoft.SqlServer.Dts.Runtime.Wrapper.ApplicationClass.LoadPackage(String FileName, Boolean loadNeutral, IDTSEvents100 pEvents)
at Microsoft.SqlServer.Dts.Runtime.Application.LoadPackage(String fileName, IDTSEvents events, Boolean loadNeutral)
--- End of inner exception stack trace ---
at ST_0f39f89613ca43e9a6660953aa72fa2c.csproj.ScriptMain.Main()
--- End of inner exception stack trace ---
at System.RuntimeMethodHandle._InvokeMethodFast(Object target, Object[] arguments, SignatureStruct& sig, MethodAttributes methodAttributes, RuntimeTypeHandle typeOwner)
at System.RuntimeMethodHandle.InvokeMethodFast(Object target, Object[] arguments, Signature sig, MethodAttributes methodAttributes, RuntimeTypeHandle typeOwner)
at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture, Boolean skipVisibilityChecks)
at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
at System.RuntimeType.InvokeMember(String name, BindingFlags bindingFlags, Binder binder, Object target, Object[] providedArgs, ParameterModifier[] modifiers, CultureInfo culture, String[] namedParams)
at System.Type.InvokeMember(String name, BindingFlags invokeAttr, Binder binder, Object target, Object[] args, CultureInfo culture)
at Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTATaskScriptingEngine.ExecuteScript()
Task failed: ST_Gen_Pkg_Src_SqlServ
Warning: 0x80019002 at CreateDynSSIS_DB_RunDynSSiSDB: SSIS Warning Code DTS_W_MAXIMUMERRORCOUNTREACHED. The Execution method succeeded, but the number of errors raised (1) reached the maximum allowed (1); resulting in failure. This occurs when the
number of errors reaches the number specified in MaximumErrorCount. Change the MaximumErrorCount or fix the errors.
SSIS package "CreateDynSSIS_DB_RunDynSSiSDB.dtsx" finished: Failure.
The error is thrown at this line:
DynamicPackage = app.LoadPackage(DynamicPackagePath, null);
Any help would be great! I've done a bit of Googling on the topic already.. and nothing has worked so far.
Hi We run std 2008 R2. I have what I hear is an odbc connector to a btrieve general ledger system.
I also hear that I have to and have created two separate odbc DSN's on my local to extract data from this source for two different companies.
I want to use the same conn mgr in ssis for otherwise identical DFTs in both companies and am hoping by making the conn mgr "name" property an expression, I'll be able to pull that off. But am not sure what that property is for. My recollection is that there was trouble going with "use connection string" (too bad cuz that property is obvious) instead of "use user or system dsn" when setting up the conn mgr but wouldn't swear to that.
Can someone advise? I'll keep looking on the internet but am coming up short so far.
my provider is ".net Providers\odbc data provider". I didn't see a property for my oledb sources to use an expression based conn mgr but may look again at that alternative. Unfortunately the going is slow cuz ssis keeps locking up in the gui presumably because its checking this connection's availability periodically.