On my Win 7 64 bit PC, I have SharePoint Designer (64 bit version) loaded and working… I also need to do work in SSIS using Excel connector for 2007 Worksheets. It requires I use 32 bit drivers for Excel Access. How can I do both? SharePoint Designer 64 bit will not Install if I have the Excel 32 bit drivers installed and SSIS Excel Connection will not work unless I do have the 32 bit drivers installed. I tried installing the 32 bit version of SharePoint Designer but it will not install on a 64 bit PC... When will this be resolved, and, what is the immediate work around? Do I need two PC's ?
↧
using SSIS Excel Connection AND SharePoint Designer 2013
↧
How can set identity for below table
Hi,
Source table like
Symbol | Expiry Month
----------------------------
ALU | 29 Nov 2013
ALU | 31 Oct 2013
ALU | 30 Sep 2013
ALU | 30 Aug 2013
ALUM | 29 Nov 2013
ALUM | 31 Oct 2013
ALUM | 30 Sep 2013
ALUM | 30 Aug 2013
----------------------------
My requirement is add column ID and ID values should like 1,2,3,4 for each individual symbol as per Date asc
Symbol | Expiry Month | ID |
--------------------------------------------------
ALU | 29 Nov 2013 | 4
ALU | 31 Oct 2013 | 3
ALU | 30 Sep 2013 | 2
ALU | 30 Aug 2013 | 1
ALUM | 29 Nov 2013 | 4
ALUM | 31 Oct 2013 | 3
ALUM | 30 Sep 2013 | 2
ALUM | 30 Aug 2013 | 1
--------------------------------------------------
Is it possible SSIS Derived column Expression /SQL Query in Table by adding Field ID
Actually I have to USE in DATA FLOW (OLE DB-SOURCE----OLE DB-Destination as above my requirement table)
So Identity , How will helpful?
If possible provide T-SQL query?
Thanks
-MADHU
↧
↧
SSIS - Importing from .CSV
All-
I have a package that loops through a bunch of .csv files and imports. Works great but is choking on one value for field "INVOICE" that does not make any sense.
Specs:
> In the flat file source editor, INVOICE has a datatype of DT_STR and length of 50 for both External & Output columns
> No data conversion on this field
> The target table has a datatype of varchar(255) for INVOICE
> I am getting the "data conversion for INVOICE failed...text was truncated etc" error on a specific file/value
> Upon inspecting the offending value, it is an invoice of length 14 that is basically the same as all other invoices that imported without issue
Any ideas why this isn't working? I would rather avoid the Ignore Truncation error option and fix this properly.
Thank you!
Bonediggler
↧
How can I pass Object Variable as a source to Data Flow Task
I call a WCF service in Control Flow using Script Task and get the response in a variable.
Now i need to insert response into a database table. I'll use a new Data Flow Task for this purpose.
My question is how can I pass this response variable to the Data Flow Task as a source
-Saeed
Saeed
↧
Data Migration from SQL to Linux DB2
Hi,
I am facing issues while moving data from SQL to Db2 on Linux. I was able to move the data from SQL to DB2 on windows, but not able to migrate it to Linux.
I am using IBM DB2 OLEDB drivers to migrate for both Linux and Windows. It is successful for Windows and for Linux it is giving TCP/IP SOCKET error and is pointing to the Windows server even though I selected Linux Connection.
Please help.
Thanks in advance.
Sri
↧
↧
Why doesn't a DateTime overflow kick out the row to the error flat file destination?
We have a flat file source which is configured to "redirect row" for errors in any input column. However, if we put in a datetime which out-of-range for a datetime column, we donot get the row kicked out to the error but rather an error is reported and the import screeches to a halt.
------------------------------------------
Error: 2013-08-16 14:43:32.20
Code: 0xC0202009
Source: Meters Data Load Meter OLE DB Destination [78]
Description: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available. Source: "Microsoft SQL Server Native Client 11.0" Hresult: 0x80004005 Description: "Invalid date format".
------------------------------------------
The problem in the input data is real but we would rather that the source row get kicked outrather than the whole import stop. The current behavior seems counter-intuitive. Is there away to configure that behavior or how do I write an error handler to handle these out-of-range errors?
↧
ssis - Cannot open datafile error
Hi -
I have a package that loops over some .csv files and loads them into an SS table. There is an error flow from the destination table to a .csv file that works fine. Except when it throws the "cannot open datafile" error in mid-package execution. Keep in mind SSIS has already written rows to the file during that same package execution.
The web seems to indicate this is a permissions issue, which is not the case here.
Any ideas?
Bonediggler
↧
Display default date value 1899-12-31 to NULL in SSIS - please help!
Hi,
I have a Excel source file with say, three columns - BirthDate,Place and Address.
In the loading table , their datatypes are date,varchar(50) and varchar(100) respectively.
The requirement is,
if the Birtdate is blank in the source then NULL should be displaced.
If Place and Address are blank, then blank should be diaplayed.
I tried 1) Checked the Retain NULL values option from the source file
Now, Both BirthDate is diaplaying as NULL as required but Place is also displaying as NULL.
But as per the requirement, Place should be displayed as blank.
I tried 2) unchecked the Retain NULL values option from the source file
Now, place is coming as blank as required but birthdate is coming as 1899-12-31.
I tried 3) unchecked the Retain NULL values and in the derived column created a derived column with expression isnull(Place)? "" : Place - this is working fine. Satisfied both of my requirements.
But there are lot of varchar columns will be come in the future and so cant create Derived column for varchar columns.
So, my requirement is, how to convert default date value 1899-12-31 to NULL in the SSIS expression or changing some properties somewhere?
I have a Excel source file with say, three columns - BirthDate,Place and Address.
In the loading table , their datatypes are date,varchar(50) and varchar(100) respectively.
The requirement is,
if the Birtdate is blank in the source then NULL should be displaced.
If Place and Address are blank, then blank should be diaplayed.
I tried 1) Checked the Retain NULL values option from the source file
Now, Both BirthDate is diaplaying as NULL as required but Place is also displaying as NULL.
But as per the requirement, Place should be displayed as blank.
I tried 2) unchecked the Retain NULL values option from the source file
Now, place is coming as blank as required but birthdate is coming as 1899-12-31.
I tried 3) unchecked the Retain NULL values and in the derived column created a derived column with expression isnull(Place)? "" : Place - this is working fine. Satisfied both of my requirements.
But there are lot of varchar columns will be come in the future and so cant create Derived column for varchar columns.
So, my requirement is, how to convert default date value 1899-12-31 to NULL in the SSIS expression or changing some properties somewhere?
↧
Loading data from excel to excel using SSIS
Hi Experts,
I've a requirement to load data from one or more excel sheets available in shared folder to another excel sheet in another shared folder.
For example, the data from excel sheet names AAA,BBB should go into new excel sheet ABB and data from AAA, CCC should go into another new sheet ACC.
the sequence should be first we have to load ABB and then ACC and if any error happens in between we have to send email.
so everytime whenever we have files in source folder this package should get run automatically by picking up the files from the folder and loading into the respective destination excel sheets.
Could you please give idea on how can do this better. I've following points in my mind...
1. Creating a table in sql server with unique id and sheet name and file path
2. In ssis, having foreach loop container,
3. inside foreach loop, data flow task to pick up file name from variable and loading till enumerated.
please help in doing it better and in efficient manner.
Thanks in advance
--NoorBi
↧
↧
SSIS Dynamically change filename that uses OLE DB Connection Manager
Ok this is what I am trying to do and i've spent DAYS on this and cant get it maybe someone here can help!
I have multiple csv files that I am trying to import into a single SQL table. Problem i had was the csv files have embedded double quotes. So i was able to solve this problem by using a Microsoft Jet 4.0 provider as the connection manager instead of the flat file manager. Yes this does handle the embedded double quote problem with csv files.
So my question is how do i loop over the csv files using the foreach loop and import the files. My data flow uses an OLE DB Source for the csv files. So i need to pick up all the csv files in the OLE DB Source step. Tried using variable with filename from foreach loop in the OLE DB connection mgr but it wouldnt take it. Guess its expecting a SQL table not a file???
So i need to somehow dynamically change the filename in the OLE DB Source. Any ideas need help ASAP?
↧
SAP MaxDB ODBC "Test connection failed because of an error in initializing provider"
I installed a SAP MaxDB ODBC driver and I created a user DSN called MaxDB_Source. But every time I test the source in the SSIS connection manager, this error always pops out:
The strange thing is, when I choose the connection from the 'Use user or system data source name' drop down list in the connection manager, test connection would always fail and the "Use connection string" would look something like this:
< Dsn=MaxDB_Source;uid=xxxxx >
However if I choose the "Use connection string" and build it, test connection succeeds and "Use connection string" looks like this:
<Dsn=MaxDB_Source;servernode=xxxx.xxxx.net;serverdb=xxx;uid=xxxxx>
But it only works when I build it. It won't work even if I copy this exact connection string and paste it in the "Use connection string" blank.
I don't want to have to build the connection string every time I use this connection, so I wonder if there's any way to solve this so I could just select the source from the drop down list just like any other connection?
Thank you.
↧
how to refresh an insert ole db after deleting coloums in a source ole db
Hi,
Is there a way to refresh an OLE DB destination with coloum mappings after removing coloums from the OLE DB source
SQL query without deleting and creating it from the beginning ?
Currently the old coloums remain in the mappings, and the only way I see is to remove and create, but this does not seem to be the efficient way.
↧
SQL Server agent job failed. error Code: 0xC0202009
i can run in VS. but when i want to run at SSIS job agent, it failed.
below is my error message
error Message
Executed as user: NT Service\SQLSERVERAGENT. Microsoft (R) SQL Server Execute Package Utility Version 11.0.2100.60 for 32-bit Copyright (C) Microsoft Corporation. All rights reserved. Started: 8:23:40 PM Error: 2013-08-18
20:23:50.47 Code: 0xC0202009 Source: XYZ Connection manager "ABCPROD" Description: SSIS Error Code DTS_E_OLEDBERROR. An OLE DB error has occurred. Error code: 0x80070005.
An OLE DB record is available. Source: "Microsoft OLE DB Service Components" Hresult: 0x80070005 Description: "Access is denied.". End Error Error: 2013-08-18 20:23:50.47 Code: 0xC020801C
Source: BONUS Source [97] Description: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER. The AcquireConnection method call to the connection manager "ABCPROD" failed with error code 0xC0202009.
There may be error messages posted before this with more information on why the AcquireConnection method call failed. End Error Error: 2013-08-18 20:23:50.47 Code: 0xC0047017 Source: BONUS SSIS.Pipeline
Description: BONUS Source failed validation and returned error code 0xC020801C. End Error Error: 2013-08-18 20:23:50.47 Code: 0xC004700C Source: BONUS SSIS.Pipeline Description:
One or more component failed validation. End Error Error: 2013-08-18 20:23:50.47 Code: 0xC0024107 Source: BONUS Description: There were errors during task validation.
End Error DTExec: The package execution returned DTSER_FAILURE (1). Started: 8:23:40 PM Finished: 8:23:50 PM Elapsed: 9.672 seconds. The package execution failed. The step failed.
Please does anyone have any experience with a similar problem and if so, how did you get round it?
Thank you...
↧
↧
Error running child packages from parent package - Error 0xC0011008
Hey...
I am running a parent SSIS package (running sp2, 9.0.3042) that calls several child packages.
On our development server, we now cannot run this because we get 1 or more of these errors:
"Error 0x80004003 while preparing to load the package. Invalid pointer . "
"Error 0xC0011008 while preparing to load the package. Error loading from XML. No further detailed error information can be specified for this problem because no Events object was passed where detailed error information can be stored. . "
It is not occuring on the same packages. It varies every time it is run.
I can run every one of the child packages individually, using the same login ID that the parent is executed under.
The parent package works fine on my local machine and other servers running the same version of SSIS. Just not on this server.
Does anyone have any ideas???
Thanks
BobP
↧
How to use single-user mode in an ETL package?
I just tried putting ALTER DATABASE {dbname} SET SINGLE_USER WITH ROLLBACK IMMEDIATE in an Execute SQL Task before my data flow task, but I got an OLEDB error during execution: "Login failed for {myDomain\myWindowsUserName}".
The connection managers within the package were all using my windows login, so I suppose what this means is that SSIS used a system login to execute the ALTER DATABASE statement, which then prevented further access to the database by my connection managers.
Am I right? Should I change the login that my connection managers use?
(Nb. I ran the package from BIDS, so the problem could become more complicated when I deploy the package and try to run it with DTEXEC or SQL Server Agent.)
Is there is a better way to lock users out, temporarily?
↧
Exception has been thrown by the target of an invocation.
I tried using the code given in this link "http://ask.sqlservercentral.com/questions/32180/loading-data-from-sharepoint-using-ssis.html" and received the following error. Can you guys help me to rectify it? Thank you.
Error: System.Reflection.TargetInvocationException: Exception has been thrown by the target of an invocation. ---> System.Net.WebException: The remote server returned an error: (500) Internal Server Error. at System.Net.HttpWebRequest.GetResponse() at System.Xml.XmlDownloadManager.GetNonFileStream(Uri uri, ICredentials credentials) at System.Xml.XmlDownloadManager.GetStream(Uri uri, ICredentials credentials) at System.Xml.XmlUrlResolver.GetEntity(Uri absoluteUri, String role, Type ofObjectToReturn) at System.Xml.XmlTextReaderImpl.OpenStream(Uri uri) at System.Xml.XmlTextReaderImpl.DtdParserProxy_PushExternalSubset(String systemId, String publicId) at System.Xml.XmlTextReaderImpl.DtdParserProxy.System.Xml.IDtdParserAdapter.PushExternalSubset(String systemId, String publicId) at System.Xml.DtdParser.ParseExternalSubset() at System.Xml.DtdParser.ParseInDocumentDtd(Boolean saveInternalSubset) at System.Xml.DtdParser.Parse(Boolean saveInternalSubset) at System.Xml.XmlTextReaderImpl.DtdParserProxy.Parse(Boolean saveInternalSubset) at System.Xml.XmlTextReaderImpl.ParseDoctypeDecl() at System.Xml.XmlTextReaderImpl.ParseDocumentContent() at System.Xml.XmlTextReaderImpl.Read() at System.Xml.XmlLoader.LoadNode(Boolean skipOverWhitespace) at System.Xml.XmlLoader.LoadDocSequence(XmlDocument parentDoc) at System.Xml.XmlLoader.Load(XmlDocument doc, XmlReader reader, Boolean preserveWhitespace) at System.Xml.XmlDocument.Load(XmlReader reader) at System.Xml.XmlDocument.LoadXml(String xml) at ST_97b868bb54ed480591d188b1748d85fb.csproj.ScriptMain.DownloadData(String url, String fileName) at ST_97b868bb54ed480591d188b1748d85fb.csproj.ScriptMain.Main() --- End of inner exception stack trace --- at System.RuntimeMethodHandle._InvokeMethodFast(Object target, Object[] arguments, SignatureStruct& sig, MethodAttributes methodAttributes, RuntimeTypeHandle typeOwner) at System.RuntimeMethodHandle.InvokeMethodFast(Object target, Object[] arguments, Signature sig, MethodAttributes methodAttributes, RuntimeTypeHandle typeOwner) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture, Boolean skipVisibilityChecks) at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture) at System.RuntimeType.InvokeMember(String name, BindingFlags bindingFlags, Binder binder, Object target, Object[] providedArgs, ParameterModifier[] modifiers, CultureInfo culture, String[] namedParams) at System.Type.InvokeMember(String name, BindingFlags invokeAttr, Binder binder, Object target, Object[] args, CultureInfo culture) at Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTATaskScriptingEngine.ExecuteScript()
Following are the changes made to the code
1. url = "http://ABCD.com/sites/NAL/NAL/Forms/AllItems.aspx"
2. The statement request.Credentials = System.Net.CredentialCache.DefaultNetworkCredentials; is replaced with request.Credentials = new System.Net.NetworkCredential(userName, password, domain)The credentials are correct since I tested it in HTTP connection manger and test connection succeeded.
↧
Why do we need to sort data before merge and merge join ssis?
Hello Everyone,
Why do we need to sort data before merge and merge join ssis?
What is the difference b/w full cache and partial cache look up in SSIS?
Thanks & Regards, ------------------------------------------REDDY
↧
↧
DLL For Connection Manager Type List UI
Which DLL is shown the Connection manager type list UI when we choose the new connection from Connection manager TAB ?
dmpcal
↧
DTEXEC not showing outcome report
I run a .cmd file that issues many DTEXEC commands. The output is directed to a file in the usual >> DOS style. The usual output is something like:
DTEXEC /FILE D:\DataWarehouse\Production\Root\SQLServer\Projects\Audits\Audits\
Audits\CompareLatestDWFP05Rows.dtsx /CHECKPOINTING OFF /REPORTING E
Microsoft (R) SQL Server Execute Package Utility
Version 11.0.2100.60 for 64-bit
Copyright (C) Microsoft Corporation. All rights reserved.
Started: 6:45:24 AM
DTExec: The package execution returned DTSER_SUCCESS (0).
Started: 6:45:24 AM
Finished: 6:45:38 AM
Elapsed: 13.837 seconds
But I have one DTEXEC that does not put out the banner or outcome report. In fact it does not output anything. But I am sure it executes properly.
DTEXEC /FILE D:\DataWarehouse\Production\Root\SQLServer\Projects\Audits\Audits\
Audits\LoadDWFP05FromDW.dtsx /CHECKPOINTING OFF /REPORTING E
I have looked at the package and compared logging options with other packages and I cannot see any difference.
Any ideas?
An afterthought - it does have a lot of warning messages - hence /REPORTING E. But so does one of the other processes and that's OK.
↧
Bulk Insert Help Needed
Please help.... Thanks in advance
I know all the text qualifiers can be solved in XML, here is the link...but this is not resolving the last record of my csv file, which is blank.
Data in CSV File
ID, Name ,Phone
100983, "Jones, Frank",555-1212
118928,"Joe",5 mngh 55-1313
115454,,555-1414
Using Bulk insert data is going like this
ID Name Phone
100983 "Jones Frank" 555-1212
118928 "Joe" 555-1313 115454..555-1414
What is expected
ID Name Phone
100983 Jones, Frank 555-1212
118928 Joe 555-1313
115454 555-1414
↧