Hi guys,
I've got a csv file wit a column customer which contains Toy "BB" red a double quote. I use the double quote as delimiter so it retrieves the error [Flat File Source [2]] Error: The column delimiter for column ""Customer"" was not found.
Any suggestion? I am googling around but it's not clear...
Thanks
Hi, I am using SQL Server 2014 with SSDT BI for Visual Studio 2013. When I execute the below query in the SSIS Execute SQL Task I get thiserror.
"[Execute SQL Task] Error: Executing the query "IF OBJECT_ID ('[DIMDB].[dbo].[Test..." failed with the following error: "The transaction ended in the trigger. The batch has been aborted."."
Query:
IF OBJECT_ID ('[DIMDB].[dbo].[Test]', N'U') IS NOT NULL
BEGIN
DROP TABLE [dbo].[Test]
END;
CREATE TABLE [dbo].[Test](
[Id] [int] IDENTITY(1,1) NOT NULL,
[Description] [varchar](255) NULL
);When run from SSMS works as expected.
Thank you in advance.
SQLEnthusiast
Hi All,
getting nulls null for mixed datatype column While loading data excel source to SQL server 2012 tableCan we perform a ping test in SSIS before send file to the ftp site?
Hi, I Think this is the second time I am asking a solution for my Problem.
-- I have 3 different Servers Dev/ QA / Prod, And I need to Migrate and run SSIS dtsx Package from a batch file .
I have developed a Package which is in Dev environment and eventually I want to migrate it to QA and Prod.
My manager wants me to setup a config file and mention the environmental variables in it.
What I have observed was, there are few parameters that will effect my migration
1. Server Name
2. User credentials(Not sure, Whether they varies or not)
3.If any, I need to further Observe.
Please provide me a decent solution for my Problem, And Thanks for it!
Regards
Ravi
RaviRocks
I keep getting this error message no matter what I do to try to fix the situation. The source and the destination datatypes are NVARCHAR. The package works fine when I'm running it inside SSDT. When I push to production and run it inside the catalog, it blows up with this error. It's the OLEDB source that is throwing the error.
I've tried changing the data types in the advanced editor but that just causes issues further down the pipe in other task. It's mostly a bunch of lookups and SSIS will complain that the lookup won't work because the datatypes aren't the same.
I think the main issue is understanding why it works fine in SSDT but not in the catalog.
I have SQL server 2012 SSIS that send files to an SFTP. When I manually run this package, it succeeds and send files but failed when I scheduled it to run through the SQL Agent?
Has anyone be in this position before?
Thanks
DBAChair
Datawarehouse lead Architect
Hello,
I'm trying to run the FTP task editor in Visual Studio 2015 and the operation fails. This is the error message I get.
.
Important Information to know:
- Running VS 2015
- The application is installed in my Windows 10 virtual machine hosted by Parallels Desktop that is installed in my MAC.
Troubleshooting:
- Connection Manager
ftp.microsoft.com, Port: 21, Timeout: 60, Retries: 5, Chunk: 1 (also tried 100 and 1000).
test.talia.net, Port:21, Timeout: 60, Retries: 5, Chunk: 1
- FTP Task Editor
File Transfer, IsLocalPathVariable: False, LocalPath: (Empty), OverwriteFileAtDest: False, isTransferAscii: False, isRemotePathVariable:False.
Here is where I click on the RemotePath field and get the error message above.
Please let me know if you need additional information!
Thank you
Hi All ,
In my project , I have around 10 package which simply loading data from txt file and generating new csv files
I have all the package name in one object table and I am looping it and executing, but here package are getting executing one at a time in sequentially.
I am executing package using below query by passing package name as parameter from table
Declare @intExecutionID bigintMy requirement is is to call all the 10 package at the same time so it can reduce the ETL load time.
Thankx & regards, Vipin jha MCP
Hi,
I'm running a package that I made, that at the end, takes data from a SQL Server table and updates a SharePoint list accordingly (OLEDB source, SharePoint list destination).
When executing, I receive the following messages:
"Error: 0x0 at Data Flow Task, SharePoint List Destination: Error on row ID="83": 0x81020016 - List item referred to in the request does not exist".
"Error: 0xC0047062 at Data Flow Task, SharePoint List Destination [47]: Microsoft.Samples.SqlServer.SSIS.SharePointListAdapters.PipelineProcessException: Errors detected in this component - see SSIS Errors".
I can't find the "ID" 83 in the table and in the list...
Do you understand where the problem is located? how can it be resolved?.
Thanks!.
Dears,
is there any reference typologies for SQL 2014 BI Stack (SSIS, SSAS) along with the performance parameters.
I have a case for planning the needed physical architecture to load 18 TB of CSV files - this data is related to telecom industry, where 1 month is around 800 GB, and we need to load the data as fast as we can. so, I need the typical HW Topology to load such data, in addition we need to consider the SSAS as well.
Mohammad Yousri - http://mohammad-yousri.blogspot.com
We are using SSIS Package (SQL Server 2012) to move data from Source Oracle DB to a Destination Oracle DB using OleDBSource and OleDBDestination Components. We are planning to set the batch size at 10,000 per batch.
The expected volume is about 500,000 (max). In this scenario when SSIS is moving the data in batches of 10,000 - if we enable checkpoints - would SSIS resume from the batch that failed and not have to start over from scratch? Please clarify?
I have an Excel Destination in My DFT and i am loading the data from SQL Server, i do not have any Unique Identity columns at my source system hence i added a column called Insert date that takes the value form Getdate(), My requirement is if i am executing my SSIS package more than once my Excel destination is been loaded with duplicate records, How to mitigate the same, i am unable to use lookup here as lookup works with Database Table level only. Kindly suggest.
Ramasubramanian S
Problem: An Excel file (XLSX) dynamically created by a SQL Task cannot be opened via Excel. The task succeeds, but when you try to open the workbook in Excel you get the fillowing error message: Excel cannot open the file 'myfile.xlsx" because the file format or file extension is not valid. Verify that the file has not been corrupted and that the file extension matches the format of the file.
Observations:
1. If the Excel file (xlsx) is created manually in Excel, then the SQL Task has no problem creating table (new worksheets) in the xlsx (so the "CREATE TABLE" statement works fine)
2. If I adjust the connection and task to work with Excel 97-2003 (xls) format then the approach works perfectly
3. The execution results show success of the SQL Task, but there are two warning messages. These same warnings appear when the SQL Task creates a new table (worksheet) successfully in a workbook (xlsx) which was created manually in Excel (and is not corrupt).
Messages as follows:
Warning: Multiple-step OLE DB operation generated errors. Check each OLE DB status value, if available. No work was done.
Warning: Multiple-step OLE DB operation generated errors. Check each OLE DB status value, if available. No work was done.
SSIS Details:
1. ConnectionString: "Data Source=" + @[User::ExcelFileFullPathName] + ";Provider=Microsoft.ACE.OLEDB.12.0;Extended Properties=\"Excel 12.0;HDR=YES\";"
2. SQLStatementSource (from SQL Task):
"CREATE TABLE `" + @[User::cfgExcelTransformTableName] + "` (
`Number` VarChar(15),
`Name` VarChar(252),
`Site/Organization` VarChar(255),
`Priority` VarChar(255),
`Description` LongText,
`Status` VarChar(255),
`Start Date` VarChar(255),
`End Date` VarChar(255),
`Category` VarChar(255),
`Project Contact` VarChar(255),
`Sponsor` VarChar(255),
`Funding Source` VarChar(255),
`Partner` LongText,
`Budget` Double,
`Allocated Funding by Source` VarChar(255),
`Allocated Funding` Double,
`Expended Funding` Double,
`Habitat Type` VarChar(255),
`Limiting Factors` VarChar(255),
`Primary Species Benefiting` VarChar(255),
`Secondary Species Benefiting` VarChar(255),
`Current Project Status` VarChar(255),
`Activity Type(s)` LongText
)
"
3. Run64BitRuntime = False
Hardware/Software Details:
1. Windows 7 Ultimate (64 bit)
2. Excel Version 14.0.4760.1000 (64 bit)
3. Visual Studio 2008
4. Office 2007 Data Connectivity Components:
http://www.microsoft.com/downloads/en/confirmation.aspx?FamilyID=7554F536-8C28-4598-9B72-EF94E038C891&displaylang=en
I was trying to estimate the size of records which can be held under a oldeb source transformation task when a sql query is executed under it .
I am using SSIS 2014 on SQL server 2014 .
I know that when a query is executed in SSIS it holds data in memory and this depends on memory of the ssis server .
I may be wrong as well.
Given that I have 4gb RAM and i5 2.3 ghz 4 logical processors cpu and if my package is executing on the SSIS server how much records will I be able to pull and push ?
Hi All,
I have one scenario where i need to use existing packages to reduce the development work, but problem is that i am unable to update the GUID's of all tasks in packages.
Reason to update the tasks GUID's in package, Because my package have logging functionality. if i keep same GUID's troubleshoot of package is difficult.
Can you please share your suggestions on this.
Thanks & Regards,
Vaishu
Hello,
ssis package1 has two variables, param1 and param2
ssis package1 has execute package task which calls package2
package2 also has two variables, param1 and param2
in package1, inside execute package task I have entered the name of package2 so that the execute package task calls package2.
inside parameter bindings, I have placedboth the variables names in child package parameters and inside the binding parameter or variable
when package1 is run, the execute package task shows a red cross but there are green ticks inside the package2 and so the package2 does not run corectly.
do you know why please?
Thanks
Hi,
Dts.Log() works fine for me when I use msdb.dbo.sysssislog table. But when I use myDB.dbo.sysssislog table, Dts.Log() doesn't log anything in the table. myDB also contains the system stored procedure [dbo].[sp_ssis_addlogentry].
I have checked the logging configurations and they are fine as for msdb, Dts.Log has no issues.
Is there anything else that I need to do when selecting database other than msdb for logging so that Dts.Log() works?
Thanks :)