Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Unzip files from FTP location

$
0
0

Hi,

I have number of files in H:\ZIP\00985.zip,H:\ZIP\00986.zip etc and zip files contain .csv files.

What i want to achieve here ti unzip all the files and store it in H:\UNZIP\ 

I tried using execute process task


The task is executing but files are not getting copied.

Any help would be beneficial.

Thanks in advance.

Kaish


Lava



Adding date check to Expression inderived column

$
0
0

I have a derived column with the following expression:

[Sales Person] == "Anne Donnelly" ? "DGN OR" : ([Sales Person] == "David Wilkinson" ? "DGN OR" : ([Sales Person] == "Marcus Pletts" ? "DGN OR" : ([Sales Person] == "Neil O'Hanlon" ? "DGN OR" : ([Sales Person] == "Aaron McKenna" ? "DGN OR" : ([Sales Person] == "Jamie Callaghan" ? "FMT OR" : ([Sales Person] == "Rhonda Corrigan" ? "FMT OR" : ([Sales Person] == "Clare Shannon" ? "OMA OR" : ([Sales Person] == "Mark Haigney" ? "OMA OR" : ([Sales Person] == "Eugene McGurk" ? "OMA OR" : ([Sales Person] == "Simon Eccles" ? "OMA OR" : ([Sales Person] == "Damien Nevin" ? "OTH OR" : ([Sales Person] == "George O'Malley" ? "TMB OR" : ([Sales Person] == "Lezley Mawhinney" ? "TMB OR" : ([Sales Person] == "Ciaran O'Neill" ? "TMB OR" : ([Sales Person] == "Samuel Mawhinney" ? "TMB OR" : ([Sales Person] == "Gemma O'Hagan" ? "TMB OR" : ([Sales Person] == "Michelle Folliard" ? "TMB OR" : "")))))))))))))))))

I'd like to change it slightly so that the if the sales person = Anne Donnelly and the Created Date is less than 2016-01-01 then DGN OR. Basically I'm looking to add the Created Date check for Sales Person Anne Donnelly. Does anybody know how I do this? I've tried a few times but must have the syntax wrong.

SSIS Package with Lookup (big reference table) runs fine on BIDS but fails when run as SQL Agent Job

$
0
0

SSIS Package with Lookup (big reference table) in one of the task runs fine on BIDS but fails when run as SQL Agent Job.

I run the package locally on my machine and it runs fine from BIDS. I run it in 64 bit mode. But when I run same package via SQL Agent Job it fails. I just get memory error 0xc0047048. On SQL Agent I am also making it to run on 64bit mode.

I strongly believe its something to do with memory on database server somehow pagefile is not enough to accommodate lookup rows while running a job via sql agent.But my local machine may have enough page file to accommodate.

Any thoughts ? If I run this specific task separately to other parallel running tasks it goes fine with both BIDS and SQL job. But I wanted to see if there is another solution.

Thanks


SQL Killer

SSIS Script task in foreach container for File Exist

$
0
0
Hello,
I am trying to identify if the folder has all total 20 files before running load task.
My files are xx_file1_xxx.txt, xx_file2_xxx.txt .................. xx_file20_xxx.txt

I placed a script task in foreach loop by passing file and folder names as variables.
My script task looks like below..
Public Sub Main()
Dim folder as string, file as string

folder = Dts.Variables ("User::folder").value
file= Dts.Variables ("User::file").value

if ( file.contains ("_file1_") or file.contains ("_file2_") or ......... file.contains ("_file20_")) Then

dts.TaskResult = ScriptResults.Success

Else
Dts.TaskResult = ScriptResults.Failure
End If
End Sub
End Class

Problem: Now this code runs without any flaw but the issue is if I don't have 1 or more files out of 20 its still succeeding.

I don't know where this condition needs to be put because my files always will be 20 in number.

SQL Killer

convert date in ssis

$
0
0

Hi All,

I have date data in source file like below

1/11/15 9:44

20/11/15 8:40

in target table column have datetime datatype

plz suggest to load using expression in derived column

Thanks in advance


Thankx & regards, Vipin jha MCP

Upgrading SQL Data tools

$
0
0

Hi all. I have a server that currently uses SQL 2010 data tools for all the SSIS packages.

Am I able to install the new latest version and not effect any of the current versions and keep the packages running via SQL Agent.

I want to be able to slowly upgrade each package, but over time. Making sure I don;t render the current ones unusable.

So, do these two versions run alongside each other ?

Thanks

Scott

SSIS 2014 with VS 2013 package designer not showing row counts?

$
0
0

Hi all,

I notice when debugging a package, the row counts are not showing up in VS 2013 using SSIS 2014. They usually show up on the arrows when you are running a package, which is extremely handy to say the least. I tested in VS 2012 using SSIS 2012, and it works fine.

Any ideas?

This person may be having a similar issue. FYI. 

https://social.technet.microsoft.com/Forums/en-US/f727c36d-eb1f-4c1e-be74-2f75daf76339/ssis-package-designer-bug-vs2012-and-vs2013?forum=sqlintegrationservices

Execute Package from Another Project SSIS 2012 (Project deployment Model)

$
0
0

Hello,

How can we execute a package from another project passing the parameter values etc (In project deployment model)? Currently after adopting to project deployment model we could able to reference to packages within the project. 

does anyone encountered anything similar before? Tried scripting the package from catalog and using Execute t-sql task but i don't see how we could pass parameter values to the package.

Thanks!!


How to Convert Excel File To CSV with SSIS

$
0
0

I'm attempting to follow the advice in this article:

http://www.techbrothersit.com/2014/09/ssis-how-to-convert-excel-file-to-csv.html

Every time I try to run the code, I get the following error:

Exception has been thrown by the target of an invocation.

   at System.RuntimeMethodHandle.InvokeMethod(Object target, Object[] arguments, Signature sig, Boolean constructor)
   at System.Reflection.RuntimeMethodInfo.UnsafeInvokeInternal(Object obj, Object[] parameters, Object[] arguments)
   at System.Reflection.RuntimeMethodInfo.Invoke(Object obj, BindingFlags invokeAttr, Binder binder, Object[] parameters, CultureInfo culture)
   at System.RuntimeType.InvokeMember(String name, BindingFlags bindingFlags, Binder binder, Object target, Object[] providedArgs, ParameterModifier[] modifiers, CultureInfo culture, String[] namedParams)
   at Microsoft.SqlServer.Dts.Tasks.ScriptTask.VSTATaskScriptingEngine.ExecuteScript()

That's all the information I get. What is the issue here?

Inserting Blank/NULL Columns to Flat File Source

$
0
0

I have a CSV flat file source with the format like:

TypeID (DT_I4) || NameID (DT_I4) || Date (DT_Date) || Description (DT_STR) || Amount (DT_Decimal, 3)

What I need to do is insert 3 new columns as such (new cols in bold):

AltTypeID (DT_I4) || NameID (DT_I4) || Date (DT_Date) || AltDate (DT_Date) || Description (DT_STR) || Amount (DT_Decimal, 3) ||Number (DT_Decimal, 4)

The columns can be 0 or NULL to begin with, I can adjust their value later with a Derived Column (the only one that gets a value is AltTypeID = 1, the other two are NULL, but do actually be NULL and not zero). Right now the only way I can add the columns is by putting them all at the end in the Flat File Connection Manager, but that's not how I want the data to be formatted. At the end of my Data Flow I need to send the info to an Access database in a specific order (as seen above), so I need to have the columns in a specific order for the Access database.

Any ideas?

'DECODE' is not a recognized built-in function name.

$
0
0

Hi folks, I was executing this query in SSIS:-

DECODE(PRODUCT,'00','Corporate Office',
'88','Corporate Office',
'01','North Carolina',
'02','North Carolina',
'03','North Carolina',
'04','North Carolina',
'05','North Carolina',
'06','North Carolina',
'10','North Carolina',
'11','North Carolina',
'16','North Carolina',
'20','North Carolina',
'21','North Carolina',
'22','North Carolina',
'23','North Carolina',
'24','North Carolina',
'25','North Carolina',
'26','North Carolina',
'27','North Carolina',
'30','North Carolina',
'31','North Carolina',
'33','North Carolina',
'98','North Carolina',
'NC2','North Carolina',
'NC3','North Carolina',
'07','South Carolina',
'08','South Carolina',
'09','South Carolina',
'99','South Carolina',
'SC2','South Carolina',
'SC3','South Carolina',
'Tennessee')   

and when I click on parse query, it complains that DECODE is not a recognized built-in function name. Can anyone of you please help me what else can I query to get the appropriate result. Someone told me of using Case when function but I am unsure of how to query it as I am still a learner. Any help will be much appreciated.

Thanks a lot.

There was insufficient disk space - TEMP

$
0
0

I am in process of parsing and loading XML files (17 folders, each has roughly 25 files so total 425 files & total size >15Gb&<25gb) and while running the SSIS package many files fails with the below message. So is there a way to overcome this.

The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{042E2673-F44A-4146-9CD1-EE602F83711B}.tmp" to length 10482212 bytes.  There was insufficient disk space.
The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{E4C54C7C-F46B-40B5-B532-19A739F519FF}.tmp" to length 10482212 bytes.  There was insufficient disk space.
The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{1934FF55-A234-496B-B0C2-AE62344B4FBA}.tmp" to length 10474604 bytes.  There was insufficient disk space.
The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{6830B82D-882F-43E2-B4C5-439E5C1B7EB1}.tmp" to length 10482212 bytes.  There was insufficient disk space.
The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{C63DEF0F-C5DD-42B5-9FDE-80EEDF40F65F}.tmp" to length 10482212 bytes.  There was insufficient disk space.
The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{1C384053-4AFC-4E05-9A76-D874B68C8A6B}.tmp" to length 10482212 bytes.  There was insufficient disk space.
The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{FD20A211-B247-4F28-B8E5-11EDCA66221D}.tmp" to length 10482212 bytes.  There was insufficient disk space.
The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{1ED2977C-4FCE-47A4-8F3E-8D97BC9F0160}.tmp" to length 10474604 bytes.  There was insufficient disk space.
The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{3BD6DFD8-83A6-4637-A971-B7B32CC2FAE6}.tmp" to length 10482212 bytes.  There was insufficient disk space.
The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{C722662D-6A43-4098-A395-97F54181F1F9}.tmp" to length 10482212 bytes.  There was insufficient disk space.
The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{142131A7-1004-4FA0-82F4-A188A960B3DE}.tmp" to length 10482212 bytes.  There was insufficient disk space.
The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{7F044653-ECC0-4717-A5FF-187AA77B0FF9}.tmp" to length 9305716 bytes.  There was insufficient disk space.
The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{B6F3DDF7-0C43-4F31-B602-9A17A4F5BF5C}.tmp" to length 10482212 bytes.  There was insufficient disk space.
The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{BEFA3941-C5BD-41AD-8501-470555789FAB}.tmp" to length 10482212 bytes.  There was insufficient disk space.
The buffer manager cannot extend the file "C:\Users\BIE4AA~1.VEN\AppData\Local\Temp\2\DTS{FD16CA75-B47E-4CF8-8994-89F406B38DC4}.tmp" to length 9305716 bytes.  There was insufficient disk space.

Also found this error, [Log provider "SSIS log provider for SQL Server"] Error: SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80040E14.
An OLE DB record is available.  Source: "Microsoft SQL Server Native Client 11.0"  Hresult: 0x80040E14  Description: "The transaction log for database 'EDW_STAGING' is full due to 'LOG_BACKUP'.".

Logging is done using SSIS log provider for SQL Server and SSIS and SQL are in same server.


Sarvan


Explicitly Stop SSIS Package Execution

$
0
0

Hi,

I have one SSIS Package, which have four Execute SQL task in Sequential manner. This Package generally takes 10 minutes to execute. I have one scenario that, If ssis package takes more than 15 minutes to execute, then it should stop(Stop SSIS package execution.).

Thanks in Advance.

The binary code for the script is not found - running SSIS 2008 pkg in 2012

$
0
0

I am building package where I modify a connection manager within a script task.  To do this, I need a reference to this  assemblyMicrosoft.SqlServer.ManagedDTS thats in the SDK folder.  What will be needed to be done on the server for deployment?  I think its just a matter of installing that assembly in the GAC.  Done that.

The package runs fine from within BIDS, but not when I install it (locally) on my local 2012 instance and then run from SSMS.  I get errors that mention "The binary code for the script is not found"

Ive seen this before in BIDS 2005, but not with newer versions.  

Any suggestions?



Date formate issue while importing data from oracle data source to SQL database

$
0
0

I Created an SSIS package where the Data is taken in from a oracle data base and is transferred to the SQL database.

But this had the confusing interpreting dates inconsistently. I need the yyyy/mm/dd in the destination for some dates it is correct ,. but, for some it is giving wrong interpretation likeyyyy/dd/mm

yyyy/mm/dd-corect

yyyy/dd/mm-wrong

 So 2016/01/04 would be correctly read as the 4th of Jan 2016. but, it is taking as 2016/04/01 so, interpreted as 1st of April 2016.

please advice

 

 


Raja


No Rows From Source

$
0
0

Hi all

My Source is oracle etrm.i can able to pull data from all tables and views except some,all permissions and connection strings are same for every package

But for only some views and tables i cant able to see the data through OLEDB SOURCE but data is actually exsist

I cant  see the data in OLEDB source when i hit preview (Its empty rows with only  columns) but data is there in oracle server


ADKR

A required privilege is not held by the client - Error Message

$
0
0

Hi

We have uploaded a SSIS package into MSDB. We have also configured the dts config file. However, it is not working and I keep getting the error :-

The process could not be created for step 1 of job 0x4B0384699C7D3945B1E07257FAD117F1 (reason: A required privilege is not held by the client).  The step failed.

The package was initially in the File System on a different server, we migrated it to a different server and do to the security protocol set by the organization, we had to place it in the MSDB. However, the job keeps failing. 

There is nothing wrong with the package because it was working earlier. Any help would be appreciated. 

Reusable tools for SSIS

$
0
0

Hi ,

I am looking for some reusable tools or components for SSIS packages.Like SSIS code review tool.I just need to get some other idea other than code review tool.It would be helpful if someone can guide me some source code(in .net or something) to achive this .

PowerQuery within SSIS in Sql 2016

$
0
0

Hi,

In mid-2015, some Sql Server MVPs mentioned that the SSIS team was working with the Power Query team to integrate Power Query to SSIS 2016.  Since then I have not heard anything and can't find anything in the 2016 documentation or online.

Does anybody know anything about this?

(note: I am not looking for a workaround)

Thank you,

Sebastien

Be our SSIS TechNet Guru of 2016 and become renowned in community and professional circles!

$
0
0

A new year! A new start for the TechNet Guru Awards 2016!

2015 Guru was soooo last year! 2016 Guru is where it's @ my friends!

This is when you make your mark on history and stamp your authority on your favoured technology!

This is when they shall know your name and come to appreciate your depth and breadth of knowledge!

This is... the Year of You!

All you have to do is add an article to TechNet Wiki from your own specialist field. Something that fits into one of the categories listed on the submissions page. Copy in your own blog posts, a forum solution, a white paper, or just something you had to solve for your own day's work today.

Drop us some nifty knowledge, or superb snippets, and become MICROSOFT TECHNOLOGY GURU OF THE MONTH!

This is an official Microsoft TechNet recognition, where people such as yourselves can truly get noticed!

HOW TO WIN

1) Please copy over your Microsoft technical solutions and revelations toTechNet Wiki.

2) Add a link to it on THIS WIKI COMPETITION PAGE (so we know you've contributed)

3) Every month, we will highlight your contributions, and select a "Guru of the Month" in each technology.

If you win, we will sing your praises in blogs and forums, similar to the weekly contributor awards. Once "on our radar" and making your mark, you will probably be interviewed for your greatness, and maybe eventually even invited into other inner TechNet/MSDN circles!

Winning this award in your favoured technology will help us learn the active members in each community.

Feel free to ask any questions below.

More about TechNet Guru Awards

Thanks in advance!
Pete Laker


#PEJL
Got any nice code? If you invest time in coding an elegant, novel or impressive answer on MSDN forums, why not copy it over toTechNet Wiki, for future generations to benefit from! You'll never get archived again, and you could win weekly awards!

Have you got what it takes o become this month's TechNet Technical Guru? Join a long list of well known community big hitters, show your knowledge and prowess in your favoured technologies!

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>