Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS Package.dtsx built by Wizard versus Visual Studio 2015

$
0
0
Hello, when I use my PC based “SQL Server Import and Export Wizard” to create a SSIS script to upload and Excel spreadsheet to a SQL Server table, I can save that generated script to a directory on my C:\ drive and then run the script directly from that C:\ drive directory just fine.

But when I create a SSIS “Integration Services Project” script using Visual Studio 2015, copy that generated script (Package.dtsx) to my C:\ drive, the “DestinationConnectionOLEDB”  is missing from the “Connection Managers” list of items and also, the Excel connection details seem to be different between the 2 different tool approaches.

So I’m wondering if I will be able to copy or deploy my Visual Studio based Package.dtsx to my PC’s C:\ drive and run the script in the same way I was able to run the Wizard based (non Visual Studio) package? thanks very much for any pointers!

Package.dtsx generated by my PC’s “SQL Sever Import Export Wizard”

Package.dtsx generated by Visual Studio above


Looking for a simple example of moving SQL 2014 data to SQL 2016 Azure using SSIS

$
0
0

Hi All,

I have no experience with SSIS 2016, developing SSIS packages in Visual Studio 2015, or pushing data to Azure, but I need to do just that.  I'm looking for a webpage or video that shows me how to create a simple "kill & fill" SSIS 2016 package that pushes data up to Azure, but haven't been able to find one.  Can I use just a data source and a data destination to move data simply when Azure is involved?  It works with the ADO.NET destination, but then complained when my Azure destination included a "geography" data type column.  I'm also confused about the Azure Blob Destination and Azure Blob Source.  

Thanks,
Eric

Error in Execute Process Task while using BCP to load data from SP to a CSV file

$
0
0

Experts,

On a high level, I am using an execute process task and using BCP to move the results from a Stored Procedure to a CSV file. There are 2 SP's that I am using and there will be 2 different files which will be generated. I don't have any issue with the output of 1st stored procedure, that's running fine and CSV file is getting generated. I use for each loop container to generate file for each SP. It fails when it tries to process the 2nd SP, this is the error that I am getting:

[Execute Process Task] Error: In Executing "C:\Program Files\Microsoft SQL Server\100\Tools\Binn\bcp.exe" " "EXEC SP2 1" queryout "\\local\Test\SP2_Output_ID1.csv" -c -t, -T -S<ServerName> -d<DBName>" at"", The process exit code was "1" while the expected was "0".

Running the SP "EXEC SP2 1" gives me the results, however it's failing to generate the "SP2_Output_ID1.csv" file in the "\\local\Test\" folder.

SP1 runs perfectly fine with "1" passed as parameter and CSV file also gets generated in the "\\local\Test\" folder.

Evaluation of expression into OLE DB Source component

$
0
0

Dear All,

I built a parametric query (that I saved into a variable named "User::QueryString") like this:

"SELECT * FROM "+@[User::TableName]+" WHERE "+@[User::PrimaryKeyName]+"="+@[User::Value]

("User::TableName","User::PrimaryKeyName" and "User::Value" values change during my "execution flow" and, for "User::QueryString" I enabled the "EvaluateAsExpression" option)

Then, in a Data Flow task, I inserted an "OLE DB Source" component, I chose the option "SQL query from variable" and I specified my "User::QueryString" as variable.

What I noticed is that this expression is evaluated only the first time (let's say, when I put the component into my data flow task) and, even if the value of "User::TableName","User::PrimaryKeyName" and "User::Value" changes (due for example to iterations of a Foreach Loop), the expression is never "updated" into the "OLE DB source" component (It seems that it's evaluated only at creation time of the component, in a static way)

Is there a solution (or even better some tricks) to overcome this problem?

Thanks for your help


SSIS with Oracle | Attunity Destination vs OleDb Destination

$
0
0


We are using SSIS with an Oracle Database. What is the guidance in terms of the usage of Attunity Destination vs OleDb Destination? From basic checks, we seem to find that the Attunity Adapter does not seem to support Transactions. Is there any documented data points in terms of the performance difference between the two adapters. 

SQL server for 32 bits

$
0
0
Please finding difficulties, i can't find SQL server for 32 bits, so please is it that i am looking at the wrong place or there is actually none

SQL Agent using SSISDB environments

$
0
0

So for starters, sorry if this in the wrong section, I feel this would be the best way to do this. I have been doing research online and I can't seem to find anything that quite fits what I am trying to do so I turned here.

Let me begin this by saying we are trying to give our developers the access to run SQL agent jobs that are related to their Databases, and we are trying to do this without granting them Agent Operator Permissions. We are looking at doing this by creating a stored procedure that calls the correct SQL Agent job. Now here is where I am running into my issue. A little more background, we are running MSSQL 2014 on these servers and are using SSISDB and environments. So with that in mind, I have to directions I am thinking of going. The first is to create multiple Agent jobs, pointed to the different environments needed, and then have a parameter that just starts the specific Agent job. 

Then next way I am thinking of doing it is actually my question. Inside the SQL agent, there is a drop down menu where you can select the different environments (picture provided). Because of this, I know there would be a way to change the variable on the Fly. My question is, what table is this stored in? I have been looking inside both MSDB and SSISDB and can't seem to find it. Once I get that, I know I could hack something out that works. 

Sorry for the long post, trying to explain as much as I can. Thanks.



Avoid loading Holiday Calendar data in SSIS

$
0
0

Hi All,

we have a holiday table in our database. If the incoming file has a data which is same as date present in the holiday calendar, SSIS should skip that row. I tried using lookup but it works only when source file has one holiday date. If there are multiple holiday dates in the source file, it doesn't work.

Source File

Holiday Calendar




Thanks 


SSIS Package execution failed for Sql server 2014 (Error return value =5)

$
0
0

We are migrating our SQL server 2005  to SQL server 2014 and we have migrated our SSIS packages using SSDT for Visual Studio 2013 and deployed on this new SQL Integration Service server 2014.

These 2014 packages are executed from the VB script and command string generated from the VB script to execute the package is given below. VB script will be finally be called from scheduler.

Current we only tried to execute the VB script from the 32 bit command prompt and faced the version issue as described in my first email below.

Command String:

CMD.EXE /C cd \Program Files (x86)\Microsoft SQL Server\120\DTS\Binn\ & DTEXEC /SQL "\MLdbToOTRdb" /SERVER PDC0US-SQLBIX01\BIXDBP1 /CONFIGFILE "D:\OTR\SSIS\Configfiles\CommonCopy.dtsConfig" /MAXCONCURRENT " -1 " /CHECKPOINTING OFF /REPORTING 

We already have working 2014 SSIS packages but on other database 2014 server.

In the log files of this working 2014 SSIS packages we have ' Microsoft (R) SQL Server Execute Package Utility Version 12.0.4100.1 for 32-bit.' in the logs files. This log file is created by the DTEXEC.

But on the new production 2014 database server the SSIS package logs ‘Microsoft (R) SQL Server Execute Package Utility Version 11.0.2100.60  for 32-bit’ in the log files.

Please help.

Is the DTS api discontinued in Sql Server 2016?

$
0
0

Looking at this page https://msdn.microsoft.com/en-us/library/cc879336.aspx (Upgrade Integration Services), I note the following:

Support for migrating or running Data Transformation Services (DTS) packages has been discontinued in in the current release of SQL ServerIntegration Services. The following DTS functionality has been discontinued.
  • DTS runtime
  • DTS API
  • (etc)

However, looking at this page https://msdn.microsoft.com/en-us/library/bfff5b25-cfe1-449b-8e07-38cd511ac307 (Integration Services Backward Compatibility), i see it clearly stated that there are no discontinued features in SSIS 2016.

So now I am confused: Is the DTS runtime and api supported or not? I am in charge of an application using the DTS api to dynamically build and execute SSIS packages. Will I be able to upgrade to SSIS 2016 without causing problems for this application? I realize that I may have to update some component ids here and there.

An additional question: Is there a way to install SSIS 2016 alone on a Windows 7 x64 machine? The Sql Server 2016 setup balks if not on at least Windows Server 2012.


SSIS Gurus, step up and be known!

$
0
0

August Gurus step up and show us your knowledge on the latest and the greatest technologies Microsoft have to offer!

And for your efforts, eminent leaders in your technology will evaluate your contributions and award real virtual medals!

All you have to do is add an article to TechNet Wiki from your own specialist field. Something that fits into one of the categories listed on the submissions page. Copy in your own blog posts, a forum solution, a white paper, or just something you had to solve for your own day's work today.

Drop us some nifty knowledge, or superb snippets, and become MICROSOFT TECHNOLOGY GURU OF THE MONTH!

This is an official Microsoft TechNet recognition, where people such as yourselves can truly get noticed!

HOW TO WIN

1) Please copy over your Microsoft technical solutions and revelations toTechNet Wiki.

2) Add a link to it on THIS WIKI COMPETITION PAGE (so we know you've contributed)

3) Every month, we will highlight your contributions, and select a "Guru of the Month" in each technology.

If you win, we will sing your praises in blogs and forums, similar to the weekly contributor awards. Once "on our radar" and making your mark, you will probably be interviewed for your greatness, and maybe eventually even invited into other inner TechNet/MSDN circles!

Winning this award in your favoured technology will help us learn the active members in each community.

Below are June's mighty winners and contenders!

 BizTalk Technical Guru – June 2016 
Gold Award Winner

SMSVikasKHow to Re-create BizTalk Server Project Artifacts from a DLL or an Assembly from an existing projectEd Price: “Great detail! Great job walking us through the images! Glad to have the code download link! As Shashidharan wrote in the comments, “Nice Article Vikas. Very helpful :)” Great job on this!”
Sandro Pereira: “Nice article, very useful! This problem happens more often that you can imagine. Another option will be BizTalk NoS add-in but is great to know other ways!”
SW: “Very useful and informative article.”
Silver Award Winner

Johns-305BizTalk Server: Sending Control Messages to Long Running ProcessesSW: “Excellent article!!!”
Ed Price: “Strong introduction and great use of images! Great to have the sample on MSDN Gallery! It could use a See Also section (links to other Wiki articles) and References.”
Sandro Pereira: “Great article.”
Bronze Award Winner

SMSVikasKBizTalk Custom Pipeline Component to Add, Update, Remove Target Namespace, Qualified Prefix for every elementSandro Pereira: “Again very useful article. This is a common problem and you will find several examples of pipelines to change the target namespace but I think this is the first time I see all 3 operations combined. However, I will follow a different approach and set a property to specify the operation in the pipeline for better clarification”
Ed Price: “Good job on this article. Good use of images and formatted code. Great to have the source code downloadable!”
SW: “Very useful and informative article.”

Guru Award Microsoft Azure Technical Guru – June 2016 
Gold Award Winner

Dileepa KariyawasamUse Azure Active Directory to Custom Brand Your Office 365 Sign In Page – Step by StepEd Price: “This is an incredibly valuable scenario that’s executed well! It could be improved with a TOC and References and See Also sections at the end.”
Silver Award Winner

ChervineSchedule PowerShell Scripts to Manage Azure Virtual MachinesAS: “The article represents good overview of the Azure Automation service. However it is suggested best practice to use service principals in Azure AD instead of a regular users. And use certificate to authenticate the service principal.”
Ed Price: “Wow! Fantastic solution, great write-up, good use of headers/sections, formatting, a diagram, images, code formatting, and a solid References section! As AS mentions, this could be improved with the Azure AD perspective. Great article!”
Bronze Award Winner

Michel JatobáConfiguring Client VPN PowerShell on Microsoft Azure (ARM)Ed Price: “Good job on this. The Introduction, “Configuring VPN Certificate” section, and use of images… really stand out. This article is similar to an Azure doc one (https://azure.microsoft.com/en-us/documentation/articles/vpn-gateway-howto-point-to-site-rm-ps/), but it’s done a little differently, and the images help. It could be improved with See Also and References sections at the end, as well, as little more refinement on the code formatting (which admittedly, should be easier to do). Good job on this. “

Guru Award Miscellaneous Technical Guru – June 2016 
Gold Award Winner

SYED SHANUMVC Dashboard with Chart using AngularJS and WEB APIPhilippe Levesque: “Excellent ! The use of animated gif is really good”
Richard Mueller: “Lots of well thought out code. Grammar needs work.”
Ed Price: “Powerful article with a great use of code! The images won’t show for me. I love the Download section at the end for the MSDN Gallery item!”
Silver Award Winner

Santhakumar MunuswamyDisqus Integration in Asp.Net MVCEd Price: “Beautiful job with the structure, images, and code. Good to have the reference link. ”
Richard Mueller: “Good images. We need more references.”
Philippe Levesque: “”
Bronze Award Winner

Dileepa KariyawasamOffice 365 Journaling Workaround – How to GuideRichard Mueller: “Interesting solution. I like that this is not first person or personalized. Could there be references?”
Philippe Levesque: “”
Ed Price: “Also a good topic. This could be improved with section headers, and with See Also and References sections. Great use of images!”

Guru Award SharePoint 2010 / 2013 Technical Guru – June 2016 
Gold Award Winner

Waqas SarwarSharePoint 2016 Site Use Confirmation and Deletion( real world example)Hezequias Vasconcelos: “It is an excellent content for file management. Helps administrators manage and better optimize disk space in the database.”
TN: “That’s ok to be published even it’s a very basic article”
John Naguib: “Good one”
Silver Award Winner

Waqas SarwarSharePoint 2016: Checklist for Successful InstallationJohn Naguib: “Good CheckList, it is better to upload as excel ”
Hezequias Vasconcelos: “It is an excellent content for SharePoint 2016 installation management I miss about updates to the SQL, and Windows SharePoint and Language packs that are important also in the installation of products. Reference: https://technet.microsoft.com/en-us/library/mt715807(v=office.16).aspx”
TN: “That’s ok to be published even it’s a very basic article”
Bronze Award Winner

Waqas SarwarSharePoint 2016 Managing Registered Accounts and Shell Admin access( Real World Example)John Naguib: “Nice article”
Hezequias Vasconcelos: “Perfect maintenance and account management in SharePoint 2016. Good Job.”
TN: “That’s ok to be published even it’s a very basic article”

Guru Award Small Basic Technical Guru – June 2016 
Gold Award Winner

Nonki TakahashiSmall Basic: MouseEd Price: “I love this series! Nonki takes us end to end on using the mouse in Small Basic. I love the definition! Very strong See Also section.”
Michiel Van Hoorn: “Nonki again delivered a great article on a SB function (MOUSE). Very useful if you want to interact with mouse”
Carmelo La Monica: “I don’t know small basic, but this is good point to learn. Congrats.”
Alan Carlos: “”
Silver Award Winner

DevaSmall Basic VideosCarmelo La Monica: “Very good videos, good fo to learn Small Basic. Congrats for all videos.”
Alan Carlos: “Good guidance, very helpful!”
Michiel Van Hoorn: “Nice overview of available videos”
Ed Price: “Great to have this list on the Wiki! Thanks!”

Guru Award SQL BI and Power BI Technical Guru – June 2016 
Gold Award Winner

Thomas LeBlancAnalysis Services: Solving Hierarchy Errors of UniquenessPT: “Thanks for the article, Thomas. You’ve explained the use case and steps for creating a hierarchy very plainly. This is a good piece.”
Ed Price: “Great scenario and use of images! It could be improved with headers and a TOC, and with References and See Also sections at the end. This is a powerful topic.”
Silver Award Winner

Sudeep RajIntegration Services: Using DB Mail to send HTML format mailPT: “Thank you for explaining this technique; simple and effective.”
Ed Price: “Fantastic topic from Sudeep, with solid colouring on the code formatting! Could be improved with References and See Also sections.”
Bronze Award Winner

Jens VestergaardExtracting SSAS MD Database(s) XMLA w/ PowerShellPT: “This is a useful script that I’ll probably use in the future. This is a good start but the post could use a little more structure to be complete; an introduction, objective statement and conclusion. Thanks for your contribution.”
Ed Price: “Good PowerShell solution. Could benefit from more of a breakdown of the code. “

Guru Award SQL Server General and Database Engine Technical Guru – June 2016 
Gold Award Winner

Hezequias VasconcelosSQL 2016 – Install SSMS Management StudioUR: “Why is an installation instruction of an “old” version of SSMS in June a WIKI? The latest version isn’t a preview anymore. An installation step by step isn’t worth a WIKI entry. I would have seen more details about the differences between SSMS 2016 previous version. What are the differences? What will work better? What (and there is a lot!) is not working good?”
Ronen Ariely: “A great subject for article. Screenshot images of each step helps simplify the instructions, makes the article more useful for new users. There is some room for improvement. See article comment section.”
Silver Award Winner

FLaufferSQL Server Troubleshooting: How to remove a bad execution plan from plan cacheRonen Ariely: “A nice article of a simple case study and a solution. It’s very short and has potential to be even better with a bit more expansion”
UR: “I am missing a more detailed explanation WHY a plan can go wrong. Basically it is more “story around DBCC FREEPROCCACHE”.”

Guru Award System Center Technical Guru – June 2016 
Gold Award Winner

Digvijay S RajawatSCVMM 2012 R2 & Hyper-V: Storage Migration in Microsoft Private CloudEd Price: “Wow! Great formatting and sections. Very good use of tables. Could use a See Also section (to link to other Wiki articles). The processes are very clear and incredibly detailed. Fantastic article!”
Carmelo La Monica: “Fantastic topic, very nice in all parts, good images explain in all parts. Good”
Alan Carlos: “Nice article! Congratulations!”
Silver Award Winner

C Sharp ConnerSCORCH – Custom Activity OIP Limitations – C# EditionCarmelo La Monica: “I read this article, i don’t know System center, but is very detailed in all part.”
Alan Carlos: “”
Ed Price: “Good list of limitations. It would have been good to get into the code too. Another good topic!”
Bronze Award Winner

C Sharp ConnerSolution – Install Fresh Data Warehouse on Post UR Updated SCSM EnvironmentEd Price: “A lot of great detail! This could be improved with sections. Great topic!”
Carmelo La Monica: “Good explain, good work. Congrats.”
Alan Carlos: “”

Guru Award Universal Windows Apps Technical Guru – June 2016 
Gold Award Winner

Carmelo La MonicaSerial Class for UWP Part oneEd Price: “Great article! Good topic, well-written, great breakdown of sections/headers/TOC, good use of images and code, and good requirements sections! It could use a See Also section at the end with links to related Wiki articles.”
Silver Award Winner

Santhakumar MunuswamyUnderstanding AppBar and CommandBar in UWPEd Price: “Great topic. Good write-up. Good use of images and code! It could be improved with sections/headers/TOC and with See Also and References sections at the end to link to other articles.”
Bronze Award Winner

Damien AllanLaunch your App Differently from Secondary Live TilesEd Price: “Short and sweet. Good use of code and reference links. Could use improved formatting and sections/headers.”

Guru Award Visual Basic Technical Guru – June 2016 
Gold Award Winner

.paul.VB.Net – QR Code CreatorEd Price: “I love the QR Code creator! Incredibly valuable. Great job with the code, formatting, and download!”
MR: “Nice and easy! Would love to know how to generate a QR code from scratch!”
Richard Mueller: “Very useful. Simple but effective code.”

Guru Award Visual C# Technical Guru – June 2016 
Gold Award Winner

Emiliano MussoEntity Framework Introduction using C#, part II – Code-First and MigrationsRonen Ariely: “Excellent article! I loved the idea of writing series of articles. Moreover, the author translated the articles into another language. Great use of the capabilities of the TechNet WIKI.”
Ed Price: “Wow. This is an amazing article! It has it all… a great topic, fantastic formatting with headers, great code formatting, good descriptions, screenshots, references, a link to the MSDN code gallery to download the code, and an Italian version! This is a high-quality article! Other writers (including myself) should look at this one for ideas of how to achieve quality!”
Jaliya Udagedara: “Now this is a fantastic article. Well explained, filled with images, code snippets and the full sample code is available in MSDN Code gallery. Awesome job!”
Silver Award Winner

Sabah ShariqSearching data in Elasticsearch using C#Ronen Ariely: “Great article. I really enjoyed to read it. posting the code ready for download is very useful.”
Ed Price: “Great job breaking down the sections and explaining the code! Could be improved with References and See Also sections. ”
Jaliya Udagedara: “Haven’t used Elastic search before and this article contains instructions for everything that you need to get started. Nice!”
Bronze Award Winner

Sibeesh VenuWorking with API help page controller action description in Web APIEd Price: “A good topic with solid code, but it would be good to breakdown the code more and explain it in chunks.”
Jaliya Udagedara: “If you are having trouble showing descriptions in Web API help pages, this article should help you out.”

Guru Award Wiki and Portals Technical Guru – June 2016 
Gold Award Winner

Carsten SiemensTranslation Wiki: Getting startedRonen Ariely: “This article gave me new information regarding the Translation Wiki Community. This information should be published in any communication channel we have. This is a “must to know” in my opinion.”
Ed Price: “I love it. This is a great process. Thanks to Carsten for building it and Peter for compiling, editing, and publishing!”
Richard Mueller: “Very informative. The images are good, but I had to zoom them. This must have required some research. Perhaps there should be a link to the blog site.”
Silver Award Winner

Peter GeelenWiki: Before you post your article – Quick check listRichard Mueller: “Great use of Wiki guidelines. An excellent guide for all Wiki authors with great advice. I like the emphasis on researching the topic, collecting links for references, and preparing offline.”
Ronen Ariely: “Very useful, very important, and most of all: I love the way it’s organized as a check list”
Ed Price: “This is a fantastic check list to go through before you get started! It will up the quality if we use this!”
Bronze Award Winner

Peter GeelenMicrosoft Security Compliance Manager (SCM) PortalRonen Ariely: “The TechNet WIKI based on portals as an index to navigate the website. This is nice list of articles that act as portal to the Microsoft Security Compliance Manager ”
Ed Price: “Great portal. Good job getting all these links compiled for us!”
Richard Mueller: “Great links. Maybe a few words would be useful.”

Guru Award Windows PowerShell Technical Guru – June 2016 
Gold Award Winner

Richard MuellerPowerShell: Problems with the -ne Operator in Active Directory CmdletsPG: “Nice article, good quality and nice to read. Great!”
Ed Price: “Wow! I love the quality here. You get a ton of explanation for each code excerpt. Plus the Return to Top links provide easy navigation. And it ends with immersive See Also and Other Resources sections!”
Silver Award Winner

Prashanth JayaramPowerShell-List-and-Export-Installed-Program(s)-Local/Remote-system(s)PG: “Except for some introduction, the scripts need more in depth explanation.”
Ed Price: “Love the sections! It would be good to break the code down more and activate the References links at the bottom.”
Bronze Award Winner

Digvijay S RajawatUse PowerShell to Create an Azure VM report with nice lookPG: “Nice quick tip, but please keep in mind that TNWiki is not a personal blog. Better remove the personalisation.”
Ed Price: “Good topic, but it could use more explanations. Good formatting on this article!”

Guru Award Windows Server Technical Guru – June 2016 
Gold Award Winner

Ryen TangNano Server: Deploying MySQL Database ServerMark Parris: “Nice compact article on the new technology that is Nano Server.”
Philippe Levesque: “Excellent article, easy to follow step and well-written!”
JM: “This is a great article on deploying MySQL on Nano, thanks for your contribution!”
Richard Mueller: “Good use of Wiki guidelines, with code, images, and references. Good to have detailed steps.”



#PEJL
Got any nice code? If you invest time in coding an elegant, novel or impressive answer on MSDN forums, why not copy it over toTechNet Wiki, for future generations to benefit from! You'll never get archived again, and you could win weekly awards!

Have you got what it takes o become this month's TechNet Technical Guru? Join a long list of well known community big hitters, show your knowledge and prowess in your favoured technologies!

SSIS Maximum string variable length is 4000 ??? how to eliminate this variable limit ???

$
0
0

Hi all ,

I have  string type variable  , storing xml data

I have Execute Sql task , in that  a Proc  executes and save xml data in String type varibale  and this variable

is supplied to next Task2 and that varible size limit >4000 ,, how to eliminate this size limit ?? the pkg should use that varible

Please help

CDC Control Task: "Timeout expired" (when TransactionOption is Required)

$
0
0

I am doing incremental load using CDC and want to implement transaction rollback in case of any task failure including CDC control task in package.

To complete 'Get Processing Range' and 'Marked Processed Range', two CDC control tasks are added into a Sequence Container, if TransactionOption is 'Supported' (default) for the container, everything works fine. However, if TransactionOption is 'Required' on the other hands, the 'Marked Processed Range' will fail raising '[CDC Control Task] Error: "Timeout expired.  The timeout period elapsed prior to completion of the operation or the server is not responding.".
Based on tracing, the following statement is suspending.
(@name nvarchar(16))SELECT count(*) FROM [dbo].[cdc_states] WHERE Upper([name]) = Upper(@name)

60,000 files need to be copied to Azure storage and grouped

$
0
0

Hi All,

  We have around 60,000 files on premise and they follow a certain naming convention.  Group1_xyz.pdf, Group2_abc.pdf  etc are examples of file names. Can we have a storage account with "containers" as group numbers and have an SSIS package that will read the file names and based on the group number , move it to the appropriate "container"?

  Is there any other or better alternative ?

Regards,

gsanwar

File watcher task failure.

$
0
0

I am using visual studio 2015 and i have sql server 2014. So i downloaded file watcher sql server 2014 from http://www.sqlis.com/sqlis/post/File-Watcher-Task.aspx.

once i downloaded and installed it was not showing up in my toolbox i tried refreshing it but still not showing up. So, i downloaded 2016 file watcher then it showed up on my VS 2015 and package ran successfully but the problem here is, it was failing when i scheduled a job in SSMS 2014 as it is 2014 and file watcher was 2016. I can upgrade my ssms to 2016 as all my projects are using it.

Please reply to this post if you have any solution.

Thanks in advance.

Below is the error


Error:

Message
Executed as user: ----\svc-mssqld. Microsoft (R) SQL Server Execute Package Utility  Version 12.0.4100.1 for 64-bit  Copyright (C) Microsoft Corporation. All rights reserved.    Started:  12:13:17 PM  Error: 2016-08-09 12:13:17.62    Code: 0xC0010018     Source: File Watcher Task      Description: Failed to load task "File Watcher Task", type "". The contact information for this task is "File Watcher Task; Konesans Ltd; Copyright ? 2016 Konesans Ltd; http://www.konesans.com".  End Error  Error: 2016-08-09 12:13:17.62     Code: 0xC0010018     Source: File Watcher Task 1      Description: Failed to load task "File Watcher Task 1", type "". The contact information for this task is "File Watcher Task; Konesans Ltd; Copyright ? 2016 Konesans Ltd; http://www.konesans.com".  End Error  Error: 2016-08-09 12:13:17.63     Code: 0xC0010026     Source: File Watcher Task      Description: The task has failed to load. The contact information for this task is "File Watcher Task; Konesans Ltd; Copyright ? 2016 Konesans Ltd; http://www.konesans.com".  End Error  Error: 2016-08-09 12:13:17.63     Code: 0xC0024107     Source: File Watcher Task      Description: There were errors during task validation.  End Error  Error: 2016-08-09 12:13:17.63     Code: 0xC0010025    Source: FileWatcher      Description: The package cannot execute because it contains tasks that failed to load.  End Error  DTExec: The package execution returned DTSER_FAILURE (1).  Started:  12:13:17 PM  Finished: 12:13:17 PM  Elapsed:  0.156 seconds.  The package execution failed.  The step failed.


how can I run different configurations for the same SSIS packages?

$
0
0

Hi there,

My aim is to feed with different configurations one of my SSIS packages scheduled for an Agent job.

How can I achieve this customization without to be modify every time my .dtsx or without using different Agent jobs per each configuration?

My package uses database, server, log, path, etc into user variables.

And the most important thing, in order to take advantatge of that where my .DTSX package must be (the server since I want to schedule does not have SSIS so I can't choose SSIS Package Store) File System, SSIS catalog??

Thanks for share your knowledge and comments!!

SSIS Script C# OpenXML System.IO.IsolatedStorage.IsolatedStorageException

$
0
0

I have a SSIS script to delete a specific row from an Excel spreadsheet used to force numeric formatting.  When the file is small, the script works great.  When the file is large (over 8 Meg I believe), and the Packaging API goes to isolated storage the save fails because the appdomain had no identity assigned. 


How can I simply either add an identity or override the switch to the utilization of isolated storage and not need the identity for the script to save the file?

I may have overlooked a simple answer, but I have not found a workable solution yet.

missing Microsoft.SqlServer.ManagedDTS

$
0
0

Hi

I am trying to run a SSIS package first time through vb.net console application. As the first step, i was trying to add the reference for Microsoft.SqlServer.ManagedDTS assembly but it was not in the available assemblies list box in visual studio 2003!

Please guide what i am supposed to do to get it, or if there any other alternative.

 

Thanks in advance

Utsav

Looping FileName,SheetName Dynamically by Skipping First 10 Rows for Excel Source

$
0
0

How im Trying to Create a Package to fetch data from Excel Files,

1.Filename will change 2.Sheet name will change for all

3.i need to skip first 10 rows 

i'm able to use SQL command but how do i loop  Dynamically by giving a variables forFile Name and Sheet Name in sql command.

how to import data(from Sheet 1) from multiple excel files to multiple columns of a single tablesql tables

$
0
0

I have a specific task and trying to figure out a solution ..
I have a client folder that gets loaded with an excel file for every month. It has multiple sheets but I need to pull just 1 sheet(same columns) from every excel file and load in to a same table.

Every sheet has 2 columns (State and Col2).

Month1

STATE

COL2

TX

.62

PA

.82

VA

.92

Month2

STATE

COL2

TX

.22

PA

.32

VA

.42

and so on..

Col 2 is the percentage column which I need to load to database to calculate average on that column and report.
Can you please guide how to perform this task.

Thanks in advance

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>