Job execution fails using SQLServerAgent account but runs successfully under another windows personal account.
Both have same security access on server and DB.
The Windows account is mapped to dbo on the database .
The package uses procedures and views which are using encryption by certificates.
Please advice on how to provide security so that job runs from the agent
So I followed the instructions to move SSISDB. MSDN article: hh213291(v=sql.110)
Step 8 in the restore section says to run catalog.check_schema_version to check compatability. The MSDN for this is lacking.
It returns:
SERVER_BUILD SCHEMA_VERSION SCHEMA_BUILD ASSEMBLY_BUILD SHARED_COMPONENT_VERSION COMPATIBILITY_STATUS
11.0.3412.0 2 11.0.3412.0 11.0.2100.0 11.0.3000.0
0
What does compatibility_status = 0 mean?
So it appears from an issue I encountered and from the entries on this blog that if permissions are not correct on a directory that SSIS will throw a warning that no files were found instead of an error that the account doesnt have rights to the directory. This seems counter intuitive. They are two very seperate things. Files not being there is not always an issue if the package is just periodically checking and doing something if the files are there. But not being able to even check because of a permissions issue is an entirely different situation and it seems this would raise an error on the package. Is there really no way to differentiate between these two occurrences? Surely this is a bug right? Or is there something I'm missing here?
Any help with this would be greatly appreciated. I have fixed the issue on this occurrence by using a proxy account but since this did not cause the package to fail we went longer than we would have wanted with our ETL process not bringing in certain files. I just assumed (please no cliche reply :)) that if you got a hard access error it would register that.
I have created a report which renders data for an advertiserid,I have 5 advertiser ids and there should be 5 reports for all the five advertisers and all the five reports need to be uploaded to ftp site. I hope this can be done in SSIS.
Can anyone please help or provide me a reference.
Thanks in advance
I work in Healthcare and I just started using SSIS tool. I have so far created basic packages for ETL processes. I need to create a package with some advanced skills.
Here`s my scenario:
I have a report that runs monthly & quarterly. The rowcount is about 5 million rows. I want to run a refresh at the end of the each month.
here`s the table structure
Servicenumber, amount, startdate,enddate,paid date,Department.
My source is our OLTP DB, what happens is lets say if i pull data for q1(12/1 - 02/28) and load in "Table1" job done plain and Simple. The report runs at Monthly and Quarterly schedules. The issue is I will get diff numbers in monthly run than quarterly run. I want to lets say Pull data weekly and at the end of the month run a refresh.
Can someone help me how can i achieve this ?
Hi,
Using PowerShell, I have created SQL server agent Job for a SSIS package
After the above job is started, I want to check continuously if the job is running or not.
Once the job finishes (either successful or failure), I want to start another job for the same SSIS package.
Could somebody help with the PowerShell script on how to check if SQL server agent job is running or not?
Any help is appreciated.
Thanks
Bhargavi
Hello,
We have SSIS running in the file system and logs are not stored in SQL Server. we want to implement the health check to currently running job. Is there any way to get the job status? . I already referenced the following link but looks like this one able to give the status only the job running thru SQL Agent.
http://msdn.microsoft.com/en-us/library/microsoft.sqlserver.management.smo.agent.job.currentrunstatus.aspx
please help me on this regard.
Thanks in advance.
The following is my Data Flow:
Ole DB Source > Copy Column> Derived Column>Ole DB CommandMy OLE DB Source has the following SQL command task:
SELECT*FROM Repair RLEFTOUTERJOIN Vehicle VON R.SN = V.SNAND R.Reg = V.RegLEFTOUTERJOIN Product PON R.PID = P.PIDThis yields a column of concern for me named PartNumber, which are represented by the following 2 formats:
%-%%-%-%The following are my Copied Columns:
Input Column= PartNumber
Output Alias = Copy of PartNumberThe following are my Derived Column expressions:
Derived Column Name Derived Column Expression
Name Replace 'PartNumber'LEFT(PartNumber,FINDSTRING(PartNumber,"-",1)-1)
Copy of Name Replace 'Copy of PartNumber'RIGHT([Copy of PartNumber],LEN([Copy of PartNumber])- FINDSTRING([Copy of PartNumber],"-",1))So My PartNumber Column is Replaced with ######### of typestring and the Copy of PartNumber column is replaced with#### of type int
As I stated earlier PartNumber also is in the format of %-%-% which raises the following question:
How can I replace PartNumber Column with NULL if in format of%-%-% and take the PartNumber and put it in new column namedSubPart while keeping all the logic within SSIS objects?
So in essence I want to do something like the following:
PartNumber =CASEWHEN'PartNumber'LIKE'%-%-%'THEN ABC = PartNumber AND PartNumber ISNULLENDI have tried the case statement in a Derived Column expression and is not working. Would I add theCASE statement to the SQL command task in my OLE DB Source?
I hope this question is concise for you.
Having a simple SSIS package that downloads a file from SharePoint using client object model.
the task runs successfully through VS2010 IDE and SQL Agent on development workstation but fails when running through SQL Agent on the server. there are other similar SQL jobs that work fine, so the permission should not be an issue.
the error happens so that I cannot trap it using try/catch. when editing script in VS2010, I noticed the path of SharePoint assemblies are referring to version 16 of SharePoint (2013 ?) and I have SharePoint 2010 on server. As I have set it to run no any version of SharePoint (using "Specific Version = False") I expect it runs with 2010 version but it doesn't.
I'm using SQL Server 2012 Enterprise x64.
Thanks for help.
Hi all,
I'm running SSIS and SQL server on a single PC.
I have an ETL process consisting of several SSIS packages to load data from a source OLTP to a data warehouse.
OLTP DB resides on SQL 2012 instance.
Datawarehouse resides on SQL 2008R2.
My SSIS packages 'hangs' and reports it is failing to swap out memory buffers - they're all held by the SQL 2012 (source db) instance.
On my PC I've configured max memory on each SQL instance:
PC Memory = 16GB
SQL 2012 Max Memory = 6GB
SQL 2008r2 Max Memory = 4GB
My ETL package now runs smoothly.
My question is - what is best practice for managing this memory contention in a production environment. I do not want to limit the available memory to my OLTP db.
My ETL is ran once per day - overnight. Perhaps I could reconfigure max memory before and after each ETL processs? But I don't like this as it would require a server restart & cold cache for my OLTP apps.
Thanks for reading. Appreciate suggestions.
Clay
I converted a SSIS project originally developed in VS2005 on an XP box. Copied the whole project over to Win7 64bit box and converted it into a VS2008 project. One blazing error:
Error 4 Error loading MobileData.dtsx: Failed to decrypt protected XML node "DTS:Property" with error 0x8009000B
"Key not valid for use in specified state.". You may not be authorized to access this information.
This error occurs when there is a cryptographic error. Verify that the correct key is available.
Thing is it rebuilds in output fine and actually have run it through and producing output file just fine.....do I ignore this error?
I'd hate to put it into production and the deal blow up.
TIA
Harry
I have a table which consists of several columns at Source table. While importing the data i have to map with destination table. But one of the column is getting generated with the help of web service which has three parameters ie.e coming from source table.
Here i have to call a webservice for generating column with the help of three input parameter of a source table. I have to also import other columns to the destination table.
Is it possible and if then how?
I have a SSIS package with a two script components, inside of two separate data flows. In the first, I'm getting row numbers that are written out with other data to a text file destination. I am using a variable to store the last row number, so I can pick up the next row number in the subsequent data flow. I get an error: Script Component has encountered an exception is user code: HRESULT: 0xC0010009. However, if I add a breakpoint to either of the scripts, it runs successfully. Has anyone seen a script component run successfully with a breakpoint, but fail without it?
Brad Johnson
Hi,
I'm a little confused as to why there is no "Restore Database Task" in the SSIS Toolbox when editing a package in BIDS/SSDT?
We are provided with a native "Back Up Database Task" but no corresponding restore component. Searching the web shows that most developers are using "Execute T-SQL Task" to restore a database, which is fine.
But why have half the a solution to the backup/restore activity in the toolbox?
Thanks,
Gary
Step 1 - truncate destination table
on success
Using obdc source table source to a odbc destination use a fast table load to take three colums out of source, and copy to destination.
In the source, column 1 is the primary key (int)
Other two columns are time stamps
Destination table, column 1 is int (no keys) - does not allow nulls, column 2 & 3 allow nulls
Noramlly the rowcount in the source and destination tables match after a run. However, on occasions, the destination table count is less than the source table. On the destination odbc source, we enable identify insert and check constraints. I can't see how we'd drop rows since by definition the row needs to existing in the source (we're copying the primary key).
The first time this occurred, anecdotal information is that the source sql server was under memory stress.
Has anyone seen this behavior before? Any ideas on how to resolve it?
Ken
Hi All
in one of my requirement we need to get the file from SFTP location . The problem here in our comapny there is security issue so now they are not allowing to install any thing newly . so how can we use existing script task to download file from SFTP location.
Surendra Thota
Hello,
I am running to the below error after we upgraded the Oracle client to 11g from 10g. The source of the Data is Oracle database . Looked online but each error is pointing towards different route, Confused here any help is very much appreciated. Have to say I am not a pro with SSIS.
SSIS package "Bentek_ISO_Package (2).dtsx" starting.Hi,
I created a sql server job with one job step for a SSIS package using Powershell.
When I run the job (manually), it shows "success" state, but it should fail (because of the bad configuration parameters).
But if I go to job properties, and then edit job step properties (don't have to make any changes here, just clicking ok button is enough)
then the job run will fail as expected.
I am not sure why it is not failing first time?
Any help is appreciated.
Thanks
-Bhargavi
Hi,
I have source as FlatFile -----> lookup ----->adonet destination
I had 2 fields descrption datatype of varchar(500), its in flatfile datatype:string(dt_str) of 500
name: datatype of varchar(250).....flatfile datatype: string(dt_str) of 250.
Data is not loading from lookup to adonetdestination.My task execution is completed succeesssfully with out errors. but no data in tab.
please help it.
Thanks
AVS