Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Regarding the SSIS Transaction for sequence container

$
0
0

Dear All,

I have implemented the External transaction for my sequence container. This has 8 DFTs in it . It is  working fine in case of success or failure.

Now I wanted to implement the solution like if the job stops at the 4th task then first 3 tasks has data in it .

But I wanted to rollback if the job stops in halfway the execution of sequence container. Please help me to solve this issue.

Thank you

Sri


Assign different static Increment value in different csv files using ssis

$
0
0

Hi,

   I have a table T with columns Code datatype is nvarchar(5) andName nvarchar(30). Table T has 100 records and column Name only have data and column Codehas Null values. I have to generate csv files using this table data through SSIS . Each file should have 25 records and assign some static value(different for each file ex: file1 is T1 and file2 is T2..etc) in columnCode . I am able to generate files with 25 records for each file but not able to assign different static value in different csv files. Is it possible using SSIS?

Please suggest.

Thanks in advance.

Visu

CDC Source timeout and transaction intergrity

$
0
0

Hi All,

I have created a SSIS Package which does the incremental update using CDC Controls.

The design is similar to any standard CDC incremental package.

It has a CDC Start which sets the Mark Processing Range, a data flow and a Mark Processed Range.

The issue that i'm facing is that the CDC Source control time-out but i can still see rows moving from CDC Source to Splitter and target table. After the rows are transferred, the Data Flow task Fails which leads to package failure.

This results in Mark Processed Range not being executed.

So my query is

1. Why is CDC Source being time-out?

2. What can i do so that all three i.e Mark Processing Range, data flow and Mark Processed Range execute successfully or nothing does.

Thanks.


Please specify your SQL Server version while posting questions
Please Mark This As Answer if it solved your issue
Please Vote This As Helpful if it helps to solve your issue

Send Mail task not working properly when it configured in Precedence Constraint (Failure)

$
0
0

Hi,

Send Mail task not working properly when it configured in Precedence Constraint (Failure)...

Scenario:
I'm using multiple containers in my ssis package. Also I have configured mail task for capturing error.
I'm getting mail only when error occurs in foreach loop container. If error occurs in other containers it doesn't works.

Actually I would like to receive mail notification on error when it occurs in any of the containers or DFT.

Please suggest your comments..

Regards

Guru

Job JOB_NAME reported: Unable to terminate process 4bd0 launched by step 1 of job JOB_ID (reason: Access is denied)

$
0
0

All of a sudden I am getting this error

Job JOB_NAME reported: Unable to terminate process 4bd0 launched by step 1 of job JOB_ID (reason: Access is denied) on all my DTS packages and maintenance plan.

There was no DB/Server related changes. It is SQL server 2014 STD 64 BIT on Windows server 2012 R2

Verbose log is blank


aa


Dynamic creation on DataBase

$
0
0
Hi,
I have a reqirement where in i need to create a Database dynamically in SSIS, Database name is given in table.


Regards,
Miranda

Script task to query AD

$
0
0

I am working on a Script task that pulls AD info to a SQl table. So far many attribures I pulled from AD work fine.

But for PASSWD_CANT_CHANGE attribute in UserAccessControl, I always get the value of 0 meaning false. Help please

bool CannotChangePassword = false;

const int UF_PASSWD_CANT_CHANGE = 0x0040; if (Convert.ToBoolean(flags & UF_PASSWD_CANT_CHANGE)) { CannotChangePassword = true; // cannot get to here } else { CannotChangePassword = false; //always return false }



SQLFriend




Missing Fact tables (measures) from SSAS Cube in SSIS

$
0
0

Dear friends,

I am trying to consume data from SSAS cube over a SSIS package. Concerning this, I created an OLE DB Provider for Analysis Services 12.0 connection type which is connecting to that Cube. It has connected to Cube successfully. Also I am able to see whole Dimension tables. HOWEVER, problem is that I cannot see fact tables. It just displays me dimension table. Normally, I have permission to get all fact table data. To test my permission, I've connected to that Cube over Excel and was able to see entire tables including fact and dimensions. Now, I am really confused.. Why can't I see that facts?? 

Thanks in advance.


Omnipotent


Creation Of DataBase Dynamically

$
0
0

Hi Guys,

I need to create a DB dynamically in the Server from the SSIS only....

Please suggest me how to implement this....


RamarajuC

Integration services catalog

$
0
0

Hi, We are using SQL Server & SSIS 2014. I have been pushing my client to use the new integration services catalog and they are a little skeptical about the encryption key, how to secure it and worst case scenario losing the key and secondly integration services need to be up and running all the time for the jobs to run.

I believe for the second part the jobs to run irrespective of where the packages are sql server, file system or catalog the integration services need to be up & running. (Please correct me if I am wrong).

Is there a way to recover the encryption key?

Thanks in advance.......


Ione

MAster PAckage is executing upto certain point only

$
0
0

I have a sql agent job which runs the Masterpackage, Master package has aroung 35 child packages calling in it. Issue with this Master package is it running upto 30 child packages and I get success message on  job. It is not executing packages beyond 30 what could be the problem. I disabled the all the 30 child packages and ran it again it ran those other 5 child packges without any problem. can someone help me what the issue is .

Thanks


sree

Executing SSIS Package on hosting server

$
0
0

Hi guys,

My Environment:

  • SQL Server 2014 Standard Edition
  • SQL Server Installed on a hosted environment (different domain than our company domain)
  • I have to use DNV\MyUserName when RDP in order to access the hosted environment. 
  • Our Company Domain is IHM\MyUserName
  • Ultimate Objective is to Execute SSIS package from a .NET application (I'm currently using MS LightSwitch)

I have the SSIS package deployed to SSISDB Catalog, I can run it locally without any problem.

Here is the script:

declare @output_execution_id bigint
exec [dbo].[CopyNewDataToLegacy] @output_execution_id output
print @output_execution_id

If I take the same script and run it from my local machine domain(IHM\MyUserName)

I get the following error

Msg 27123, Level 16, State 1, Procedure create_execution, Line 38
The operation cannot be started by an account that uses SQL Server Authentication. Start the operation with an account that uses Windows Authentication.
Msg 27123, Level 16, State 1, Procedure start_execution, Line 32
The operation cannot be started by an account that uses SQL Server Authentication. Start the operation with an account that uses Windows Authentication.

It's very clear to me that I can't execute the package without Windows Authentication.

  1. Is there a workaround to execute SSIS package with SQL Server Authentication?
  2. We have a secondary domain control in the hosted environment company but I can't see our IHM\Users from DNV Environment (I browsed Entire Directory from (SSMS >>> Logins >>> New Login >>> Click Search Button >>> Locations) I only see users under DNV\Users (which is not our domain)
  3. I'm sure we are not the only company having this kind of issues, so I'm wondering how other companies who use hosting environment are working around this limitation.

I appreciate all the help.

Thank you


Codernater

Can we use LoadFromSqlServer method to execute the SSIS Package deployed in SQL server 2014?

$
0
0

Hi Team,

When we started the project, we used SQL Server 2008 R2 as DB and VS 2012(C#) for developing the UI. Recently we upgraded the .Net fwk to 4.5.2(VS 2013) and SQL server to 2014. This resulted in one odd behavior.

From our .Net code (a WCF service), we were using LoadFromSqlServer method to load the package deployed in SQL server 2008 R2, which was just working fine. However the same didn't work when we migrated to SQL Server 2014. Please note, we did upgrade all the SSIS packages using the upgrade package wizard from the SQL server 2014.

After going through this sample code, https://msdn.microsoft.com/en-us/library/ms136090.aspx, we understood, Microsoft recommends to use LoadPackage method to load the package from SQL server. We tried this and things worked just as expected.

Few Questions:

1. Is LoadFromSqlServer method decommissioned? Should we not use this to load the package deployed in SQL server >=2012 ?

2. Updating the code to use the LoadPackage method is the only or the best way to resolve this issue if the packages are deployed in SQL server that is >=2012 ?

It is quite important for our team to know this as we have to rebuild few other components based on the response to the above questions.

Appreciate your suggestions.

Thanks.


Ravikiran. S

SSIS: How to load 2 different excel files to 2 different tables?

$
0
0

Hi All,

I'm new to SSIS. I have 2 different excel files file1 and file2. file1 should be loaded to table1 and file2 should be loaded to table2. Both of the files will have 1 sheet inside. Do I need to create separate excel source for file1 and file2? I mean file1 in one excel source and that will be connecting to 1 execute sql task. file2 in other excel source and that will be connecting to another execute sql task. Is this the way I should proceed or is there any looping should be done?  I need to schedule this activity to run every week. So, I'll get new files every week with the same file names and sheet names. Do I need to consider anything for this requirement also?

I'm planning to do truncate and reload not an incremental load.

Please help me on this. It would be great if you can give me a step by step solution for this since I'm new to this.

Regards,

Julie

cannot open database SSISDB request by login

$
0
0

Hi have a ASP.NET app that access the DBs in a SQL 2012 server.  I added code to access the SSISDB but it returns an error " cannot open database SSISDB request by login"

doing some basic troubleshooting:

-When login to SSM (2012-R2) with windows/sa credentials I can access SSISDB and its tables with no problem

-but when I try to access SSISDB via T-SQL as follows:

osql -Usa -Ppasswrod

>sp_helpdb...(this lists all the DBs including the SSISDB)

>use SSISDB

>go

>select * form TableName

>go

This script returns an error stating that SSIDB does not exist

any help is greatly appreciated


SQL error {11}

$
0
0
        When I try to do any maintenance on my PC, using any programme to delete browser history & cookies. I get the same message time & time again. Error executing SQL error [11]. The database disc image is malformed. " select [SQL] from sqlite_master where [ type ] = " table and lower (name) ="cookies" :malformed database schema (is transient) - near " where " : syntax error. Can anyone please help me?. 

SSIS with DQS Performance Issues

$
0
0

I recently started working on SSIS.

I have a SSIS package which loads around a Million records from various Excels files. This is pretty fast like a minute or 2 .

After this is done cleansing activity starts and this is where my problem starts. I have like 20 domains in my DQS in which some of them do basic checks like length of data in column is not more than a certain value(like Name cant be more than 50) and some validate the data based on regular expression like phone number matches a pattern etc.

I also have a composite domain on top of these which internally have 6-7 rules.

like rule 1 if Domain 1 is a particular value Domain 2 cant be empty

When i cleanse 1M records directly from DQS it takes around 40 min to cleanse. When i do the same task on same data through SSIS it takes more than 8 hours and aborts some times

I have tried to increase the DefaultBufferMaxRows to 100000, DefaultBufferSize to 104857600 for the project.

I also tried to update DCChunkSize to 100000 from 10000 in [A_CONFIGURATION] table.

I even used Balanced Data Load Distributor to split the load into 4 cleansing tasks but none or all of them couldn't make a significant improvement. These slightly slightly reduced time by an hour or so, but sometimes it fails due to memory constraints.

Is this the max performance we could get in SSIS?

Also takes uses 100% CPU every time and doesn't free most of it even after finishing or stopping Visual studio. I have to end SQLServer From task manager.

I am running this on 16GB machine


rp


DB Server and SSIS Server on different machine

$
0
0

Hi Experts,

After reading two links I am little confused and please clarify my doubt.

As per this link http://blogs.lessthandot.com/index.php/datamgmt/dbprogramming/mssqlserver/when-is-dtexec-installed/, we can execute packages only when we install Integration Services (DTEXEC works only after that).

As per this link https://msdn.microsoft.com/en-us/library/bb522532(v=sql.105).aspx, we can execute packages from DB Server if integration services is not present on same machine and packages will execute from server from which they were started (i.e. DB Server via job).

My scenario, I have DB server installed on machine A and SSIS server on machine B. I am creating sql agent job on machine A and pointing to packages stored in file system on SSIS server B. My confusion is since we did not install integration services on machine A (DB Server), how packages execute from here? Will the packages run from server A but use DTEXEC of server B? If I am not wrong SQL Agent Job also uses DTEXEC to execute the package so how does it work without integration services installed? 

Thank you in advance!

Oracle connectivity error in SQL Agent scheduler

$
0
0

Hi,

I have created an SSIS package , that collects the data from Oracle  and load it into SQL SERVER . The package runs fine , when I run it through Microsoft BIDS. It gets failed only when I schedule it through Jobs scheduler (SQL Agent) .  I am using attunity drivers for oracle connector.

the error is:  data flow task: oracle source failed validation and returned error code 0x80004005

please advice me

thanks


Raja

Integration Services class cannot be found. - SSIS - SQL Server 2014

$
0
0

Hi,


We are facing some problem in SSIS on SQL Server 2014. We had used MSSQL Server 2014 Standard Edition(64 bit) with sql server data tools visual studio 2012 (Shell).

When we open / create any SSIS package, We receive attached error screen and unable to check or edit SSIS packages. Due to this SSIS Jobs are unable to run. But earlier we were able to run schedule jobs in same environment and we have not any changes on server.

I am attaching snapshot of error for better understanding.

Kindly help to resolve this issue. Thanks in Advance.

Regards,
Rajesh


Rajesh Agravat

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>