Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

SSIS Integration ODCB destaenation

$
0
0

Hello,

I am working on integrate SSIS from Oracle database to Dynamics AX, In step to add ODCB destination I can see some tables and other not listed.

Can you please tell me what I should to check : security for Oracle user, connection etc.

Thanks


SSIS Integration ODCB destination

$
0
0

Hello,

I am working on integrate SSIS from Oracle database to Dynamics AX, In step to add ODCB destination I can see some tables and other not listed.

Can you please tell me what I should to check : security for Oracle user, connection etc.

Thanks


SSIS: How can I choose tables to transfer in a Transfer SQL Server Objects task within a For Each Loop

$
0
0
I have a FOREACH ADO loop that is populated via a select statement similar to (select [table_name] from INFORMATION_SCHEMA.TABLES WHERE <conditions>).  The foreach loop assigns the [table_name] column to a User:: variable.  Within the ForEach loop, I want to do a Transfer SQL Object task to transfer that table from one server to another.  How can I specify to use my variable name as the table(s) to copy in the task within the loop?  Any help is appreciated.

Referencing dynamic variables in the Script task

$
0
0

Hello,

The package I am working with has two string variables, strFileStringName which is static with it's value hard-coded and strSiteFileName which is a dynamic with the expression defined as:

@[User::strFileStringName] + "_" + SUBSTRING ( REPLACE (@[User::FileDate], ".", ""), 5, 4)+SUBSTRING ( REPLACE (@[User::FileDate], ".", ""), 1, 4) + ".xls"

FileDate is another dynamic variable derived from GETDATE.

The expression works just fine in the expression builder, but when the used in a script task, only the static variable is recognized but not the dynamic variable. I have tried to use the MsgBox to output the variable, the static variable values shows up but not the dynamic variable. The processing icon keeps going in circles.

Any idea why/where I am going wrong?

Thank you.

SFTP only specific files in a folder

$
0
0

Hi gurus, 

I have a requirement to not send files that have a specific string in it but send everything else in the local folder. 

For example I have these files in my folder C:/Testfiles

052719OHTHINAPP_17008281852_01.txt

052719HWAPP_17008128852_01.txt

052719OQSUMORA_10533538916_01.txt

052719OWSUMORA_1053353896_01.txt

052719PUSUMBPA_1053353896_01.txt

I should not send *ORA*.TXT files from this folder. How can I do that using SSIS For Each loop and sfTP task?

Thanks.

SSIS processes data well in VS but don't process in SSMS schedules job

$
0
0

Hello Experts,

I've created a SSIS project in Visual Studio and it runs runs well to process the text file, insert records in SQL tables and move the processed file to archive folder when I manually execute the package in Visual Studio.

But, after I deployed the project to SSISDB in the Integration Services Catalogs and created a job in SQL Server Agent, I can see that the job succeeded in the history, but the the text file was not processed, the records were not inserted to the SQL tables and the text file was not moved (of course)

Why the same package is running correctly in Visual Studio but not in jobs in SQL Agent? What is not configured or set correctly    

Thanks,

lw


lw

SSIS processes data well in VS but doesn't process data file in SSMS schedules job

$
0
0

Hello Experts,

I've created a SSIS project in Visual Studio and it runs well to process the text file, insert records in SQL tables and move the processed file to archive folder when I manually execute the package in Visual Studio.

But, after I deployed the project to SSISDB in the Integration Services Catalogs and created a job in SQL Server Agent, I can see that the job succeeded in the history, but the the text file was not processed, the records were not inserted to the SQL tables and the text file was not moved to archive folder (of course)

Why the same package is running correctly in Visual Studio but not in jobs in SQL Agent? What is not configured or set correctly    

Thanks,


lw


صيانه كاريير (العباسية) 01014723434 carierr 01225025360


HOW TO CREATE DYNAMIC FOLDER TO INSERT EXPORTED FILES INTO ??

$
0
0
Hi All,

In my actual project, my boss asked me to export data from database to csv flat files.

So, as I don't know .net code, I use SSIS File System task and ForEach Loop Container.

I built a package which:
1. Select data filtered by year, month and region
2. Create differents folder to archive files exported like this:
A- Year\MONTH\REGION\ .csvfiles

One difficulty that I have is to create folder and sub folder only if it does not exist.

Any help or suggestions would be appreciated.

Thank U.

SSIS Foreach Loop ignore errors

$
0
0

Afternoon,

I have a foreach loop container that calls a number of execute package tasks to rebuild a data warehouse. The container has a list of database names and within the container these are mapped to a parameter this then gets passed to the execute package task that performs an ETL on a certain table, it then goes to the next table etc. When all tables are complete the loop selects the next database.

The issue I have is if one of the packages fails the task stops. I have since changed MaximumErrorCount to 0 this executes the rest of tables per database even if a table has failed. What I would like to achieve is just to end the foreach loop for the current database, flag an error and go onto the next database in the list if any package fails.

Importing a package with SMTP Connection Manager-SSIS 2017

$
0
0

I am trying to import a package to SSIS 2017 .I have a SMTP connection manager in my package which is causing the issue while I import :

OLE received a packet with an invalid extension. (Exception from HRESULT: 0x80010112) (Microsoft.SqlServer.DTSRuntimeWrap)

I tried removing the connection manager and did an import. It worked.

Can you please let me know if I am missing any assemblies?

Sending Files to SFTP Using WinSCP

$
0
0

Hi Everyone,

I created an SSIS package that sends a file to an SFTP location using the WinSCP.dll

This works fine but I noticed that the code tries to rename the file when it sends it to the location.

My coding skills is not strong but I was wondering if someone can help me review the code to identify what is making the code to rename the file as I dont want the file to be renamed.

            string file = Dts.Variables["User::file"].Value.ToString();
            string winscpexe = Dts.Variables["User::WinSCPexe"].Value.ToString();

            SessionOptions sessionOptions = new SessionOptions
            {
                Protocol = Protocol.Sftp,
                // select ReadOnlyVariables, and tick the below properties.
                HostName = (string)Dts.Variables["host"].Value,
                UserName = (string)Dts.Variables["username"].Value,
                Password = (string)Dts.Variables["password"].GetSensitiveValue(),
                SshHostKeyFingerprint = (string)Dts.Variables["Fingerprint"].GetSensitiveValue(),
                PortNumber = (int)Dts.Variables["port"].Value
            };

            try
            {
                using (Session session = new Session())
                {
                    // As WinSCP .NET assembly has to be stored in GAC to be used with SSIS,
                    // you need to set path to WinSCP.exe explicitly,
                    session.ExecutablePath = @winscpexe;

                    // Connect
                    session.Open(sessionOptions);

                    // Upload files
                    TransferOptions transferOptions = new TransferOptions();
                    transferOptions.TransferMode = TransferMode.Binary;



                    TransferOperationResult transferResult = session.PutFiles(
                        @file, "/", false, transferOptions);

                    // Throw on any error
                    transferResult.Check();

                    // Print results
                    bool fireAgain = false;
                    foreach (TransferEventArgs transfer in transferResult.Transfers)
                    {
                        Dts.Events.FireInformation(0, null,
                            string.Format("Upload of {0} succeeded", transfer.FileName),
                            null, 0, ref fireAgain);
                    }
                }

                Dts.TaskResult = (int)DTSExecResult.Success;
            }
            catch (Exception e)
            {
                Dts.Events.FireError(0, null,
                    string.Format("Error when using WinSCP to upload files: {0}", e),
                    null, 0);

Thanks


me

SSIS package configuration best practice

$
0
0

Hello all,

This is more a request for advice than a technical issue, but I'm hoping someone can assist.

My environment is SQL Server 2008 R2. We use XML package configuration files in our development and production environments, primarily to store connection info and relative path info. We store our packages in the file system, rather than in SQL Server, and execute them from the SQL Server Agent accordingly.

I'm currently using a to store the XML package configuration file settings for my packages. I haven't worked with the SQL server table option, but find it interesting. Could someone comment on some of the practical applications of using the SQL server table approach instead of using XML configuration file? Is it a good practice to use XML package configuration file for the SSIS Package?

Thanks in advance.

Red

Getting OLEDB Provider microsoft Jet 4.0 is not registered error

$
0
0

Hi Team, 

I found this error while generating excel file (.xls) in SSIS: 

NOTE: 

1. Having Microsoft access database engine 2010 (english) installed. 

2. Office suite is there (excel application is installed).

3. WOrks fine when run in visual studio. 

Thanks,

Vikram 

 

Using SSIS with CSOM to create/update Microsoft Project Server Lookup table

$
0
0

Hi everyone.  Hope this finds you well. Some background:  I have a requirement to integrate Microsoft Project Server (MPS) with a Project Management tool and send data from the PM tool to MPS.  The project data will be utilized as drop-down values in a Lookup Table.  From my understanding, writing data to MPS is done through the CSOM.  

2 questions: 

1.  Can the Sharpoint List connectors in SSIS be utilized for the integration piece of the above requirement, i.e., can the Sharepoint connector be used as a target?  If yes, can someone kindly walkthrough how to configure the connector to access the CSOM?

2.   Does anyone have C# or .NET code that can be shared that performs the Lookup table manipulation, i.e. inserting/deleting lookup values?

Thanks everyone.  Please let me know if there are questions.  Appreciate any assistance.

Hans 




How to merge two columns into one column

$
0
0

We have Visual Studio 2015. We have a flat file source (CSV) with two columns that we want to merger into one column in the SQL Server table. The two input columns are "Fans (LIfetime)" and "LinkedInFollowers". The column in SQL is "Fans (Lifetime)". Basically we want to Merge the LinkedFollowers data into the Fans (Lifetime) data. This is the data source we are using. The data conversion step of for a date field conversion. Looked at Merge and Union All as possible ways to do this but no luck.

File System Task stops working when when using an older TargetServerVersion

$
0
0

A developed a package in 2017 and it works.

I am running it in the Dev environment and using resource on my same machine to test.

It uses a file system task that moves a file.

When I change the TargetServerVersion to 2014 it stops working and I get a "Could not find a part of the path."

The variables i use are still correct.

If I change it back to 2017 it starts working again.

Using VS 15.9.11

Tried updating to 15.9.12 but still have the problem.

File System Task stops working when using an older TargetServerVersion

$
0
0

I developed a package in 2017 and it works.

I am running it in the Dev environment and using resource on my same machine to test.

It uses a file system task that moves a file.

When I change the TargetServerVersion to 2014 it stops working and I get a "Could not find a part of the path."

The variables i use are still correct.

If I change it back to 2017 it starts working again.

Using VS 15.9.11

Tried updating to 15.9.12 but still have the problem.

Ssis job fails with below error.

$
0
0
Hi Msdn, I have an ssis job which sends mails to customers and job failed with below error. Can you postsolution for this. Thanks.

Realtime Column Propagation possible in SSIS ?

$
0
0

Hi,

I am a datastage guy for most of my life, so pardon me, if i am asking a stupid question.

Requirement : The csv file which is the source can different number of columns at different dates.

Currently it has 70 columns, but tomorrow it can come with 75 columns or 60 columns.

I have to read the csv file and load it to the table. The data volume is also huge.

In datastage, we have a schema file concept, which enables us to propogate column metadata on runtime.

Is it possible in SSIS or can you guide me in a proper direction as to how to handle the above situation. 

Thanks for your help in advance. Cheers!!!!!

Viewing all 24688 articles
Browse latest View live


<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>