how to connect with project online data using the ODATA connector it hasmulti factor authentication..Because I didn't find any option to use the multi factor authentication and it is giving error when I am trying with basic authentication.
Please help me is there any way to connect ODATA connector using multi factor authentication, if not suggest any work around approach to load the Microsoft project online data into Sql server.
Hi All,
There is a SSIS package to execute processing of SSAS DB(process server) and then sync to another SSAS DB(query server), which is configured under SQL Server Agent Job. I ran it by click on 'Start job at step..' and it went successful. I noticed below content of message in 'View History' for same job:
"Executed as user: XX\YYYYYYY. Microsoft (R) SQL Server Execute Package Utility Version 12.0.6205.1 for32-bit Copyright (C) Microsoft Corporation. All rights reserved. Started: 4:11:27 PM Execution ID: 7090352. To view the details for the execution, right-click on the Integration Services Catalog...."
I rechecked and confirmed SQL Server installation is 64 bit only, but why I got this message which is saying Execute Package Utility ran as 32 bit. how this is possible? I gone through below documentation of Microsoft but it doesn't say what i want to know. Also it is guiding how to run this in 32 bit env whereas I am looking for 64 bit env.
https://support.microsoft.com/en-my/help/934653/how-to-use-the-64-bit-sql-server-agent-to-schedule-a-sql-server-2005-i
can anyone please help on this, why it is showing as 32 bit bit in message? And how can I make/run it under 64 bit? will there be any consequences of it if runs under 64 bit?
Any hints, comments, guide, help will be highly appreciated.
Thanks in Advance,
Hi,
I am getting this error while I use drop down list of any db components to fetch the table name. please suggest me how to resolve this, as this is the 2nd time I am getting the error. When I first got this error, I re-installed VS 2017 and SSDT. after that it started working normally for some time and now I am getting the same error.
Hi all, since few days Excel Source in SSIS stopped working due to the following message
Could not retrieve the table information for the connection manager 'Excel Connection Manager'.
Failed to connect to the source using the connection manager 'Excel Connection Manager'
I troubleshooted for a long time and already tried several solutions found:
- set to false the Run64bitRuntime option for the project
- set the Excel version to 97-2003, 2007-2010, 2016 in Excel Connection Manager
- installed Microsoft Access Database Engine 2010 Redistributable
- installed Microsoft Access Database Engine 2016 Redistributable
- ran a repair of Office 2016 installation
- ran a repair of Microsoft Visual Studio 2017
I'm opening a new topic for this issue because none of the above attempts worked for me
The issue started about 5 or 6 days ago
I have no more ideas. Any suggestion will be appreciated
Thanks a lot
Hello Everyone-
I have folder A with 100s of text files. Below is the naming convention
ProviderName_ProviderID_PatientID_Datetimestamp.txt
I already built a SSIS package, where i get the PatientIDs from Table and match with the PatientID of the filename and move the files to Folder B.
Now my question is:
In the filename, if the ProviderID value is either 7 or 1 or 142 or 145, i dont want to move this files to Folder B. How can i write this expression or how can i update the expression in precedence constraint.
. Thanks
I have a package that uses two connection managers. One requires that an SSH tunnel is opened via Cygwin.
I currently have an execute process task that opens a cmd window and gives it the argument to open the ssh tunnel which it does successfully. The problem I am having is that I cannot get it to see the connection manager, once the SSH tunnel task is executed, is able to connect successfully.
When I run the cmd to open the SSH tunnel manually then manually test the connection manager via right-click--> edit on the connection manager it succeeds in the test. I cannot, however, get it to do this within the flow itself without me manually doing something before hand.
Things I've tried:
Tried using a Script Task to acquire the connection (using C#) This returns an error of unable to
establish connection.
Set 'Delay Validation' to True on the connection manager as well as the tasks that use this
connection manager.
Trying to figure out how to use a Script Task to add a new connection and acquire it in C# to the
already existing package. I have yet to have any positive findings from my internet searches.
What I am trying to do in the package:
1. Establish the ssh tunnel using Cygwin (works)
2. Connect to database using a connection manager that uses this newly created tunnel
(does not work)
Any help would be much appreciated.
I have a simple data flow. CSV to SQL. To keep the question simple lets say that my CSV has 5 columns and the values are 1, 2, 3, 4, 5 and that the SQL table has 6 columns called one, two, three, four, five and total.
When I run the task the row in SQL would be 1, 2, 3, 4, 5, NULL
I would like that to be 1, 2, 3, 4, 5, 15 (with 15 being the sum() of the other 5 CSV values)
I have looked at the aggregate task but cannot find a way to produce an additional extra value as the aggregates seem to want to work on a column by column basis
Hi Team,
It is possible to inactive old record and insert updated record into destination table without using staging tables in SSIS.
In my destination table am adding two more fields like Checksum and isActive.
table 1 in server 1
table 2 in server 2
Sample Data:
Table 1-
| ID | BirdName | TypeOfBird | ScientificName |
| 1 | Eurasian Collared-Dove | Dove | Streptopelia |
| 2 | Bald Eagle Hawk | Haliaeetus | Leucocephalus |
| 3 | Coopers Hawk | Hawk | Accipiter Cooperii |
| 4 | Bells Sparrow | Sparrow | Artemisiospiza Belli |
| 5 | Mourning Dove | Dove | Zenaida Macroura |
| 6 | Rock Pigeon | Dove | Columba Livia |
| 7 | Aberts Towhee | Sparrow | Melozone Aberti |
| 8 | Brewers Sparrow | Sparrow | Spizella Breweri |
| 9 | Canyon Towhee | Sparrow | Melozone Fusca |
| 10 | Black Vulture | Hawk | Coragyps Atratus |
Table 2-
| ID | BirdName | TypeOfBird | ScientificName | ChkSum | isActive |
| 1 | Eurasian Collared-Dove | Dove | Streptopelia | -431711260 | 1 |
| 2 | Bald Eagle Hawk | Haliaeetus | Leucocephalus | -930602208 | 1 |
| 3 | Coopers Hawk | Hawk | Accipiter Cooperii | -1404287439 | 1 |
| 4 | Bells Sparrow | Sparrow | Artemisiospiza Belli | 1260241452 | 1 |
| 5 | Mourning Dove | Dove | Zenaida Macroura | 1833338614 | 1 |
| 6 | Rock Pigeon | Dove | Columba Livia | 1036590421 | 1 |
| 7 | Aberts Towhee | Sparrow | Melozone Aberti | -512603321 | 1 |
| 8 | Brewers Sparrow | Sparrow | Spizella Breweri | -2032422573 | 1 |
| 9 | Canyon Towhee | Sparrow | Melozone Fusca | 664005555 | 1 |
| 10 | Black Vulture | Hawk | Coragyps Atratus | 1276845352 | 1 |
Sql update query -
update Table1 set TypeOfBird='Blk Hawk' where ID=10
OUTPUT:
Thanks Bala Narasimha
Hi Team,
It is possible to take Conditional split out put as input for sql execute task.
If it is possible please help on same.
Thanks Bala Narasimha
Hello,
I have created a stored procedure which calls a SSIS package. The SSIS package creates a file in a folder on the server. When running the stored procedure from the SSMS server, being connected with a Windows Authentication username, everything works fine.
If I run the stored procedure from Microsoft Flow, making the conection to the database with the same user as above, I am getting the error:
Export data to CSV file:Error: CSV File Destination failed the pre-execute phase and returned error code 0xC020200E.
Export data to CSV file:Error: Cannot open the datafile "\\m-.........csv".
It cannot write the file to the location, even if the user has full rights on the server.Has anyone encountered this error so far?
I have tried different solutions, but none of them worked.
Thank you.
SSIS Control Flow with FTP Task completes but Remote Server file does not update<o:p></o:p>
Hello, This is my first time setting up an FTP Task in an SSIS Control Flow in order to send files to a remote server. The remote server requires a username and password. I believe I have that setup correctly. I start the Debug and the entire Control Flow process completes without error. I check the remote server but the file has not updated with today's time stamp. What is preventing my flat file submission from replacing the remote file? Can you tell me where I might begin to look or troubleshoot with regard to the disconnect? I checked the Execution Results but that did not tell me much.I am working on a SSIS package, In which my package is always running on the server even if the folder has no files in it. I just want to only execute my package when it has files in both the folders the foreach loops are looking at.
If the folders are empty the package shouldn't be executed.
Thanks,
Minhal
Hi Team,
I have downloaded azure service pack for ssis. I used Azure downloadtask and upload task. I am able to execute both tasks fine in visual studio 2015. While deploying the ssis package into Integration services Catalog i am getting below error.
“Azurestorage” is not recognized as a valid connection manager type”.
Earliest reply will be appreciate and it will be helpful for me.
Regards,
Sarath
401 Unauthorized - Connecting to SharePoint from SSIS only if package executed using DTexec from remote server
Looks like from DTexec is using anonymous access instead integrated authentication
Need help
I am using O365, Windows 10 and Visual Studio 2017. I have installed Microsoft Access Database Engine 2016 Redistributable 64-bit. I get the error 'No tables or views could be loaded' when setting up the Excel Connection Manager. I have tried various connection strings and saving the Excel file in various versions. I have also tried setting Run64BitRuntime to true or false. I have also tried installing Microsoft Access Database Engine 2010 Redistributable and changing the connection string to earlier versions of Excel.
Please could you confirm the settings I should be using for all of the above as nothing I've tried has worked.
Hello All,
I have a script task in a for each loop container that calculates the filesize, and if the filesize is > 0 the subsequent tasks gets executed.
Here the code inside the script task is not getting executed and hence the file size is empty/0 and the control is not going to the subsequent tasks.
is this something to do the framework ? can anyone please help my solve this issue.
Thanks,
Rahul.
The separate console application works just fine and file gets downloaded through https call.
static void main() {MainAsync().Wait();}
static async Task MainAsync() {}
We can't do the async call with SSIS package script task. I was trying to find a way to make https via httpClient but always returns result error(marked in bold). Any way to fix this one? I see my script task project target framework is .net 4.5
public void Main()
{
GetData();
Dts.TaskResult = (int)ScriptResults.Success;
}
public static void GetData()
{
HttpClient client = new HttpClient();
var byteArray = Encoding.ASCII.GetBytes(string.Format("{0}:{1}", "TestUser", "TestPass"));
client.DefaultRequestHeaders.Authorization = new System.Net.Http.Headers.AuthenticationHeaderValue("Basic", Convert.ToBase64String(byteArray));
HttpResponseMessage response = client.GetAsync("https://Report/OutboundA00&format=csv").Result;
HttpContent content = response.Content;
if (response.IsSuccessStatusCode)
{
var responseContent = response.Content;
// by calling .Result you are synchronously reading the result
string responseString = responseContent.ReadAsStringAsync().Result;
//Console.WriteLine(responseString);
System.IO.File.WriteAllText("c:\\csv_outbound.csv", responseString);
}
}
Appreciate either fix the above or any other sample where I can call https url to download the data(it takes 2 minutes hence webclient wont work)
Many thanks,
Hello Team,
We are trying to pull data from Sharepoint site using SSIS ODataSource Connection Manager. But, we are facing issue with the ODataSource which is failing when we are trying to test the connection. It is giving below error message, even though the password we are giving is correct.
TITLE: OData Connection Manager Editor
------------------------------
Test connection failed
------------------------------
The sign-in name or password does not match one in the Microsoft account system. (Microsoft.SqlServer.IntegrationServices.ODataConnectionManager)
We are using SSDT Version 2017. Here is the screenshot for your reference.
Can you please let us know, what would be the issue and how to fix this.
Thanks in Advance!!
Hi Everyone,
I have a really weird issue and I am kinda stuck now. So my SSIS package does some insert in sql server and it works completely fine when I do it from BIDS. But I get error when I deploy the package to sql and run the package from the sql server. I get error:
OLE DB Destination Input has lineage ID 2006 that was not previously used in the Data Flow task.
OLE DB Command Input has lineage ID 3293 that was not previously used in the Data Flow task.Again package runs completely fine from SSIS BIDS. All mappings are perfect. Also my package use a user component that are also deployed through GAC on sql server machine. I am pulling all my hairs out at this time. I added few new columns to the table so I had to remap those in sql and then deploy the package back to SQL. Does anyone has any idea about this issue?
Thanks,
Rohit