Hi Guys,
Anyone with good videos and links on how best to optimize an sql query. I have a complex query that I need to improve performance on and I need a resource to guide me on it.
me
Hi Guys,
Anyone with good videos and links on how best to optimize an sql query. I have a complex query that I need to improve performance on and I need a resource to guide me on it.
me
Hi All,
I have a package that loads the data from flat file to a sql server table . It is failing on a column name. I opened in notepad++ and went to the row number and saw that the address has quotes in it
"123 MAIN ST APT "B""
What i did was in the file connection manager i changed the text qualifier from " to <none>. Now no issues package runs fine but the data in the table is enclosed in quotes.
Is there a way i can remove those extra unwanted quotes please?
Thanks
Hi,
I want solution in SSIS, for below query.
In my source table for column "Contact" data is 111222333 (Varchar data type).
I want change that string into destination "Contact" column as 111-222-333.
Please suggest.
We have a SSIS package that pulls data from multiple data sources.
So, the ssis package has Execute SQL task that feeds the list of SQL Servers to be used a data sources.
The second step is For Each Loop that has data flow task. The Source Connection manager is expression based with servername as variable.
This works fine the only issue is, if the data source is not available, I do not want the package to fail but rather log that error and continue processing other data sources.
Any thoughts how to make the package continue processing other data source without failing the package, if one of them is not accessible.
Hope it Helps!!
I recive the following error message trying to deploy a SSIS project from VS2010 to SQL SERVER 2012.
A .NET Framework error occurred during execution of user-defined routine or aggregate "deploy_project_internal":
System.ComponentModel.Win32Exception: A required privilege is not held by the client
System.ComponentModel.Win32Exception:
at Microsoft.SqlServer.IntegrationServices.Server.ISServerProcess.StartProcess(Boolean bSuspendThread)
at Microsoft.SqlServer.IntegrationServices.Server.ServerApi.DeployProjectInternal(SqlInt64 deployId, SqlInt64 versionId, SqlInt64 projectId, SqlString projectName)
. (.Net SqlClient Data Provider)
I change the SQL servers account to use a local admin account that is a member of local administrators , and have added the SQL server account to DCOM Config “Microsoft SQL Server Integration Services 11.0,” node security as per Peter instructions , however still cannot deploy a project get the some error message.
Please advice.
The SSIS 2016 service (MsDtsSrvr.exe) is causing the error detailed below to be logged in the server's application log every 5-10 seconds. I have been unable to figure out what the actual issue is and how to stop it. The error is logged even when no packages are being run. I thought it might have something to do with .Net framework automatic debugging and so i tried to exclude the process from automatic debugging (https://docs.microsoft.com/en-au/windows/desktop/Debug/configuring-automatic-debugging#related-topics) but this had no impact.
While this doesn't appear to be causing any actual issue I thought it best to stop thousands of these errors being logged. Any assistance would be appreciated.
Log Name: ApplicationHello there. Ignoring any discussion of 'coding it right in the first place' (I have my reasons)….I have an SSIS package that loops through a task and sometimes it fails and other times it doesn't.
I've got it functionally working, i.e. errors are ignored, parents + package succeed (as designed) but I can't seem to supress the error logs.
Is there a way to stop these logs?
Thanks.
Hi all,
I'm trying to make a dtsx package to read some Excel files from a Sharepoint document library. This library has some folders inside. I have
to read only files in one of these folders. I installed the Sharepoint List Adapter from Codeplex. How can I get the list of Excel
files that are in this folder I'm interested in? In the Sharepoint List Source I can set only the Site URL and the list name (the name of the document library), but so I only can get the name of the folders in the library.
Thank you in advance!
Hi,
I've implemented a SSIS 2017 package having a merge transformation and an aggregate transformation.
In the aggregate transformation I've specified a group by operation for a DT_WSTR code and a count distinct for the same code.
In the merge join transformation as join Keys I've specified the code from the aggregate transformation, on the right side, and the equivalent code on the left side: for a specified value for the matching code no values are returned from the right side (aggregate transformation). I've queried the corresponding source table and I can see that the two codes match rightly.
How can I solve this issue? Can I use an aggregate transformation before a merge transformation? Is there a bug? Thanks
Obviously, I've ordered the two sources for the merge join transformation.
I am having a problem with a SSIS Project in the SSIS Catalog. When I schedule the package to run, I get an "Unexpected Termination" error.
If I look in the event viewer, I get the following error:
The SSIS Execution Process could not write to the IS catalog: SERVER:SSISDB Error details: Cannot find the symmetric key 'MS_Enckey_Proj_Param_13', because it does not exist or you do not have permission
If I check sys.symmetric_keys, this key does not exist.
If I check sys.certificates, I can see a certificate name MS_Cert_Proj_13, but no certificate named MS_Cert_Proj_Param_13.
We have recently upgrade the servers to SQL 2014 CU4 from SQL2012. All the other projects that are working fine were created on SQL2012 and uploaded then. This is the first project deployed since the upgrade.
I have created a new solution, recreated the parameters and copied the package into this solution. I then built this and deployed it with the same results.
Any one seen similar or know how to fix this?
Thanks
Hi guys,
I am creating an SSIS package that loads data from MSSQL table into a text file. One of the requirement is for the size and position of the data in each column in the text file to be the same.
For instance, if the result of the query is shown as below:
ProductID ProductName ProductColor ProductCategory
1 Tesla Black Car
2 Samsung White Mobile Device
3 Acer Grey Laptop
The requirement is that for each of the rows returned from the table, the column position on each row should be:
ProductID: 1-4
ProductName: 5-20
ProductColor: 21-35
ProductCategory: 36-50
So in the case of ProductID, there should be 3 spaces before the ProductName since the length is one.
I will greatly appreciate any assistance on this.
Thanks
me
Hi ,
We are facing the issue called - unexpected Termination .
We are using the below mentioned SQL Server :
Microsoft SQL Server 2016 (RTM) - 13.0.1601.5 (X64)We have already done the below investigations :
1) We have investigated the SSIS Catalog DB standard reports ( all executions ) and found the fail job's status as unexpected Termination. We have checked warning messages in the report but there are no such messages being reported .
2) We have made the recovery model of the SSIS DB to simple , but the same problem exists.
3) While doing the investigation of the windows event viewer we have got the below information -
GENERAL:This looks similar to the earlier reported issue :
https://connect.microsoft.com/SQLServer/feedback/details/774370/ssis-packages-abort-with-unexpected-termination-message
Please help .
Thanks & Regards,
Abhisek
Abhisek Mondal
Hi All,
I am using below sql query to read data from a json file and load data into table. I am using Execute SQL task to execute the query. I want the file path to be stored in a variable. How can i do it in SSIS?
Hi All,
I am using below sql query to read data from a json file and load data into table. I am using Execute SQL task to execute the query. I want the file path(C:\Users\SYED\Desktop\Practice\generated.json) to be stored in a variable. How can i do it in SSIS?
DECLARE @EMPLOYEEDETAIL VARCHAR(MAX) SELECT @EMPLOYEEDETAIL = BULKCOLUMN FROM OPENROWSET(BULK'C:\Users\SYED\Desktop\Practice\generated.json',SINGLE_BLOB) JSON --SELECT @EMPLOYEEDETAIL IF (ISJSON(@EMPLOYEEDETAIL) = 1) BEGIN --PRINT'JSON FILE IS VALID' INSERT INTO [dbo].[EmployeeDetails] SELECT * FROM OPENJSON(@EMPLOYEEDETAIL,'$.EmployeeD.Employee') WITH ( NAME VARCHAR(100) '$.name', Gender Varchar(100) '$.gender', Company Varchar(100) '$.comapny', email Varchar(100) '$.email' ) END
Regards
Syed Faiz
Hello, I have problem execute sql task. when click on BUILD QUERY, show login failed.
I have no problem to use connection manager to login to the database connection.
the error is only when click on BUILD QUERY, out put LOGIN FAILED, but login and password is righ when test connection on manager manager.
Please Help. thanks
Hi I have a csv file with the columns as below. The column names and order of columns can be changed.
DeptID|Dname|Loc or DeptName|Dept_id|Location or Loc_ID|Dept_ID1.
I got a requirement that if the column comes with different names I need to check the combination , if any of the value matches, I need to add the columns in insert statement.
For this I have created a table as
Actual Table Structure is Dept is the tablename (DeptId int,Dname VARCHAR(50),Loc VARCHAR(50))
By using Deptconfig Table How can I achieve my requirement.
Please let me know if I miss some thing.