HI I got a Date column with blanks and incorrect format
I ran the query
Select * from StagingI am getting only null values. some OF the date format is not in correct format.
2012-05-01
27/05/2012
07MAY2014
19/07/13
How can run query that will show me null and incorrect date format
How to build logic in SSIS that can choose a date value by comparing the project parameter value and the date obtained from a sql task.
Project parameter "ParmDate" is an Integer yyyymm = 999999
Sql task query
select cast(convert(varchar(6),DATEADD(month, -6, getdate() ),112) as Int) as SqlDate
Choose date
If ParmDate = 999999
then pass SqlDate
else pass ParmDate
Questions
What task do I use to do the if logic.
How should the Sql Task be configured to pass the output values from the above query.
Hi,
I had recently upgraded SSDT to 15.8.2 as well as SSIS to 2.0. However, my packages that contain the Oracle Source are not longer being loaded. Error as below, any ideas?
Severity Code Description Project File Line Suppression State
Error Validation error. WF_PCD_POLICYCLAUSESDTL: WF_PCD_POLICYCLAUSESDTL: The component metadata for "Oracle Source, clsid {ADD1F766-6414-4995-AF01-83C5B7AFC90C}" could not be upgraded to the newer version of the component. The PerformUpgrade method
failed. EG Extract - MGA.dtsx 0
Kind regards
Coby
Hi,
We have migrated SSIS packages from 2008 R2 to VS 2017 SSDT with SQL server 2016
how can we overcome below warnings, though the package executes successfully.
------------------------------------------------------------------------------------------------------------------
Found SQL Server Integration Services 2008 Script Task "ScriptTask_d947e38d166847a6a48c583961bbc309" that requires migration!
-------------------------------------------------------------------------------------------------------------------
Hi,
I have an EBCDIC file and I am trying to load it using SSIS.
I created a flat file connection manager, changed the Code page to 1140 (IBM EBCDIC - U.S/Canada (37 + Euro))
When I load the data all my data is loading with special characters. Any help on this, please?
FYI... Pics loaded below for reference:
FYI... I can provide the file if needed since it is a public file and no private data is there in it.
Some data looks good in the Preview mode but when I drag little far it looks weird again.
For the same files running on the same packages that we have developed here in our project, we are hitting this null reference exception when it is being run on the server.
We built SSIS packages for Dynamics CRM. Error screenshot below.
Any ideas where to start checking? seems like the error is not coming from our codes.
Hi All,
I have a set us like this below:
While inserting value to the variable var_processed_files, the string is getting truncated if it is more than 4000 characters. Im using SSIS 2012. Please help if there are any workarounds.
Hi Team,
I have a situation. I have 4 csv files in 1 folder. I want to move each file to specific folders . File Names and Folder names are static.
I want to it in very easy way with minimum variables .
e.g. M:/Abhi a.csv , b.csv , c.csv, d.csv
I want to move a.csv in M:/A , b.csv in M:/B , c.csv in M:/C , d.csv in M:/D
Actualy i need to do this task for 4 different environment say Dev, prod, UAT and i dont want to create so many variables.
Thank you... Need your expertise.
Regards
Shaky
Shakky
Hi all, I'm trying to load a file .csv that has a column with a text containing commas. The text is between double quotes, but on the HDFS File Source there are no properties about quote identifiers, it is possible to set only the column delimiter.
This is weird.
I know that I can copy the file locally and use a flat file connection, but I would rather not do it...
Hello,
I am trying to open a SSIS project from the TFS which returns with the error
"there is an error in XML document (986, 10)" in VS 2015, I have no idea why it is coming though and what to check within.
After ignoring the errors the project shows nothing just PROJEC Name(Load failed) and I can not even reload the project.
Doubt: There is one Oracle connection manager defined which i have no access to, But i need to use different connection
to which i have access.
Would appreciate help!!
Dilip Patil..
I have concerns about multipel column delimiters in single file. How can manage it? Please give yours feedback on this.
Ex:
1;;;; ABC;;XYZ12;;;;00000
Hi,
I'm trying to access to the SSIS 2017 Server present on a dev machine where I have the sysadmin role in SQL Server and I belong to the machine administrators, but I've this error:
Any suggests to me, please? Thanks
Hi,
I'm trying to deploy a SSIS solution using the project deployment model but I obtain this error:
Any ideas to solve this issue, please? Many thanks
Hi,
I have two packages:
Package ONE pulls data from source (cloud) to destination (on-prem):
a) Unecrypted tables go to DB1
B) Encrypted tables go DBstg
Package TWOdecrypts data from DBstg to DB1 (within the same instance)
Each package has a sequence container. Inside each sequence container, there are about 16 Data Flow Tasks. Inside each Data Flow Tasks, there are 8-10 tables. The way the package works is: First it gets max date from destination then gets max date from source. After this, it will compare between source and destination tables then it replicates the difference ... SELECT * FROM TABLENAME WHERE (Date > ? and Date <=?). Once replicatiOn is done, it decrypts from DBstg to DB1.
The problem is sometimes, the package fails after after half the tables are populated from the source to the destination or half of the tables are dcrypted from DBstg to DB1. half of the load is done.
The following are not an option:
My question is, how do I go about implementing a method to delete records
My question is, how do I go about implementing a method to delete records when the packages fails half way after records are inserted into half of the tables? The option to use Script Task inside Data Flow Task is not available. I see OLE DB Command
but it does not look like I can use as much as I can use Script Task to update a table.
Any help really appreciated!
Thanks
IN~
how to connect with project online data using the ODATA connector it hasmulti factor authentication..Because I didn't find any option to use the multi factor authentication and it is giving error when I am trying with basic authentication.
Please help me is there any way to connect ODATA connector using multi factor authentication, if not suggest any work around approach to load the Microsoft project online data into Sql server.
Hi,
I'm looking for a solution when we have dynamic columns in the source file to load to a database. I found multiple solutions but I have chosen the below since I have not much exposure to C#.
https://social.technet.microsoft.com/wiki/contents/articles/29153.ssis-importing-flatfiles-with-varying-number-of-columns-across-rows.aspx
But, I ddidn't understand the second approach mentioned in this. Mainly, how can I get 2 outputs from aggregate function.
Thank You
Julie
Hi All,
I need to update records based on Items by priority.
1.column5
2.column6
3.column7
Items are ranked by priority. If 1 is missing then move to 2 then to 3.
I have already an SSIS which runs sucessfully to bring latest data from source to destination for few columns.
SSIS Package is
ole DB source - > lookup transformation -> ole DB command.
Using below condition in lookup transformation
WITH cte_latest AS (SELECT [column1_id], [column2_id], [column3_id], [column4_id], [column5_id], [column6_id], [column7],row_number() OVER (partition BY column7 ORDER BY column6 DESC) Rn
FROM [dbo].[source] WITH (nolock)
WHERE column7 IS NOT NULL AND column7 != '0' ) SELECT *
FROM cte_latest
WHERE rn = 1
Now I need to bring the data into destination based on Items priority but it should avoid duplicates.
Thanks for your help in advance
Thanks, Naga