I need a way of detecting if a data source (mdb file) contains a column or not. I have a data source being downloaded every 5 minutes and sometimes it will contain a column called FlareT and sometimes it will not.
If the source contains the column FlareT I execute one task else I execute a different task.
I think this can only be done using a script component?
HI,
We are planning to move some database from Old drive to new drive and we are going to decommission the old drive.
we have more than 200 package in that same server but msdb is placed in C drive. My question is we already deployed all package in integration service but we are going to remove my old drive so it will affect my package
Thanks,
karthik B
We have developed several packages with Oracle Attunity connection (Project level connection). While we deploy this package using SQL server agent the job when runs it fails. This is due to the password is NULL for oracle connection. Our package protection level property is SaveSensitiveDataWithUserKey.
So at this moment what is the correct method to deploy the packages to make it run via SQL server agent.
Sarvan
Hi,
Why this task is not able to put in order my columns???
The order desired (for my plain file as output) is:
As you will see in my query the columns are placed as desired but then metadata columns list dismiss that.
is it for these columns are hardcoded strings??
Thanks for your help
Hello all.
I'm having a problem with one of my SSIS drivers (Progress 9.1D) since installing Oracle Data Tools And Attunity 2.0.
The problem is, when I try to 'Preview' the data in the ODBC source task (connected to a source via the Progress 9.1D driver) I get the error:
"Unable to cast COM object of type 'Micorosoft.Sqlserver.Dts.Pipeline.Wrapper.CManagedComponentWrapperClass' to interface
type 'Attunity.IntegrationServices.DataFlowUI.ODBCUI.IAttunityConnectionODBC'. This operation failed because the QueryInterface
call on the COM component for the interface with IID '{AD1F8A0A-7C00-4310-9FCC-D208D8980655}' failed due to the following error:
No such interface supported (Exception from HRESULT: 0x80004002 (E_NOINTERFACE))."
Anyone know what this means or how I might get rid of it?
Attunity seems to work fine.
Thanks in advance,
Robert
When I run a SSIS package to do a full processing of a SQL 2016 Tabular Model deployed on SQL 2016 with compatability set to 1200, it fails and gives me the following error:
"[Analysis Services Execute DDL Task] Error: This command cannot be executed on database 'TabularDatabaseName' because it has been defined with StorageEngineUsed set to TabularMetadata. For databases in this mode, you must use Tabular APIs to administer the database."
How do I change the StorageEngineUsed to the Tabular API's so that the I can process it correctly?
When manually processing this model within SSAS, it works 100% correctly.
Hi All,
I am doing an automated deployment of ispac files into SSIS catalog with SSISDB.catalog.deploy_project
I have 1 sensitive package parameter into my project which i will bind it with environment-variable-sensitive from catalog.
What project and package protection should i pick to adapt this?
- If you pick Do not save sensitive data and deploy – you can run the project fine from the catalog using environment and sensitive variable bind to the package parameter but not from SSDT (GetSensitiveValue() returns empty)
- If you pick Encrypt sensitive data with user key – work well in SSDT but it doesn’t decrypt in the catalog
a a If I go with Encrypt sensitive data with password - will work in SSDT but it won't in the catalog since deploy_project doesnt have a password parameter on deployment as far as i saw
a Any suggestions?
I have a PowerShell script that deploys an SSIS project to SSISDB. It works fine for projects using DontSaveWithSensitive protection but fails for projects using EncryptAllWithPassword.
The message in SSISDB.internal.operation_messages is "Failed to deploy the project. Fix the problems and try again later.:The encrypted data in project manifest failed to load. The project manifest is corrupted or if the project is password protected, the specified password is incorrect." (id=380696).
The code I use reads the isPac file, then deploys the project:
[byte[]] $projectFile = [System.IO.File]::ReadAllBytes($isPac)
$project = $folder.DeployProject($proj, $projectFile)
(This code fragment shows up in most examples I have found.)
The DeployProject() method fails. It does not appear to have a mechanism for accepting the password required to perform the decryption.
Any ideas on how the SSDT deployment wizard handles this? Or other strategies?
Thanks.
I have a specific task and trying to figure out a solution ..
I have a client folder that gets loaded with an excel file for every month. It has multiple sheets but I need to pull just 1 sheet(same columns) from every excel file and load in to a same table.
Every sheet has 2 columns (State and Col2).
Month1
STATE | COL2 |
TX | .62 |
PA | .82 |
VA | .92 |
Month2
STATE | COL2 |
TX | .22 |
PA | .32 |
VA | .42 |
and so on..
Col 2 is the percentage column which I need to load to database to calculate average on that column and report.
Can you please guide how to perform this task.
Thanks in advance
Hi all
I'm using SSMS 2012 sp1 BI ed., and I got some troubles during the execution of packages.
Sometimes I have the "Unexpected Termination" message and looking into the app log i got:
"Log Name: Application
Source: SQLISServer
Date: 17/09/2013 5:03:11
Event ID: 1
Task Category: None
Level: Error
Keywords: Classic
User: N/A
Computer: AKTWDB01.Aktua.local
Description:
Service Control
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="SQLISServer" />
<EventID Qualifiers="0">1</EventID>
<Level>2</Level>
<Task>0</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2013-09-17T03:03:11.000000000Z" />
<EventRecordID>174537</EventRecordID>
<Channel>Application</Channel>
<Computer>AKTWDB01.Aktua.local</Computer>
<Security />
</System>
<EventData>
<Data>Thread was being aborted.; at System.Data.SqlClient.TdsParserStateObject.get_Status()
at System.Data.SqlClient.TdsParser.Connect(ServerInfo serverInfo, SqlInternalConnectionTds connHandler, Boolean ignoreSniOpenTimeout, Int64 timerExpire, Boolean encrypt, Boolean trustServerCert, Boolean integratedSecurity)
at System.Data.SqlClient.SqlInternalConnectionTds.AttemptOneLogin(ServerInfo serverInfo, String newPassword, Boolean ignoreSniOpenTimeout, TimeoutTimer timeout, SqlConnection owningObject)
at System.Data.SqlClient.SqlInternalConnectionTds.LoginNoFailover(ServerInfo serverInfo, String newPassword, Boolean redirectedUserInstance, SqlConnection owningObject, SqlConnectionString connectionOptions, TimeoutTimer timeout)
at System.Data.SqlClient.SqlInternalConnectionTds.OpenLoginEnlist(SqlConnection owningObject, TimeoutTimer timeout, SqlConnectionString connectionOptions, String newPassword, Boolean redirectedUserInstance)
at System.Data.SqlClient.SqlInternalConnectionTds..ctor(DbConnectionPoolIdentity identity, SqlConnectionString connectionOptions, Object providerInfo, String newPassword, SqlConnection owningObject, Boolean redirectedUserInstance)
at System.Data.SqlClient.SqlConnectionFactory.CreateConnection(DbConnectionOptions options, Object poolGroupProviderInfo, DbConnectionPool pool, DbConnection owningConnection)
at System.Data.ProviderBase.DbConnectionFactory.CreatePooledConnection(DbConnection owningConnection, DbConnectionPool pool, DbConnectionOptions options)
at System.Data.ProviderBase.DbConnectionPool.CreateObject(DbConnection owningObject)
at System.Data.ProviderBase.DbConnectionPool.UserCreateRequest(DbConnection owningObject)
at System.Data.ProviderBase.DbConnectionPool.GetConnection(DbConnection owningObject)
at System.Data.ProviderBase.DbConnectionFactory.GetConnection(DbConnection owningConnection)
at System.Data.ProviderBase.DbConnectionClosed.OpenConnection(DbConnection outerConnection, DbConnectionFactory connectionFactory)
at System.Data.SqlClient.SqlConnection.Open()
at Microsoft.SqlServer.IntegrationServices.Server.ProcessCrashHandler.PackageExecutionHandler(Object sender, EventArgs e)</Data>
</EventData>
</Event>"
AND
"Log Name: Application
Source: SQLISServer
Date: 17/09/2013 5:03:11
Event ID: 1
Task Category: None
Level: Error
Keywords: Classic
User: N/A
Computer: AKTWDB01.Aktua.local
Description:
Service Control
Event Xml:
<Event xmlns="http://schemas.microsoft.com/win/2004/08/events/event">
<System>
<Provider Name="SQLISServer" />
<EventID Qualifiers="0">1</EventID>
<Level>2</Level>
<Task>0</Task>
<Keywords>0x80000000000000</Keywords>
<TimeCreated SystemTime="2013-09-17T03:03:11.000000000Z" />
<EventRecordID>174536</EventRecordID>
<Channel>Application</Channel>
<Computer>AKTWDB01.Aktua.local</Computer>
<Security />
</System>
<EventData>
<Data>The Integration Services process (Process ID 5296) for operation 100681 (GUID:14f3ffba-770c-4a39-9bd4-d08fd0a547bd) terminated because the AppDomain 22 is unloaded. Try restarting the execution.</Data>
</EventData>
</Event>"
Does anybody knows how to solve it or how to manage it?
Thanks!
I want to lookup an id from a dim using a lookup transformation and there is fromdate and todate within the dim, so I want to pass a date from the source and do a between lookup on the fromdate and todate within the lookup transformation. Because you have to supply it with parameters in the lookup I cant get it to use the single source date and do a between in the lookup.
At the moment it is only possible to do a single mapping against the source column, Can you suggest a way do a between ?
Hi,
Requirement : I need to design Integration services packages to load incremental data. I am thinking of following strategy Please suggest the best approaches among this and let me know in case of an alternate way.
Approach 1: I will create a table "Last Run Info", this table contains table name and last run date for the table.
In the source task we will use this value to select those record where date is greater than this date.
Ex:- Select * from SourceTable where date >= {LastRundate(paramter)}
This table will be updated after every successful execution of package.
Approach 2: I will get the MAX date from the destination table and use it to select those record where date is greater than this date.
Ex:- Select * from SourceTable where date >= (Select MAX(DateModified) from DestinationTable)
Approach 3: Using lookup or merge join or something to compare combination of multiple fields values between source and destination table and insert the new value and modify the existing records. (this is a bad approach as size of the source and destination is very huge).
Please suggest the best approach from the above or any alternative approach.
Hello Everyone,
Please could you let me know, how I can extract the data from SAP using SSIS. I have a requirement from customer in which I need to extract data from their SAP server with oracle as backend. But they do not want me to directly connect to their oracle tables due to some licence issue. I have checked some forums in which data provider for .net data provider for mySAP business suite is used. I have tried downloading this connector but it is only available for SQL server 2008 and I have SQL server 2012 r2 enterprise. So what is the best method to extract the data directly from SAP.
Thanks,
Abhishek
I have this VB Script that works with an SSIS package. It runs the SSIS package and inputs the dates based on the value that is returned- "W" for week or "M" for month, it then puts the start and end date of either the month or week into an access table. I did not create this but I am trying to move the whole SSIS package over to a new server that is a Windows Server 2008 R2 64 bit operating system.
Below is the original Script I have tried everything to get this up and running and I am not sure what else to try.
I have tried to change the dates in SSIS but have not been able to find a way, I have tried to convert this to a VB.net file and run it, and that has not worked, I have tried altering the connection to every kind imaginableand I have looked up switching it a bat file... Any other ideas?
If I could at least populate the dates in access that would great and I could figure out what to do from there. The dates are needed first at the SSIS package uses them when it runs!
Thanks!
'#################################################
WEEKLY version
'#################################################
Dim varPath
'#####SET SSIS PACKAGE PATH#####
varPath = "\\C:\Package.dtsx"
'###############################
'#############################
IsThisMonthOrWeek = "W"
'#############################
'###CALL SUB###
PopulateMonthWeek
'###############
Set WshShell = WScript.CreateObject("WScript.Shell")
ReturnCode = WshShell.Run("%systemroot%\Syswow64\cmd.exe /C C:\Program Files (x86)\Microsoft SQL Server\100\DTS\Binn\dtexec.exe/FILE """ & varPath & """ /MAXCONCURRENT "" -1 "" /CHECKPOINTING OFF /REPORTING EWCDI ")
'#########################################################################################
SUB PopulateMonthWeek
set con = createobject("ADODB.Connection")
dbPath = "C:\dealer.mdb"
conString = "Provider=Microsoft.Jet.OLEDB.4.0;Data Source=" & dbPath & ";User Id=admin;Password=;"
con.open conString
IF IsThisMonthOrWeek = "W" THEN
con.execute "update tbl_startEndDates set weekOrMonth = '" & IsThisMonthOrWeek & "', startDate = '" & getFirstDayOfMonth & "', endDate = '" & getLastDayOfMonth & "'"
ELSE
con.execute "update tbl_startEndDates set weekOrMonth = '" & "W" & "', startDate = '" & Date() - WeekDay(Date())-6 & "', endDate = '" & Date() - WeekDay(Date()) & "'"
END IF
con.close
set con=nothing
END SUB
FUNCTION getFirstDayOfMonth
valMonth= month(now())-1
valYear= Year(now())
if valMonth = 1 then
valMonth = 12
valYear = valYear-1
end if
getFirstDayOfMonth = valMonth & "/1/" & valYear
END FUNCTION
FUNCTION getLastDayOfMonth
valMonth= month(now())-1
valYear= Year(now())
if valMonth = 1 then
valMonth = 12
valYear = valYear-1
end if
din = valMonth & "/1/" & valYear
getLastDayOfMonth = dateserial(year(din),month(din)+1,0)
END FUNCTION
I am trying to make a job for automatic transfer from access database to ms SQL server. I made a package in SSIS and when I run it manually it completes, but when I starts it via job it fails I guessed it may be from proxy so i made credential and proxy to run the package, but it fails again. Could you please give me an idea how I can resolve that problem.
Hi All,
I need to load data from fixed width flat file to sql server table. The table screenshot is given below. There's blank data for LastName field in my flat file.
I'm able to load the data to sql server as blank space but I need to load it as NULL value. Here's the package.
Please see the expression in the derived column.
Then the data type of expression became Unicode String. Then I tried to connect DerivedColumn task to OLEDB destination, but it showed an error message."LName cannot convert between Unicode and Nonunicode". So, I have added data conversion task to convert DTWSTR to DTSTR. Then I connected it to OLEDB destination. And it worked without any error. But, still the data loaded as blank space , not as NULL value.
Thanks,
Julie
Hi, I m trying to connect to Integration services from my local machine SSMS but its giving me error Below. Looks like its pretty common error and the resolution is something mentioned here which I already tried with no luck:
http://stackoverflow.com/questions/24885641/ssis-error-0xc00160ae-access-is-denied
It works fine if I add the user under administrators group but we don't want to add everyone under that group.
any thoughts? Thanks for the help!