Hi,
i need to have a daily Job which has some logic need to create and filla static table. I would like to know if i can use for a job SSIS and write this job in C#?
a) is this possible?
b) where to start :)
best regards
bog
↧
Writing C# Code for an SSIS Job?
↧
Package Configuration Wizard or Project Deployment Model
I am using SQL Server 2012 and I have multiple SSIS packages working in DEV.
My aim is to deploy these to File System for execution by a Windows Service application. Should I therefore using the Package Configuration Wizard for storing DEV and PROD server details?
Is the Project Deployment Model only required when deploying to SQL Server?
↧
↧
Continuous integration
Hi - I am looking for good resources to implement the Continuous Integration (CI) to our MSBI project using TFS. We have .sql scripts, SSIS packages and SSRS reports. I got some idea on how to build using Build defintion but unsure about deployment after build queue completed successfully. Could you please enlighten me how can I deploy them after build in TFS.
thanks
↧
How to get SSIS job metadata.
Hi Team,
On my development, test and production SQL server, there are tables/stored procedures/functions, tables, SSIS jobs pointing to SSIS packages.
From those, I need to delete unwanted things. Can someone help me to find out best way to this done. I would like to know query to get this done.
For example, query to get the details like who has created job and which package it is referring instead of doing manual check.
Any advice on this point will help me.
Thanks
↧
SISS DSN on SQL server
Newbi here,
I have been tasked to learn Cognos and want to us SSIS for building a dataware house
I have loaded Integration Services Microsoft Visual Studio on my laptop and created a package. I had to create a local DSN on my laptop for the connection manager to work. I am connecting to an AS400 so used client access for the DSN drivers. All seems good as I can see the table and data. I built a package and actually deployed to the 2012 SQL server with no errors. I configured Integration Services Catalog and put it in a new folder.
When I run it from the SQL server I get errors with the ODBC connection. So the first question is do I need to add client access to the SQL server and create a duplicate DSN? AND will I need a duplicate DSN on the SQL server for all future packages?
Or is this a 32 bit vs 64 bit thing?
Second question, are there any good diagrams of the SSIS development to implementation framework / infrastructure best practices. EG put Visual studio on developer workstation, SSIS on SQL server, ......
Thanks for any help,
Jeff
↧
↧
How to merge/replace data in a table when importing new data from csv
I have a late breaking change request from a customer where I created a basic routine to import data from a csv file into a table. They now want the ability to "update" data via the csv import. Meaning if the first 2 columns in the record from the csv match a row in the table, delete that row in the table and replace with the row from the csv file. It is literally a 3 column file/table.
CREATE TABLE [dbo].[Profile_Actuals](
[Date] [datetime] NULL,
[Profile] [varchar](4) NULL,
[Value] [real] NULL
)
GO
↧
Which problem arise Ttype guess rows registry =8 to 0 in SSIS?
already in our Production system, Type guess rows registry =8, all package are running in production and Not using IMEX=1 in Excel connection Provider.
Now my problem is:
Now I newly developed a SSIS package moving to production by changing Type guess rows registry =0 in Reg edit.and Excel Connection with
Provider=Microsoft.Jet.OLEDB.4.0;Data Source=C:\MyExcel.xls;
Extended Properties="Excel 8.0;HDR=Yes;IMEX=1"
Now Is Type guess rows registry =0 any affectto other SSIS Packages??
my guess is Problem METADATA issue will arise?
So please give clarification ??
Thanks
↧
Calculations in query taking long time and to load target table
Hi,
I am pulling approx 45 Million records using the below query in a ssis package which pulls from one DB on one server and loading the results to another target table on the another server. In the select query I have a calculation for 6 columns. The target table is trunctaed and loaded every day. Also most of the columns in the source which I used for the calculations is having 0 and it took approximately 1 hour 45 min to load the target table. Is there any way to reduce the load time? Also can I do the calcultions after once all the 47 M records loaded during query running and then calculate for the non zero records alone?
SELECT T1.Col1,
T1.Col2,
T1.Col3,
T2.Col1,
T2.Col2,
T3.Col1,
convert( numeric(8,5), (convert( numeric,T3.COl2) / 1000000)) AS Colu2,
convert( numeric(8,5), (convert( numeric,T3.COl3) / 1000000)) AS Colu3,
convert( numeric(8,5), (convert( numeric,T3.COl4) / 1000000)) AS Colu4,
convert( numeric(8,5),(convert( numeric, T3.COl5) / 1000000)) AS Colu5,
convert( numeric(8,5), (convert( numeric,T3.COl6) / 1000000)) AS Colu6,
convert( numeric(8,5), (convert( numeric,T3.COl7) / 1000000)) AS Colu7,
FROM Tab1 T1
JOIN Tab2 T2
ON (T1.Col1 = T2.Col1)
JOIN Tab3 T3
ON (Tab3.Col9 =Tab3.Col9)
Anand
↧
Derived column conversion to Excel
My Ole DB query runs several functions that return decimal fields. My user wants these fields as numbers (simple) but also wants nulls to print if that's what the function returns. Since Excel doesn't know what to do with Nulls, I provide the string NULL for three other alpha fields as shown, but I can't seem to satisfy both Excel and the data. Can someone assist me with the right way to write the conversion routine for the decimal fields?
↧
↧
Suddenly started getting error: Unable to start program 'DTS' when try to execute SSIS Package
Me and my team member suddenly started getting following error when try to execute SSIS Package in SSDT (VS 2010)
I searched everywhere but virtually no information available about this Error. Anyone has suggestion on how to fix this error?
NOTE: Tried to execute package from command line and it works...
------------------------------------------------
Error starting debugging.
------------------------------------------------
ADDITIONAL INFORMATION:
Unable to start program 'DTS'.
Operation not supported. Unknown error: 0x80040038. (Microsoft Visual Studio Debugger)
------------------------------
Thanks,
Nayan
<a href="http://binaryworld.net/blogs"> Visit My Blog</a>
↧
How to connect SSIS to Salesforce
Hello,
I read about use of -
1.DBamp to connect salesforce from ssis and import data.
2. Export from salesforce to CSV and then import that into SSIS
Are there any other ways of importing / connecting, Any suggestions or ways to achieve this .
Thanks,
Amit
↧
SSIS Version issue running on command line
I have a Project created in VS2010 that I want to run on SQL2012. The Project deploys to SSMS2012 fine. Runs without error. I converted the Project to a package so I can run it from the command line. When I run it from the command line I get an error that says it is an older version. XML says package format 6 but when I run it on the command line it thinks I am trying to run it against 2008 which is 3 but I am not.
This server was a 2008 server that was upgraded. Is it possible that there is a dll or something that was not upgraded that make it still think it is a 2008? If so what is it and how do I change it? Could it be just a path issue. I have to run it from a particular path. I am running it from the default path location in users.
↧
Sqlserver 2012 Replication
Hi Friends,
I want to inquire microsoft offering any tool for configuration and monitor sqlserver replication.
thank you.
regards,
asad
asad
↧
↧
parallel processing of data from single source table to single Destination table
Hi,
I want to process multiple ID same time and insert and update in single destination table, but I get deadlock problem.
What is the best practices of parallel processing?
Regards,
Manish
↧
SSIS DB
I am using SQL server 2014. I have SSISDB catalog.
Even though the server wide default logging level is set to "NONE", the operation log is getting big and the size of SSISDB is getting big.. I thought NONE options do not keep any logs?? .. I have set the retention period to 5 days..
and SSIS maintenance job takes forever... deleting records very slowly.. is it some kind of Bug? I know there is bug fix for this issue in SQL server 2012 but I didn't see anything related to SQL server 2014. Anyone has the same issue? how can I keep the SSISDB size minimum and run SSIS maintenance job faster in 2014?
Thanks
Even though the server wide default logging level is set to "NONE", the operation log is getting big and the size of SSISDB is getting big.. I thought NONE options do not keep any logs?? .. I have set the retention period to 5 days..
and SSIS maintenance job takes forever... deleting records very slowly.. is it some kind of Bug? I know there is bug fix for this issue in SQL server 2012 but I didn't see anything related to SQL server 2014. Anyone has the same issue? how can I keep the SSISDB size minimum and run SSIS maintenance job faster in 2014?
Thanks
↧
Adobe Acrobat xpro with integration services?
Hello i need help. Anyone who knows how i can make to call adobe acrobat using integration services? Thanks.
↧
Checking SSIS variable of Object data type for NULL Value
Hello, everyone,
In my SSIS package, I have a variable FilesInfo of Object data type that gets its values from the Full Result Set from an Execute SQL task, which may or may not return any results. I have a Foreach loop container to do further processing. If the values are not null, the package executes successfully. However, it throws an error when nothing returned fromthe SQL task.
To fix this, I want to add a Precedence Constraint to direct the flow only when FilesInfo is NOT NULL. Is there a way to do it? And if so, what is the exact syntax?
Thank you for your help in advance.
Regards
↧
↧
DW on Open source platform
My company is using MS BI stack (SSIS, MS SQL Server, SSRS) for DW. We'd like to take the entire process to something which is open source and
efficient platform. What are our options here? Can Python, Hive, Tableau be useful in this case? Sorry for my limited knowledge, but is Hive a DBMS system similar to SQL server??
↧
SSIS Excel to sql import : First 10 rows in excel have column names
Hi,
I am loading one excel file into sql table, Here i am facing problem with the excel source file.
My excel file contains column names in first 10 rows and next to that cell have rows info.
Starting from 'TableName' to 'Partition column' are column names in sql table and next to that cells are values for those col's.
Now i need to export this data into sql tables : Rows as col's and respective values as rows from Excel.
Also, this file have multiples sheets , i want to load 3rd sheet and save the sheet name in variable
Can anyone help me on this??
↧
Connexion entre Power Bi Designer et l'as400
Bonjour,
J'aimerais me connecter a mon as400 mais je n'y arrive pas .
Avez vous une idée.
Merci d'avance de votre compréhension
Didier
↧