Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live
↧

Do you want to be acknowledged as SQL Server Integration Services Guru? Submit your work to May 2020 competition!

May 3, 2020, 2:01 am
$
0
0


What is TechNet Guru Competition?

Each month Microsoft TechNet Wiki council organizes a contest of the best articles posted that month. This is your chance to be announced as MICROSOFT TECHNOLOGY GURU OF THE MONTH!

One winner in each category will be selected each month for glory and adoration by the MSDN/TechNet Ninjas and community as a whole. Winners will be announced in dedicated official post in the Microsoft Blog and a links will be published atMicrosoft community Wiki group on Facebook, and other acknowledgement from the community will follow.

Some of our biggest community voices and many MVPs have passed through these halls on their way to fame and fortune.

If you have already made a contribution in the forums or gallery or you published a nice blog, then you can simply convert it into a shared wiki article, reference the original post, and register the article for the TechNet Guru Competition. The articles must be first published during May 2020 and must be in English. However, the original blog or forum content can be from beforeMay 2012.

Come and see who is making waves in all your favorite technologies. Maybe it will be you!

Who can join the Competition?

Anyone who has basic knowledge and the desire to share the knowledge is welcome. Articles can appeal to beginners or discuss advanced topics. All you have to do is to add your article to TechNet Wiki from your own specialty category.

How can you win?

  1. Please copy/Write over your Microsoft technical solutions and revelations to TechNetWiki.
  2. Add a link to your new article on THIS WIKI COMPETITION PAGE (so we know you've contributed)
  3. (Optional but HIGHLY Recommended) Add a link to your article at the TechNetWiki group on Facebook to get feedback and tips from the Microsoft Community council members, from the Judges, and from the community. The group is very active and the members simply love to help. You can even get direct improvements to your article before the contest starts.

Do you have any question or want more information?

Feel free to ask any questions below, or Join us at the official MicrosoftTechNet Wiki groups on facebook. Read More about TechNet Guru Awards.

If you win, people will sing your praises online and your name will be raised as Guru of the Month.

PS: Above top banner came from Arul Mouzhi.

Please Mark This As Answer if it solved your issue
Please Vote This As Helpful if it helps to solve your issue
Visakh
----------------------------
My Wiki User Page
My MSDN Page
My Personal Blog
My Facebook Page

↧
Search

Gather Stats Strategies for Data warehouse environment

May 3, 2020, 2:35 am
$
0
0
Hello All,
I am wondering about Gather Statistics strategies for a Data warehouse being built from scratch.
Any guideline and suggestion will be great?
For example: It is very essential after first time initial load, essential for large volume of transaction records  load etc
Recommendations may help me to define frequency for same.

Thanks,
Rajneesh
↧
↧

Message "column processing is not possible because more than one code page is specified for it (65000 and 1252)"

May 4, 2020, 1:12 am
$
0
0

Dear All

I am trying to import csv file to SQL Server 2019 using SSIS. For file i choose code page 65000 but after starting of package i got message ""column processing is not possible because more than one code page is specified for it (65000 and 1252)". I didn't choose 1252 that's why can't understand how to fix it. 

↧

Executing user on SSIS Catalogue SSISDB

May 4, 2020, 7:29 am
$
0
0

Hi,

I have a package which i execute from the Intergation Services Catalogue, the option where you can do Validate, Execute, Config (not from a scheduler job). I am establishing the database connections via a special Windows username lets call it CORP/XUZ. I am running the package via my own account CORP/ABC and  I am the caller. However, i don't have access to the PROD Stored procs whereas the "Destination DB User name" has permissions to exec the stored proc. It connects fine to the PROD database wheread I as a user can't do. Also passes package validation.

However, fails  on SP exec cause of no permission  to execute the SP. I am suspecting it's because it's using my credential CORP\ABC instead of CORP/XUZ. Unfortunately I can't get the CORP/XUZ to execute the package due to permission issues with accounts.

Does anyone know what's happening here and why it fails to exec the stored proc?

Thank you.

Panos

 


↧

Processing an SSIS object variable in PowerShell

May 4, 2020, 9:08 am
$
0
0

I'm looking to pass an object variable from within SSIS to a PowerShell script but can't seem to make any progress.

Has anyone done this successfully?

Thanks.

↧
↧

What some methods for converting/upgrading existing SSIS packages to newer version of Visual Studio?

April 20, 2020, 8:22 am
$
0
0
I've found out that with the latest version of Visual Studio e.g. 2019, it breaks our existing SSIS packages. Are there ways we can simply convert/upgrade our existing SSIS packages to the new version?
↧

Use a vector variable as a Parameter in a Ole DB Source filter

April 24, 2020, 5:23 am
$
0
0

Hi,

I am in a situation where I have a vector of integers( SSIS object variable ), and I need to do a select in a really really huge table( hundreds of millions rows ), but I only need the data that match some register of my vector( foreign key ). So what I wanted is do something like that in the OleDB Source:

select * from table where columnA in ( ? ) 

And mapping the '?' to my variable vector of object type. I tried above and not work. What can I do? Is it possible to use the vector on the ole DB source? If not, what approach would help me to filter these items?

The other option that I thought was do a for each loop package in my vector, and do the select for each item. But my table is huge, I don't want do the select multiple times

Best regards,

Luis

↧

Validation Error. Execute SQL Task : There were errors during task validation.

May 10, 2018, 5:48 am
$
0
0

SSIS package "Package.dtsx" starting.
Information: 0x4004300A at Data Flow Task, SSIS.Pipeline: Validation phase is beginning.
Error: 0xC0202009 at Package, Connection manager "Excel Connection Manager 47": SSIS Error Code DTS_E_OLEDBERROR.  An OLE DB error has occurred. Error code: 0x80004005.
An OLE DB record is available.  Source: "Microsoft JET Database Engine"  Hresult: 0x80004005  Description: "The Microsoft Jet database engine cannot open the file ''.  It is already opened exclusively by another user, or you need permission to view its data.".
Error: 0xC020801C at Data Flow Task, P***** [299]: SSIS Error Code DTS_E_CANNOTACQUIRECONNECTIONFROMCONNECTIONMANAGER.  The AcquireConnection method call to the connection manager "Excel Connection Manager 47" failed with error code 0xC0202009.  There may be error messages posted before this with more information on why the AcquireConnection method call failed.
Error: 0xC0047017 at Data Flow Task, SSIS.Pipeline: component "P******" (299) failed validation and returned error code 0xC020801C.
Error: 0xC004700C at Data Flow Task, SSIS.Pipeline: One or more component failed validation.
Error: 0xC0024107 at Data Flow Task: There were errors during task validation.
SSIS package "Package.dtsx" finished: Failure.

Above is the output when I try to debug a package. The file is not open and I do have the permissions. Any help appreciated. Thank you.

↧
Search

SQL Server Maintenance plan job failed

May 5, 2020, 2:56 am
$
0
0

I have created a maintenance plan to backup database, recently after a server reboot, the maintenance plan started to failed. I have recreated back the job but it's still failing with same error below. I know I can use other way to backup database but I want to know why it's failing with maintenance plan.

Message Executed as user: MTRADE\svc_eforex. Microsoft (R) SQL Server Execute Package Utility Version 11.0.2100.60 for 64-bit Copyright (C) Microsoft Corporation. All rights reserved. Started: 5:09:30 PM Error: 2020-05-05 17:09:45.76 Code: 0xC00291EC Source: {EDE87A0E-6D01-4C6C-BE30-10DCFB40ED52} Execute SQL Task Description: Failed to acquire connection "Local server connection". Connection may not be configured correctly or you may not have the right permissions on this connection. End Error Error: 2020-05-05 17:10:00.31 Code: 0xC0024104 Source: Back Up Database (Full) Description: The Execute method on the task returned error code 0x80131904 (A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: SQL Network Interfaces, error: 26 - Error Locating Server/Instance Specified)). The Execute method must succeed, and indicate the result using an "out" parameter. End Error Error: 2020-05-05 17:10:14.85 Code: 0xC0024104 Source: {CA2864D8-321C-4C00-9E9A-3DE24396F7C2} Description: The Execute method on the task returned error code 0x80131904 (A network-related or instance-specific error occurred while establishing a connection to SQL Server. The server was not found or was not accessible. Verify that the instance name is correct and that SQL Server is configured to allow remote connections. (provider: SQL Network Interfaces, error: 26 - Error Locating Server/Instance Specified)). The Execute method must succeed, and indicate the result using an "out" parameter. End Error DTExec: The package execution returned DTSER_FAILURE (1). Started: 5:09:30 PM Finished: 5:10:14 PM Elapsed: 44.062 seconds. The package execution failed. The step failed.


↧
↧

Using Kerberos integrated authentication to connect to SQL Server

May 5, 2020, 3:34 am
$
0
0

Hi,

We are deploying a java application to RHEL 7.5, this java application need connect to SQL Server 2016. As security request, we must use integrated security to connect SQL Server 2016. Follow Microsoft website's suggestion, we are implementing Kerberos in Windows AD Server and RHEL 7.5.  Microsoft's document is 

Register a Service Principal Name for Kerberos Connections

We've little confuse on Manual SPN Registration section. Based on this section's command, we need to run 

setspn -A MSSQLSvc/myhost.redmond.microsoft.com:1433 redmond\accountname  

But where are  we run this command?  On AD server or Database server ? 

I would be grateful if you can help.

↧

SET VALUE FOR INPUT

May 6, 2020, 3:40 am
$
0
0
Hello,

I want to write a value to a variable in package using script component using C#.

 public override void Input0_ProcessInputRow(Input0Buffer Row)
    {
        /*
         * Add your code here
         */
        decimal PMR_Value = 1000.0000000000m;

        if (Row.idPMR_IsNull)
        {
            Row.idPMR = PMR_Value;
        }
        else
        {
            Row.DirectRowToSortie0();

        }
    }
I get this error :idPMR 'is not valid - The value' 'is not valid according to its data type' Integer '- The string' 'is not a valid Integer value 

↧

Path of dtsx file

May 6, 2020, 10:46 am
$
0
0

SSIS 2012

How can I find out the path of the dtsx file for a package when it is running and then put it in a SSIS variable? We run all of our packages through a command prompt using dtexec. I know the path is part of the command sent to dtexec but I need the package to figure out its path and set it to the variable when it runs.

Thanks,
Scott

↧

Verify if all rows are Appending in Destination Table

May 6, 2020, 11:50 am
$
0
0

Hi

Both tables are in same SQL server database. Source table collects daily data, which is appends in Destination table. Next before collecting new daily data Source table is truncated. New data again appending in Destination.

After appending in Destination table I want to verify that all rows from Source are appended in Destination. If not repeat step A.

A. Count Rows in Source and append in Destination

RowCount is stored in variable: SourceRowCount

B. Count Rows Destination, RowCount is stored in variable DestinationRowCount

SELECT COUNT(*)   FROM [DestinationTable] where DateTime = Convert(Date,dateadd(d, -1, getdate()))


Regards

↧
↧

Error calling "sp_send_dbmail" inside SSIS Script Task (VB)

May 6, 2020, 2:40 pm
$
0
0

Hey all, I have an issue that has me stumped.  I am calling sp_send_dbmail from within a Script Task.  The code works fine in SQL Server 2008, but is failing in SQL Server 2017.  

sSQL = "exec msdb.dbo.sp_send_dbmail @profile_name = 'My DB Mail Profile',@recipients = 'John.Doe@company.com',@subject = 'Test' ,@body='Test';"

oCmd.CommandText = sSQL
oCmd.ExecuteNonQuery()


I know that DB Mail is setup correctly, as running the exact same call in a query window works fine.

I know the connection is fine, as I can run a test UPDATE command through the same connection, e.g. 

   sSQL = "update MyTable set MyField = 'some value' where MyID = 'abc123'"

It fails on the ExecuteNonQuery call, returning a most unhelpful runtime error:

Permissions are not an issue - it fails even with full server Admin and SQL Server sysadmin.

Has something changed from SS 2008 that might account for this?

I would be most grateful for any help!  

Thanks, Jeff

↧

How indexing works in oracle DB based on given scenario?

May 7, 2020, 2:31 am
$
0
0

Hello Experts,

Let me try to understand how indexing works in oracle database with below scenarios:
Approach 1 in table 1:
index(Column1, column2, column3)
Approach 2 in table 1:
index(column1), index(column2), index(column3)
Table2
index(field1)
select table1.column 5, table1.column 6
from table1, table2
where
table1.column1='XYZ'
and table1.column2=table2.field1

1) Number of I/O from disc to memory for bringing index column will be same with approach 1 and approach 2
2) how many index table space for approach 1 and approach 2
3) what is difference between these  different approach in terms of how indexes are stored , referred and performed
4) index will still useful though column3 is not used in join (for both approach)?

Thanks,

Rajneesh

↧
Search

foreign key constraints in dimensional model of data warehouse

May 7, 2020, 9:57 am
$
0
0

Hello Experts,

Is it true that we never enable foreign key constraints in dimensional model of data warehouse?

If yes, then what is rationale behind that?

Thanks,

Rajneesh

↧

restore database SSIS catalog

May 7, 2020, 9:44 am
$
0
0

One developer accidently deploy a SSIS project and overwrite an exisitng project with the same name.

I would  like to restore the SSIS database on the same server overwriting the existing SSISDB database.

I see online there is a need to restore the master key.

Do I need to do that step?

I use the backup of yesterday, I do this on same database on same server.

THanks

Thanks

↧
↧

Do Data Warehouse standards allow foreign key constraints at a dimensional model?

May 7, 2020, 9:57 am
$
0
0

Is it true that we never enable foreign key constraints in dimensional model of data warehouse? If yes, then what is the rationale behind that?

As per my research:

Some experts told me in a dimensional model, FK will never be enabled, and it is the responsibility of the ETL process to ensure consistency and integrity.

Data integrity issues may come into picture, even though ETL is responsible enough through proper dependency.

Examples:

  • Late arriving dimension from source

  • few records could not pass data quality check and routed to error table.

  • intermediate tables are not populated due to batch load failure, and proper restart or recover steps are not followed. Someone restarted the last session to load data into the facts table while some of the dimensions are yet to be populated,

  • primary key constraints will help me to avoid duplicate record population if data in intermediate tables are getting processed one more time due to re triggering target table load session accidentally.

What issues do you see by enabling FK constraints in dimensional model?



↧

easier way to designate maiden pkg run as historical

May 7, 2020, 10:48 am
$
0
0

Hi we run 2014 enterprise.  I kind of have to live with what you see below so i'm just looking for the easiest way to work with it.  i'm aware of the better way of doing this but that will have to wait.

in certain packages we have a user variable called loadtype that is used by the extract component to extract "historic"ally or "incremental"ly.  our pkgs currently run from msdb's [dbo].[sysssispackages] table. and they are executed via sql agent.

i looked at one of the sql agent jobs for a way to change this variable dynamically, preferably without getting into configs.

i noticed the command you see in the box below in the agent's command line tab.

is there a way when we are running our maiden runs to extend this command to override the default value of the loadtypevar?

/SQL "\"\LoadStaging_xxxx\"" /SERVER yyyyyyy  /CHECKPOINTING OFF /REPORTING E

↧

Examples to create SSIS packages dynamically

May 7, 2020, 10:45 am
$
0
0

Hi,  I have been tasked to come up with C# prototype to create SSIS 2017 packages dynamically.

Very simple case - a single DATA FLOW TASK between sql server source/destination.

It has been done already many times before, probably.

I'm aware of incomplete bits in Microsoft docs..

Is there a blog or example of complete solution that I can use?

Please point me to the right direction.

I'm using VS 2017 with sql server 2017

thank you!

↧
Viewing all 24688 articles
Browse latest View live
Search
<script src="https://jsc.adskeeper.com/r/s/rssing.com.1596347.js" async> </script>