Quantcast
Channel: SQL Server Integration Services forum
Viewing all 24688 articles
Browse latest View live

Please Help regarding "SSIS Data Transformation and Load Error due to truncation occured"

$
0
0

I am trying to load a .xlsx file having 8000+ records into SQL Server Database Table. I am loading it using a SSIS package created in Visual Studio 2017 (SSDT). Following is the error I am getting:-

[Data Conversion [2]] Error: Data conversion failed while converting column "Notes" (38) to column "Copy of Notes" (10).  The conversion returned status value 4 and status text "Text was truncated or one or more characters had no match in the target code page.".

[Data Conversion [2]] Error: The "Data Conversion.Outputs[Data Conversion Output].Columns[Copy of Notes]" failed because truncation occurred, and the truncation row disposition on "Data Conversion.Outputs[Data Conversion Output].Columns[Copy of Notes]" specifies failure on truncation. A truncation error occurred on the specified object of the specified component.[SSIS.Pipeline] Error: SSIS Error Code DTS_E_PROCESSINPUTFAILED.  The ProcessInput method on component "Data Conversion" (2) failed with error code 0xC020902A while processing input "Data Conversion Input" (3). The identified component returned an error from the ProcessInput method. The error is specific to the component, but the error is fatal and will cause the Data Flow task to stop running.  There may be error messages posted before this with more information about the failure.

Strangely, it is not erroring out from the 1st record itself. Rather it loads 292 records and then errors out. I have used a Data Conversion block from excel source to OLEDB destination. My excel column which is failing is "Notes". In Advanced Editor I can see the output column data type is: Unicode text stream [DT_NTEXT]. 

In my destination Table, "Notes" column datatype is Varchar (-1). That means it has MAX limit.

In my data-conversion block I have created a new column "Copy of Notes" by changing datatype to "text stream [DT_TEXT]".

Please help me why I am getting this error after few records get loaded? What can I do? I have also tried setting disposition field in the advanced editor to RDIgnoreFailure but to no use. It still fails. Kindly help me.


ssis packages deployment error 2012 :Microsoft SQL Server, Error: 27203

$
0
0

HI .

  when i was  deploy the ssis packages in same server  vs 2012. am facing  this issue : and how can solve the  this issue . please provide me another way of deployment in ssis packages.  

Microsoft SQL ServerError27203,

do i really need to keep versions of my sln, proj etc files?

$
0
0

Hi we run 2017 std. I just created a git repository for my pkgs. And recently adopted the whole ssis catalog thing.

From what i'm seeing, long term management of catalog pkgs will be most smooth from the project level, not the pkg level because pkg deletes pose a challenge.  That makes me wonder about what to version. 

What non dtsx files should I keep in my repository? It seems that the sln or proj would make a developer aware of a missing pkg in his local directory if the sln or proj is kept in sync with the remote repo when he goes to do some work.  It seems that the ignore file is meant to keep some of the ancillary (perhaps unnecessary for versioning) files like xxx.database out of the repository.   does anybody have a good strategy that works well with GIT and the ssis Catalog? 

OLE DB Source query takes long time

$
0
0

My SQL query is very simple. I am selecting some columns from a view. The result comes in SSMS in 5 seconds.  But the same query if i use in my OLE LB Source in SSIS 2012, its running for hours and not giving any results. I tried many times.Same result. Please help me what should I do now?

SSIS packages stored location and access permissions?

$
0
0

Hello we currently have SQL Server 2016 installed along with SSIS running on the same server.

We recently got a request to have SSIS packages on this SQL server.

I'm not too familiar with SSIS but is there anything further that needs to be configured/installed?

I was under the impression that SSIS packages get stored within one of the SQL Server install folders and that users would access them via Management Studio or something else...not really by navigating via File Explorer?

Thanks in advance.

LDAP query and SSIS

$
0
0

Before someone 'fires up', I mean LDAP - NOT active directory. I am trying to query Novell e-Directory (and, no, I cannot get permission to install the ODBC connector that Novell offers).

Anyone have a link to something that DOESN'T assume that LDAP and Active Directory are the same thing?

How to keep the first row and first column freeze when scroll the report ?

$
0
0
How to keep the first row and first column freeze when scroll the report ?

My XSD and XML files

$
0
0

I'm using SSIS to copy data from a XML file.I have a xsd but only read a part of my xml, for example doesn't read the three first elements Date, Name and Phone number, only read the elements contained in info elements. Someone can help me?

This is my XSD

<?xml version="1.0" encoding="utf-8"?>
<!-- Created with Liquid Studio 2019 (https://www.liquid-technologies.com) -->
<xs:schema xmlns:xd="http://schemas.microsoft.com/office/infopath/2003" xmlns:s0="http://microsoft.com/webservices/SharePointPortalServer/UserProfileService" xmlns:d="http://schemas.microsoft.com/office/infopath/2009/WSSList/dataFields" xmlns:tm="http://microsoft.com/wsdl/mime/textMatching/" xmlns:diffgr="urn:schemas-microsoft-com:xml-diffgram-v1" xmlns:s1="http://microsoft.com/wsdl/types/" xmlns:ns1="http://schemas.xmlsoap.org/wsdl/soap/" xmlns:pc="http://schemas.microsoft.com/office/infopath/2007/PartnerControls" xmlns:http="http://schemas.xmlsoap.org/wsdl/http/" xmlns:mime="http://schemas.xmlsoap.org/wsdl/mime/" xmlns:_xdns0="http://schemas.microsoft.com/office/infopath/2003/changeTracking" xmlns:dfs="http://schemas.microsoft.com/office/infopath/2003/dataFormSolution" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:soap12="http://schemas.xmlsoap.org/wsdl/soap12/" xmlns:q="http://schemas.microsoft.com/office/infopath/2009/WSSList/queryFields" xmlns:ma="http://schemas.microsoft.com/office/2009/metadata/properties/metaAttributes" xmlns:tns="http://IBKC.int/" xmlns:my="http://schemas.microsoft.com/office/infopath/2003/myXSD/2012-06-21T16:04:39" xmlns:soap="http://schemas.xmlsoap.org/soap/envelope/" xmlns:soapenc="http://schemas.xmlsoap.org/soap/encoding/" xmlns:wsdl="http://schemas.xmlsoap.org/wsdl/" xmlns:msdata="urn:schemas-microsoft-com:xml-msdata" xmlns:dms="http://schemas.microsoft.com/office/2009/documentManagement/types" attributeFormDefault="unqualified" elementFormDefault="qualified" targetNamespace="http://schemas.microsoft.com/office/infopath/2003/myXSD/2012-06-21T16:04:39" xmlns:xs="http://www.w3.org/2001/XMLSchema">
  <xs:import schemaLocation="C:\Users\alfre\OneDrive\Desktop\MaintanceFileDefinition1.xsd" namespace="http://www.w3.org/XML/1998/namespace" />
  <xs:element name="gpDDAMaintenance">
    <xs:complexType>
      <xs:sequence>
        <xs:element minOccurs="0" name="Date" type="xs:date" />
        <xs:element minOccurs="0" name="Name" type="xs:string" />
        <xs:element minOccurs="0" name="PhoneNumber" type="xs:string" />
<xs:element minOccurs="0" name="Info">
         <xs:complexType>
<xs:sequence>
<xs:element minOccurs="0" name="FormStatus" type="xs:string" />
<xs:element minOccurs="0" name="FormName" type="xs:string" />
<xs:element minOccurs="0" name="FormEmailAddress" type="xs:string" />
<xs:element minOccurs="0" name="EmailAddressOverride" />
<xs:element minOccurs="0" name="DepositWorkflow" type="xs:boolean" />
<xs:element minOccurs="0" name="RateWorkflow" type="xs:boolean" />
<xs:element minOccurs="0" name="HiddenPassword" type="xs:string" />
</xs:sequence>
</xs:complexType>
</xs:element>
</xs:sequence>
      <xs:attribute ref="xml:lang" use="optional" />
    </xs:complexType>
  </xs:element>
</xs:schema>

This is my XML

<xml version="1.0" encoding="utf-8"?>
<?mso-infoPathSolution name="urn:schemas-microsoft-com:office:infopath:XXXXXXmyXSD-2012-06-21T16-04-39" solutionVersion="1.0.20.207" productVersion="16.0.0.0" PIVersion="1.0.0.0" href="aaaa.com?>
<?mso-application progid="InfoPath.Document" versionProgid="InfoPath.Document.4"?>
<?mso-infoPath-file-attachment-present?>
<my:gpDDAMaintenance xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns:dfs="http://schemas.microsoft.com/office/infopath/2003/dataFormSolution" xmlns:tns="http://IBKC.int/" xmlns:_xdns0="http://schemas.microsoft.com/office/infopath/2003/changeTracking" xmlns:soap="http://schemas.xmlsoap.org/soap/envelope/" xmlns:diffgr="urn:schemas-microsoft-com:xml-diffgram-v1" xmlns:msdata="urn:schemas-microsoft-com:xml-msdata" xmlns:soapenc="http://schemas.xmlsoap.org/soap/encoding/" xmlns:http="http://schemas.xmlsoap.org/wsdl/http/" xmlns:tm="http://microsoft.com/wsdl/mime/textMatching/" xmlns:ns1="http://schemas.xmlsoap.org/wsdl/soap/" xmlns:mime="http://schemas.xmlsoap.org/wsdl/mime/" xmlns:soap12="http://schemas.xmlsoap.org/wsdl/soap12/" xmlns:wsdl="http://schemas.xmlsoap.org/wsdl/" xmlns:s0="http://microsoft.com/webservices/SharePointPortalServer/UserProfileService" xmlns:s1="http://microsoft.com/wsdl/types/" xmlns:pc="http://schemas.microsoft.com/office/infopath/2007/PartnerControls" xmlns:ma="http://schemas.microsoft.com/office/2009/metadata/properties/metaAttributes" xmlns:d="http://schemas.microsoft.com/office/infopath/2009/WSSList/dataFields" xmlns:q="http://schemas.microsoft.com/office/infopath/2009/WSSList/queryFields" xmlns:dms="http://schemas.microsoft.com/office/2009/documentManagement/types" xmlns:my="http://schemas.microsoft.com/office/infopath/2003/myXSD/2012-06-21T16:04:39" xmlns:xd="http://schemas.microsoft.com/office/infopath/2003" xml:lang="en-US">
<my:Date>2019-05-16</my:Date>
<my:Name>Jhon</my:Name>
<my:PhoneNumber>111-111-1111</my:PhoneNumber>

<my:gpInfo>
<my:FormStatus>Saved</my:FormStatus>
<my:FormName>AAA-157758106D-20190516131812</my:FormName>
<my:FormEmailAddress></my:FormEmailAddress>
<my:EmailAddressOverride></my:EmailAddressOverride>
<my:DepositWorkflow>true</my:DepositWorkflow>
<my:RateWorkflow>false</my:RateWorkflow>
<my:HiddenPassword>asd</my:HiddenPassword>
</my:gpInfo>
</my:gpDDAMaintenance>


Export SQL Server query output into a tab delimited format but the format must be text (ms-dos)

$
0
0

Dear Experts,

I have this requirement from application team to output a query in a specific format. I used the export data wizard available in SQL Server and could generate an output file that is tab delimited. However, the output file is in text (Tab delimited) format.

They want it to be in the MS DOS tab delimited format. Is there any way we could generate an output file in that format?

Can you please share your suggestions?


MM

Package reference error

$
0
0

We need some urgent help regarding a unusual error occurrence happening very frequently during our SSIS executions from SSIS catalog.  We have few projects were parent package calls many child packages. we get below error while package executions

 " Error 0x80131500 while executing package from project reference package abc.dtsx" The package failed to load due to error 0xC0011008 "Error loading from XML.

No further detailed error information can be specified for this problem because no Events object was passed where detailed error information can be stored.". 
This occurs when CPackage::LoadFromXML fails. "

I have read many blogs and forums on this issue and followed suggested instructions but none of them have worked. 

Database and SSIS servers are separate. we using SQL Agent to run the packages and packages are using PostGre SQL 9.0. 

Recently we have installed PostGre SQL 11 on the SSIS server. since we faced this problem very frequently so we stop the PostGre services and we are still getting this issue. 

We never faced this issue before but in recent days the occurrence has gone up.  We thought of PostGre SQL Oledb driver used by SSIS but still not sure.

When we restart the server then everything works fine for few days and the issue then again pops up after 3-4 days.

Any suggestions or help would be a great help for us.

Thanks

  

SSIS Precedence Constraint Not Behaving as Expected

$
0
0

This should only hit if the variable = 'True'. In the screenshot below it clearly says 'False' but still hit. I have tried Changing the 'Logical AND' to 'Logical OR' as well have tried changing every other operation and combination with "Evaluation operation:"

https://imgur.com/VuSPgqn

can packages be deployed to the catalog right from the file system

$
0
0
Hi, we run 2017 std. Our dbas may wish to deploy legacy file system pkgs to the catalog right from the file system, bypassing vs/ssdt. Is that possible? I clicked import packages from the folder called projects under ssisdb just to get a sense of what that might do and it looked like it had to do too much with conversion so I don't pursue that path further.

Project connections issue

$
0
0

Hi,

Myself and my colleague is working on a single solution having individual copies of the sample template. We have defined project connection managers but when either of us copy the solution from his system to mine and vice versa ..The existing packages does not recognize the project connections setup.

Please advise.

Thanks.

Connecting to a remote SQL Server SSISDB catalog from SSMS

$
0
0

Hello,

I've installed SQL Server with SSIS service on my virtual machine, and I am trying to connect to it remotely via SQL Server Management Studio. 

I've followed the rules provided by an article I've found in my Resources file (which I got while installing the server) called "Before you get started":

  • Enabled TCP/IP protocol
  • Disabled Firewall on the computer that has SQL Server installed
  • Made a new login that has the same username and password as the computer I'm trying to connect from (not really sure if I have the right password, how do I check that? I've used the username provided through a command in cmd "whoami" and the password is my password I use when logging into the computer).

----

When logging from SSMS (the version is the same as the version of SQL Server), I run it as administrator, click to connect to a database engine, and choose windows authentication, and an error pops.

The error I am getting is: "The target principal name is incorrect.  Cannot generate SSPI context."

Please let me know if I am missing something?

Thanks in advance!

Jovana


Jovana Majcen

Loop through folders and archive files

$
0
0

Hi,

I am a beginner in SSIS and I am struggling to get this accomplished, It will be great if someone could help me.

So, I have a directory structure like this

RootDirectory*Sub-directory1--History--Reports**Sub-directory2--History--Reports**Sub-directory3--History--Reports

I want to set up an SSIS package, which goes through each sub directory every day and if a reports folder exists in the sub directory, it copies the contents of the folder to the history folder in the same sub directory and then deletes any files in the history folder that are older than 14 days.

I have tried different ways, but had no luck accomplishing this.

Could anyone please help me with this? 

Thank you in advance!


Archive files in corresponding folders

$
0
0

I dun know how to archive different files in corresponding folders.

Here's what my client request:

There is a root folder: "C:\Sales\Forecast"

In this root folder, there are many subfolders based on user name: "C:\Sales\Forecast\Mandy", "C:\Sales\Forecast\Carman"....

 

And in each user folder, there are Archive folder: "C:\Sales\Forecast\Mandy\Archive", "C:\Sales\Forecast\Carman\Archive"....

 

Now i need to loop all csv files in each user folder:

"C:\Sales\Forecast\Mandy\Sales_Forecast.csv", "C:\Sales\Forecast\Carman\Sales_Forecast.csv"....

 

After that, i need to archive each files into archive folder base on each user:

"C:\Sales\Forecast\Mandy\Sales_Forecast.csv" ---> "C:\Sales\Forecast\Mandy\Archive\Sales_Forecast-20080701.txt",

"C:\Sales\Forecast\Carman\Sales_Forecast.csv" ---> "C:\Sales\Forecast\Carman\Archive\Sales_Forecast-20080701.txt"

 

In Foreach Loop editor, i set:
Folder: "C:\Sales\Forecast"

Files: "Sales_Forecast.csv"

and tick 'Traverse subfolder'

 

And i know how to use "Flat File Connection" and "File System Task".

But in "File System Task", i dun know how to set the value of "Destinationvaluable' which depends on corresponding subfolders since the folder of the csv files is not the same everytime.

SQL Server Copy DB Wizard still broken. Any Fixes?

$
0
0

I have been using  the SQL Copy Database Wizard through the GUI (SMS)  to copy a DB up until SQL 2016. Every installation I have where 2016 or greater has been involved the feature is broken and always gives the same error. It doesn't matter if I use an existing DB I have imported or create a new blank test DB. Same error. I have seen numerous posts but no solution. I have installed numerous versions of SQL Management studio (including the latest) but the GUI appears to be broken on all of them. In SQL 2014 standard this issue doesn't happen. Anyone know of a fix for this? This is becoming very frustrating. I have even tried a clean install of server & SQL. Same results. The error in the SQL log forevery computer is always an INDEX error.

OnError,TESTSVR,TESTSVR\Administrator,CDW_TESTSVR_TESTSVR_1,{3CA6823C-A220-4ABE-A900-DAB1D9485F38},{594FCC26-657E-4036-9C21-E53D74BB4C90},11/06/2019 12:16:35,11/06/2019 12:16:35,0,0x,Index was out of range. Must be non-negative and less than the size of the collection.

This is happening on every machine I install SQL 2016 or 2017. I have tried SQL Management Studio all the way back to 16.5.3....I have no clue what the error is referring to. The DB can be a test db with no data and I still get this error.

Thanks for your time..

FTP Task get file from Linux

$
0
0

Hello,

I am trying to ftp get from Linux server.  Task runs successfully, but I do not see files in Windows server.  When I change the source file name from 2019_11_06_08:00:28_S.txt to 2019_11_06_S.txt FTP works.  I figured ":" being not allowed as part of the file name in Windows must be the culprit. 

Can I use character manipulation to remove ":" from the file name during the ftp task?

Thank you in advance,

Kiyo

Can't connect to SSIS error message

$
0
0

Hello we have SQL Server 2016 installed on one of our Windows Server 2016 and also installed/enabled SSIS on same server.

User is trying to connect via Management Studio as "Integration Services" for Server type in drop down but getting following error message:

Cannot connect to OurSQLServer2016WithSSISInstalled.

Connecting to the Integration Services service on the computer "OurSQLServer2016WithSSISInstalled" failed with the following error: "The RPC server is unavailable.".

This error occurs when the computer host name does not exist, or cannot be reached.

The user mentions he's outside of our network so would we need our Network team to whitelist his IP or anything else from my DBA team SQL Server perspective I'd need to do?

Thanks in advance.

How to create audit trigger when data insert & update existing data through SSIS package?

$
0
0

I have SQL table populating data via SSIS package (all inserts and updates). I want to create audit table to see whether record is a new entry or an update.

Thank you so much


Viewing all 24688 articles
Browse latest View live