hi folks,
I am looking for an advanced "Derived Column" component that would take a metadata-like config file for columns transforms, and use that to do all transforms (rather than do all transforms at "design time", through developer intervention).
We currently have an SQLServer based ETL engine that takes various files, of diffrent formats, different set of fields, various different transforms, be them LTRIM, RTRIM, CAST, ISNULL, REPLACE, etc etc....and outputs a (very long) sql statement. The problem is that all of these transforms are *very* slow.... this is a task that is much better suited for SSIS and Derived Column components. However, we cannot entertain to have developer-intervention for each file, etc... we'd like to have a metadata-like file that can be automatically built to be passed unto the component, for processing.
Are there any such tools on the market?
thanks much,
Cos
cos