Thursday, 6 October 2011

ETL Extraction Transformation Loading

TOTAL Transformations=21

1.Sorting.

2.Data Cleaning.

  • Data Validation: finding duplicates replace or delete the duplicate.
  • handling missing values finding and replacing.
3.Filter Transformation: Capture part of the data.

4.Expression Transformation: Data manipulation or pre-calculation.

5.Append Transformation: Upload data form one file to another existed file.

6.Concatenation: Capture multiple to new file.

7.Interleaving: Integration between sorting and count.

8.Join or  Merge.

9.Transpose or Normalization: Reshape.

10.Aggregate Transformation: Simple analysis.

11.Update Transformation: To replace the old values by the new values by the new values.

12.Modify Transformation: To replace the old values by the new values by the expression.
                         (Modify=Update+Expression)

13.Lookup Transformation: Lookup target file related information available then replace. If it is not available  then add this type transformation is called lookup transformation.

14Reformatted data or data conversion: convert the data one format to another format. Conversion are 
i. character to character
ii.Numeric to Numeric
iii.Character to Character
iv.Numeric to Character.

15.Rank Transformation: Generating Ranks.
Loading:  Upload the data into database.
  • Using SAS can be generated multidimensional analysis  by OLAP (online Analytical Process) and create cubes and summarized files.
  • This process can be called data aggregation.
  • Run the statical operating using Ttest, ANOVA, Correlation, regression and etc.
  • Develop applications for data mining and multivariate analysis.
  • Generates reports in tabular format.
  • Generates graphs (Charts, pie, plots).

No comments:

Post a Comment