ETL Developer
Cyient Technologies
Jun 2018 - Jun 2019 (1 year 1 month)
Responsibilities
• Created numerous data frames and datasets using the Spark-SQL context to pre- process the model data.
• In charge of ETL design (identifying the source systems, designing source to target relationships, data cleansing, data quality, creating source specifications, ETL design documents).
• Wrote SQL queries to retrieve information from the databases depending on the requirement and for data cleanup process.
• Analyzed and understood the ETL workflows that have been developed.
• Involved in reviewing and understanding the Business requirements.
• Validated the data transformations and performed end-to-end data validation for ETL.
• Used various Transformation likes Aggregations, Loo