Associate Data Engineer
ExtensoData, F1Soft
Oct 2019 - Jan 2021 (1 year 4 months)
Evaluated the current architecture of Foneloan and designed the new one that satisfies the diverse requirements of multiple clients while keeping the ETL flow generic.
•Automated the ETL process, eliminating the necessity of manual coding to manage the data flows.
•Performed data cleansing and validation using PDI.
•Optimized SQL queries, reducing processing time by more than 50%.
•Increased the efficiency of data fetching by approximately 30%, using query optimization and indexing.
•Ingested data from disparate data sources like SQL, MySQL, Oracle, and CSV, using Pentaho to create data views for business intelligence tools.
•Tested the end-to-end flow of the project named Budget, raised bugs, and provided recommendations.
•Generate