Data Engineer
Quadrant Technologies
Jul 2018 - Jul 2021 (3 years 1 month)
โข Interacted with clients to gather data requirements, analyze business use cases, and develop scalable ETL pipelines to extract data from various sources such as SQL Servers, Excel files, and CSV datasets. โข Designed and developed SSIS packages to automate the extraction, transformation, and loading (ETL) of large datasets into SQL Server databases. โข Created and optimized Stored Procedures, User Defined Functions (UDFs), Views, Indexes, Triggers, and Common Table Expressions (CTEs) to support reporting and data validation needs. โข Used Spark SQL within Azure Databricks to transform, filter, and analyze large volumes of semi-structured and structured data. โข Implemented Grab & Add (GnA) techniques to replicate data across servers for