Sahil Shrivastava

Data Engineer

Brickred Systems

May 2024 - Current (2 years 1 month)

Deployed a containerized application using Docker on a Kubernetes cluster, reducing false error rates by 98%. Implemented multiple Python Scripts to transfer 30,000 test cases from On-Prem TFS to Cloud Environment Azure. Optimised ETL processes using Python, SQL&ETL tools Data stage, ODI, BODI reducing batch processing time by 50%. Developed Testing Frameworks and Benchmarking solutions for existing code increasing coverage to 90%. Utilized the Terraform exporter utility to generate Terraform code for deployment of Databricks workflow. Established a connection between Azure Synapse Analytics and Power BI for seamless data visualization. Worked on an Output Verification Tool for new versions of Machine Learning Models and Products, ensuring

I

Software Engineer

Infinite Options

Jul 2023 - May 2024 (11 months)

Implemented Azure data warehousing solutions using Azure Synapse Analytics to improve query performance by 20%. Developed data validation scripts, identifying and correcting 5000+ data inconsistencies across legacy systems. Experienced in leveraging Hadoop for processing and analyzing large-scale datasets using Big Data tools like Hive. Conducted extensive data cleaning and analysis on 100,000+ rows of data to uncover trends and patterns.

DA-IoT Intern

Rockwell Automation

Jun 2022 - Aug 2022 (3 months)

Developed APIs using Flask for efficient data storage and retrieval, Increasing productivity by 10%. Architected and implemented a scalable data pipeline increasing the data processing capacity by 30%. Implemented OCR solution to read data from files directly into Excel. Speeding up the process for the client significantly. Utilized Databricks for data cleaning and enhanced visualizations, improving data insights and understanding.

G

Junior Data Analyst

Genius Lead

Aug 2020 - Aug 2021 (1 year 1 month)

Analyzed trends in customer data, implemented strategic changes resulting in a 15% increase in company profits. Leveraged Power BI to create interactive dashboards, enhancing use case analysis and decision-making for users. Conceptualized and spearheaded the development of ROYBOT an innovative voice assistant leveraging AI technologies.

K

Modeling Junior Data Analyst Intern

Kanors Energy Research

Dec 2018 - Aug 2019 (9 months)

Demonstrated ability to handle multiple projects and resolve complex issues, Data Variety and Cleaning of Data. Implemented Data Analysis algorithms in a team environment to enhance customer interaction. Worked on visualizations, increasing customer interaction with related products by 25%.

Sahil Shrivastava

About

Detail

Timeline

Résumé