Data enthusiast eager to contribute to the success of business and team through expertise in BigData Analytics, Data Modeling and Warehousing. Proficient with hands-on experience in SQL, Python, Big Data technologies like Hadoop, Spark, Hive, Sqoop, Predictive modeling. Motivated to learn and excel in Data Science industry.
Contact Laxmi regarding:
work
Full-time jobs
Timeline
work
Job
school
Education
folder
Project
Résumé
Jobs
verified_user
20% verified
C
Data Engineer
County of Sacramento
Jan 2023 - Current(3 years 10 months)
▪ Proficient in overseeing the complete project life cycle and actively engaged in every stage, encompassing tasks such as acquiring data, performing data cleansing, conducting data engineering, and creating data visualizations. ▪ Supporting Department of Human Assistance (DHA) in a cloud migration project, migrating data from diverse sources such as On-Prem, Oracle, Redshift, and Hybris SQL, and crafting ETL processes utilizing PySpark,SQL on Visual Studio Code. ▪ Employed Python, Spark SQL to load data in Parquet files into Delta Lake by loading data into SPARK tables and SQL Server tables, which in turn is consumed for Web Development and Reporting. ▪ Developed Pyspark utility to migrate 18TB of DHA raw
B
Data Engineer
Blue Cross and Blue Shield NC
Nov 2020 - Feb 2023(2 years 4 months)
Involved in requirements gathering, analysis, design, development, change management, deployment.
Developed data pipelines to ingest encounter claims from multiple vendors into data lake using Hadoop, Hive frameworks installed on EMR.
Developed Spark jobs in PySpark to perform ETL on Dataiku on weekly Pharmacy claims and daily Insurance claims from Anthem and loaded into Teradata to provide dual eligibility plan for Medicaid and Medicare subscribers.
Migrated data from various sources into Teradata and HDFS using data pipelines built with PySpark jobs.
Perform Partitioning and Bucketing for efficient data access and validate data stored in Hive tables.
Well versed with Dataiku platform,
Data Engineer verified_user
Verified experience
Scholastic
Jun 2020 - Nov 2020(6 months)
Extensively worked on Spark using PySpark for computational (analytics), installed it on top of Hadoop.
Performed advanced analytics by making use of Spark with Hive translated into actionable reports using Tableau.
Experienced in getting data from heterogenous sources like Oracle, Redshift, HybrisSQL developing ETL jobs using PySpark and Databricks and creating Data Lake(AWS S3) which is used in building reporting dashboards.
Well versed with GitHub and CICD Pipeline.
Worked on Spark using Python and Spark SQL for faster testing and processing of data.
Responsible for writing Hive Queries for analyzing data in Hive warehouse using HQL. Created multiple Hive tables, implemented Partitio
Data Engineer
Capital One
May 2019 - Apr 2020(1 year)
▪ Experience in all stages of SDLC (Agile, Waterfall), writing Technical Design document, Development, Testing and Implementation of Enterprise level Data mart and Data warehouses. ▪ Extensively worked on Spark using Python on cluster for computational (analytics), installed it on top of Hadoop performed advanced analytical application by making use of Spark with Hive and SQL/Oracle. ▪ Worked on Spark using Python and Spark SQL for faster testing and processing of data. ▪ Responsible for writing Hive Queries for analyzing data in Hive warehouse using HQL. Created multiple Hive tables, implemented Partitioning in Hive for efficient data access. ▪ Perform Partitioning and Bucketing for efficient data access
Jr Data Engineer
Tech Mahindra
Mar 2018 - Dec 2018(10 months)
Experienced in managing entire project life cycle and actively involved in all the phases of project life cycle including Data acquisition, Data cleaning, Data Engineering and Data Visualization.
Maintained large databases, collaborated with operations team to create data models with SQL and extracted relevant data and data manipulation using SQL queries involving Aggregations, Pattern Matching, Joins etc.
Worked on Ad-hoc requests of generating actionable reports by performing ETL using complex SQL Joins and Microsoft Excel in an Agile project framework to give solutions to business team.
Scheduled and sent reports on Monthly, Quarterly and Annual basis to business teams using Python for their Analysis.
Education
verified_user
0% verified
Master's degree, data science
University of Maryland Baltimore County
Jan 2019 - Jan 2020(1 year 1 month)
Bachelor of Technology, Computer Science
Jawaharlal Nehru Technological University
Jan 2014 - Jan 2018(4 years 1 month)
High School, Mathematics,Physics and Chemistry
Sri Chaitanya College of Education
Jan 2012 - Jan 2014(2 years 1 month)
P
School
Paramita High School
Jan 2002 - Jan 2011(9 years 1 month)
Projects (professional or personal)
verified_user
0% verified
S
Sentiment Analysis on Yelp Data
Mar 2020 - May 2020(3 months)
Orchestrated ETL Pipeline by storing huge json files in MongoDB and ETL operations using Apache Spark, SparkSQL to perform streaming and querying on the data and Assessed public perspective and reported various factors affecting Restaurant business in USA and Predicted ratings on analyzing text reviews by EDA using NLTK tools and fed the data to classifier model which forecast ratings with 74% accuracy.
C
Churn Analysis on Telecom Data
Feb 2020 - Current(6 years 9 months)
The main goal of my project is to predict churn of telecom data. This scenario is very common and often seen in our daily life. The main idea was to analyze the factors that effect churn which in turn would be helpful for companies in retaining their customers and also in acquiring new ones. In order to accomplish my goal,I built classification and regression models, furthermore I would performed Clustering, Dimensionality Reduction, Feature Engineering and Hyper Parameter Tuning.Evaluated performance of the the model with Learning Curve.
D
Denver Crime data
Oct 2019 - Dec 2019(3 months)
The main objective of big data project was to analyze the trends of various crimes in Denver and segregate them according to traffic crimes and other offences. In this project, data of traffic accidents and other crimes are retrieved and analyzed separately on monthly, daily and hourly basis. My prominent goal was to collaborate Hadoop, Apache spark, Hive and Jupyter Notebook. Used Python to perform Exploratory Data Analysis and HiveQL to query the data.
A
Analysis of Crops grown in Asia in 2016 and 2017
Apr 2019 - May 2019(2 months)
The prominent goal was to extract insights in the field of agriculture in Asia during 2016-2017. To accomplish my goal started with Data Pre-processing, Analysed data by Exploratory Data Analysis and performed Data Visualizations using Tableau.
A
Analysis of Child Mortality Rate
Mar 2019 - Apr 2019(2 months)
Analyzed rate of disease related infant deaths in countries all over world from 2000-2017. Created single data frame by aggregating 13 different CSV files of 13 different diseases by thorough Data Pre-processing and analyzed fluctuations in death rate over the period of 17 years. Performed visualization of highly prevailing diseases in Africa and generated an interactive choropleth map depicting total number of deaths due to respiratory diseases in all the countries.
S
Sentiment Analysis on Google Play Store Data
Mar 2019 - May 2019(3 months)
The main goal was to examine and explore revenue made by applications on Google Plays Store. Later analysed various genres and determined which of them will require better applications. Furthermore, applied various Machine Learning algorithms and evaluated the performance of each algorithm and performed Sentiment Analysis.