a

akhil kumar

About

Detail

Senior Data Engineer at Walgreens
Atlanta, Georgia, United States
Contact akhil regarding: 
work
Full-time jobs

Timeline

work
Job
school
Education

Résumé

Jobs verified_user 0% verified
  • Walgreens
    Senior Data Engineer
    Walgreens
    Oct 2021 - Current (4 years 10 months)
    • Performed wide, narrow transformations, actions like filter, Lookup, Join, count, etc. on Spark Data Frames. • Worked with Parquet files and ORC using PySpark, and Spark Streaming with Data Frames. • Creating different AWS Lambda functions and API Gateways, to submit data via API Gateway that is accessible via Lambda function. • Responsible for Building Cloud Formation templates for SNS, SQS, Elastic search, Dynamo DB, Lambda, EC2, VPC, RDS, S3, IAM, Cloud Watch services implementation and integrated with Service Catalog. • Developed batch and streaming processing apps using Spark APIs for functional pipeline requirements. • Automated data storage from streaming sources to AWS data lakes like S3, Redshift and RDS by configuring AWSKinesi
  • UnitedHealth Group
    Senior Data Engineer
    UnitedHealth Group
    Jan 2020 - Sep 2021 (1 year 9 months)
    • Hands on experience in Architecting Legacy Data Migration projects such as Teradata to AWS Redshift migration and from on-premises to AWS Cloud. • Worked on Ingesting data by going through cleansing and transformations and leveraging AWS Lambda, AWS Glue and Step Functions. • Installed and configured Hadoop Map Reduce, HDFS, developed multiple Map Reduce jobs in java and Scala for data cleaning and pre-processing. • Created a Lambda Deployment function and configured it to receive events from S3 buckets. Installed and configured Hive and written Hive UDFs and Used Map Reduce and Junit for unit testing. • Developed Mappings using Transformations like Expression, Filter, Joiner and Lookups for better data messaging and to migrate clean a
  • Elevance Health
    Senior Data Engineer
    Elevance Health
    Sep 2018 - Dec 2019 (1 year 4 months)
    • Created Pipelines in ADF using Linked Services/Datasets/Pipeline/ to Extract, Transform, and load data from different sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards. • Experience with migrating SQL databases to Azure Data Lake, Azure Data Lake Analytics, Azure SQL Database, Data Bricks, and Azure SQL Data warehouse, as well as controlling and giving database access and migrating on-premises databases to Azure Data Lake stores using Azure Data Factory. • Developed ETL pipelines in and out of data warehouse using combination of Python and Snowflakes SnowSQL Writing SQL queries against Snowflake. • Hands on experience across Hadoop Ecosystem that includes extensive experience in Big Data tech
  • Credit Karma
    Data Engineer
    Credit Karma
    Jul 2016 - Aug 2018 (2 years 2 months)
    • Analyzed existing databases, tables and other objects to prepare to migrate to Azure Synapse. • Compared Snowflake on Azure vs Azure Synapse. • Worked on on-prem Datawarehouse migration to Azure Synapse using polybase and ADF. • Analyzed Azure Data Factory and Azure Data Bricks to build new ETL process in Azure. • Analyzed database tables and denormalized to create Operational Data Store (ODS) to improve query performance. • Worked with wif developers, DBAs, and systems support personnel in elevating and automating successful code to production. • Created SSIS Packages using Lookup, Derived Columns, Condition Split, Aggregate, Execute SQL Task, Data Flow Task, Execute Package Task etc. to generate underlying data for teh reports and to ex
  • Bharti Airtel Limited
    Big Data Engineer
    Bharti Airtel Limited
    May 2012 - Mar 2016 (3 years 11 months)
    • Worked to rapidly evaluate, create, and test new use cases for the organization in a quick-paced Agile development environment. • Involved in every project from inception through completion with little guidance. • Maintaining existing ETL workflows, data management and data query components. • Collecting, aggregating, and moving data from servers to HDFS using Apache Kafka. • Creating Hive tables, loading with data, and writing hive queries that will run internally in a map-reduce way. • Migrating ETL jobs to Pyspark scripts do Transformations, even joins and some pre-aggregations before storing the data into HDFS. • Provided support for Azure Databricks and building data pipelines using Pyspark. • Involved in the migration of Big data Pl
Education verified_user 0% verified
  • CVR College of Engineering Hyderabad
    Bachelor of Technology - BTech, Computer Science
    CVR College of Engineering Hyderabad
    Jul 2008 - May 2012 (3 years 11 months)