A

Akhil Niranjan

About

Detail

Data Engineer at Lowe's Companies, Inc
United States

Contact Akhil regarding: 
work
Full-time jobs

Timeline


work
Job

Résumé


Jobs verified_user 0% verified
  • L
    Data Engineer
    Lowe's Companies Inc
    Sep 2021 - Dec 2023 (2 years 4 months)
    Responsibilities: • Built a scalable technical architecture and data processing layer on Azure Cloud to solve business problems for a leading health insurance company. • Performed ETL activities using Azure Data Factory and Databricks. • Set up a development environment on IntelliJ to develop code in Python. • Structured code in different files as per organization standards and following best practices. • Perform Text Cleansing by applying various transformations using Spark Dataframes. • Developed a validation framework in Pyspark to ensure data quality as well as check for accuracy and completeness of data. • Built test functions to locally test the developed functions. • Experience on Migrating SQL database to Azure data Lake, Az
  • Visa
    Data Engineer
    Visa
    Jan 2020 - Sep 2021 (1 year 9 months)
    Responsibilities: • Understand Business requirements, analysis and translate them into Application and operational requirements. • Designed a one-time load strategy for moving large databases to Azure SQL DWH. • Extract Transform and Load data from Sources Systems to Azure Data Storage services using Azure Data Factory and HDInsight. • Created a framework to do data profiling, cleansing, automatic restart ability of batch pipeline, and handling rollback strategy. • Design and implement database solutions in Azure SQL Data Warehouse, Azure SQL • Implemented masking and encryption techniques to protect sensitive data. • Implemented SSIS IR to run SSIS packages from ADF. • Databricks job configuration, Refactoring of ETL Databricks not
  • Komodo Health
    Data Engineer
    Komodo Health
    Jun 2018 - Dec 2019 (1 year 7 months)
    Responsibilities: • Developed data pipeline using Spark, Hive, and HBase to ingest customer behavioral data and financial histories into the Hadoop cluster for analysis. • Working Experience on Azure Databricks cloud to organize the data into notebooks and make it easy to visualize data using dashboards. • Performed ETL on data from different source systems to Azure Data Storage services using a combination of Azure Data Factory, T-SQL, Spark SQL, and U-SQL Azure Data Lake Analytics. Data Ingestion to one or more Azure Services • (Azure Data Lake, Azure Storage, Azure SQL, Azure DW) and processing the data in In Azure Databricks. • Created database tables and stored procedures as required for reporting and ETL needs. • Databricks job
Education verified_user 0% verified
  • M
    Master of Science