Naveen Ch

Around 5+ Years of professional experience in full life cycle system development involving analysis, design development, testing, documentation, implementation & maintenance of application software in Web-based and Client/Server environment. Expertise in building batch and real-time data processing systems leveraging AWS services (S3, Redshift, EMR, Lambda, Dynamo DB) and Azure services (ADLS, ADF, Data bricks, Synapse Analytics). Practical knowledge in setting up and designing large-scale data lakes, pipelines, and effective ETL (extract/load/transform) procedures to collect, organize, and standardize data that can be used to Converted a current on-premises application to use Azure cloud databases and storage. Experience in deploying Microsoft Azure Multi-Factor Authentication (MFA). Experience using various Hadoop Distributions (Cloudera, Map R, Hortonworks, Azure) to fully implement and leverage new Hadoop features. Expert in creating various Kafka producers and consumers for seamless data streaming with AWS services. Good understanding of Spark Architecture with Data bricks, Structured Streaming. Setting Up AWS and Microsoft Azure with Data bricks, Data bricks Workspace for Business Analytics, Managing Clusters in Data bricks, Managing the Machine Learning Lifecycle. Created Python code to collect data from H Base and develop the PySpark implementation of the solution. Experience in automating day-to-day activities by using Windows PowerShell. Experience working with Agile SCRUM/RAD methodology and (TDD) Test Driven Development. Develop DDL and DML statements for data modelling, data storage and looked into performance fine tuning. Designed and developed ETL jobs for large scale data ingestion, transformation, cleansing, and migration between a variety of sources and sinks using PySpark, Scala, SQL, Kafka, Airflow. Experience in migrating on premise to Windows Azure using Azure Site Recovery and Azure backups. Deployed Dockers Engines in Virtualized Platforms for containerization of multiple apps. Hands-on experience interacting with REST APIs developed using the micro-services architecture for retrieving data from different sources. Experience with Snowflake cloud data warehouse and AWS S3 bucket for integrating data from multiple source system which include loading nested JSON formatted data into snowflake table. Expertise in building CI/CD on AWS environment using AWS Code Commit, Code Build, Code Deploy and Code Pipeline. Experience in Cisco Cloud Center to more securely deploy and manage applications in multiple data center, private cloud, and public cloud environments. Worked on production support looking into logs, hot fixes and used Splunk for log monitoring along with AWS Cloud Watch.