saimanikanta kukkadapu

• Data Engineer with over 7+ years of professional work experience in IT industry with Enterprise Application development involving business Analysis, Development, Maintenance & support. • Experience in Software Development Life Cycle (SDLC) including Requirements Analysis, Design Specification and Testing as per Cycle in both Waterfall and Agile methodologies. • Experience building distributed high-performance systems using Spark and Scala. • Experience in creating Data Lake using spark which is used for downstream applications. • Experience in developing Kafka producers and Kafka consumers for streaming millions of events per minute on streaming data using PySpark, Python and Spark Streaming. • Experience in implementing applications on Spark frameworks using Scala. • Experience in using Python for Data Engineering and Modeling • Experienced in developing Web Services with Python programming language. • Experience in designing star schema, Snowflake schema for Data Warehouse, ODS architecture. • Experience in Snowflake data warehouse, developed data extraction queries, automatic ETL for data loading from Data Lake. • Experience with Informatica (ETL Tool) for Data Extraction, Transformation and Loading. • Hands on experience in working with Tableau Desktop, Tableau Server and Tableau Reader in various versions. • Proficiency in designing scalable and efficient data architectures on Azure, leveraging services like Azure Data Lake, Azure Data Factory, Azure Data Bricks, Azure SynapseDB, and Power BI. • Experience in Data Analysis, Data Validation, Data Cleansing, Data Verification and identifying data mismatch, data quality, metadata management, and master data management. • Experience working on creating and running Docker images with multiple micro services. • Hands on experience working Amazon Web Services (AWS) using Elastic Map Reduce (EMR), Redshift, and EC2 for data processing. • Experience with the Apache Airflow engine that can easily schedule and run my complex data pipelines which will make each task to get executed in a correct order. • Hands on experience on Star Schema Modeling, Snow-Flake Modeling, FACT and Dimensions Tables, Physical and Logical Data Modeling using Erwin. • Experience automating data engineering pipelines utilizing proper standards and best practices (right partitioning, right file formats, incremental loads by maintaining previous state etc.,). • Experience in extracting source data from Sequential files, XML files, CSV files, transforming and loading it into the target Data warehouse. • Experienced working with JIRA for project management, GIT for source code management, JENKINS for continuous integration and Crucible for code reviews. • Hands on experience in SQL and NOSQL database such as Snowflake, HBase, Cassandra and MongoDB. • Excellent communication skills, interpersonal skills, problem solving skills a very good team player along with a can do attitude and ability to effectively communicate with all levels of the organization such as technical, management and customers.