Sudeshna Palit

Experienced and results-driven IT professional with over 8 years of expertise in Data Engineering, Data Modeling, and Data Warehousing across diverse industries. Proficient in designing and implementing Data Warehouses and Data Marts using star schema, Snowflake Schema, and Data Vault techniques. Adept at leveraging Hadoop architecture and components, including Map Reduce, HDFS, HBase, Hive, Sqoop, and more, with exposure to AWS and Azure. Having extensive hands-on experience configuring and installing Hadoop/Spark Ecosystem Components. Skilled in Apache Spark ecosystem for large-scale data processing and transformation, utilizing in-memory computing capabilities written in Scala. Extensive background in working with OLAP & OLTP data sources such as MongoDB, Oracle, Postgres, MySQL, and Redshift. Specialized in data migration projects using Sqoop to transfer data between RDBMS, NoSQL databases(MongoDB, Cassandra) and HDFS. Proficient in ETL processes for collecting, aggregating, and moving data from various sources. Comprehensive experience with Hadoop architecture, MapReduce programming, and developing MapReduce and Streaming jobs for data cleansing and aggregation. Solid AWS experience, including EC2, S3, RDS, Glue, Athena,VPC, IAM, Elastic Load Balancing, Auto Scaling, CloudWatch, SNS, SES, SQS, and Lambda functions in Python. Proficient in setting up and managing ELK Stack for log analysis and visualization. Implemented Data warehouse solutions in Amazon Redshift and worked on migration projects. Designed and implemented a scalable MongoDB data model for a cross-functional data modeling project, . Implemented a flexible schema design to accommodate diverse data sources, facilitating seamless storage and retrieval and leveraged Azure services for scalable cloud-based solutions, optimizing data management and enhancing analytical capabilities in a unified environment. Skilled in Cloud Databases and Data Warehouses, including SQL Azure and Snowflake. Experienced in Snowflake Database, Schema, and Table structures, with hands-on experience in Snowflake utilities and Big Data model techniques using Python. Expertise in logical and physical Data Modeling using normalizing techniques. Strong foundation in the complete Software Development Life Cycle with proficiency in Agile and Waterfall methodologies. Technical skills include Python, R, PowerShell, CSS3, Web Services, Django, and Microsoft Azure. Well-versed in Big Data Technologies, Databases, Reporting Tools, ETL Tools, Version Control Tools, BI Tools, and Operating Systems.