Poojith Reddy

I possess over 8 years of professional experience as a Data Engineer, Big Data Engineer, and Cloud Engineer, I am well-versed in Data Engineering, Data Pipeline Design, Data Modeling, Development, and Implementation, adeptly managing the Software Development Life Cycle (SDLC) encompassing Requirements Analysis, Design Specification, and Testing in both Waterfall and Agile methodologies. I excel in data collection from diverse sources using Sqoop and Talend, employing Python, R, SQL, Microsoft Excel, Hive, PySpark, and Spark SQL for Data Mining, Data Cleansing, Data Munging, and Machine Learning. I have also ventured into web application development with Python, Django, XML, CSS, HTML, JavaScript, and JavaQuery. Proficient in the Hadoop ecosystem, including HDFS, MapReduce, Yarn, Spark, Hive, Pig, HBase, ZooKeeper, Oozie, Flume, Storm, and Sqoop, I have designed and maintained Snowflake data pipelines for seamless data ingestion and transformation. My extensive toolset includes Teradata, Informatica, UNIX shell scripting, Apache Druid, Apache Hadoop, SSIS, SAS, NoSQL databases, Oozie, Airflow, Spark MLlib, Matillion, TIBCO, Cloudera, Hortonworks, Snowflake, Control-M, and Microservices. I've harnessed the power of cloud platforms such as Azure, AWS, and Google Cloud Platform (GCP) as well for comprehensive data engineering solutions, integrating automation into workflows with regression scripts for ETL validation and CI/CD pipelines for automated deployment and scaling. I navigate data processing workflows with ease, leveraging tools like Apache NiFi and DataStage. My expertise in SQL spans multiple dialects, and I have a strong foundation in Data Marts and Dimensional Data Modeling. Proficient in project management tools like JIRA, source code management through GIT HUB and SVN, continuous integration via Jenkins, and code reviews with Bitbucket and Crucible, I am passionate about translating data into actionable insights and remain enthusiastic about embracing new challenges in the evolving field of data engineering.