A Senior Big Data Software Engineer passionate about data and the insights that large data sets can provide. I Designed, developed, and maintained data engineering data pipelines requiring the use of data collection and analysis using Cloud (Azure, AWS) services, Big Data (PySpark, Databricks, Hive, Sqoop, HDFS, Spark SQL), Cloud Warehouse database(Snowflake, Redshift), Data Streaming (Kafka, Spark Stream, SnowPipe), Data Warehouse databases (Teradata, Vertica, Oracle), Data Integration (IICS Data Integration, Ab-Initio, Informatica PowerCenter, IBM DataStage), Programming (Python, Unix/Linux), and CI/CD (AzDO repo/pipeline, Azure data factory, logic app, Airflow) tools and technologies.