🚀 With around 4 years of hands-on experience as an Azure Data Engineer, I specialize in designing data-intensive applications within the realm of Cloud Data Engineering, Data Warehousing, Hadoop Ecosystem, Big Data Analytics, Data Visualization, Reporting, and Data Quality solutions.
🌟 My expertise shines when it comes to crafting Spark applications using Spark-SQL in Databricks. I use this powerful combination to extract, transform, and aggregate data from various file formats, revealing valuable insights into customer usage patterns.
📂 What sets me apart is my experience in migrating SQL databases to Azure Data Lake, Azure Data Lake Analytics, Azure SQL Database, Data Bricks, and Azure SQL Data Warehouse. Not only do I handle the migration, but I'm also adept at controlling and managing database access. I'm also experienced in migrating on-premises databases to Azure Data Lake Store using Azure Data Factory.
🔧 I'm all about orchestrating data integration pipelines, and I do this with finesse using Azure Data Factory. I leverage a variety of activities, including Get Metadata, Lookup, For Each, Wait, Execute Pipeline, Set Variable, Filter, and many more to streamline the process.
🕒 Additionally, I'm well-versed in setting up workflows using Apache Airflow and Oozie workflow engines. This comes in handy when managing and scheduling Hadoop jobs, ensuring seamless and efficient data operations.
🤝 I'm here to collaborate, learn, and contribute. If you're interested in discussing data engineering, Azure, or any exciting opportunities, let's connect! Feel free to reach out and let's explore the possibilities.
#AzureDataEngineer #BigData #ETL #DataIntegration
