A

Arun Danveer Vedhakkannu

About

Detail

Tamil Nadu, India

Timeline

work
Job

Résumé

Jobs verified_user 0% verified
  • Sony Music Entertainment
    Assistant Technical Lead (Data Engineering & Data Analysis)
    Sony Music Entertainment
    Aug 2021 - Current (5 years 3 months)
    Implemented an S3-triggered, Lambda-orchestrated Glue PySpark pipeline to process and load data into Amazon Redshift in an automated and scalable manner.Automated mission-critical data workflows using Python, Pyspark, and SQL/PLSQL, resulting in a 20% reduction in processing time for core pipelines.Architected and led a real-time integration platform using Kafka (MSK) and Elasticache Redis, processing 10,000+ API requests/day and serving as the single source of truth for multiple downstream systems.Designed and implemented platform-level APIs using AWS Lambda, API Gateway, Redshift, and advanced SQL optimization, improving data retrieval performance and scalability.Led the migration from EC2 to a fully containerized solution using Docker an
  • Sony Music Entertainment
    Data Engineer (Sony Music Consumer Analytics)
    Sony Music Entertainment
    Oct 2019 - Aug 2021 (1 year 11 months)
    Designed and delivered a real-time artist portal platform on AWS Private Cloud, ensuring high availability, reliability, and performance for global users.Built high-performance PySpark transformations for large datasets, applying Spark optimization techniques to ensure scalable and efficient data processing.Integrated metadata and media ingestion pipelines from Spotify, Apple, and Deezer, establishing the primary image and metadata source for Sony's global applications.Migrated legacy automation scripts to AWS Managed Airflow, improving scheduling efficiency, reducing processing time by 30%, and lowering operational overhead.Optimized database performance through schema redesign, indexing strategies, and query optimizations, reducing storag
  • Agilisium Consulting
    Software Engineer - Data Integration
    Agilisium Consulting
    Dec 2017 - Oct 2019 (1 year 11 months)
    Created an API using AWS Lambda and Redshift to provide data for calculating metrics, revenue, and product details. This API served as a key data source for front-end applications.Developed clean, efficient, and maintainable Python code, adhering to best practices and design patterns, ensuring scalability and ease of future updates.Designed and optimized SQL databases, including schema creation and query performance tuning, leading to improved data retrieval efficiency and overall system performance.Led the development of robust ETL processes, facilitating efficient data movement and transformation across diverse systems and APIs, supporting timely and accurate data-driven decision-making.Wrote complex queries for multiple chatbot teams at
Education verified_user 0% verified
  • S
    SQL Advanced
  • P
    Python
  • A
    AWS Cloud Practitioner
  • A
    AWS Solution Architect
  • P
    Processing Data with Python
  • D
    Data Structures and Algorithms
  • Anna University
    B.E, Electronics and Communication Engineering
    Anna University