Kaushik N

Kaushik N

About

Detail

Senior Data Engineer at Charter Communications
Sunbury, Ohio, United States
Contact Kaushik regarding: 
Flexible work
Starting at USD60/hour

Timeline

work
Job
school
Education

Résumé

Jobs verified_user 0% verified
  • Charter Communications
    Senior Data Engineer
    Charter Communications
    May 2022 - Current (4 years 2 months)
    > As a data expert, I was a part of the Data Strategy Team responsible for creating Data Engineering solutions and generating insights. > Led 2 Jr. Data Engineer employees and 1 intern in the team to successfully deliver large-scale data engineering solutions. > Designing and automating data pipelines, real-time streaming, and ETL processes. > Experience in developing Spark applications using Spark-SQL for data extraction, transformation, and aggregation from multiple file formats for Analyzing & transforming the data to uncover insights into customer usage patterns. > Worked on Oracle Databases and Snowflakes. > Created action filters, parameters, and calculated sets for preparing dashboards, worksheets, and visualizations using PowerBI.
  • Silicon Valley Bank
    Data Engineer
    Silicon Valley Bank
    Sep 2019 - Apr 2022 (2 years 8 months)
    > Working with Big Data technologies and part of Enterprise data management in various phases like Design, Development, and Monitoring. Worked for the core financial module with Enterprise level Data Lake and Data Governance. > Successfully led and applied solution architecture designs for the pipelines with enterprise architecture strategies. > Worked on a full spectrum of data engineering pipelines: data ingestion, data transformations, and data analysis. > Build a real-time streaming pipeline utilizing Kafka and Spark Streaming, through DataBricks and perform real-time analytics on streaming data. Skills: DataBricks, Azure Data Factory, Spark, Scala, Python, Java, Hive, Talend, Kafka, PySpark, Bitbucket, Jira.
  • American Airlines
    Database Administrator
    American Airlines
    Jun 2017 - Aug 2019 (2 years 3 months)
    > I was the part of Data Warehousing and Integration team responsible for designing and maintaining the data warehouse. > Worked with various data formats and APIs to extract, transform, and load data into the data warehouse. > Worked extensively on building and automating data ingestion pipelines and moving terabytes of data from existing data warehouses to the Google Cloud. > Implemented Apache Airflow for authoring, scheduling, and monitoring Data Pipelines. > Responsible for data services and data movement infrastructures good experience with ETL concepts, building ETL solutions, and Data modeling. > Developed various automated scripts for DI (Data Ingestion) and DL (Data Loading) using python & java map reduce. > Hands-on experience i
  • G
    Big Data Engineer
    Grapesoft Solutions
    Nov 2015 - Mar 2017 (1 year 5 months)
    • Imported data from different relational data sources like RDBMS, Teradata to HDFS using Sqoop. • Imported bulk data into HBase using Map Reduce programs. • Perform analytics on Time Series Data exists in HBase using HBase API. • Designed and implemented Incremental Imports into Hive tables. • Used Rest API to Access HBase data to perform analytics. • Worked in loading and transforming large sets of structured, semi structured, and unstructured data. • Involved in collecting, aggregating, and moving data from servers to HDFS using Apache Flume.
  • Ceequence Technologies Pvt Ltd
    Data Analyst
    Ceequence Technologies Pvt Ltd
    Jul 2014 - Oct 2015 (1 year 4 months)
    • Involved in designing physical and logical data model using ERwin Data modeling tool. • Created Stored Procedures, Database Triggers, Functions and Packages to manipulate the database and to apply the business logic according to the user's specifications. • Created Triggers, Views, Synonyms and Roles to maintain integrity plan and database security. • Creation of database links to connect to the other server and Access the required info. • Used Advanced Querying for exchanging messages and communicating between different modules. • System analysis and design for enhancements Testing Forms, Reports and User Interaction.
Education verified_user 0% verified
  • JNTUH College of Engineering Hyderabad
    Bachelor of Technology - BTech, Computer Science
    JNTUH College of Engineering Hyderabad
    Jun 2009 - May 2013 (4 years)