Sai Kiran

● Motivated Data Engineer having 8+ years of professional experience in Data Engineering, Analytics, Data Modeling, Data Science, Data Architecture, Programming Analysis and Database Design of OLTP and OLAP systems with sound knowledge in Cloud Technologies (AWS, Azure). ● Highly dedicated, inspiring and expert Sr Data Engineer industry experience exploring various technologies, tools and databases like Big Data,AWS,S3,Snowfake, Hadoop, Hive, Spark, python, Sqoop, CDL(Cassandra) ), Teradata, E - R ( Confdential), Tableau, SQL,PLSQL,Abinitio(ACE), and Redshift but always making sure of living in the world I cherish most i.e. DATA WORLD. ● Over 8+ years of overall IT experience in a variety of industries, which includes hands-on experience in Big Data and Dataware house ETL technologies. ● Have comprehensive experience in Big Data processing using Hadoop and its ecosystem (MapReduce, Pig, Hive, Sqoop, Flume, Spark ). ● Good working experience on Spark (spark streaming, spark SQL), Scala and Kafka. ● Good working knowledge on Snowfake and Teradata databases. ● Extensively worked on Spark using Scala on cluster for computational (analytics), installed it on top of Hadoop, performed advanced analytical applications by making use of Spark with Hive and SQL/Oracle/Snowfake. ● Excellent Programming skills at a higher level of abstraction using Scala and Python. ● Hands-on experience in developing SPARK applications using Spark tools like RDD transformations, Spark core, Spark MLlib, Spark Streaming and Spark SQL. ● Strong experience and knowledge of real time data analytics using Spark Streaming, Kafka and Flume. ● Working knowledge of Amazon’s Elastic Cloud Compute (EC2) infrastructure for computational tasks and Simple Storage Service (S3) as Storage mechanism. ● Worked on reading multiple data formats on HDFS using Scala. ● Involved in converting Hive/SQL queries into Spark transformations using Spark RDDs . ● Good experience in creating and designing data ingest pipelines using technologies such as Apache Storm- Kafka. ● Experienced in working with in-memory processing frameworks like Spark Transformations, SparkQL, MLib and Spark Streaming. ● Good working experience on using Sqoop to import data into HDFS from RDBMS and vice-versa. ● Experienced in implementing POC using Spark Sql and Mlib libraries. ● Improving the performance and optimization of the existing algorithms in Hadoop using Spark Context, Spark-SQL, Data Frame, Pair RDD, YARN. ● Hands-on experience in handling Hive tables using Spark SQL.