J
Jaya sai Krishna Hanumandla
About
Detail
Senior data engineer
Denver, Colorado, United States
Contact Jaya regarding:
work
Full-time jobs
Résumé
Jobs
verified_user
0% verified
Senior Data EngineerHelloFreshMay 2022 - Current (4 years 5 months)• Build features for pricing optimization ML models with customer historical data, which provide best offers to customers. • Design and implement an experiment data collection pipeline using python, PySpark and AWS s3, ECS, EC2 and other services, which will be the inputs for ML models. • Created and implemented a data quality package, which is part of data pipelines to provide quality data to stakeholders(Data scientist and ML's). • Use prefect to schedule the data pipelines weekly. • Using DataBricks(PySpark and sql) for data analysis and projecting the business behavior based on historical data. • Continuous followup with stakeholders to meet the business requirement on data availability. • Using Github for code availability and r- Data Engineer IIKapitusNov 2020 - May 2022 (1 year 7 months)• Worked on predictive machine learning models using python with the historical data we have in legacy systems. • Developing the data flow on AWS cloud and creating the Athena tables on top of s3 files, which will project the visuals for sales and cash flow. • Created the API's Endpoints which are being used by multiple web services. • Written optimized SQL queries according to the mapping document. • Setting up the CloudWatch for projecting the logs for the workflow. • Using S3, Ec2, sqs, lambda, Athena, Glue and EKS services on AWS. • I Wrote some machine learning models for analysis using python. • Using bitbucket for code availability and responsible for merges and changes. • Using Alteryx workflow to deploy the changes into ap
- Data EngineerTectonicJun 2019 - Nov 2020 (1 year 6 months)• Worked on writing scripts using python and PostgreSQL, MYSQL for the data validation. • Actively involved in creating the data frame for the requirement of the project using python/python modules. • Created a process which can generate the pdf files and update the fields in it using the info we have in the MYSQL database. • Worked on automating the software workflow process. • Developed the API's and using the API calls connected the social media(youtube, facebook, insta, twitter)pulled data and stored into the database and made a process to run every day to grab the latest data. • Used the flask framework to run the application locally and test the flow. • Worked on data migration without loss of data from instance to instance und
- Data EngineerOppenheimerFundsDec 2017 - Jun 2019 (1 year 7 months)• Developed test scripts using python and postgreSQL for the data validation. • Written the python scripts to load the data into the tables(Data Injection). • Used Autosys and MoveIT tools to place the file from on premise to AWS-S3 buckets. • Written the jil scripts to autosys jobs and scheduled jobs on every business day. • Used celery scheduler to place the file into tables from AWS-S3. • Used AWS Athena to query the data on top s3 bucket(files inbound) which helps the business people for data analysis. • Involved in software development life cycle (SDLC) of tracking the requirements, gathering, analysis, detailed design, development, system testing and user acceptance testing. • Actively involved in developing the methods for Cr
- CPython/Devops DeveloperCableLabsFeb 2017 - Dec 2017 (11 months)• Actively involved in setting up the production environment in AWS using kubernetes and used mongo-db sharding for the data distribution into different shards and maintained the replica's in different AWS regions for data redundancy. • Extensive experience in deploying, managing and developing MongoDB clusters. Creation, configuration and monitoring Shards sets. • Used Django/Python web-framework to develop applications. • Developed Scripting based frameworks on python using Linux Platform used by embedded engineers for automating mundane tasks. • Built some frameworks which allow writing scripts in python, which will send and receive data over serial port to communicate with device firmware.
- SoftwareDeveloperAxis BankJan 2015 - Dec 2015 (1 year)• Used Django/Python web-framework to develop applications and developed Scripting based frameworks on python using Linux Platform used by embedded engineers for automating mundane tasks. • Used AWS Lambda with Amazon S3 and extensively used Python requests.urllib and urllib2 module to call web services • worked on Python OpenStack APIs and used NumPy for Numerical analysis also • worked on real time in memory distributed systems. • Worked with the Stakeholders, gathered requirements and developed high level design documents. • Have used Python libraries like NumPy/ SkiPy, Pandas for market analysis and done some machine learning using Python.
Education
verified_user
0% verified
- Bachelors of Mechanical EngineeringJawaharlal nehru university
- WMaster of scienceWilmington University, Leeds school of Information systems