Senior Software Engineer, Machine Learning
Circinus, LLC
Jan 2020 - Aug 2021 (1 year 8 months)
• Lead ML Infrastructure design & development, building continuous learning & inference pipelines for numerous natural language processing using state of the art language models. • Built ETL/ELT pipelines for ingesting billions of structured/unstructured data records/hour from various APIs and data streams into ElasticSearch orchestrated with Apache Airflow. • Leading a team of Data Scientists to develop and enhance ML/DL models and deploy scalable solutions for tasks including sentiment analysis, entity extraction, and document classification. • Tools: PyTorch, TorchServe, Docker, Spark, Terraform, Ansible, SageMaker, FastAPI, ElasticSearch, Jenkins, MLFlow, Textract, and Apache Airflow, Celery, SQS.