N
Niteesh Nitin Singh
About
Detail
Gujarat, India
Résumé
Jobs
verified_user
0% verified
AI/MLEngineerPerplexityMay 2024 - Current (2 years 1 month)• Architected and optimized transformer inference pipelines with PyTorch, TorchScript, CUDA, and 4-bit, cutting quantization latency 37%, reducing memory 45%, and boosting daily engagement 22% across global LLMs-powered AI assistant workloads. • Designed and deployed RAG pipelines with FAISS, BM25, Hugging Face, and LangChain, grounding answers in enterprise knowledge bases and reducing hallucinations 28% across 50M+ queries with production-grade reliability. • Scaled training of 70B+ parameter LLMs across 1,000+ GPU clusters using DeepSpeed ZeRO-3, NCCL, and continuous batching, achieving 5.7 TFLOP/GPU throughput and accelerating iteration cycles for next-gen search and assistant models. • Deployed and scaled inference services on Kube- Machine Learning EngineerMetaJun 2020 - Jul 2023 (3 years 2 months)• Led distributed training of large-scale transformers on 2,048-GPU clusters with DeepSpeed ZeRO-3, NCCL, and PyTorch, achieving 5.7 TFLOP/GPU throughput and accelerating iteration cycles for 70B-parameter experiments, informing LLaMA and LLMs research. • Automated ingestion and preprocessing of 12TB+ daily conversational logs using Spark, PyArrow, Hive, and Airflow, generating privacy-compliant datasets that fueled RLHF pipelines and safety-aligned training for next-gen LLMs. • Architected production-grade AI-assisted pipelines with FBLearner Flow, Hydra, MLflow, Docker, and Kubernetes, enabling reproducible training, experiment tracking, scalable deployments, shadow deployments, and automated testing integrated into Meta CI/CD workflow
Education
verified_user
0% verified
- CAI Agent Developer SpecializationCoursera – Vanderbilt University
- ADeep Learning SpecializationAndrew Ng (Coursera – DeepLearning.AI)
- MAWS Certified Machine LearningMLS-C01
- AGenerative AI with Large Language ModelsAWS & DeepLearning.AI)
- MMicrosoft AI & ML Engineering Professional CertificateMicrosoft)
- Master of ScienceCleveland State University