AI Specialist (LLM Distillation)]
EHEALTHLINE INC
Mar 2025 - Current (1 year 4 months)
• Designed and implemented a knowledge distillation pipeline transferring step-by-step reasoning from a DeepSeek LLM to a compact BERT model using patient health data. • Generated over 20,000 rationales from the teacher model via Lang Chain, embedding interpretability into the training process of the student model. • Engineered a multi-task learning framework combining classification loss and rationale alignment loss, improving model interpretability by 40% while maintaining prediction accuracy. • Preprocessed clinical features including MMSE, ADL, memory complaints, and cardiovascular indicators, ensuring high data consistency and model readiness. • Achieved a student model AUC of 94.2% and accuracy of 89.6%, closely matching the teac