Nikhil Kasukurthi
Staff AI Engineer
Independent ML Research & Consulting · Göttingen, Germany
- MedAssist, an agentic LLM platform adopted by Apollo Hospitals. Its booking agent serves 100K daily active users.
- KARMA, an open-source LLM evaluation library the Gates Foundation adopted for healthcare bot evaluation.
- Speech LLM for medical transcription, served through custom vLLM plugins at 60% lower inference cost.
- Eka MCP server, open-source tools grounding LLMs in Indian clinical context (500K+ drugs, treatment protocols, clinical calculators).
I have 8 years of experience building AI products, now doing independent research and consulting. Right now I'm training a context-gating agent with GRPO that decides which retrieval results enter the main agent's context, and porting NVIDIA's Cosmos world model to vLLM Omni.
Before this, I led an AI team at Eka.care, a healthcare company building AI tools for doctors across India. I care most about the gap between what a model can do and what a user actually needs. I sat in clinics, watched doctors work through 100 patients a day in 3-minute windows, and built the products above around those constraints, along with medication search handling 1M requests a day.
Earlier, I built search ranking at Udaan for 5M daily users and published three peer-reviewed papers (Bioinformatics, IEEE ISBI) from research at NCBS-TIFR and SigTuple. I write here about what I learn along the way.