RAG tooling and generation API for customer support chatbot
Jan '25 – pres.
CHECK24
Tech Lead of team of 3 devs
Fullstack dev
Data Scientist
Led team scaling from single dev to 3-person fullstack team.
Established CI/CD practices, mentored members, defined roadmap.
Made critical Azure API pricing/performance decisions.
Handles 100+ RAG configurations, 200k daily requests.
Azure Cognitive Services
AWS CloudFormation
FastAPI
asyncio
Postgres+pgvector
React
MCP
Human preference - driven model comparison dashboard and fine-tuning
Mar '24 – Dec '24
CHECK24
Data Scientist
API dev
Built interactive ELO scoring dashboard to evaluate and compare GPT, Claude, Gemini and other models based on human agents' selection preferences from multiple model suggestions.
Developed end-to-end fine-tuning (GPT-3.5/4o) and evaluation pipeline.
Designed strategy for systematic model rollouts based on real-time (daily) preference data from agents.
Built API serving 4000+ suggestions daily from diverse models/providers.
Azure Cognitive Services (OpenAI models)
OpenAI fine-tuning api
Vertex AI (Claude and Gemini models)
Streamlit
Search Query Spellchecker
Mar '22 – Mar '24
CHECK24
Data Scientist
API dev
Designed and built ensemble spellchecker with custom seq2seq transformer, owning the complete roadmap: dataset engineering, model training, evaluation, deployment, monitoring, and KPI definition. Delivered production system: 10+ req/s at 200ms median response time, <1% overcorrection rate. Revisited twice over 18 months for retraining and optimization.
Huggingface Transformers
Elasticsearch
Docker Compose
Pandas
Leadership and Mentoring Experience
2025 CHECK24 Lead responsibility in team of 3 devs, 2 POs (see above)
2024/2025 CHECK24 Focused onboarding of 2 junior hires (1 month each)
2022 CHECK24 Mentored a junior DS for 6 months with daily guidance
2021 Cognostics Led 2-month project with 2 working students