The posting, in Doctolib's own words
archived Nov 19, 2026Join a team of passionate and hardworking entrepreneurs to transform healthcare! Working in the tech team at Doctolib involves building innovative products and features to improve the daily lives of care teams and patients. We work in feature teams in an agile environment, while collaborating with product, design, and business teams.
What you'll do
We are looking for a Staff AI Software Engineer to join the AI Evaluation team (EvalX) at Doctolib and help every AI product team measure, understand and improve the quality, reliability and safety of their systems. Our AI products span patient-facing conversational agents, AI-powered phone assistants and clinical assistants supporting healthcare professionals. EvalX builds the platform, tools and methods that let these teams evaluate continuously, and our ambition is to make evaluation a core engineering practice. In this role, you will work at the intersection of platform engineering, applied AI and product teams: you build shared evaluation capabilities, and you work directly with the teams that use them so they actually get adopted.
Read the full posting ↓
In this role, you will:
Design, ship, and operate production-grade evaluation tooling (APIs, services, CI/CD integrations) used by AI product teams across Doctolib Work hands-on with product teams to assess how they evaluate today, define improvement plans, and help them own their evaluation quality Design evaluation strategies for agentic systems, combining deterministic checks, LLM-as-a-judge, simulation-based testing, and human review Build intelligent capabilities for production sampling, dataset representativeness monitoring, distribution-shift detection, and test case generation Help teams define meaningful quality metrics, representative datasets, and reliable quality gates throughout the development lifecycle Turn recurring product needs into reusable, self-service platform capabilities, and measure success through adoption, team autonomy, and evaluation coverage Contribute to cross-functional initiatives that shape Doctolib's AI platform and best practices for building and evaluating systems