Evals London

Evaluating AI applications, not just models.

A London meetup and community for people who build AI-powered products. Model benchmarks on leaderboards are interesting, but how do you evaluate your specific RAG pipeline in production?

Sister meetup of Evals.cz, which has run four Prague editions since February 2026. More

What we tackle

🔍

RAG system quality

Evaluating retrieval quality and end-to-end RAG pipelines in production

⚠️

Production regressions

How to catch and fix problems in deployed AI systems

👥

Human-in-the-loop

Evaluation approaches that combine human expertise with automation

⚙️

Development lifecycle

Integrating evals into development and CI/CD pipelines

Who it's for

ML/AI engineers

You deploy and monitor models in production

Backend developers

You integrate LLMs or RAG into an existing product

Data scientists

You measure and improve the performance of AI systems

Product managers

You need to understand the quality of AI features

AI researchers

You study the reliability and safety of AI

Beginners welcome

Practical interest and curiosity are all you need

Meetup format

LocationDawn Capital, LondonLevel 7, Ilona Rose House, Manette Street, London W1D 4AL
WhenWednesday 11 November 2026, 18:00–21:00
FormatKeynote + discussion tables
LanguageEnglish
"What broke in production and how we fixed it"— no sales pitches

Discussion tables

After the keynote, from 19:15, the room splits into small groups. Each table has one topic and one lead.

[01]

LLM evals 101

Led by Šimon Podhajský

[02]

Building evals with domain experts

Led by Conor Svensson

[03]

Agent and eval debugging

Led by Reza Amini

[04]

Evaluating open-ended research agents

Led by Giovanni Riva, Edison Scientific

[05]

Long-running agent swarm evals

Led by Lindell Cumes

[06]

Trusting evals

Led by Jenny Chim

How it works
  • 15–20 people per table, though numbers vary.
  • The lead opens with a few minutes on how they approach the problem. Then the group works through its own cases.
  • No slides at the tables.
  • Pick one table and ideally stay there.
  • Bring an eval problem you are stuck on.
House rules
  • Talk about systems you've worked on yourself.
  • Share real numbers, including the embarrassing ones.
  • No sales pitches, from the stage or at the tables.

Partners

Want to support a future edition? Partner with us

Registration closed

Edition #1

Wed 11 Nov at Dawn Capital

Registration is closed and the waitlist is on Luma. Samuel Colvin, creator of Pydantic, opens with the keynote "Constrained Optimism". Then six discussion tables, each with its own lead. Bring an eval problem you're stuck on.

Wed 11 Nov 202618:00–21:00Dawn CapitalLondon
Join the waitlist on Luma
A taster

What we'll dig into

  • Error analysis & failure taxonomies
  • Assertion-based evaluation
  • LLM-as-Judge frameworks
  • RAG-specific metrics
  • Evaluating agents & tool use
  • Human evaluation & annotation design
  • Wiring evals into CI/CD