Home / How we test questions
AccuracyWe test every question before you do.
One wrong answer can teach you the wrong fact. So we built Teacup Test around one rule: every question is tied to a fact and checked against it, and a second AI model tests it again.
1. Facts first
We write each fact from the official handbook in our own words, with its chapter and topic. We never copy the handbook's sentences. Where the world has moved on since the 2013 handbook, we say "the handbook says", because the real test follows the handbook.
2. One fact, one question
Every question is written from one fact, in one of four kinds of question: one answer, true or false, which of two statements is right, and choose two. The explanation says why the right answer is right, in simple English.
3. A second test
A different AI model, from another company, re-tests every question against its fact: one right answer only, the answer matches the fact, British spelling. If it has any doubt, the question is taken out. Every new question passes this test before it goes live.
4. Reports, usually within the hour
Every question has a "Report a question" button. A report is re-tested, usually within the hour. If the question is wrong or unclear, it is taken out for everyone at once and replaced. If you leave your email, we tell you what we found.
Our own numbers, today
- 572 live questions, written from 327 facts
- 572 of them re-tested by our second model so far
- 0 reported questions re-tested this month
These numbers come straight from our question bank and update by themselves. Questions retired after a report are counted out at once.
Three reports, out it goes
If three different learners report the same question within a week, we take it out, whatever the re-test says. A few questions too few is better than one wrong answer. Reports from people who aren't signed in count as one learner together, so nobody can take out good questions on their own.
Put the kettle on. Your first mock test is free.
24 questions. 45 minutes. No sign-up.
Take a free mock test