Find out why a test fails only sometimes

Finds out why a test fails only some of the time, and shows you the runs that prove it.

Get started for free

What you ask

Search Acme

billing

2

  1. Lena

    @devboxes test/reminders.test.ts fails about one CI run in ten and I can't see a pattern. why?

  2. devboxes APP

    Test order. customer-import.test.ts leaves two reminders in the outbox and reminders.test.ts expects it empty, so it fails whenever import runs first. That explained every failure in 50 runs.

What devboxes does

  1. Run the test many times

    • devboxes runs the test at least 50 times and keeps the output of every failure.

  2. Compare the failures

    • You learn what's different between the runs that fail and the ones that pass.

  3. Make it fail on demand

    • The test then fails on demand, or you get a list of everything that was tried.

  4. Report the cause

    • Its reply names the cause and shows the runs that prove it.

Good for

Startups

More tasks to ship from issues

Ask devboxes to find out why a test fails only sometimes

Get started for free