Skip to main content

Pick a database on evidence

We want a database choice anyone can check: the same open tests for every engine, every result public.

  • 40 engines checked
  • 4 protocols
  • TPC-C on 32 vCPU · 128 GB
  • Open source

Building a database? Get it measured

Stroppy is an open project that measures databases the same way and publishes every result. We run the workloads, check protocol compatibility against the original engine, and link every number to the run behind it.

40
engines checked for protocol compatibility
4
protocols: PostgreSQL, MySQL, MongoDB, Elasticsearch
7
TPC-C runs in the public rating, each with its report
4
tools behind the numbers

What gets in the way of choosing a database

Compatibility

“Compatible” doesn’t say what breaks

Engines claim the PostgreSQL or MySQL protocol; clients find the gaps in production, one query at a time.

Stroppy Conformity runs the same checks on the original and on the engine, and keeps what each answered: the request, the original’s reply, the engine’s reply.

Open the conformity map

Speed

Vendor benchmarks don’t compare

Each vendor picks its own workload, machine and settings, so two published numbers rarely measure the same thing.

We run the same TPC-C on one 32 vCPU · 128 GB node, every engine deployed and tuned the same way, and every row opens the report of its run.

See the ratings

Client

The load generator is part of the result

How a client sends a transaction changes the number it reports, often by more than the database does.

On the same OrioleDB, the same TPC-C ran at 4,410 transactions a second with 18 round trips each, and at 15,791 with one. The rating shows both.

How we found it

Effort

A bench stand takes weeks

Machines, deployment, tuning, monitoring and teardown come before the first number, and again for every engine.

Stroppy Cloud brings the stand up in your own cloud account, deploys and tunes the database, runs the test and keeps the report after the machines are gone.

Stroppy Cloud

“PostgreSQL‑compatible” rarely is

Each engine against PostgreSQL itself, on the same checks. A score is how often the engine answers like the original; the line marks 80, where we call an engine compatible.

16 of 20PostgreSQL-compatible engines score under 80 of 100

  1. alloydb-omni98.9
  2. cloudberry98.7
  3. yugabytedb97.7
  4. pgbouncer91.3
  5. cockroachdb68.2
  6. doltgres64.4
  7. serenedb62.7
  8. cedardb46.6
  9. duckgres33.8
  10. materialize31.4
  11. ydb21.5
  12. cratedb20.1
  13. risingwave18.1
  14. arcadedb15.2
  15. questdb13.7
  16. greptimedb13.3
  17. spanner-pg10.5
  18. picodata7
  19. clickhouse4.3
  20. immudb3.3