Pebble Benchmarks

Last updated

Benchmarks are run nightly using pebble bench ycsb on AWS machines equipped with local SSD storage. The AWS instances show remarkably high instance to instance performance variability. In order to smooth out that variability the benchmarks are run multiple times each (using different instances) and outliers are excluded.

Enabled columnar blocks

Enabled value separation (values=1024 variant)

Vary count of cached blob file readers

YCSB A (50% reads, 50% updates, zipf key distribution)

YCSB B (95 reads, 5% updates, zipf key distribution)

YCSB C (100% reads, zipf key distribution)

YCSB D (95% reads, 5% updates, uniform key distribution)

YCSB E (95% scans, 5% updates, zipf key distribution)

Insert-only (100% inserts, zipf key distribution)

Write throughput (100% inserts, zipf key distribution)

This benchmark attempts to find the optimal write throughput by driving more and more load against the DB until a target heuristic fails (currently a mixture of number of L0 sublevels, L0 files, and whether the DB has experienced a write stall). These benchmarks are run nightly using pebble bench write on GCP n2-standard-32 machines equipped with 16 local SSDs in a RAID 0 array.