ProviderBench
All projects

Own Open Source Product · Solo Developer

ProviderBench

Measured, not marketed.

Role

Own Open Source Product · Solo Developer

Period

2026 to Present

Technical frame

Go / Next.js

Initial problem

Cloud plans advertise vCPUs, RAM, and NVMe storage, but those labels say little about the performance a customer receives on a real shared host. CPU steal time, noisy-neighbor variance, random I/O, and fsync latency stay invisible until a production workload is already affected. Existing comparison tables repeat specification sheets instead of publishing measurements that can be reproduced or disputed.

Implementation

ProviderBench ships as a static Go binary that runs a complete benchmark in roughly ninety seconds and writes a portable JSON report. It measures compute, memory, disk, network, and virtualization signals with documented source code and copy-to-run commands. Managed Hetzner campaigns can provision multiple fresh hosts, spread samples across physical infrastructure, execute repeated measurements, and tear everything down. The Next.js website publishes dated raw results and keeps provisional datasets visibly separate from ranked comparisons.

Outcome

  • Turns cloud-provider claims into measurements that buyers can reproduce themselves
  • Makes overselling signals such as CPU steal time and fsync behavior visible before migration
  • Keeps every comparison tied to dated raw data and public benchmark source code

My contribution

  • Designed the benchmark methodology, report format, provisional-data rules, and public comparison model
  • Built the Go CLI, Linux measurement probes, managed campaign runner, and JSON pipeline
  • Built and deployed the Next.js comparison site, metric documentation, and reproducibility workflow

Impact

  • Turns cloud-provider claims into measurements that buyers can reproduce themselves
  • Makes overselling signals such as CPU steal time and fsync behavior visible before migration
  • Keeps every comparison tied to dated raw data and public benchmark source code

What mattered

01

Dependency-free Go CLI with a full run in roughly ninety seconds

02

Measurements for CPU throughput, steal time, memory, random I/O, fsync, and network

03

Raw dated JSON reports that remain reproducible and independently disputable

04

Managed Hetzner campaigns across fresh instances and repeated samples

05

Public metric methodology with direct links to the benchmark source

06

Copy-to-run commands connecting every published number back to the CLI

Insights

ProviderBench cloud provider benchmark comparison

The live comparison connects every metric to its method, source, and CLI command

ProviderBench CLI documentation

One static Go binary runs the benchmark and produces a shareable JSON report

Technical frame

Technical frame

The technical frame sits at the end on purpose: it shows the engineering substance behind the solution.

GoNext.jsLinuxBenchmarkingJSONHetzner CloudVercel
Koenigsegg Connected Vision

Next project

Koenigsegg Connected Vision

An unofficial product concept for a living digital twin.

View project

Start a project