Benchmarking Object Store with Minio Wrap

bench_object_store.md

This test is done aginst a local instace of Minio, running on my laptop (Intel® Core™ i7-10510U CPU @ 1.80GHz × 8, Linux x1-carbon 6.2.0-37-generic x86_64 GNU/Linux)

wrap can be found at https://github.com/minio/warp

Benchmarking Object Store

Mixed benchmark

$ warp mixed --host=127.0.0.1:9000 --access-key=$MINIO_KEY --secret-key=$MINIO_SEC --autoterm --bucket=test

Throughput 240.7MiB/s within 7.500000% for 52.094s. Assuming stability. Terminating benchmark.
warp: Benchmark data written to "warp-mixed-2023-11-23[174256]-JJhh.csv.zst"                                                                                                                                    
Mixed operations.
Operation: DELETE, 10%, Concurrency: 20, Ran 3m5s.
* Throughput: 5.33 obj/s

Operation: GET, 45%, Concurrency: 20, Ran 3m6s.
* Throughput: 239.46 MiB/s, 23.95 obj/s

Operation: PUT, 15%, Concurrency: 20, Ran 3m6s.
* Throughput: 79.89 MiB/s, 7.99 obj/s

Operation: STAT, 30%, Concurrency: 20, Ran 3m6s.
* Throughput: 15.96 obj/s

Cluster Total: 319.09 MiB/s, 53.17 obj/s over 3m6s.
warp: Cleanup Done.

GET with Range benchmark

$ warp get --host=127.0.0.1:9000 --access-key=$MINIO_KEY --secret-key=$MINIO_SEC --autoterm --bucket=test --range
Throughput 357.3MiB/s within 7.500000% for 11.312s. Assuming stability. Terminating benchmark.
warp: Benchmark data written to "warp-get-2023-11-23[175615]-0Urz.csv.zst"

----------------------------------------
Operation: PUT. Concurrency: 20
* Average: 131.93 MiB/s, 13.19 obj/s

Throughput, split into 185 x 1s:
* Fastest: 158.8MiB/s, 15.88 obj/s
* 50% Median: 134.8MiB/s, 13.48 obj/s
* Slowest: 98.1MiB/s, 9.81 obj/s

----------------------------------------
Operation: GET. Concurrency: 20
* Average: 333.74 MiB/s, 183.17 obj/s

Throughput, split into 40 x 1s:
* Fastest: 385.5MiB/s, 190.45 obj/s
* 50% Median: 332.2MiB/s, 200.90 obj/s
* Slowest: 268.6MiB/s, 195.35 obj/s
  warp: Cleanup Done

List benchmark

$ warp list --host=127.0.0.1:9000 --access-key=$MINIO_KEY --secret-key=$MINIO_SEC --autoterm --bucket=test
Throughput 27006.2 objects/s within 7.500000% for 15.344s. Assuming stability. Terminating benchmark.
warp: Benchmark data written to "warp-list-2023-11-23[175850]-noqc.csv.zst"

----------------------------------------
Operation: PUT. Concurrency: 20
* Average: 1.24 MiB/s, 1303.83 obj/s

Throughput, split into 7 x 1s:
* Fastest: 1463.9KiB/s, 1499.05 obj/s
* 50% Median: 1369.5KiB/s, 1402.37 obj/s
* Slowest: 1103.0KiB/s, 1129.44 obj/s

----------------------------------------
Operation: LIST
* Average: 25664.13 obj/s

Throughput, split into 55 x 1s:
* Fastest: 30766.44 obj/s
* 50% Median: 26533.34 obj/s
* Slowest: 20246.66 obj/s
  warp: Cleanup Done.