Skip to content

Remove Alpine reference from README language section#762

Merged
MDA2AV merged 2 commits into
mainfrom
bench-g11
May 26, 2026
Merged

Remove Alpine reference from README language section#762
MDA2AV merged 2 commits into
mainfrom
bench-g11

Conversation

@MDA2AV
Copy link
Copy Markdown
Owner

@MDA2AV MDA2AV commented May 26, 2026

Description

PR Commands — comment on this PR to trigger (requires collaborator approval):

Command Description
/benchmark -f <framework> Run all benchmark tests
/benchmark -f <framework> -t <test> Run a specific test
/benchmark -f <framework> --save Run and save results (updates leaderboard on merge)

Always specify -f <framework>. Results are automatically compared against the current leaderboard.

Run benchmarks locally

You can validate and benchmark your framework locally with the lite script — no CPU pinning, fixed connection counts, all load generators run in Docker.

./scripts/validate.sh <framework>
./scripts/benchmark-lite.sh <framework> baseline
./scripts/benchmark-lite.sh --load-threads 4 <framework>

Requirements: Docker Engine on Linux. Load generators (gcannon, h2load, h2load-h3, wrk, ghz) are built as self-contained Docker images on first run.

@MDA2AV
Copy link
Copy Markdown
Owner Author

MDA2AV commented May 26, 2026

/benchmark -f genhttp-11 --save

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 26, 2026

👋 /benchmark request received. A collaborator will review and approve the run.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 26, 2026

👋 Heads up! This PR modifies the following frameworks:

@github-actions
Copy link
Copy Markdown
Contributor

github-actions Bot commented May 26, 2026

Benchmark Results

Framework: genhttp-11 | Test: all tests

Test Conn RPS CPU Mem Δ RPS Δ Mem
baseline 512 1,460,048 5726.1% 217MiB NEW NEW
baseline 4096 1,446,129 5809.5% 545MiB NEW NEW
pipelined 512 2,969,441 5001.8% 166MiB NEW NEW
pipelined 4096 2,864,770 5393.6% 436MiB NEW NEW
limited-conn 512 981,946 5684.4% 199MiB NEW NEW
limited-conn 4096 937,433 5813.2% 357MiB NEW NEW
json 4096 664,500 5960.5% 492MiB NEW NEW
json-comp 512 331,651 5560.6% 448MiB NEW NEW
json-comp 4096 320,499 5947.0% 2.2GiB NEW NEW
json-comp 16384 292,823 5794.4% 4.0GiB NEW NEW
json-tls 4096 268,302 5741.4% 566MiB NEW NEW
upload 32 2,663 2684.9% 104MiB NEW NEW
upload 256 3,016 3953.7% 156MiB NEW NEW
api-4 256 39,577 392.9% 142MiB NEW NEW
api-16 1024 116,025 1528.3% 288MiB NEW NEW
static 1024 39,675 4184.6% 424MiB NEW NEW
async-db 1024 173,341 3522.3% 334MiB -1.6% -16.5%
crud 4096 454,457 4081.8% 615MiB NEW NEW
echo-ws 512 1,729,463 5802.1% 167MiB NEW NEW
echo-ws 4096 1,769,589 5896.0% 768MiB NEW NEW
echo-ws 16384 1,574,650 5776.0% 1.8GiB NEW NEW
Full log 

  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency    295us    217us    510us   1.81ms   4.01ms

  8647316 frames sent in 5.00s, 8647315 frames received
  Throughput: 1.73M req/s
  Bandwidth:  11.54MB/s
  WS upgrades: 512
  WS frames:   8647315
  Latency samples: 8647276 / 8647315 responses (100.0%)
[info] CPU 5802.1% | Mem 167MiB

=== Best: 1729463 req/s (CPU: 5802.1%, Mem: 167MiB) ===
[info] saved results/echo-ws/512/genhttp-11.json
httparena-bench-genhttp-11
httparena-bench-genhttp-11

==============================================
=== genhttp-11 / echo-ws / 4096c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   2.47ms   1.55ms   5.55ms   15.00ms   27.90ms

  7099550 frames sent in 5.00s, 7095812 frames received
  Throughput: 1.42M req/s
  Bandwidth:  9.61MB/s
  WS upgrades: 4096
  WS frames:   7095812
  Latency samples: 7095800 / 7095812 responses (100.0%)
[info] CPU 5574.5% | Mem 474MiB

[run 2/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   2.07ms   1.33ms   4.56ms   12.30ms   24.00ms

  8749328 frames sent in 5.00s, 8745715 frames received
  Throughput: 1.75M req/s
  Bandwidth:  11.81MB/s
  WS upgrades: 4096
  WS frames:   8745715
  Latency samples: 8745684 / 8745715 responses (100.0%)
[info] CPU 5923.9% | Mem 619MiB

[run 3/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     4096 (64/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   2.21ms   1.56ms   4.77ms   11.50ms   20.90ms

  8851269 frames sent in 5.00s, 8847949 frames received
  Throughput: 1.77M req/s
  Bandwidth:  11.93MB/s
  WS upgrades: 4096
  WS frames:   8847949
  Latency samples: 8847863 / 8847949 responses (100.0%)
[info] CPU 5896.0% | Mem 768MiB

=== Best: 1769589 req/s (CPU: 5896.0%, Mem: 768MiB) ===
[info] saved results/echo-ws/4096/genhttp-11.json
httparena-bench-genhttp-11
httparena-bench-genhttp-11

==============================================
=== genhttp-11 / echo-ws / 16384c (tool=gcannon) ===
==============================================
[info] waiting for server...
[info] server ready

[run 1/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   5.00ms   3.08ms   11.70ms   29.00ms   47.70ms

  6279883 frames sent in 5.00s, 6269477 frames received
  Throughput: 1.25M req/s
  Bandwidth:  8.75MB/s
  WS upgrades: 10406
  WS frames:   6269477
  Latency samples: 6269477 / 6269477 responses (100.0%)
[info] CPU 5506.9% | Mem 857MiB

[run 2/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   8.25ms   5.38ms   19.30ms   41.90ms   65.40ms

  7818158 frames sent in 5.00s, 7802464 frames received
  Throughput: 1.56M req/s
  Bandwidth:  10.99MB/s
  WS upgrades: 16383
  WS frames:   7802464
  Latency samples: 7802458 / 7802464 responses (100.0%)
[info] CPU 5919.9% | Mem 1.4GiB

[run 3/3]
gcannon v0.5.3 [WS]
  Target:    localhost:8080/ws
  Threads:   64
  Conns:     16384 (256/thread)
  Pipeline:  1
  Req/conn:  unlimited (keep-alive)
  Expected:  200
  Duration:  5s


  Thread Stats   Avg      p50      p90      p99    p99.9
    Latency   8.16ms   5.28ms   19.30ms   42.30ms   64.20ms

  7889636 frames sent in 5.00s, 7873253 frames received
  Throughput: 1.57M req/s
  Bandwidth:  11.11MB/s
  WS upgrades: 16383
  WS frames:   7873253
  Latency samples: 7873253 / 7873253 responses (100.0%)
[info] CPU 5776.0% | Mem 1.8GiB

=== Best: 1574650 req/s (CPU: 5776.0%, Mem: 1.8GiB) ===
[info] saved results/echo-ws/16384/genhttp-11.json
httparena-bench-genhttp-11
httparena-bench-genhttp-11
[info] skip: genhttp-11 does not subscribe to echo-ws-pipeline
[info] rebuilding site/data/*.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/frameworks.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/api-16-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/api-4-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/async-db-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/baseline-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/crud-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/echo-ws-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-16384.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-comp-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/json-tls-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/limited-conn-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-4096.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/pipelined-512.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/static-1024.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-256.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/upload-32.json
[updated] /home/diogo/actions-runner/_work/HttpArena/HttpArena/site/data/current.json
[info] done
httparena-postgres
httparena-redis
[info] restoring loopback MTU to 65536
[info] restoring CPU governor → powersave

@MDA2AV MDA2AV merged commit d169549 into main May 26, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@Kaliumhexacyanoferrat Kaliumhexacyanoferrat Awaiting requested review from Kaliumhexacyanoferrat Kaliumhexacyanoferrat is a code owner

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@MDA2AV