Skip to content

test: add inference replay harness MVP - #1

Open
bk-nvidia wants to merge 1 commit into
mainfrom
feat/inference-replay-harness
Open

test: add inference replay harness MVP#1
bk-nvidia wants to merge 1 commit into
mainfrom
feat/inference-replay-harness

Conversation

@bk-nvidia

@bk-nvidia bk-nvidia commented Jul 29, 2026

Copy link
Copy Markdown
Owner

Summary

  • add a strict v1 synthetic replay fixture for the streaming 429 follow-up regression
  • launch the real nemo-relay process against a raw-TCP local provider
  • verify the 429 response and a successful follow-up stream on one reused upstream connection
  • add deterministic deadlines, sanitized diagnostics, fixture validation, and a focused just command

This is the smallest Phase 1 slice. It replays synthetic workload structure; ATOF/ATIF compilation is intentionally left for a follow-up.

Validation

  • cargo test -p nemo-relay-cli --test inference_replay_tests -- --nocapture
  • cargo test -p nemo-relay-cli --test inference_replay_tests streaming_429_followup
  • cargo clippy -p nemo-relay-cli --test inference_replay_tests -- -D warnings
  • cargo fmt --all -- --check

Signed-off-by: Benjamin Klieger <bklieger@nvidia.com>
@bk-nvidia
bk-nvidia force-pushed the feat/inference-replay-harness branch from 12dadee to d993bea Compare July 29, 2026 05:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant