hedged-requests

Package speculatively provides a simple mechanism to re-execute a task in parallel only after some initial timeout has elapsed.

State-aware hedged requests for serverless GPU inference — return the first valid result and cancel the losers with an audited receipt.

A zero-overhead, transparent sidecar for UDP Request Hedging built with eBPF/BCC. Bypasses Python GC and Scheduler jitter by handling retries directly in the SoftIRQ context.

Interactive simulator for speculative request hedges, tail latency, backend work amplification, and loser cancellation.

Adaptive hedged requests for Go. Reduces tail latency without external dependencies.

Simulate when hedged requests improve tail latency and when they cause overload.

Bounded hedged execution for reducing tail latency in Go services.