Skip to content

trtllm: forward routing.priority to the engine waiting queue - #28

Merged
sopwg612 merged 2 commits into
feat-deepinfra-runtime-07-09from
feat-trtllm-routing-priority
Aug 3, 2026
Merged

trtllm: forward routing.priority to the engine waiting queue#28
sopwg612 merged 2 commits into
feat-deepinfra-runtime-07-09from
feat-trtllm-routing-priority