Skip to content

[sglang] Experimental dense tensor-parallel recipe (NCCL all-reduce over VMM-IPC)#2

Draft
rchalamala wants to merge 22 commits into
devin/1784752573-sglang-nofabric-ep-ipcfrom
devin/1784764658-sglang-tensor-parallel
Draft

[sglang] Experimental dense tensor-parallel recipe (NCCL all-reduce over VMM-IPC)#2
rchalamala wants to merge 22 commits into
devin/1784752573-sglang-nofabric-ep-ipcfrom
devin/1784764658-sglang-tensor-parallel

[sglang] README: warmup-restore now default-on; document fallback, cl…

4769c0f
Select commit
Loading
Failed to load commit list.

There are no checks for this commit