Server: fused single-GPU decode for --batched-session (co-decode 2-4 sessions in one graph pass)#604
Open
iCreil wants to merge 10 commits into
Open
Server: fused single-GPU decode for --batched-session (co-decode 2-4 sessions in one graph pass)#604iCreil wants to merge 10 commits into
iCreil wants to merge 10 commits into
Enhance your code review process with GitHub Actions
GitHub Actions make it easy to automate all your software workflows, now with world-class CI/CD.
Build, test, and deploy your code right from GitHub. Learn more about GitHub Actions.
Linux, macOS, Windows, and containers
Matrix builds
Any language
Live logs
Built-in secret store
