Skip to content

Reduce overhead of CUDA actors#3

Merged
KyleKlenk merged 1 commit into
uofs-simlab:mainfrom
fahim-hamid:smaller-overhead-hopefully
Jul 21, 2026
Merged

Reduce overhead of CUDA actors#3
KyleKlenk merged 1 commit into
uofs-simlab:mainfrom
fahim-hamid:smaller-overhead-hopefully

Conversation

@fahim-hamid

Copy link
Copy Markdown

Summary of changes:

  • Reduced CAF CUDA overhead in command submission, argument packing, lookup, allocation, and temporary command handling.
  • Improved CUDA context lifetime, stream ordering, resource teardown, and module reload behavior.
  • Batched synchronous output collection and removed unnecessary host/device copies where possible.
  • Made CUDA memory ownership and callback handling safer.
  • Updated SC26 sequence benchmarks to use consistent native/CAF semantics.
  • Added CUDA 12/13 and Windows/MSVC compatibility fixes.
  • Added automatic cubin, DLL, and executable output handling.
  • Updated benchmark runners to support CMake builds and calculate averages/stddev.
  • Added portable CMake targets for all SC26 benchmarks w/ instructions libcaf_cuda/sc26/benchmarks/README.md.
  • Preserved the existing Makefile and legacy benchmark-runner workflows where practical, hopefully any personal scripts don't break, let me know if I can fix anything!

@fahim-hamid
fahim-hamid force-pushed the smaller-overhead-hopefully branch from 1286370 to 239b78a Compare July 20, 2026 23:07
@KyleKlenk
KyleKlenk merged commit a9c8696 into uofs-simlab:main Jul 21, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants