Training-free speculative decoding for ONNX Runtime and Hugging Face PyTorch models
-
Updated
Jul 14, 2026 - Python
#
prompt-lookup-decoding
Here are 3 public repositories matching this topic...
(Re)-implementation of "Prompt Lookup Decoding" by Apoorv Saxena, with extended ideas from LLMA Decoding.
-
Updated
Aug 20, 2024 - Jupyter Notebook
Speculative Decoding on Bandwidth-Bound Hardware
-
Updated
Apr 20, 2026 - Jupyter Notebook
Add this topic to your repo
To associate your repository with the prompt-lookup-decoding topic, visit your repo's landing page and select "manage topics."