Skip to content

Add optional aria2c download acceleration - #452

Open
zeeshanhaque21 wants to merge 2 commits into
youssofal:mainfrom
zeeshanhaque21:feat/aria2-downloads
Open

Add optional aria2c download acceleration#452
zeeshanhaque21 wants to merge 2 commits into
youssofal:mainfrom
zeeshanhaque21:feat/aria2-downloads

Conversation

@zeeshanhaque21

@zeeshanhaque21 zeeshanhaque21 commented Sep 4, 2026

Copy link
Copy Markdown

Summary

  • add an optional aria2c backend for parallel Hugging Face model pulls
  • resume existing .incomplete files with 16 segmented connections and four concurrent files
  • report accurate structured progress through aria2 JSON-RPC instead of sparse-file size
  • verify Hugging Face SHA-256 checksums before atomic rename
  • keep Hugging Face credentials off process arguments and fall back to Python when aria2c is unavailable

Usage

Install aria2 with Homebrew, then use the default auto selection or pass --download-backend aria2 to require it. Pass --download-backend python to retain the built-in path.

Verification

  • repository CI test set plus aria2, Hugging Face loader, and artifact suites
  • real loopback aria2 resume from a 512 KiB partial with final SHA-256 verification
  • Python bytecode compilation

Closes #451

@zeeshanhaque21
zeeshanhaque21 marked this pull request as ready for review September 4, 2026 18:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add optional aria2c backend for resumable Hugging Face model downloads

1 participant