All issues

Search results

Add vLLM-compatible observability metrics and GuideLLM benchmark interoperability

enhancementNew feature or requestNew feature or request

Status: Open.

#192 In scouzi1966/maclocal-api;

· scouzi1966 opened on Aug 17, 2026

Add Qwen 3.8 VLM vision-tower support in API and WebUI

enhancementNew feature or requestNew feature or request

Status: Open.

#191 In scouzi1966/maclocal-api;

· scouzi1966 opened on Aug 17, 2026

Qwen 3.8 MTP sidecar is loaded as base-model weights and prevents startup

bugSomething isn't workingSomething isn't working

Status: Open.

#181 In scouzi1966/maclocal-api;

· scouzi1966 opened on Aug 16, 2026

Enhancement: Record chat sessions to disk as OpenAI-shaped JSONL (--record)

Status: Open.

#138 In scouzi1966/maclocal-api;

· jesserobbins opened on Jun 18, 2026

Pre-existing assertion failures on Qwen3.5-35B-A3B-4bit (--concurrent + --enable-grammar-constraints): streaming tool-call coercion drift + same-seed non-determinism

Status: Open.

#127 In scouzi1966/maclocal-api;

· scouzi1966 opened on May 10, 2026

Concurrent x8 prefix cache + grammar returns empty responses

Status: Open.

#86 In scouzi1966/maclocal-api;

· scouzi1966 opened on Apr 4, 2026

Feature request: add Gemma 4 audio input support

Status: Open.

#85 In scouzi1966/maclocal-api;

· scouzi1966 opened on Apr 4, 2026

Your project is featured in Awesome MLX

Status: Open.

#65 In scouzi1966/maclocal-api;

· raullenchai opened on Mar 26, 2026

GET /v1/models should list cached models from MACAFM_MLX_MODEL_CACHE

Status: Open.

#64 In scouzi1966/maclocal-api;

· scouzi1966 opened on Mar 26, 2026

Nemotron-3-Super-120B: 7 tok/s vs 33 tok/s claimed — fused MoE kernel needed

Status: Open.

#52 In scouzi1966/maclocal-api;

· scouzi1966 opened on Mar 16, 2026

Support dense Qwen3.5 model architecture (qwen3_5)

Status: Open.

#31 In scouzi1966/maclocal-api;

· jsirish opened on Mar 2, 2026

feat - afm as proxy for intelligent routing

Status: Open.

#18 In scouzi1966/maclocal-api;

· rimusz opened on Feb 17, 2026