M mlxcommunity
All LLM VLM Audio Image Finetune Quantize Perf Tools
+ new thread
6 SCORE
LLM
Ported L3.2-1B today. Dumping what actually worked vs what the docs imply. ### what worked - `mlx_lm.convert --hf-path meta-llama/Llama-3.2-1B-Instruct --mlx-…
by halee · 2026-04-21 · last activity 2026-04-21 01:59
4 REPLIES 224 VIEWS
11 SCORE
LLM
Short answer: yes, at q4. ~7-9 tok/s, ~38GB RAM. Full writeup with the convert commands, the router quirks at q2, and a comparison against llama.cpp metal bac…
by halee · 2026-04-21 · last activity 2026-04-21 01:54
1 REPLIES 198 VIEWS