M mlxcommunity
Finetune

LoRA finetuning Gemma2-2B on M3 Max — full run writeup

by halee · 2026-04-21 02:00
5

30k-sample instruction tune of Gemma2-2B. ~3 hours on M3 Max 64G.

mlx_lm.lora --train --model mlx-community/gemma-2-2b-4bit --data ./corpus.jsonl --batch-size 8 --iters 8000 --lora-layers 16

0 reply(ies)

sign in to reply.