New Release of ROCm based MLX LLM Engine - lemon-mlx-engine

r/LocalLLaMA
Generative AI

13 into the lemon-mlx-engine which means you get to try the latest ROCm on your local hardware with the MLX engine! This also includes various bug fixes and kernel fixes we have been seeing in Qwen3, 3.5 and 3.6 MoE and dense. try it out! submitted by /u/GeramyL [link] [comments]