Inferencing at 10.33 t/s on Qwen 3.5 35B on a $300 laptop

r/LocalLLaMA
Open Source AI

Overview: As the market for consumer computing parts becomes scarce due to the AI boom, finding ways to use lower-end hardware for less-demanding applications of AI can be highly beneficial. This is an ongoing project of mine to push the limits of a standard laptop on pure cpu/ram inference in highly favorable conditions.