r/MacOS • u/angrythunder64 MacBook Pro • 8d ago
Help How to check Apple Neural Engine (ANE) usage while running models?
Hi,
I'm building AI applications and I do development/testing on my M5 MacBook Pro. I can see, whenever I'm using AI, my RAM and my GPU usage starts going high, which is expected. But I want to use the Apple Neural Engine (ANE) to my advantage for faster performance. I run models through Ollama or from LMStudio so far, when I observed in mactop, they seem to use GPU only, and the ANE usage is 0.
My questions:
- Am I really using ANE without my knowledge, but mactop shows it wrong?
- If mactop is correct, and if I am actually not using ANE, which LLM runner is optimized for MLX ? I heard Ollama recently supports MLX, so it should have taken advantage, right?
Duplicates
mac • u/angrythunder64 • 8d ago
Question How to check Apple Neural Engine (ANE) usage while running models?
macbookpro • u/angrythunder64 • 8d ago