r/MacOS MacBook Pro 8d ago

Help How to check Apple Neural Engine (ANE) usage while running models?

Hi,

I'm building AI applications and I do development/testing on my M5 MacBook Pro. I can see, whenever I'm using AI, my RAM and my GPU usage starts going high, which is expected. But I want to use the Apple Neural Engine (ANE) to my advantage for faster performance. I run models through Ollama or from LMStudio so far, when I observed in mactop, they seem to use GPU only, and the ANE usage is 0.

My questions:

  1. Am I really using ANE without my knowledge, but mactop shows it wrong?
  2. If mactop is correct, and if I am actually not using ANE, which LLM runner is optimized for MLX ? I heard Ollama recently supports MLX, so it should have taken advantage, right?
0 Upvotes

Duplicates