OpenVino Runs very slow on Apple Silicon Mac, probably using CPU speeds only

Just installed latest Audacity with OpenVino. The experience isn’t really going well for me. Super audio restoration takes over an hour to finish on audio that lasts two minutes long. Demucs is also 20 times slower with audacity. haven’t tried music generation features yet. Within the devices list to use, I only see “CPU”. The only thing that seems to work is noise restoration and deep filter net 3. Any suggestions?

What kind of system (CPU in particular) are you using? For reference, here is the list of supported OpenVINO platforms: System Requirements — OpenVINO™ documentation

When you say Demucs is 20 times slower with audacity – what are you comparing to?

Ah sorry, I missed the ‘Apple Silicon Mac’ in the title – which model are you using? And yes, for Mac devices OpenVINO only supports running on the CPU.

My Mac is an M4 Mac with 16 GB of RAM and 512 GB of SSD space. The CPU specs are as follows, a 10 core CPU with four performance cores and 6 efficiency course. 10 core GPU with 16 GB unified memory. Home brew installed. Accessibility (voiceover) features enabled, can’t be disabled because I rely on these features. macOS Sequoia 15.5.

When I say I am comparing audacity Demucs to something, I’m referring to the installation through PIP and running the command line tool.

Hey @djallegretto,
OpenVINO isn’t optimized for Apple Silicon, so everything runs on CPU only — that’s why it’s so slow. Apple’s Neural Engine isn’t supported, and no GPU acceleration is available on macOS. For now, you might get slightly better results using Rosetta or sticking to lighter effects. Hopefully, future updates improve performance on M1/M2 Macs.