How accurate is Apple’s new transcription AI?

As I pointed out recently, while Whisper is top of mind and still a pretty good transcription model, OpenAI has moved away from it. That said, the fact that Apple’s new transcription API is faster than Whisper is great news. But how accurate is it? We tested it out.

Full disclosure: the idea for this post came from developer Prakash Pax, who did his own tests. As he explains it:

I recorded 15 audio samples in English, randomly ranging from 15 seconds to 2 minutes. And tested…