OpenAI Hears You Whisper | Hackaday

Need to you want to test large-good quality voice recognition without having acquiring something, superior luck. Confident, you can borrow the speech recognition on your cellphone or coerce some digital assistants on a Raspberry Pi to deal with the processing for you, but these are not excellent for major operate that you don’t want to be tied to some closed-supply remedy. OpenAI has launched Whisper, which they claim is an open up source neural internet that “approaches human level robustness and precision on English speech recognition.” It seems to perform on at the very least some other languages, also.

If you try the demonstrations, you’ll see that speaking rapid or with a beautiful accent does not seem to be to impact the final results. The publish mentions it was properly trained on 680,000 several hours of supervised details. If you ended up to discuss that substantially to an AI, it would acquire you 77 years devoid of sleep!

Internally, speech is split into 30-second bites that feed a spectrogram. Encoders approach the spectrogram and decoders digest the effects making use of some prediction and other heuristics. About a third of the knowledge was from non-English speaking sources and then translated. You can read the paper about how the generalized training does underperform some especially-experienced products on normal benchmarks, but they belive that Whisper does much better at random speech beyond certain benchmarks.

The measurement of the product at the “tiny” variation is however 39 megabytes and the “large” variant is around a gig and 50 %. So this most likely is not likely to operate on your Arduino any time shortly. If you do want to code, nevertheless,  it is all on GitHub.

There are other methods, but not this robust. If you want to go the assistant-based route, here’s some inspiration.