A new standard for AI powered live captions
Add flawless closed captions to your live stream through automatic speech-to-text conversion
Our AI powered captioning solution is easy to use, reliable and efficient. Its unique speech-to-text technology, with optional support for human real-time correction, makes your captions more accurate and readable than ever.
Unique speech-to-text technology
Our technology for auto-generating closed captions leverages the latency that comes with the HTTP Live Streaming protocol. By slightly increasing it, we achieve a triple goal:
- Longer audio streams can be sent to the Automatic Speech Recognition (ASR) engine. This allows the ASR engine to better interpret the words and construct correct phrases and sentences. This increases the accuracy of the conversion.
- Optionally, a human editor can make real-time corrections to the automatically generated captions, before they are translated and shown in the live stream.
- Clevercast has slightly more time to process the ASR output. This allows us to improve the readability of the captions and makes them easier to understand.
Most accurate live captions available
For an indication of the difference in accuracy and readability with other platforms, we recorded the same live stream with auto-generated captions in Clevercast, YouTube and Vimeo. All recordings are unedited.
The live stream featured a number of different speakers, each with their own speech pattern and accent.
Note that Clevercast features to improve caption accuracy, such as keyword vocabularies and real-time correction, were NOT used during this test. All captions were generated fully automatically in real-time, without human intervention.
If you want to assess the quality of our live closed captions firsthand, don’t hesitate to request a trial account.
Above are unedited recordings of the same live stream with auto-generated captions in Clevercast, YouTube and Vimeo. The demo uses excerpts from the following videos available June 20, 2023 under a CC-BY 4.0 license:
Paywall: The Business of Scholarship by Jason Schmitt
Will saving poor children lead to overpopulation? Free material from WWW.GAPMINDER.ORG
Real-time correction for 100% accuracy
Even though the accuracy of speech-to-text conversion is already very high, some live streams require perfection. That’s why Clevercast offers a real-time correction interface.
The cloud interface lets you edit the AI generated captions in real-time, just before they are sent to the live stream (and translated into other languages). It lets you change words and move them to different lines for improved readibility.
Making these corrections is a simple task that requires no experience or training. Our intuitive interface allows anyone to edit the captions in a browser with mouse and keyboard.
Intelligent caption rendering in the player
Because of the increased latency, Clevercast can add the captions to the live stream in an intelligent manner. This allows Clevercast player to show (partial) sentences, rather than separate words. This makes the closed captions easier to read and understand.
Viewers, anywhere in the world, can watch the live stream and select their preferred caption language in our video player. Our customizable HTML5 player can be easily embedded into any device and platform. Just copy the embed code from Clevercast.
Alternatively, you can choose to display the rolling text in a separate widget. This widget also allows your viewers to change their preferred language.
Live AI translation to other languages
Clevercast can automatically translate closed captions in real-time and make the additional languages available in the live stream.
The accuracy of the translations mostly depends on the quality of the source captions. With an accurate source, all extra languages – even unpopular ones – will be translated with an 99.9+% accuracy. Note that when using our correction interface, the corrected captions will be used as the source for translation.
Alternatively, you can also use a professional captioner for the source language, combined with AI translation for the extra languages.
Cloud recording and Video on-Demand
Clevercast makes a cloud recording of the multilingual live stream, which can be downloaded. All caption languages can be downloaded as WebVTT files. This allows you to upload them to YouTube or social media channels for on-demand viewing.
You can also convert the cloud recording of your live stream to Video on-Demand (VoD). Our VoD player with all closed captions can be added to your site or platform by copying the embed code for your event.
Let us assist you
If you have no experience with automatically generated closed captions and are not sure whether it is the right choice for your event, don’t hesitate to contact us.
We can help you review your options and provide the necessary tips. If desired, we can offer professional correctors for your event, communicate with them, provide them with all the relevant documentation and monitor your live stream.
Get Started Now
Start live streaming today with a solution of choice. No credit card required.
Or contact us for more info.