Live speech-to-text closed captions, T@H improvements, new features …

A new major version of Clevercast is now available. It includes a much-anticipated feature: the ability to add multilingual live captions to a live stream via an automatic speech-to-text conversion and translation. Additionally, it includes a number of other features, improvements and bug fixes.

 

Multilingual live captions

Clevercast now allows you to add multilingual closed captions to a live stream, using any incoming RTMP or SRT broadcast. Closed captions can be added automatically via speech-to-text, or manually via real time transcription. In both cases, viewers can select the resulting closed captions in Clevercast player. Additionally, automatic translations can be added, resulting in closed captions in any number of languages.

Multilingual closed captions can be combined with remote simultaneous interpretation via Translate@Home.

Clevercast Player with the multilingual closed captions and audio menus

Clevercast delivers a high-quality, global live stream using adaptive streaming. The embedded player’s closed caption and audio menus allow your viewers to choose their preferred language(s) at any point in the live stream. Clevercast player provides the best possible experience on any device and platform.

 

Translate@Home improvements

When an interpreter is using interpreter relay, she can now use sliders to change the relative volume of the translation and the floor audio. This also goes for managers who are listening in real time to an interpreter (in the management room).

An interpreter can now determine if she wants Clevercast to do noise suppression and gain control (see T@H interpreter manual). This way, interpreters with professional equipment which already does this can disable the same behaviour in Clevercast, since doing it twice may deteriorate the audio quality.

The upgrade contains a slight change to the handover procedure for interpreters in Translate@Home: when the handover is accepted, the interpreter who initiated the handover will no longer be automatically muted. Instead, she sees a message that the handover has been accepted, so she can mute herself after completing her sentence. See our interpreter manual for a detailed explanation of the handover procedure.

Invitation to accept a handover and new volume sliders on the left

Other T@H improvements:

  • the handover procedure is possible in dual language rooms (assuming both interpreters have selected the same language in the dual room)
  • the microphone icon of unmuted interpreters is now coloured red (in accordance with ISO standards)
  • different fonts and colours are used for interpreters and managers in the participants lists
  • an additional message is shown if interpreter handover is cancelled
  • unnecessary system messages are no longer shown in the message list

 

Private subdomain for new Clevercast accounts

For new accounts, Clevercast now uses the account name as subdomain by default. For example, someone with an account named ‘kite‘ will get access to Clevercast via https://kite.clevercast.com/ (instead of https://app.clevercast.com, like it used to be).

This has the advantage that administrators can now log into multiple accounts simultaneously with the same email address. If you have an existing account, we can convert it to subdomain access if you wish.

 

Overview of resource usage per day

The account overview page now contains a per-day overview of data traffic (VoD and live) and live processing hours usage.

Overview of resource usage on a daily basis

 

Pseudo-live streaming improvements

  • Single-language pseudo-live streams now start playing immediately in the embedded player on any device and under all circumstances (previously it could take a few seconds on certain devices).
  • It is again possible to simulcast a monolingual pseudo-live stream (if supported by your plan). This was temporarily restricted due to improvements to the pseudo-live streaming engine.

 

Minor changes

  • For all types of multilingual streaming, both VoD and live, you can now set the default audio and/or caption language by adding audio_default and captions_default to the player embed code. The value of audio_default and captions_default is always the ISO 639-1 language code (eg ‘en’ for English).
  • Recording of multilingual live streams has been improved so very short broadcast interruptions no longer result in multiple recorded files, which need to be stitched afterwards.
  • Clevercast Learning: the same .csv file format is now used for import and export of users.
  • Clevercast Learning and Clevercast Webinar: import of users and registrants is also possible with .csv files separated by semicolon.
  • Bugfix: the maximum number of languages for pseudo-live streaming was calculated incorrectly under some circumstances.