Spotify will use OpenAI's tech to translate podcasts to more languages

In a nutshell: Spotify reports that the quantity of human beings taking note of podcasts has exceeded 100 million and keeps to develop. The streaming provider is now exploring new strategies to broaden get admission to to its podcast provider for an even large audience of creators and languages. It pursuits to attain this by leveraging the abilities of AI algorithms to mechanically translate content from some distinguished figures in the enterprise.

Spotify has unveiled Voice Translation for podcasts, a new pilot service that makes use of AI to translate audio suggests into numerous languages. Through the software of device mastering strategies, podcasts can preserve the unique podcaster's voice, resulting in a extra herbal sound.

Voice Translation is constructed upon a tool evolved by means of Spotify and consists of present day advancements in AI audio technology, which include OpenAI's contributions. OpenAI, based in San Francisco, has evolved a flexible speech recognition model called "Whisper," which has gone through education on a massive dataset of various audio. This training permits it to carry out obligations including multilingual speech popularity, speech translation, and language identity.

Thanks to Whisper and its AI model, Spotify claims that translated podcasts sound greater natural than conventional dubbing. According to the streaming provider, a podcast recorded in English can now be offered in different languages while preserving the speaker's "exclusive speech characteristics."

The initial collection of AI-translated podcasts, compiled on a devoted Voice Translations Hub, capabilities episodes from well-known podcasters together with Dax Shepard, Monica Padman, Lex Fridman, Bill Simmons, and Steven Bartlett. At this stage, most effective a restrained range of catalog episodes and upcoming releases will undergo translation. Spotify has dedicated to providing translations in Spanish, French, German, and other unspecified languages. The agency is also collaborating with other podcasters to encompass their suggests in the translation provider.

According to Ziad Sultan, Spotify's VP of personalization, offering translated podcasts that retain the author's authentic voice allows listeners global to discover and be stimulated by new podcasters in a extra proper manner. Spotify is taking a thoughtful method to AI to foster a deeper connection among listeners and creators, which appears to be a key element of the organization's venture to liberate the potential of human creativity.

Voice-translated episodes may be reachable worldwide for both top rate and free subscribers. Initially, translations will be to be had in Spanish, with French and German variations set to be brought within the coming days and weeks.