Microsoft Edge Gets Real-Time Video Translation for a More Inclusive Web Experience

Microsoft Edge is about to become a more accessible web browser with the introduction of real-time video translation. This innovative feature, powered by generative AI, will allow users to translate both captions and audio of videos on the fly, directly within the browser.

Breaking Down Language Barriers with Real-Time Translation

Announced just a day after the launch of Copilot+ PCs with similar translation capabilities, Microsoft Edge's real-time video translation aims to bridge the language gap and enhance accessibility for a wider audience. This includes viewers with disabilities who may benefit from captions or audio dubbing in their preferred language.

Supported Languages and Platforms

Currently, the feature translates English to five languages: Hindi, German, Spanish, Russian, and Italian. Additionally, it can translate Spanish to English. Users can enjoy this functionality on popular platforms like YouTube, Coursera, and LinkedIn. Major news websites such as CNBC, Reuters, MoneyControl, and Bloomberg are also included.

Privacy-focused On-Device Processing

Microsoft emphasizes user privacy by performing the translation entirely on the user's device. This means the video and audio content never leave the machine, protecting user data.

How Real-Time Video Translation Works (Based on Unlisted Microsoft Edge Video)

A glimpse into the feature's functionality comes from an unlisted video on the official Microsoft Edge YouTube channel. Once rolled out, a "Translate Video" option will appear above the video player. Users can then select the source and target languages from options including English, German, Spanish, Italian, Hindi, and Russian.

The first use might require a one-time installation of the language translation model. Following this, users will have the choice between subtitles or dubbed audio. Selecting subtitles displays captions in the chosen language, while audio dubbing provides a translated voiceover after a brief processing time.

Future Availability and Enhancements

While Microsoft hasn't revealed the exact rollout date, the company promises to expand support for additional languages and websites in the near future. This real-time video translation feature represents a significant step towards a more inclusive and accessible web browsing experience.

Conclusion

The introduction of real-time video translation in Microsoft Edge represents a significant advancement in making digital content more accessible and inclusive. By leveraging the power of generative AI, Microsoft is not only enhancing user experience but also setting new standards for privacy and security with on-device processing.

This feature, which will initially support translations across several major languages and platforms, underscores Microsoft's commitment to innovation and user-centric technology. As the company continues to expand language support and refine this functionality, users worldwide can look forward to a more connected and accessible digital experience. With these advancements, Microsoft Edge is poised to become a leading tool for breaking down language barriers and fostering global communication.