An Azure service to easily conduct machine translation with a simple REST API call.
Video translation can be used in either the Foundry portal/Speech playground UI or through the REST API.
In Foundry portal / Speech playground:
- Go to the model catalog in Microsoft Foundry portal.
- Search for Azure-AI-Speech.
- Select Azure-AI-Speech.
- Select Speech capabilities by scenario > Video translation.
- Select Go to Speech playground.
- Select My videos > Upload video.
- Choose a Voice type:
- Standard voice: automatically matches the speaker to a standard voice.
- Personal voice: uses a matching personal voice. Personal voice requires approved access.
- Upload the video. Requirements:
-
.mp4 - less than 5 GB
- shorter than 4 hours
-
- Enter:
- Number of speakers
- Language of the video
- Translate to language
- Acknowledge pricing information and code of conduct.
- Optionally open Advanced settings.
- Create the project.
Subtitle options when creating a project:
- Automatic subtitles: produces both source and target subtitles.
- Upload source language subtitles: produces both source and target subtitles.
- Upload target language subtitles: produces only target language subtitles.
After upload and creation:
- Processing status can be checked on the project tab.
- When the video shows Succeeded, open it to compare Translated and Original tabs.
- The original and translated scripts appear beside the video, and hovering a script segment jumps to that part of the video.
Adjustments after translation:
- Change voice settings such as voice type, gender, and voice.
- Add or remove script segments.
- Adjust script timing with the waveform.
- If a segment shows unidentified voice, manually change the voice name.
- Select Save to keep work in progress without charges.
- Select Apply changes to apply edits; charges occur when changes are applied.
Translate the same original video to another language:
- Open the project.
- Select + New language.
- Choose the new target language and voice type.
- A new project is created automatically.
Using the REST API:
- Create a translation for a video stored in Azure Blob Storage and specify parameters such as source language, target language, voice type, and whether subtitles are burned into the video.
- Start translation by creating an iteration.
- Check status periodically until it is Succeeded or Failed.
- Download the translated video and subtitles.
- Optionally create more iterations to refine the result.
REST API prerequisites:
- Azure subscription
- Speech resource in a supported region
- Azure Blob Storage account
- Supported source and target languages
- Video file in
.mp4, less than 5 GB, shorter than 4 hours
- How to use video translation (ai-foundry-portal)
- How to use video translation (ai-foundry-portal)
- How to use video translation (ai-foundry-portal)
- How to use video translation (speech-studio)
- How to use video translation (speech-studio)
- What is video translation?
- How to use video translation (rest-api)