[Sora配音] Methods for dubbing Sora-generated videos, how to use dubbing software, and a sharing of various tools

Sora-generated videos have no sound. At the current stage, OpenAI has officially stated that it has no plans for dubbing support, so after release, in most cases we will likely need to dub the videos ourselves. Therefore, this article introduces how to use external tools for dubbing.

Dubbing Type Selection

Dubbing is divided into two forms. The first is narration, which is relatively simple; narration is done in the form of voiceover, and you can use CapCut or any other free software for dubbing. This is easy to do. The difficulty lies in the second type: lip-sync, which requires the characters in the video to open their mouths and speak with a realistic effect. Therefore, the core of this article is using external tools for dubbing.

Method 1: Manual Dubbing

Those who frequently browse short videos have surely seen funny Journey to the West-style videos, imitating and recording the voices of Tang Monk, Sun Wukong, Zhu Bajie, and Sha Wujing, then importing the recorded content into editing software to match the lip movements. The manual dubbing we discuss is done in this way: record audio and then edit.

Recommended tools:
1. Jianying (CapCut) (includes both dubbing and video editing, but has few free voice types and cannot adjust tone)
2. Eleven https://elevenlabs.io/ — a foreign free dubbing software with no restrictions.
3. iFlytek-type and Moyin-type tools are quite recommended; they can flexibly adjust tone, speed, etc., but are paid.

A more advanced approach is voice cloning, which can use any voice you want, such as celebrities, friends, relatives, or deceased relatives.
You can learn it in our column Voice Generation http://www.niubo1ai.com/gid_9.html.


Method 2: AI Generation

AI automatically matches lip movements. You can upload audio or use their online audio generation feature to generate audio before integrating it with the video.

Recommended tools:
1. LALAMU — LALAMU is the top recommendation because it is completely free; the next two charge per use and by duration.
2. did
3. heygen

All the above tools are available in our Tool Navigation http://www.niubo1ai.com/123/.