Spoken Tutorial Technology/Dubbing a spoken tutorial using Audacity and ffmpeg/English for Translation

From Process | Spoken-Tutorial
Jump to: navigation, search
Timing Narration
00:00 Hello friends. Welcome to this Spoken Tutorial on how to dub from one language into another in Linux Operating System.
00:10 For this all you need is a headset with an audio input or a stand-alone microphone and speakers which can be attached to your computer.
00:19 Audacity® is free, open source software for recording and editing sounds.
00:24 It is available for Mac OS X, Microsoft Windows, GNU/Linux, and other operating systems
00:32 You can download it free of cost from the site audacity.sourceforge.net/download
00:39 I am using the Ubuntu Linux 10.04 version operating system.
00:44 I have already downloaded Audacity version 1.3 and installed it on my PC through the Synaptic Package Manager.
00:52 For more information on how to install software in Ubuntu Linux,
00:57 please refer to the spoken tutorials on Ubuntu available on this website.
01:02 The first and foremost thing you need to do is to listen to the original video.
01:09 Then translate the script in such a way that the narration time for each sentence is of same or lesser duration than the sentence in the original script.
01:18 This can be done by noting down the begin time of each sentence.
01:23 If you cannot do this for every sentence, you can do this for a combination of two sentences.
01:29 That is, even if there is a mismatch at the end of the first sentence, the sync should become correct after the second sentence is completed.
01:37 It may also be possible to skip a few words or even sentences from the original,
01:42 so long as the meaning is not changed. Please ensure that this is done.
01:48 Now we will open audacity, Click on Applications,
01:54 Sound&Video and choose Audacity to run it.
01:58 This will open an empty project on your screen.

On the menu bar you can see various options like file , edit , view , transport, tracks and others.

02:11 We will learn about some of them as we go along. Under the main menu, you will see the VCR controls - Pause, Play, Stop, Rewind, Forward and Record.
02:25 Next to this, you will find the Audio Tools toolbar.
02:30 This has the Selection Tool and the Time Shift tool which we will use in this tutorial.
02:36 By default the Selection Tool is active.
02:40 Lets do a dubbing now. I will play a tutorial on Scilab which is in English that is – matrixoperation.wmv. (tutorial plays)
03:03 And I need to dub this tutorial into Hindi using Audacity.I have already done its translation and noted the timings as mentioned earlier.
03:14 Now I’m going to record it here. For recording , click on the Record button and start the narration.
03:22 (साइलैब के इस्तेमाल से मैट्रिक्स ऑपरेशन के इस ट्यूटोरियल में आपका स्वागत है । इस ट्यूटोरियल के अभ्यास लिए आपके सिस्टम में साइलैब का संस्थापन होना आवश्यक है ।)
03:32 Click on the STOP button to stop the recording.You will notice 2 stereo tracks on the Audio Timeline where the narration can be seen.
03:43 The spikes are waveforms. Stereo Tracks contain a single label area to the left with two waveforms on the right.
03:50 These correspond to the 2 channels of input - left channel and right channel.
03:56 Ideally, record in one go. You will end up with a single audio track. Remember to pause for 1 second in between sentences, in this case.
04:08 Now split the clip into smaller clips at the beginning of each sentence. CTRL+I is the shortcut for splitting the audio tracks into smaller clips.
04:19 I will split the audio here.Slide the clip on the track to match the timing of that sentence as noted earlier.
04:27 Choose the time-shift tool. Observe that the cursor is now a double headed arrow.
04:33 I will shift the clip to this time. Remember, you have to go in the reverse direction that is starting from the last clip to the first.
04:42 This is because unless you create space, the previous clip cannot move from its position.
04:49 To start with the next narration that is narration of the next sentence, click on the selection tool, click on any one of the channels on the timeline.
05:01 Now click on the Record button to start साइलैब कंसोल विंडो खोलिए Now click on the Stop button to stop.
05:12 This second narration will come in another stereo track . Likewise you can record different narrations which will be seen on different tracks.
05:22 Now we will see how to merge all these narrations or how to bring them onto a single track. Choose the time shift tool.
05:32 Select the audio clip by right-clicking on it and drag-and-drop it at the end of the first audio track. Similarly do so for all the clips.
05:43 We can remove an audio track by clicking on the X button in the label area. Let me remove the second audio track which is now empty.
05:51 While sliding the clips on the first track, remember to match the begin time of the clips to the begin time of the corresponding sentence, as noted earlier.
06:01 Once we have synchronised the beginning of each sentence with the corresponding time noted earlier, we can save our project. To do so, go to the file menu and click on Save Project As.
06:15 A dialogue box will open. Click on OK. Next it will ask for a file name. I am giving this file name hindi _matrix operation.
06:29 Next it will ask for the location where it has to be saved. I will choose Desktop and click on Save. This will save the project as a .aup file.
06:41 Finally, export the final project to the required audio format i.e. wav, mp3 and others.
06:49 To do that, go to the Menu Bar. Click on File. Choose the Export option. Click on it.
06:58 It will ask for a file name. I will give the name as scilab_hindi _matrix_operation.
07:06 Also give the location where it has to be saved.
07:12 Next choose the format for saving. I will click on ogg format and then click on Save.
07:21 Next you will get a box called Edit Metadata. Here you can add the artist name and other information as per your requirement.
07:29 Click on Ok. This will create your final audio file.
07:35 ffmpeg is an open source audio and video converter that supports most standard codecs. It can convert from one file format into another quickly and easily.
07:48 The binary for ffmpeg is available for download from http://ffmpeg.org/.
07:56 Click on Download. Scroll down and choose the appropriate one.
08:09 To learn how to install packages in Linux, please watch the spoken tutorials on Ubuntu available on this website. Once you have downloaded and installed ffmpeg,
08:21 you will be able to execute simple yet powerful commands to extract video or audio components separately from a media file or merge the video and audio from 2 separate media files into one.
08:37 Let me switch to the terminal window.
08:41 Let me type pwd “present working directory” and press Enter. Displays my Present Working Directory. The ls command will list all the files and folders which are present in this directory.
08:56 Let me change to the Desktop directory and Test. CTRL+L to clear the terminal screen. ls to list the files present in this directory.
09:15 Now let me type the command - ffmpeg -i compiling.wmv TEST0.ogv
09:30 The -i switch tells ffmpeg that the file immediately after it, is the input file. compiling.wmv is the input file here.
09:42 If -i option is omitted, ffmpeg overwrites that file when it tries to create the output file.
09:50 ffmpeg uses the extension of the output file to determine the output format and the codec to use. However, this can be overridden using command-line parameters.
10:03 We will look at some of these shortly. This command is very useful to convert a video from one format into another.
10:12 To execute the command press Enter. But I will skip this and proceed further.
10:18 Using the ffmpeg command in the Terminal window, we can separate the video component from the original spoken tutorial.
10:26 To do so, type ffmpeg -i functions.ogv -an -vcodec copy TEST1.ogv
10:45 The '-an' switch automatically removes all audio from the output and keeps only the video component. TEST1.ogv is the output file.
10:59 Press Enter. Now we have separated the video component which means that the video is devoid of the original audio.
11:09 Let me open the Test folder here. Here is Test1.ogv. Let me play this file. <Play for 5-6 secs>
11:25 Let me clear the terminal window once again. Now let us type the command - ffmpeg -i functions_hindi.ogv -vn -acodec copy TEST2.ogg.
11:54 The '-vn' switch removes the video from the output and keeps only the audio component. Press Enter to execute this command.
12:04 Now we have separated the audio component which means that the output is devoid of the original video.
12:12 Let us check it. Let me open the Test directory once again. Here is TEST2.ogg. Let me play this. <Play for 5-6 secs>. OK.
12:26 So let me close this. Lets go back to the terminal window. I'll clear the terminal window by pressing CTRL+L.
12:35 Now let us see how we can merge the audio which we saved with the video of the original tutorial.
12:42 In the terminal, we will type - ffmpeg -i TEST1.ogv -i TEST2.ogg -acodec libvorbis -vcodec copy FINAL.ogv. Press Enter.
13:20 It is encoding now. Let me clear the terminal. Let me open the Test directory. Here is FINAL.ogv just as we saved.
13:34 Let me play this file now. <Play for 5-6 secs>. Simple, isn't it?
13:46 Now, one can also use editing packages like KdenLive, Kino, LiVES and many others to replace the existing audio of an original spoken tutorial with a dubbed audio.
13:59 To make things easier for our dubbing contributors, we are in the process of creating a GUI application in Python,
14:06 which executes all of the above ffmpeg commands – that is To Extract Audio, To Extract Video and To Merge.
14:15 The application and the spoken tutorial for the same will soon be available on this website.
14:22 That's all we have. Let me summarise the tutorial for you. Install Audacity once through Synaptic Package Manager.
14:30 Listen to the original tutorial and mark the begin time of each sentence. Open Audacity. Start narrating with appropriate pauses between sentences. Ideally, record in one go.
14:44 Split the audio into sentences. Starting from the back, slide the clips to match the noted timing.
14:52 When done, save the audio stream in ogg format. Using ffmpeg commands, separate the video component from the original spoken tutorial.
15:04 Merge the dubbed audio and the separated video component to create the dubbed tutorial.
15:11 Spoken tutorial activity is the initiative of the ‘Talk to a Teacher’ project coordinated by www.spoken-tutorial.org, developed at IIT Bombay.
15:25 Funding for this work has come from the National Mission on Education through ICT, launched by MHRD, Government of India
15:34 For more information, please visit http://spoken-tutorial.org/NMEICT-Intro.
15:47 This brings us to the end of this tutorial. This script has been contributed by ----------------------(name of the translator) and this is -----------------------(name of the recorder) from --------------------------(name of the place)signing off.

Contributors and Content Editors