Docs

Install Auto-Lip-Sync

You can download the latest version from your dashboard.

To install Auto-Lip-Sync in Blender:

1. Open Blender
2. Open "Preferences" via (Edit → Preferences)

3. Navigate to "Add-ons"

4. Click "Install"

5. Select the downloaded ZIP-file
6. Activate the addon by ticking the checkbox

Getting Started

All of Auto-Lip-Syncs settings live within the context menu which can be opened by pressing "N" on your keyboard.

Next, log in with your credentials. To start synchronizing, create a pose library and setup your rig configuration.

Rig Configuration

Create a pose library

To use Auto-Lip-Sync, you need a pose library for your face-rig.

To create one:

1. Select all the bones of your face-rig armature
2. Activate "Pose Mode" via the drop-down in the top left corner or by pressing Ctrl + Tab
3. In the "Properties Panel" navigate to the "Object Data Properties"
4. Within the section "Pose Library" click "New" and name the pose library appropriately

5. Click on the shield icon next to the pose library name to save the library

6. Move your rig in the desired pose
7. Click on the "+" to save the pose and name the pose accordingly

8. Repeat steps 5 to 7 until you saved all of your poses

Setup your rig configuration

Next, go to "Rig Configuration" in the Auto-Lip-Sync tab. Here you can select a pose for every phoneme. On the left side, you can see the phoneme and an example word containing it. Based on this information you can choose the pose of your face rig which best resembles that phoneme.

Note: Most face-rigs will use the same pose for multiple phonemes

Settings

Audio Path

Please provide the path to the audio file by clicking on the folder symbol on the right-hand side. You can use audio files in the most common formats like WAV, MP3, OGG, WMA, ACC or FLAC.

Transcript Path

Please provide the path to the transcript by clicking on the folder symbol on the right-hand side.

Note: This file should be saved as a plain file (TXT file).

Start Frame

This setting allows you to manually set the first frame of your animation. By default, the animation will start at the frame selected by your cursor in the timeline.

Interpolation

You can choose how to interpolate between the different poses:

• Bezier: smooth transition between poses (Default)

• Linear: smooth transition between poses with sudden starts and stops

• Constant: no transition phase between poses