Docs

Contents

  1. Install Auto-Lip-Sync
  2. Getting Started
  3. Rig Configuration
    1. Create pose assets (Blender 3.X.X)
    2. Create a pose library (Blender 2.X.X)
    3. Setup your rig configuration
  4. Settings
    1. Audio Path
    2. Transcript Path
    3. Start Frame
    4. Interpolation
    5. Restore Animations

Install Auto-Lip-Sync

You can download the latest version from your dashboard.

To install Auto-Lip-Sync in Blender:

  1. Open Blender
  2. Open "Preferences" via (Edit → Preferences)
    3. Blender open preferences
  3. Navigate to "Add-ons"
    4. Blender navigate to add-ons within the preferences
  4. Click "Install"
    5. Blender install addon
  5. Select the downloaded ZIP-file
  6. Activate the addon by ticking the checkbox
    7. Blender activate addon

Getting Started

All of Auto-Lip-Syncs settings live within the context menu which can be opened by pressing "N" on your keyboard.

tab Auto-Lip-Sync in Blender context menu

Next, log in with your credentials. To start synchronizing, create a pose library and setup your rig configuration.

Rig Configuration

Create pose assets (Blender 3.X.X)

To use Auto-Lip-Sync, you need to save your poses as assets in the current files asset browser.

  1. Select your face-rig
  2. Activate "Pose Mode" via the drop-down in the top left corner or by pressing Ctrl + Tab
  3. Move your rig in the desired pose
  4. Click on "Create Pose Asset"
    5. Blender create pose asset
  5. Repeat steps 3 and 4 until you saved all of your poses

Create a pose library (Blender 2.X.X)

In older Blender versions, the poses are stored in a pose library instead of the newer asset browser.

To create one:

  1. Activate "Pose Mode" via the drop-down in the top left corner or by pressing Ctrl + Tab
  2. In the "Properties Panel" navigate to the "Object Data Properties"
  3. Within the section "Pose Library" click "New" and name the pose library appropriately
    4. Blender create pose library
  4. Click on the shield icon next to the pose library name to save the library
    5. Blender save pose library
  5. Move your rig in the desired pose
  6. Select all the bones of your face-rig armature
  7. Click on the "+" to save the pose and name the pose accordingly
    8. Blender create new pose
  8. Repeat steps 5 to 7 until you saved all of your poses

Setup your rig configuration

Next, go to "Rig Configuration" in the Auto-Lip-Sync tab. Here you can select a pose for every phoneme. On the left side, you can see the phoneme and an example word containing it. Based on this information you can choose the pose of your face rig which best resembles that phoneme.

Note: Most face-rigs will use the same pose for multiple phonemes

Setup face rig

Settings

Audio Path

Please provide the path to the audio file by clicking on the folder symbol on the right-hand side. You can use audio files in the most common formats like WAV, MP3, OGG, WMA, ACC or FLAC.

Transcript Path

Please provide the path to the transcript by clicking on the folder symbol on the right-hand side.

Note: This file should be saved as a plain file (TXT file).

Start Frame

This setting allows you to manually set the first frame of your animation. By default, the animation will start at the frame selected by your cursor in the timeline.

Interpolation

You can choose how to interpolate between the different poses:

  • Bezier: smooth transition between poses (Default)
    • Bezier Interpolation
  • Linear: smooth transition between poses with sudden starts and stops
    • Linear Interpolation
  • Constant: no transition phase between poses
    • Constant Interpolation

Restore Animations

If you want to restore one of your previous animations, you can enable "Restore Animation" and choose one of the clips you previously aligned.

Note: You will not be charged for the animations you restore.

If you have any questions, please don't hesitate to get in touch with contact@auto-lip-sync.com.