Logo - Crazy Minnow Studio - game, asset, tool development

Welcome to Crazy Minnow Studio! We are a small indie software development team primarily focused on game development using the Unity engine. Our pipeline includes: games, game development tools and assets, and video tutorial production. Check out our Unity lip sync asset, SALSA Lip-Sync, available on the Unity Asset Store. Follow our blog for updates on our Unity asset and game development, as well as other happenings in indie game development.

Using MakeHuman Characters with SALSA Lipsync

We're very excited to announce SALSA support for MakeHuman characters using our free SalsaSync add-on. This free add-on allows you to create a custom map to link SALSA and RandomEyes output to MakeHuman exported characters using the workflow outlined below. If you're not familiar with MakeHuman, check the website for more information. There are multiple programs used to achieve this workflow, and they are all documented below.

PLEASE NOTE: These instructions require you to download and install the appropriate add-on scripts in your Unity project. If you skip this step, you will not find the applicable option in the menu.


01/22/2019 - Tested with SALSA v1.5.5 and SalsaSync v2.6.0.


If you're new to SALSA, don't start here. Instead, try our simpler workflows for Adobe Fuse, Autodesk Character Generator, Daz3D, iClone CC3, or MCS. This is an advanced use-case scenario and should only be attempted by those already familiar with, or at least willing to learn, MakeHuman, Blender, and Unity. We do not provide support for the MakeHuman or Blender applications.

Please visit the Unity community discussion linked below for information on how to export characters from MakeHuman in a way that will retain the available blendshapes and leverage a custom armature to provide a nice balance between animatability, efficiency, and SALSA compatibility.

https://forum.unity.com/threads/makehuman-and-unity.617311/

Once you have successfully imported your MakeHuman character into Unity, and verified that BlendShapes are available on the Body SkinnedMeshRenderer component, follow the steps below to setup SALSA Lipsync using our free SalsaSync add-on.

 

SALSA setup using SalsaSync for character linkage

  1. Download and install SALSA from the Unity Asset Store and our SalsaSync add-on from our download page into your project.
  2. Select your character in the Unity [Hierarchy], and add the following components:
    • ​Salsa3D - Add an audio clip
    • RandomEyes3D (for eye control) - No config
    • CM_SalsaSync - Link the Body SkinnedMeshRenderer to the saySmall, sayMedium, and sayLarge shapes:
      • SALSA mouth shapes (saySmall, sayMedium, sayLarge)
        • Add SaySmall shapes: [mouth_open, 10]
        • Add SayMedim shapes: [lips_lower_in, 60], [lips_mid_upper_up_left, 50], [lips_mid_upper_up_right, 50], [lips_upper_in, 60], [mouth_corner_up_left, 60], [mouth_corner_up_right, 60], [mouth_up_left, 30], [mouth_up_right, 30], [mouth_wide_left, 70], [mouth_wide_right, 70]
        • Add SayLarge shapes: [mouth_down_left, 30], [mouth_down_right, 30], [mouth_narrow_left, 75], [mouth_narrow_right 75]
      • Jaw bone control
        • Jaw Local Rotation Axis: X_negative
        • Jaw Bone: Link to your characters jaw transform
        • Jaw Range of Motion: 1
        • Add Jaw shapes:
          • SMR: Teeth, Shape: mouth_open, 100
      • Eye bone controls
        • Eyelid Control: Bones
        • Eyelid Local Down Roation: X_negative
        • Eyelid Bone Left: uplid.L
        • Eyelid Bone Right: uplid.R
        • Eyelid Range of Motion: 1
        • Eye Control: Bones
        • Eye Local Up Rotation Axis: X_positive
        • Eye Local Right Rotation Axis: Z_positive
        • Eye Bone Left: eye.L
        • Eye Bone Right: eye.R
      • Add other SkinnedMeshRenderers to be synchonized:
        • Eyebrow
        • Eyelashes
        • Teeth
        • Tongue

Click play and enjoy!

Back to top

 

NOTE: While every attempt has been made to ensure the safe content and operation of these files, they are provided as-is, without warranty or guarantee of any kind. By downloading and using these files you are accepting any and all risks associated and release Crazy Minnow Studio, LLC of any and all liability.

Download Files

Simple Automated Lip Sync Approximation
~ We look forward to seeing what you create! ~

Buy SALSA on the Asset Store

Categories: SALSA, Blender

Comments: No comments yet