SALSA LipSync Logo

SALSA LipSync Suite v2 is full of hot features to spice up your character animations!

I have to laugh at this asset, not because it’s stupid, but because it’s so simple, brilliant and works that it makes me laugh...(★★★★★) -Christopher (Unity Asset Store review)

Also, see the FAQ for more information.

Platforms: Supports Unity & Unity Pro. Tested on Windows, Mac, Linux, Android, IOS, Windows Store UWP. WebGL is supported when combined with our Amplitude asset.

Unity Version Support: SALSA 2.x - supported on Unity 5.6.0+ (to current STABLE version). NOTE: We do NOT support non-release candidates, alpha, beta, technical-preview, etc.

Buy SALSA on the Asset Store

Integrations and Workflows:

Modeling Systems Supported:

Also works with these model systems:

Demostrations:

SALSA LipSync

  • Real-time, automated lip sync approximation -- analyzes audio waveforms in realtime, no need to preprocess audio files
  • Language-agnostic lip-sync processing, works with any spoken language, dialect, or accent.
  • Works with 2D and 3D character models:
    • Supports mix and match animating controller types:
      • Shape (blendshape)
      • (NEW!) Bone
      • Sprite (2D switcher)
      • (NEW!) UGUI Sprite (2D switcher)
      • (NEW!) Texture (2D switcher)
      • (NEW!) Material (2D switcher)
    • 2D switchers leverage single image/material swaps or (NEW!) multi-frame cell animations
    • (NEW!) 2D switchers supports 3 activation methods:
      • On unitl Off (animates throughout the activating and deactivating phases)
      • On while Active (only animates while in the activating phase)
      • On when 1.0, off when 0.0 (switches to the on state when activation is complete and to the off state when deactivation is complete)
  • NEW! Unlimited mouth-shapes (visemes) can be defined. Each viseme can consist of unlimited ExpressionComponents which are definitions for a single controller type (i.e. bone, shape, texture, etc.). NOTE: there are practical limitations and considerations for number of visemes and number and type of components. For example, multiple sprites cannot exist on a sprite renderer at the same time.
  • NEW! Animation easing control.
  • NEW! Look-ahead processing eliminates audio processing lag.
  • NEW! Works with 2D or 3D audio sources, full lip-sync dynamics regardless of distance from AudioSource.
  • NEW! Unified 2D/3D engine. 2D and 3D components are no longer class separated.
  • NEW! Time/duration-based animation control.
  • NEW! Reuse blendshape or bone components for multiple visemes.
  • NEW! Advanced Dynamics produces infinite variations on animations to eliminate stale, stagnant movement.
  • NEW! Ultra-fast QueueProcessor technology prioritizes and blends components together when visemes change, regardless of completion status of animations. The QueueProcessor allows configuration and reuse of components across module types (SALSA, Eyes, EmoteR) as well, implementing a prioritization override to prevent component fighting within the suite.

EmoteR

  • NEW! Separate emote randomization (EmoteR) module.
  • NEW! Randomly activate 1 or more simultaneous emotes, with random or specified hold times.
  • NEW! Real-time lip-sync emphasis expressions - be as subtle or aggressive as you want, Salsa and Emoter work together to automagically give you lip-synchronized emphasis expressions - breathe even more life into your characters!
  • NEW! Repeater animations -- create repeating/looping animations easily.
  • NEW! Persistence option available to override externally driven animations (i.e. mecanim).
    • Override indefinitely or blend out and back into mecanim animations.
  • NEW! Uses the same expression and component definitions to create emotes as SALSA does visemes.

Eyes

  • NEW! Head, eye, and eyelid tracking, and blinking.
  • NEW! Heads, eyes, and eyelids are tracked individually to provide accurate depth tracking.
  • NEW! Tracking available for bones, blendshapes, sprite transforms, and sector-based sprite, texture, and material swapping.
  • NEW! Adjustable saccadic eye movement while tracking (bones, blends, and sprite transforms), adds realism.
  • NEW! Works with any number of heads, eyes, and eyelids.
  • Works on 2D and 3D characters.
  • Target Affinity gives your character an attention span while tracking another object