Unity Timeline for SALSA AudioClips, Emotes, and TextSync
Tested with Unity versions 2017.1 - 2018.1 (release)
Timeline functionality for SALSA Lip-Sync is now called "Unity Timeline SALSA Core" and contains functionality for sequencing AudioClips on a SALSA-enabled character as well as a new option to sequence character emotes, leveraging RandomEyes3D configuration of custom-shape groups. In addition to the SALSA Core functionality, we also provide a separate Timeline implementation for our free SALSA TextSync add-on. For implementation instructions, check out the videos below. And download the files in the SALSA Downloads area.
UPDATE: v0.4.0 (2018-11-29): SalsaAudio tracks/clips now respond to Timeline pause/resume events.
UPDATE: v0.3.4 (2018-07-10): fixes issue where multiple instances of the same clip on a track does not animate properly.
UPDATE: v0.3.3 (2018-07-08): adds functionality for character emote sequencing.
UPDATE: v0.3.2 (2018-05-04): fix for intermittent duplicate play of AudioClip.
UPDATE: v0.3.1 (2018-05-02): disabled clip playing during design time.
The EmoteClip action: When used on an Emote Track allows configuration and timing of RandomEyes custom-shape groups. Simply add an Emote Track to the Timeline and add Emote Clips to the track. Select the emote clip in the Timeline and configure the name of the RandomEyes3D custom-shape group to drive (case-sensitive).
Ensure your RandomEyes3D component is linked to the track binding and your custom-shapes and groups are properly configured. NOTE: the same RandomEyes3D component instance can be linked to multiple Emote Track bindings to create NLE-styled overlaps/blends of emotes.
Ensure the RandomEyes3D custom shapes and groups are configured and the group names match the names configured on the Timeline Emote Clips.
The AudioClip action: When used on a Salsa Audio Track allows configuration and timing of AudioClips to drive SALSA's lipsync approximation algorithms. The Salsa Audio Track is configured to point to the AudioSource used by SALSA. Unity maintains control focus for AudioClips dragged onto a Timeline track, so it is necessary to configure the specific AudioClip in the Inspector. Once an AudioClip is configured for the track clip, the clip container in the track will dynamically adjust its length to be the duration of the AudioClip. Additionally, the clip container's name will also be dynamically changed to that of the AudioClip name.
The TextSync action: When used on a Salsa Text Sync Track allows for configuration and timing of TextSync text on a Timeline track to drive SALSA's implementation of text-to-lipsync via TextSync. It works similarly to the Audio Track and dynamically adjusts its length to be representative of the TextSync processing of text input. And, it dynamically changes the clip container's title to be that of the configured text string.