Smooth Lips

I previously posted on my keyframing process while lip syncing and a little on how it evolved. I would now like to explain this in more detail. First I will describe the controls for the character that I am currently animating, and then I will describe the process.

I use sliders that are set-driven keyed to blendshapes and joint movements. Here are the ones I use for lip syncing:

• mouth open/close - left/right
• lips sealed
• smile types 1,2,3 and pout
• eee, oh, ooo, bpm, fv
• tongue controls
  

Step 1: Mark the "r" and "w" sounds

Here I'll go through and and place a keyframe at every point that these sounds show up. On these frames I will key the sliders for "lips sealed", "ooo," "mouth open/close," and "smile." Next I will go through the animation and keyframe the beginning and ends of these sounds. At these points I will only key the "lips sealed" and "ooo" sliders, leaving "mouth open/close" and "smile" open for the different shapes that will come before or after.

Step 2: Mark the "eee" sounds

This step is similar to the step above but I am only using the slider for "eee." Since I am only using one slider it is easier to create all of the keys in one pass instead of going through and doing the "on's" first and the "off's" second.

Step 3: "bpm"

Same as 1, keying "bpm," "mouth open/close," and "smile" on the first pass, and keying the beginning and end frames of the sounds on a second pass using only the "bpm" slider. It is important that the "lips sealed" slider be keyed to zero at every point the "bpm" is on.

Step 4: "fv"

Just like 3.

Step 5: "Mouth Open/Close"

At this point there will be a lot of keys for this slider in place already. Most of the keys to place now are opening the mouth for vowel sounds and closing it for most of the remaining consonants. I will place these keys going straight through from the beginning to the end of the clip.

Step 6: Tongue movement

Besides cleanup and tweaking the last thing to do is create the tongue movements. Here I will animate the tongue to move down and in the correct shape whenever the mouth is open and to create "l," "th," and other sounds.

Going to Siggraph!

Ok not really.  But I will be following it here:  http://area.autodesk.com/siggraph

Thanks for the link Matt.

*EDIT* I've been to Siggraph twice since this post, with my now former co-worker Matt. We brought our boards and had a great time!

Oh btw i'm a huge nerd.

This is the top of my two computer towers at work.

Lip Syncing, or This "N" is Not Like the Other.

One thing I have realized about lip syncing is that the mouth shape for one specific consonant is not the same for another. This happens when the vowel sound leading into the consonant is different. For example, if you are adding a keyframe for an "nn" sound after an "ee" the lips will still hold the "ee" shape as the teeth start to touch, where as if the "nn" follows an "oo" the lips will still hold that instead.

Originally the process I would go through would be to to keyframe the consonants of a sentence or two first and then go back to add the vowel sounds, all by reusing the same mouth shapes over and over. I have since switched to going through and keyframing the sliders of my rig that control the vowel sounds and other lip movements(bpm, fv, r, w) first, and then going back through to key the sliders for the "n,t,s,th,sh" sounds and the tongue movements. This keeps the mouth movements smooth and less jumpy while allowing me to work more quickly than going from the first to last sounds in succession.

New Blog.

Well here is my first blog. I intend to post my thoughts about what I am working on and on subjects relating to my work. The purpose for blogging these thoughts is both for sharing them with others and recording them for myself. Maybe someone other than myself will get something out of this endeavor.

Blogs away!