Hey! I'm having an incredible learning experience, not only learning how Blender works (yes, still learning), but also about Open-Source and the incredible software available. Stick around!
Lipsyncing simplified
April 30, 2015
Hey all!
This is one I am very excited about writing! A while ago, I did a test in lipsyncing and I used a vector based method of doing it, not vector as in the PC does everything, but like hard vector, as in cell animation. That went fine, but it was not accurate to the level that I really wanted it to be, but I saw an amazing experiment a while back in the Blender community on Google+. Someone there did lipsyncing by backing audio to F-curves. Not a new concept to me, but the idea to use it for lipsyncing was imo, a blessing beyond words, because it makes animation a lot easier.
Just to give credit where credit is due, here is the post. Thanx for posting that Jeff!
Now, GOD did enable me these past few days to take it a lot further than just baking a normal file to F-curves. Not saying that is what he's done, but I know the file has music on it and will affect the result.
In order to get a good result, I took out the F's in the audio file, using noise removal in Audacity and baked the resulting file to the jaw's X-axis. This enabled the mouth to close on the F's, instead of being open, like the volume would tell it to be. I am very very satisfied with the result this gives and with the amount of time it saves! wow!
Here is the result:
What I would recommend is that you use the original for your audio though. The f-removed file does not sound good, haha.
If you use Make Human, like I do, you would know that there is no facial rig (at least non that I've seen), that controls the mouth, other then open and closed and the tongue. This is not enough for words like world, more, floor, void, was, etc. They all require closure to a point. You can overcome this by adding an O shape key. That allows you to only have to animate the rounding of the mouth, since the opening and closing is done via audio. It means you can animate a ten second length of mouth animation in about an hour, if not less. And as always, the more you practice, the better it will be!!
So, with only the O to animate, if you're using Make Human, get out there and lipsync something!!! hahaha.
PS, I've tried animating the O with sound too, didn't work for me, but if you got it right, do share your method with the rest of the Blender communirty! I also looked at the results from auto lipsyncing programs, and they just don't work for me, because nr1, I'm not happy with the results and nr2, the animation can only be imported using a script. Not saying they are bad, but I'd rather do it manually at least for now.
Thank YOU so much for enabling us to be so much more efficient! JESUS, we know that good things only come from YOU and we thank YOU always, in JESUS Name! Amen!
This is one I am very excited about writing! A while ago, I did a test in lipsyncing and I used a vector based method of doing it, not vector as in the PC does everything, but like hard vector, as in cell animation. That went fine, but it was not accurate to the level that I really wanted it to be, but I saw an amazing experiment a while back in the Blender community on Google+. Someone there did lipsyncing by backing audio to F-curves. Not a new concept to me, but the idea to use it for lipsyncing was imo, a blessing beyond words, because it makes animation a lot easier.
Just to give credit where credit is due, here is the post. Thanx for posting that Jeff!
In order to get a good result, I took out the F's in the audio file, using noise removal in Audacity and baked the resulting file to the jaw's X-axis. This enabled the mouth to close on the F's, instead of being open, like the volume would tell it to be. I am very very satisfied with the result this gives and with the amount of time it saves! wow!
Here is the result:
What I would recommend is that you use the original for your audio though. The f-removed file does not sound good, haha.
If you use Make Human, like I do, you would know that there is no facial rig (at least non that I've seen), that controls the mouth, other then open and closed and the tongue. This is not enough for words like world, more, floor, void, was, etc. They all require closure to a point. You can overcome this by adding an O shape key. That allows you to only have to animate the rounding of the mouth, since the opening and closing is done via audio. It means you can animate a ten second length of mouth animation in about an hour, if not less. And as always, the more you practice, the better it will be!!
So, with only the O to animate, if you're using Make Human, get out there and lipsync something!!! hahaha.
PS, I've tried animating the O with sound too, didn't work for me, but if you got it right, do share your method with the rest of the Blender communirty! I also looked at the results from auto lipsyncing programs, and they just don't work for me, because nr1, I'm not happy with the results and nr2, the animation can only be imported using a script. Not saying they are bad, but I'd rather do it manually at least for now.
Thank YOU so much for enabling us to be so much more efficient! JESUS, we know that good things only come from YOU and we thank YOU always, in JESUS Name! Amen!
Posted by Marius Oberholster. Posted In : Tips
.PNG)
