A new version of Cineversity has been launched. This legacy site and its tutorials will remain accessible for a limited transition period

Visit the New Cineversity
   
 
Hybrid animation lip sync with images of phoenomes?
Posted: 21 March 2015 09:53 PM   [ Ignore ]  
Avatar
Total Posts:  86
Joined  2008-03-29

Hi,

I was wondering the best way to do lip sync inside of C4D using images for the lip sync?  Kind of like some of The Lego movie, where instead of modeling each sound, I’d simply be swapping the images of lips in the correct pose.  Is there a good tutorial for this?  Or a shader that can do this?  I’m in C4D r16 Studio. Thanks!

Biagio

 Signature 

We make TV and film, and podcast about it.
Joke Productions - company site
Producing Unscripted - podcast and blog about unscripted television
Joke and Biagio - filmmaking blog

Profile
 
 
Posted: 21 March 2015 10:40 PM   [ Ignore ]   [ # 1 ]  
Administrator
Avatar
Total Posts:  12043
Joined  2011-03-04

Hi Biagio,

Use a Plane and a Cloner. Set up a MoGraph Multi-shader, use Color instead of “Index Ratio”. (The plane could be a model or anything that can use textures of course.

With a Plain Effector set to Color only, no PSR, and a linear falloff, you can select the images by moving the Plain Effector.

Keyframe the position of the Plain Effector, and set the interpolation to “Step”.

I will ad some more ideas - if you like.

https://www.amazon.com/clouddrive/share/W3qUIpmn3ExLqKVfhRU4McuOLnyfYBPshv3oudH_5aM?ref_=cd_share_link_copy_flash

This is for the LEGO effect, real lip-sync needs perhaps something more, just saying. You might have watched the FXPHD course about stop motion. They used “MagPie” for their work. Mike did a great job with this course: https://www.fxphd.com/fxphd/courseDetails.php?idCourse=117

My best wishes.

 Signature 

Dr. Sassi V. Sassmannshausen Ph.D.
Cinema 4D Mentor since 2004
Maxon Master Trainer, VES, DCS

Photography For C4D Artists: 200 Free Tutorials.
https://www.youtube.com/user/DrSassiLA/playlists

NEW:

NEW: Cineversity [CV4]

Profile
 
 
Posted: 22 March 2015 01:45 AM   [ Ignore ]   [ # 2 ]  
Administrator
Avatar
Total Posts:  12043
Joined  2011-03-04

P.S.: As an alternative, and perhaps similar in set up, but much faster to animate are these two examples (in one file).

I used a Fracture Object to introduce the Color for the Multi-Shader.

The color is then changed by “Radio Buttons” or “Quicktab Radio” options. They work pretty simple, you just name an Integer then a semicolon and the name of the button.
This Integer value needs then to be adjusted (divided) to have the values between 0.00 and 1.00 for the color (Yes we feed one value, which will be taken for R, G, and B at the same time, creating a gray value)

So, if you have 32 images and you have 32 buttons, divide the User Data value by 32 (or 31 to be precise, as the zero has to stay zero anyway…). I would set up many images as placeholders, so the system stays the same, even if you have more “expression-images” to add. Otherwise each new image (additional image) might screw up the set up or worse the animation so far)

The XPresso is set up for the Fracture as “Relative”, so you can save the XPresso (which contains the User Data) as Object Manager> File>“Save Tag Preset”, and call it up as often as you like.

If that set up works, and you need to replace/update a single expression: just got to the MoGraph Multi-shader, pick the texture and replace it. Done.

=

The animation process is simple, just click on the button or check-box, and store the keyframe (perhaps select auto-keyframing).

If the animator is very familiar with the buttons, and the auto-keyframe is enabled, you could set the playback rate to 2 fps and click as you go. If a mistake has been made, overwritting is as simple as go back to the mistake, and click a different option.

I hope that is an option to consider.

My best wishes

https://www.amazon.com/clouddrive/share/F9Ccw8yHUB1JWZgV6R9SK8nThtvy_aZvgUolidwl-JM?ref_=cd_share_link_copy_flash

The numbers of the “sphere-faces” are just placeholders. The animation test was successful, and the third images shows the set up (the text can be copied even)

 Signature 

Dr. Sassi V. Sassmannshausen Ph.D.
Cinema 4D Mentor since 2004
Maxon Master Trainer, VES, DCS

Photography For C4D Artists: 200 Free Tutorials.
https://www.youtube.com/user/DrSassiLA/playlists

NEW:

NEW: Cineversity [CV4]

Profile
 
 
Posted: 22 March 2015 01:58 PM   [ Ignore ]   [ # 3 ]  
Avatar
Total Posts:  86
Joined  2008-03-29

Ah-hah!  Thank you Dr. Sassi—you always have such amazing responses!  This is exactly the kind of thing I was looking for, and the second option is especially creative.  Thank you so much for taking the time to help with this.  I look forward to exploring both of these and implementing them. This is going to save me a lot of time.

Thanks again, and hope you’re well, Dr. Sassi!

All the best,
Biagio

 Signature 

We make TV and film, and podcast about it.
Joke Productions - company site
Producing Unscripted - podcast and blog about unscripted television
Joke and Biagio - filmmaking blog

Profile
 
 
Posted: 22 March 2015 03:14 PM   [ Ignore ]   [ # 4 ]  
Administrator
Avatar
Total Posts:  12043
Joined  2011-03-04

Thank you very much for your wonderful feedback, Biagio! I hope you and your family are well as well!

It was a pleasure, and I know that you put it in good use.

I woke up this morning and thought about “… have to mention that red, green and blue, can be used to have three images for an expression per object/setup…”, I love the questions here, they certainly echo inside of me.

Please, let me know if there is any other question!

I’m curious about the results ;o)

Have a great Sunday

:o)

This is my first test to use Amazon as “video streamer” (no sound this time):
https://www.amazon.com/clouddrive/share/W7aUIY4AyXUESdKXtowA4MueWS1LXkQQZvt6SRdAbNk?ref_=cd_share_link_copy_flash


=====

I can’t resist to point it out, even if the them was stop motion, but to be a little bit more complete, scroll down to the post of September 17, 2010
http://old.cineversity.com/forum/forum_posts.asp?TID=2720&PN=1&TPN=3
click on the “Mixer Face” object to get the Attribute Manager>User Data “mixer” :o)

 Signature 

Dr. Sassi V. Sassmannshausen Ph.D.
Cinema 4D Mentor since 2004
Maxon Master Trainer, VES, DCS

Photography For C4D Artists: 200 Free Tutorials.
https://www.youtube.com/user/DrSassiLA/playlists

NEW:

NEW: Cineversity [CV4]

Profile
 
 
   
 
 
‹‹ Q&A_miscellaneous      HAIR DYNAMIC CACHE ››