I found out through research that Anime typically do all their animation before the lip sync
and then the voice actors have to try copy whatever mouth movement the characters are doing
this is also cheaper for dubbing- when anime is exported and translated around the world, those voice actors just have to copy the movements instead of having to change the entire animation
this is because anime mouth movements are very simple
its typically just a mouth flapping open and closed with little detail. because of this it's easy to make them say anything with the simplistic mouth movement
------------------------------------------------------------------
American cartoons typically do the voice first then animate to it. this is the method i'll be doing (not for any particular reason. i guess for a short film its expected for me to do a little more work. i especially wanna do it because i must learn to do more actual lip sync and character acting for my portfolio
To lipsync I use a mirror and do funny mouth movements and then sorta replicate them. I know there's specific shape guides online and I did initially use them but later on I've found that except for the "o" and "L" and "m" "and "u" sound you can kinda just use any big open or teethy mouth shape. Those 4 exceptions I've learnt what specific shape you need though
initiialy i tried to lip sync with no advice and it came out kinda just...ok/bland/boring/weird? So I used an experience rigger called ZeBirdBrain to help
Sean advised that i put the mouth movements a slight second before the audio. this is to let your eyes/brain process the mouth movements before the speech
youtuber ZeBirdBrain also said this. she helped my lip sync flow a lot better!
She has a very cartoony lip sync style where the mouth literally floats from side to side of the character's face. while unrealistic it looks so expressive! and it was definitely better than whatever bland untimed thing i had.
I drew a red line showing how it literally floats from side to side. It especially does this for the "o" sound.
here shows me imitating her speech style: below
Here you see her mouth slides all across her face. In real life this would be uncanny and strange but since it's a cartoon it looks fine!
It's a bit "too much" but i kinda like it? It feels very stylistic. I’ll understand if not everyone likes it though as it might look distracting. For her blinking i just do it after each movement
another key thing ZeBirdBrain said is make sure each mouthsound/word has a distinct shape. putting two similar mouth shapes next to each other can make it look weird so there should almost always be contrast between mouth shapes. This is why she slides it all around the face, especially for fast dialogue.
She also said avoid animating the mouth on 1s. To many mouth movements can look weird (I learnt this last year)
--------------------------------------------
Another useful tip is ZeBirdBrain said is that: if you temporarily hide your rig’s mouth layer you should still be able to tell what the characters emotion is just through their movement
This is such useful advice! Unfortunately I won't be able to apply it because i dont have enough time to make a million movements. Also its my first time making a rigged film so im kinda scared ill break them if i move them too much haha
My lip-syncing process is shown above. I don't use many mouths and I typically stick to 2-4 frames depending on speech speed