PD 365 - What's the best way to superimpose lips from one vid to another?

Deano42

Newbie Joined: Jul 28, 2017 15:11 Messages: 2 Offline

Solved by

Jul 12, 2022 07:24

Okay, this is a very specific effect I'm trying to accomplish. I have one video wherein I am sitting and speaking. I used a special process to merge my face with another one and created a second video with the new face. But a flaw in the process has caused the lips in the new clip to remain mostly closed.

So, I want to show the lips from the original video on the face of the new video. Masking won't account for the head movements during the clips. I can try motion tracking, I guess, but it's not a static object, so I'm not sure how to set this up.

Any ideas? How cool would this be if we can make it work? What do you guys think?

Cheers.

optodata

Senior Contributor Location: California, USA Joined: Sep 16, 2011 16:04 Messages: 8630 Offline

Jul 12, 2022 13:17

The only way I can think of to do this is to use masking (with a feathered edge to let the desired lip clip show) along with manual keyframes thaat shift the lip clip's position and maybe rotation to try and match the head movements.

There's no deep fake style automated tool to blend the two together, so you'll have to decide if it's worth all the editing effort. It honestly sounds like you'd be better off redoing the "special process" until you get the lips synced there.

Deano42

Newbie Joined: Jul 28, 2017 15:11 Messages: 2 Offline

Jul 12, 2022 22:22

Quote The only way I can think of to do this is to use masking (with a feathered edge to let the desired lip clip show) along with manual keyframes thaat shift the lip clip's position and maybe rotation to try and match the head movements.

There's no deep fake style automated tool to blend the two together, so you'll have to decide if it's worth all the editing effort. It honestly sounds like you'd be better off redoing the "special process" until you get the lips synced there.

Thank you for your input. As it turns out I was able to mask the area well enough that it works perfectly! Thank you for your time in telling me the best way (only way) to do this.

Cheers!