All language subtitles for 04 - Course Introduction and Prepping Our Plate - Tracking - Planar and 2D

okay so in this clip

I wanna show you a bit about the tracking

and facial tracking for this

so in order to do our retouching

we gonna need to isolate some areas in her face

especially all the um

the open areas here

and where we don't have facial features

such as eyes and nose and mouth

and this is where we wanna do the

the clean up and removing perfections

and smooth out the skin

so in order to do that

we need to get a track going for the

for the whole face

so we can isolate these areas

that we do not want to apply or

or retouching effects to

because if we were adding it on top of everything

we will lose the quality in the prominent area

such as the mouth

for the nose and the eyes

and then it wouldn't look convincing anymore

when you see in feature film

or even some high end commercials

also when they do this type of work

they are gonna put something in the face maybe um

tattoo or a complete head replacement

they often have tracking markers on the

on the face

which is like small dots they put everywhere

and this is basically because it's

it's much easier to track

and then you get like

even distribution of features all over the face

right now I mean we don't have any tracking markers

so the only thing we really have to track is like

the the prominent features or the face

like the corners here and I mean

if we wanted to track in here

it would be very difficult

but when I planned this shot I

I felt like there was not really any need to

to go crazy with tracking markers

and then we had to spend time cleaning them and stuff

and just a normal track to

the tracks on this would work just fine

so let me show you different ways of tracking

a facial features like this

and the first one is the more advanced one

everybody has heard of 2D tracking

which is basically following some pixels

tracking them

but what I wanna show you is plain or tracking

that basically takes

the image plane

what's inside your road though

it tracks the image inside

and you get the perspective shifts when there's like

a rotation or something

so it's really great when you

when you wanna do stuff on a surface and

and plane or really

what it means is the surface

so let's say if I wanted to put like

a crazy Mike Tyson tattoo here

you know or

or something like that

we would definitely need to plan or track this

to get the rotation and to get it

the stretching you know

or if she were talking

and opening and closing her mouth

to get that relationship you know

and then a plane attracting

in this area would be the best

so let's just show like um

let me show you

just simple

how planar tracking works

so we used a built in Plano tracker in nuke

and it's pretty okay

but there is a much better one called Mocha

which an external application that I highly recommend

but this one is enough just for this

so when you do plan of tracking

same as any track

you wanna make sure you do it

in areas that is different in brightness

so we can follow on out and outer edge here

it's a good good way

something like that you know rough and then press track

as you can see it's sticking there pretty well

and you can

if you look closely

you can see that all the points

shift according to the perspective of the

the image inside

you know it only tracks what's inside of this one

so and it sticks pretty well there to the lip

so let's imagine that we wanted to put like

a lip wound or lipstick or whatever here

you know we could track something like this to to

to get a perspective on the tuning

so let's do a test here

then we create a corner pin from this

and basically what you get then is like um

corner pin this area

it takes the corners of the planar

the planar surface

and as you can see

you get some dots here

that you could not possibly to the track

like I could not put a 2D tracker here

and have it get this information so

but anyway let me put a checkerboard here

just to show you how how this kinda works

let's imagine it's like a sticker you know

then we drop our corner pin here

as you can see it indeed moves it you know

so I'm gonna buffer this so we can view it

I'll just pause for you

so I buffered this in my viewer and let's take a look

as you can see it's sticking there pretty

pretty good

get some perspective shift going

it's not perfect but

you can understand how this can work

so that is one way you can track facial features

in a good way

but we're not gonna use plane or tracks for dates

it was just to show you

I know that just simple 2D tracks will

will do just fine on this shot

so it's gonna keep it easy

which is always a good idea

and visual effects

keep it as easy as you can with the best result

the more you complicated

the more can break you know

so to track this face

and basically I'm gonna select some prominent points

and I already decided that

I'm gonna do the edges of the mouth here the nose

edges of the eyes and eyebrow

and then also

since I'm putting some glow in the eyes and stuff

I'm gonna have to track the glint in the eye

which is a bit crazy you know

because it's a reflection

and you should not really be tracking reflection

but I don't have much to go for on this shot

and I already know it works so

so that's fine

so I'm gonna put some tracking markers here

we start tracking

and I'm gonna pause for you while it's tracking

so you don't have to wait for the loading

and before I start

I just wanna show you if you

if you have difficulty with your track sometimes

there's a few settings in here you can um

you can use

adjust for luminance changes

it's if you have like

a flickering light or the light change

this will save

this will save you basically

it will make the luminance not affect your tracks

and then we have down here

if you lose your track a lot

it slips or whatever

you can put this grab pattern behavior

to basically grab a new one every n frame

so every 10 frames is gonna grab the pattern again

and that's gonna make it harder to lose it

so it's very helpful

you can put it to whatever 10 20

you name it

but just now I think this is enough

and we gonna fire it off

okay and this track finish just fine

as you can see if you view up here

it's not like

it's not like solid sticking where I put it

you know it's kind of slips up here

when there's a lot of perspective shift and stuff

but honestly

it just needs to stick somewhat in the corner

because this is just for Rotos

you know it's not

we're gonna

we're not gonna attach an object there

it's just for

for Rotos is gonna have a feathered edge anyway

so he's gonna carry on with a few more of these

just grab one and put it here

this might be a bit murky area to track

but we will give it a shot

and surprisingly it tracked just fine you know

even better than the other one

so now we have that one let's continue with the nose

if you only wanna move like one side of this

what you do on a Mac at least

is you hold CMD and then you can drag it

I'm not sure what it is on a PC or Windows

because I haven't used it in years

but if you don't hold CMD

it moves both sides you know

let me pause the video and we resume when it's done

okay and that track just fine

gonna add another one for the nose

so this one we got a bit cuter in the end

you know but the thing is when we gonna

we gonna use more than one track at once

you just click

click here to make them combine for the

for the overall track

so then they knew could just average them you know

and remove the cheater that one of them contribute to

so we'll just be fine

and now we're gonna continue with the eye

and I know that the eye is gonna be a bit tricky

because she blinks

and blinking means that

we probably gonna lose the track when she does that

we might have to do a bit manual work there

but let's see

let me pause the video

and we resume when it's done

yeah so as I thought we lost

we lost it here when she blinked with the eye

so what I'm gonna do is

I'm gonna go to the frames just before the blink

gonna kill the frames before that

and then I'm gonna jump to after the blink

and since this is just estimate

you know it doesn't have to be perfect

I'm gonna do a manual one here

and then you see

it's pretty

it's pretty okay

and then I just gonna continue the track afterwards

and then she gonna blink again soon

so you see yeah

we lost it there as well

so we're gonna have to go back

to where she blinks there you see

so gonna erase that

jump to after

the blink I erased a bit too much now maybe before

doesn't matter we can just do a manual on this

just so we get a rough one yeah

then we grab

actually let's let's move it here also

okay and we do a grab here

and we do the last part yeah

so in the spots where we don't

have any key frames in between

like here you know

as you can see

there is no keys

but still nuke

just get estimate where it would end you know

and basically

if you have more than one tracker

and the other tracker has frames

where the other one has not you

it will be using those values to apply here

and do an estimation so

and since we have plenty here

it doesn't really matter so let's

let's do the last track here

and I'm sure we're gonna have the same problem

on this one

for this one

I'm just gonna jump past all of that

since I already showed you how we do it

with the manual tracking

so I will pause

and then when I'm finished

we're gonna continue

as you can see I got a similar problem on this one

so did some manual tracking there

and then for the last one here

I think we're gonna do one in the eyebrow up there

I think one eyebrow is enough

and now we're gonna take a look at

what happens if we try to stabilize her face now with

with all of these tracks

so just hook this up

we're not gonna do the rotation

it's not really needed

it's such a small rotation

and do a transform

stabilized and I'm just gonna close this

put the viewer on the tracker

as you can see something is happening

gonna buffer this

and then we're gonna watch it together

okay so I buffered this and now let's watch it

as you can see

it's pretty much stabilized in the very center here

you know so it would be a lot easier to do like Roros

let's see what happens if we put on the rotation

also in this

and I will buffer this

okay and here it is buffered

even more stable now with the rotation

so that will make it a lot easier for us to roll to

out some of this

and to make our mats for the smoothing of the face

and removing this imperfections

and this module

we have gotten an overview of our project

and the shots we will be working on

and we denouised our footage to make sure we

we can keep the grain

and we also looked at how we can add this grain back

uh on top of the work we will do later

to keep the original plate grain

we took a look at trying plane or tracking

and how it can help speed stuff up and give you um

perspective

and stretching

if you're adding elements on this on the surface

and we also did our two retracts for her face

that we will use in the next module

where we will be starting to do our clean up work

and in remove imperfections

and start smoothing out her skin

I'll see you in the next module