All language subtitles for 5. ControlNet SD1.5 - Setup and Scribble, Lineart and Openpose

So we'll take a look at the

First and it's kind of a fun control net this is

Scribble control

Just see what's happening here we've got a number of outputs

And it's taking a scribble that I put together on canva

And it's turned it into these really interesting outcomes

Let's take a look

Look at how everything set up so

We're dealing with

SD 1.5 so

We've got a 512 by 512 I'm

And this is giving us this outcome are in the saved images

The control the load control is loading up

Control

311 PSD 15 scribble very nice name and I might sometimes to keep the original names because

Because it is much easier to

Set of know exactly which file I downloaded

Rather than changing them to a more friendly name with sometimes

Sometimes makes sense sometimes it's not that helpful in the long run

Checkpoint I'm loading is dream shaper aids for a change

And we've got the standard

Standard VA

Light steel statues Starry Sky

Beautiful desert landscape

And we go back to the history we can see what the previous ones were

2 Kings walking under a starry sigh

So this is the one with

Let's go back to

I'll have to redo that

With that bit of a reminder to

Save the other

What's the workflows before

Playing around in the history

So the workflow here which I will share with you

Basically runs from the control net which is Scribblenaut goes to dream shaper

And then we're using the standard

VA

Two men likes steel statues Starry Sky

Beautiful desert landscape

What is what it comes up with using this particular scribble

Did this particular

Control net is actually

Play pretty flexible

And it does try to follow

Play the shapes that it sees but

Sometimes it interprets things

Some mathematically so it is sort of put some Stars which didn't necessarily look like these giant Stars

So it's a very flexible one

Which I think pays to experiment with quite a bit to see how it works because it can produce some amazing results

From very very simple diagram

I control the

Play Scrabble yourself you can get them online

And working with a strength of 0.9

That we've seen I think in previous projects

What's a little bit different is that we are starting with

The image that would normally be handled by the preprocessor

So we just importing something that's already ready for the controller

To the controller I think the

The link you can see the link that

So that's basically how it works I'll share this with you and you should be able to use this

For your scribbles and

It might work for quite a few other

Control Nest as

Now the line

Control net this one is sd-15 line

This one actually comes in

With a similar kind of

Play

As the as the other one describe the one that we were dealing with

I've taken a hand

Lion

Use it to create

Delete a set of roads in the

In the country

Anderson for tropical area

Road Network

That seems to resemble

What's happening within the hand

It may be a higher number of steps

And the control net here

Is

Working with

Play

A house in the first scene

Tropical scene from above

Trees Road hand like outline of the building

So instead of taking the building and making it hand like

It's instead made the

Rodeway the main theme of the of the design so we've got a roadway

Because this image is

Where is the

The Mt Layton damage is 512 so we could increase this to 768

Think it allows us to work at that level

Without too much distortion

What happens and you can see that it is extremely quick

When we're working at

What's SD 1.5

And here we have

Something which may be resembles the prompt a bit more you've got a really unusual building

Which takes the outline of the hand

So this is a really powerful one and it's one that I think

Can be quite inventive

So we can take a look at the ones that I've created so far this is the

Shape of that of that hand

It's really kind of impressive how it works

And you can see the previous one where is combined house and

And then

With the men with the two men two Stickman you can see it's a little bit more

It's a little bit more

I would say

It's a little bit less creative in some ways

Then these crippled one

Follows the outlines a little bit more

Authentically

Play bendy the scrib

So there's that minor difference but otherwise

They do seem to carry out a similar

Kind of function

This one here

Literally the outline that we were looking at

With the two gentlemen

And you can see it's a very different idea to the to the previous one the scribble one

So use those two in similar but different situations

So this one

Which comes from comfy himself

Little bit more complicated

And I will give it to you as is it's a complicated one that produces two outcomes which you can easily do

Do with the company UI

And it starts off with the pose

Estimation is that uses a technique known as pose estimation

Unpause destination is a neural network technique that allows us to take a simple pose

Well it can take an actual subject and then interpret what

Posse must have been

Turning it into lines like this

Make a

And then turn it into an image so in this case

This particular image

It's turned into this worshipful

Image it's not 100% successful I have to say so it's a little bit

I'm more of a demonstration of what you can do

With come for you

But it is showing a gradient from

The small

Input through to the largest output so there's an enlargement going on as well

And that is a little bit of a breaking down of the the image

As as you can see where you get will you begin to see parts of the image

Duplicating

That kind of collapse does occur as you work with larger size images but it's more of

Representation of how you can do

Something that starts with a fairly small image

Basic neural net and neural network input

And this one

Goes into the open pose

What's fp16 we're using an fp16 control

Dream shaper

And then we're using the standard 84

840000

Stop PR

Vae

And then some non-descript problems

In this particular case we've got young adults expensive religious robes

For whatever reason cute natural look sanding

Sunrise beautiful landscape Bo

Boca is a photography term that means that sort of background blur

I was getting a very sharp background and when you when you in input Boca it just blows out the background

Play the photographic term which

The neural networks here in Statesville diffusion they understand

That particular word to indicate

Blood part of the image

Play pretty well trained in in that

And we've got City Lights I'm going to change that to Boca City Lights so we might get a different type of

City Lights if we put in Boca

Say the complex one beginning at 12:08 / 7:04

Which is kind of like the point of

Things Begin to Fall Apart

With dream shaper and SD 1.5

So this is maybe something that might work a little bit better inside of sdx

We've got to stop

Add CL

Lay it too so we're going to

And then we've got a couple of Samplers one for the initial run and the second one

Dot actually run

For the second enlargement run

And this is the latest UPS

So with the latest upscale

You quite often have to run a fairly

Have a family

Simple upgrade

To to the image you have to sort of run

You can't just do

Leave it sometimes you find you have to

Is it to run

Samples

What's again in order to get the upscale to work properly

But we can run it and you can see just how quick it is

Inside of comfy you

A single prompt

And then we run the second prompt the enlargement Happening Here

It's extremely quick

I've got all sorts of equipment running in the background so

Gives you an idea of just how efficient coffee UI is

And we should soon have an image although the vae may stop for a while cuz I think my

This is a very large image size and that can sometimes delay

But no it's

There we have our girls

In the roads looking kind of serious and all sorts of worship

Stop happening there

So that is the I think I probably prefer the original one here

It's a little bit technical

Include all the stuff that you need so you'll find the pose image