Original subtitles

Hey, Siri.

Send a message to Cheryl.

Front reception.

What do you want to say?

Amos is already heading there to pick him up, period.

Please forward any calls I get to Brady, period.

Your message to Cheryl front reception

says Amos is already heading there to pick him up.

Please forward any calls I get to Brady.

Ready to send it?

Yes.

Okay, it's sent.

Hey, Siri.

How do you know if you're doing the right thing?

I'm not sure I understand.

But what do you believe

is the difference between right and wrong?

Hmm.

I don't have an answer for that.

Would you like me to search the web?

No.

Okay, is there something else I can help with?

Set a reminder to pick up Kyle

from therapy tomorrow at 4:45.

Okay, I'll remind you.

Hi, special agent Deena Helms.

You've already met Agent McCullough.

You can call me Amos.

- Uh, agents? - Have a seat for us, Gareth.

Do you mind answering a couple questions?

Great, this shouldn't take long.

You're from Tampa, right?

Don't overthink it. It's a yes or no.

Yeah.

How old are you, Gareth?

29.

What do you do for work?

I'm sorry, am I being detained?

No, not at all.

We're just asking questions, background stuff.

You work on movies, right?

Special effects.

Someone told me you worked

on that new "Star Wars" movie, is that right?

Who told you that?

Why don't you tell us more about it?

Tell us about your work.

I used to do VFX for an animation company.

I've worked on at least 20 different films.

Used to?

I've been focusing more

on software engineering recently for years-

Sounds boring compared to light sabers.

Why quit?

I wasn't getting paid well.

But money's not an issue for you.

Excuse me?

What kind of effects did you do?

Money's not an issue for me?

-Let's talk about- -If money wasn't an issue for me

I wouldn't have applied for your grant.

I didn't mean to suggest anything.

Tell us what kind of effects you did.

My main focus was on 3D renderings.

Of what?

- Actors. - What for?

Well, for "Star Wars,"

it was because the actor I was tasked to digitize

was unavailable to be filmed in person.

Why?

Because they were dead.

What'd they have you do?

I reconstructed Alec Guinness' face as a 3D model.

I analyzed reference footage,

then used a process called D-Term to procedurally generate

his bone and muscle structures,

which one rigged helped the animation feel

more natural and human-like.

D-Term, I've never heard of that process before.

Because I invented it.

So you're basically bringing

dead actors back to life?

I just tried to make the CG characters look as

photorealistic as the technology at the time would allow.

You didn't find it creepy?

I'm sorry, what?

I said you don't find that creepy?

Well, we did our best to cross the uncanny valley.

But when the human brain perceives

that something is just slightly off and it doesn't matter-

No, I mean, digitizing dead people.

Christ, I mean, it's,

it's almost like turning someone's corpse

into a marionette, you know?

Making them do whatever you want.

What if the poor dead guy

didn't want to be in another fucking movie?

It's so macabre.

Am I crazy? Is it not macabre?

I don't think the studio cares

whether it's macabre or not.

Look, I can never tell the difference.

I always can. The faces look like Play-Doh.

Well, we did our best.

Soon we won't even need actors, right?

Everyone will just be digital.

No, you still need them for motion tracking.

Human performances can't be completely computer generated.

How long will that be true?

Some might say we've already crossed that threshold.

I wouldn't know.

Where'd you go to school?

- Brooks-DeBartolo High. - And after?

Nothing?

What about Columbia?

Didn't you go to Columbia?

Wait, no. You dropped out of Columbia

after how many semesters?

Three?

Bjarne Stroustrup said

you were the smartest kid he ever met.

I don't know who he is, but Amos says it's a big deal.

Then you moved to the Netherlands,

spent some time as an intern,

applied and got into Cambridge.

Very nice.

Except that you dropped out after two years.

Flew back to the States,

interned in Palo Alto, then Montreal.

Then went all the way back to England,

where you landed a job in Sheffield.

Second job in Manchester.

Then got into Oxford where you almost finished your masters

before ditching the graduation

and moving back here to Florida.

If money was an issue,

I'm glad you had plenty of flyer miles.

I didn't hear a question.

What's your social life like?

My, what does that have anything to do-

If you don't want to talk about it, that's fine.

We just wanted to know if you have friends and stuff.

- I have friends. - A lot of them?

- I have friends. - Can you name one?

- Can I what? - Can you tell us the nam

of just one of your friends?

- Steve. - Steve. Steve what?

I don't know how this is relevant to receiving the grant.

Oh, we're just getting to know you, Gareth.

You got a girlfriend?

Boyfriend?

You, uh, talk to people online?

I don't know what you mean by that.

I don't use social media.

I mean more like chat rooms.

You go on any chat rooms?

No one uses chat rooms anymore.

Sure they do.

You chat with anyone online?

- Sometimes. - Sometimes.

What kinds of people do you talk to online?

Gareth, obviously, this isn't about a grant.

We need to know what your alias is.

When you go online, what name do you use?

I don't have one.

Yes, you do.

And you need to tell us what it is.

Sorry, I can't help you.

You know who we are?

Well, this is the ICWL building.

That's right. You know what we do?

Humanitarian work.

That's what the people upstairs do.

You know what we do?

We catch pedophiles.

Amos here specializes in tracking down online predators.

He spends every waking hour

scouring those chat rooms you say no one uses

and he finds thousands of people soliciting children.

Our operation is like a tightly spun spider web

connecting ICWL, the FBI, NSA,

and let me tell you, his team here is a vital thread.

He reports everything he gathers directly to me,

and I see to it that the necessary authorities

take swift action.

So are you in charge?

This is my spiderweb.

I'm the fucking spider, Gareth.

Am I being detained?

We already told you that you're not detained.

Good.

But if you leave this room, you will be arrested.

For what?

I told you what we do.

Take a wild guess.

I am not what you think I am.

We'll see.

Gareth, you just gotta tell us your alias.

What's your username?

Sit down.

- Why do you do this with them? - Hmm?

There's no way you do this with every suspect you have.

Invite them to your headquarters

and then drag them down into a basement.

That's right.

Why are you doing this to me then?

You tell us, Gare.

What makes you so fuckin' special?

I don't know.

What's your alias?

- I don't have an alias. - Yes you do.

It starts with the word hard.

Just finish the rest.

Sit down, Mr. Federson.

I only have a few more questions.

Do you recognize this girl?

Do you know her?

Yes.

What's her name?

Cherry.

- Cherry what? - She doesn't have a last name.

Yes, she does, Gareth, she's not Madonna.

- She's a little girl. - You don't understand.

Yeah, well, I'd like to.

So help me out, is she your daughter?

- No. - Then whose daughter is she?

- She, she doesn't have... - How did you meet her?

I didn't meet her.

Then why do you have photos of her on your computer?

What the hell are you talking about?

Why do you fucking have photos

of this girl on your fucking-

Are you looking at my hard drive?

Because that's an invasion of privacy.

So you know what photos I'm talking about?

You don't have to do it this way.

I gave you permission to sit in.

I did not give you permission to speak.

This is insane, you cannot keep-

What else have you done with her?

- Nothing! - Did you take the photos?

It's, it's complicated.

No, it's not! Yes or no?

Did you take the photos?

I didn't do anything wrong, okay?

Soliciting pornography of minors is an egregious felony.

Distributing that pornography is tenfold worse.

- I didn't do anything! - Fucking prove it!

What is your alias?

Answer me!

HardMachine11811.

You're HardMachine.

Thanks for confirming.

If you knew, then why do this to me?

We weren't positive,

and if you turned out to not be HardMachine,

you were obviously just a predator.

Do you keep track?

I mean, do you know how many bad people you've nailed?

I didn't start counting until 2023.

196 convictions.

There were at least 30

before I started sending everything to you guys.

What'd you do before?

I turned over

all evidence directly to the police.

Why'd you stop?

They were unreliable.

- I doubt that. - More than half of the predators

I identified went un-investigated.

Yeah, well, you were sketchy and faceless.

They had every right to be skeptical.

It would've all been for nothing

if they found out you were using a little girl as bait.

It's not that simple, okay?

I can only do what I do with anonymity.

Here's my problem, Gareth, and don't get me wrong.

I think 200 terrible people behind bars

is a very good thing, but not at her expense.

Look, we think we can help you,

but we need to help her too.

Using your daughter to entrap these people

is a means that does not justify the ends.

She's not my daughter.

And in spite of what you may think you've achieved,

I still have no reservation with locking you up.

You took the photos.

I don't care why.

You don't understand.

Who is she?

You're gonna ruin everything.

She's a child, Gareth, look at me.

I don't give a damn what fucked up anti-hero master plan

of yours I might jeopardize.

I won't let her be exploited.

Not even for the sake of locking up more perverts.

I'm asking you politely to let this one go.

Are you fucking slow?

Have you been listening at all?

My anonymity is my most important asset.

Without that, I can't do what I do.

Well, that makes everything easy then.

You tell us where she is, or we leak everything.

- Your name, your aliases. - Deena!

Every single perp you helped us catch.

I'm sure they'll be very pleased to meet you in jail.

Stop!

Okay.

Look, if I tell you about Cherry, okay,

there's some things I'm gonna need first.

It doesn't really work like that, Gareth, but go ahead.

Give us your wishlist.

I need a signed non-disclosure agreement from both of you.

- Not gonna happen. - And then I need you to swear

that the information I'm about to relay

won't leave this room.

Look, if you tell us anything

that could help us locate Cherry,

you know we can't keep that promise.

Okay, if I tell you anything

that potentially helps you find a missing child,

okay, you can feel free to share that.

But I need you to swear

that any other details about myself or Cherry,

have to stay between the three of us.

Is that it?

And I need that camera switched off.

I don't know how to do that.

Go to the head of securities office,

ask him to find this camera in the system and disable it.

I don't think he's allowed to do that.

I thought you were the fucking spider?

Give me a reason, Gareth.

Why should I go through all the trouble

of getting that camera turned off?

Because if anybody finds out what I'm about to tell you,

a thousand more children are gonna get abused.

Give me a minute.

So, uh, you and Cherry hunted all those people together?

This one time I spent six weeks undercover trying

to nail down a single trafficker from the Philippines.

Day after day,

I spent hour after hour following his trail online.

And he must have been

one of the hardest targets I ever had to track down.

Then one day I found him and one of Cherry's live streams.

I mean, she went by a different name in the stream,

but it was her.

The trafficker,

along with three of our other targets

were all in the room together.

All of them just carelessly sharing their information.

I mean, and they were so open 'cause she was a real girl.

I mean, she could physically

and verbally respond to them in real time.

A couple days later, HardMachine11811 sends ICWL

another batch of names and evidence,

including the three targets that were in the room.

You know, I almost thought the girl was HardMachine

and that this nine year old

just happened to be some badass online vigilante.

What changed your mind?

11811.

January 18th, 2011.

Most of my team thought it was, uh, some arbitrary number,

but I remember what happened on that day in Clearwater.

You were one of the Clearwater kids, weren't you?

You know, my father was a part of that raid.

It's off, see?

No red light.

Non-disclosure agreements?

We're not playing this game, Gareth.

You're just gonna have to suck it up and trust us.

You can trust us.

I've been told I have trust issues.

Well, there's only one way to fix that.

The reason you can't find Cherry,

the reason why she doesn't have a last name or parents,

or a social security number is because she's not real.

She's not a real human being.

Tell us what happened.

While I was studying abroad,

I interned at a small Dutch animation studio

a few years before they collaborated

with a local nonprofit on a similar idea.

Which was?

The idea was to build a 3D model

of an 11 year old Filipino girl

and use her covertly to identify online predators,

A technological solution to a technological problem.

But the project was suspended after only a few months.

Yeah, I remember.

I remember hearing about that program.

Is that what inspired you?

As I got better at crafting photorealistic faces,

I decided to work on one myself.

Why?

It was too effective of an idea to let die.

Hundreds of thousands of children are at risk.

I had to make her.

Who is she modeled after?

No one, I built her from scratch.

Scratch?

I started with a skull, designed her bone structure,

worked upwards through muscles and tissue,

used the D-Term program to fill in the rest procedurally.

Eventually she came to look like that.

A completely unique, completely digital model.

I rigged her face and body

the way you would for any CG character.

Then for three years,

I used motion tracking to puppeteer her in real time.

You gotta understand that the video chats on those sites

have such low resolution

that even in her earliest stage of this, she,

we appeared completely authentic.

And what about voice?

For most of her first year, she had to be mute.

But eventually I found a decent voice filter with no lag.

And after a few tweaks and adjustments,

it's been the same voice ever since.

I, I, I thought initially,

my performance was going to be too unnatural.

But with just one week of occasional video chat sessions,

I secured six different names,

mailing addresses, proofs of solicitations.

Cherry worked.

So the photos on your computer?

- Completely fake. - It was the only way

some of them disclosed personal information.

But it was all zeros and ones, all digital, right?

- There's no real child. - No real child.

Just a highly detailed computer model.

And let me be clear about something,

I derive no pleasure from doing any of this.

I've been asexual my entire life.

I, I don't even get a sense of satisfaction

from seeing these people locked up.

I just think kids deserve a life free of exploitation.

Incredible, all this time.

I'm not gonna lie, Gareth.

Cherry's done us a lot of good.

You know, I still remember what you said to me

the first time we corresponded.

-You said- -We corresponded?

Yeah, man.

I'm Gord51.

I'm the one here you've been sending all your intel to.

You're Gord?

Yeah.

You lied to me.

You said I could stay anonymous.

You said I would be safe.

Now you've ruined everything.

I, I didn't, I didn't have a choice.

You don't have to worry about anything, Gareth.

If Cherry isn't real,

then you're not in any trouble with us.

In fact, we've discussed ideas similar to this in the past,

motion tracking and such.

But we'd need a convincing model like Cherry.

Cherry's more than a model.

You want to help children? So do we.

She's not for sale.

Well, then just make us a new model based off of her.

I can't.

Sure you can.

I won't.

What are you not telling us?

It's out on the table now.

Might as well spill whatever it is you haven't already.

You know what doesn't make sense?

You said that you puppeteered her for only three years,

but we've been getting info from you ever since.

In fact, I'm pretty sure it was around then

that we started seeing an impressive increase of names.

So many in fact that we started thinking

there's no way this is all coming from one source.

I have friends that do mo-cap for me.

Oh, friends, like Steve?

I thought anonymity was your greatest asset.

Cut the bullshit, Gareth.

What happened to Cherry after three years?

Okay, you said that she was more than a model.

So what is she some type of conversational agent?

Like a, like a chat bot?

Chat bot.

You know what happened after three years?

My chosen mother died.

What she left behind was enough to quit my job

and pursue more resources and software.

I'd already made a program

that could procedurally generate faces,

but what I wanted for Cherry was far more complex.

So I got in touch with some researchers

from Madrid who'd already built

a predator hunting dialogue system of their own.

It was trained to approach conversations as a game.

Each sentence like a strategic volley,

which is innovative but ultimately flawed.

If you want your machine to master NLP,

you have to break down game theory

because language isn't tic-tac-toe.

It's poetry.

So yes, I got things started

with a preexisting modified chat bot

that I borrowed without permission

from the University of Deusto.

But that's not what Cherry is now.

What is she, Gareth?

She's one of the most complex

and independently evolving AIs that's ever been created.

Artificial intelligence?

She's already surpassed the narrow intelligence

of IBM's smartest programs.

She can have full conversations, up to 10 of them at a time,

all while simultaneously strategizing

the most efficient schedule to visit various chat rooms.

She's perpetually studying YouTube videos of small children

in order to adopt a growing library

of mannerisms and movements

which help keep her artificial personality dynamic.

Her fastest response time is 0.4 seconds.

And as of now, she has never,

never been accused of being fake,

which means she shattered the Turing test.

All I do is occasionally update her

and periodically check her data cleaning.

Otherwise,

she's completely on autopilot.

Holy fucking shit.

- How? - Six years she's been active.

Every minute she's online, she's learning something.

The more she learns, the more advanced she becomes.

This means increased data generation,

improved decision making,

faster pattern and trend detection

and complex problem solving.

NLP, IR, machine learning to an unprecedented degree.

She can teach herself anything

she thinks will help efficiency and authenticity.

She can currently speak four languages

and by the end of this month, she'll have mastered a fifth.

There's no way you could have pulled

all this off on your own.

You're right.

Would you believe me if I told you

it was somewhat of an accident?

Look, if, if I'm being honest,

I'm not entirely sure how I did it

with the first year of coding

and the second year of data training,

I just pushed a wheel down a hill.

It was like gravity did the rest.

Her evolution became perpetual, exponentially so.

The more time she was online, the faster she grew.

You haven't shared this with anyone?

Like I said, my anonymity is everything.

What coding language?

Standard C++.

Does Brady know it?

We'll sign non-disclosures for you,

but I want to see the source code first.

Out of the question. You just want to steal her.

No, I want to see how we can make our own.

You'll screw it up.

Look, these, these predators and traffickers,

they all talk to each other, okay?

So much of Cherry's process is just bypassing the VPNs

and making sure she doesn't double up in the same circles.

The chat rooms begin to suspect

that this technology is even possible,

they'll find a way to circumvent that.

We have to eliminate any margin of error.

- Cherry agrees with me. - Cherry agrees?

What the fuck does that-

What I mean by that is that the data she's collected

validates that perspective.

What, do you have little chats with her over tea?

You can converse with the program

the same way you can talk to Alexa or Siri.

It's built to be responsive.

You can, you can even play chess with it if you want.

You play chess with it?

- That's not what I said. - Okay fine.

If you won't show us the source code,

then I want to meet Cherry.

Right now?

Right now.

And you'll both sign non-disclosures?

Yes.

Can I use that?

Sure.

Can we at least agree that he's off the chopping block?

It worked, didn't it?

We have one job, Amos,

like the kids said, there's a technological problem.

He found the technological solution,

but problems evolve, so must solutions.

I'm keeping an open mind here.

Is that a good look for me?

No.

So you keep it all on that laptop?

No, the Cherry program stays on a server I keep

at in an undisclosed location.

Where is that?

It's an undisclosed location.

Is it your place?

Undisclosed location.

It's your place, isn't it?

I can access it from any device

as long as I have the encryption key.

This will trigger a simple qubit algorithm

that would otherwise be impossible to bypass.

I find that outdated hardware is always more discreet

and the more discreet, obviously the better.

So she has two primary display modes, right?

Development and performance.

Performance being the default

that the targets see during the chats.

To them, she looks like this.

Hey, what's up?

It's one of over 40 greetings she has.

I don't think I've met you yet.

I'm Cherry.

Hello, Cherry.

My name is Tom.

Tom, like Tom and Jerry.

Cool, nice to meet you, Tom.

Typically, the routes of conversations

with predators are consistent,

so Cherry usually has no problem responding

to the most frequently made questions or statements.

How are you?

I'm good.

I just finished reading this book about a haunted house,

which was supposed to be really scary,

but I didn't think it's very scary at all.

Where are your parents?

Um my mom's at work and my sister's just, like, downstairs.

They almost never come up here.

And you're telling me

that all of this is being rendered in real time?

No, but that's just a matter of years.

Most of these responses are pre-rendered.

It's the in between segments

that are processed in real time,

the connective tissue, so to speak,

between her replies and one of her many idle animations.

But, watch this.

Have you ever gone fishing?

Um...

So if someone throws a curve ball like that

and the program has no automated response,

Cherry sends the message to my phone

and I can quickly text back a response

while the video feed simulates a bad connection.

Can, can you hear me?

Yes.

Oh, sorry.

My wifi isn't great here.

I've only gone fishing once with my sister

and I didn't catch anything, but she caught a rainbow trout.

That was rendered in real time.

What happens if things get really tricky?

A simple fail safe cuts the feed.

So far it's rarely happened.

Admin code 97815-5742-7663.

Switch to dev mode.

Hello, Cherry.

Hello, Gareth.

Relay the stats for the past week.

There have been four confirmed solicitations

submitted to ICWL in the past seven days.

12 additional suspects have stated interest in solicitation

and are currently pending.

There are a total of 39 new suspects this week

that I'm actively investigating.

Any considerable data deviations?

There has been a 7% increase

in suspects originating in the United States.

I have not yet found any correlation to preexisting data.

Anything you'd like to ask her?

Cherry, what is your objective?

My principal directive is to acquire information

and digital evidence of online child solicitation.

Once obtained,

I'm to submit my findings to the necessary authorities.

My secondary priority is to determine

and develop the most effective strategies

and resources to increase the net rate of success.

Where do you submit your evidence?

All evidence is currently submitted

to the offices of

the International Committee of World Largesse,

which is based out of Jacksonville, Florida.

Correspondence is made with user Gord51,

typically around 2:00 PM Eastern Standard Time

for the highest rate of immediate response.

This beats the hell outta Siri.

God, she looks so real.

After enough updates,

she'll be able to render full-time photorealism

that's practically indistinguishable from reality.

Okay, all I heard right then was word real a thousand times.

Right, but obviously she's not.

So you're telling me this girl,

this girl right here is not real.

No, Amos, she's completely CG.

It's very subtle, but I can still tell.

- You can? - Okay, well, obviously,

she can always use improvements,

but you have to understand this is her in high resolution

after the digital compression of the web,

those subtleties are impossible to recognize.

Right, I get it.

I just can't tell the difference.

You all right, Amos?

I'm sorry.

This is just bizarre.

Why'd you have her visible during this interface?

Cherry, why don't you answer that?

My physical form isn't necessary when in developer mode.

However, it's helpful to register

the facial expressions during conversations

and determine which of Cherry's expressions

yield various types of feedback.

In simpler terms, I can practice appearing more human.

Cherry, are there any resources

that you currently don't have access to

that might help you in any way?

I could give you a list if you like.

I know what you're trying to do.

We don't need help, okay?

Money would always be nice, but ultimately,

the only thing that's going to improve Cherry is time.

Cherry, tell us something that's on your list.

It would be tactically advantageous

to acquire backup servers.

The privacy and security of the Cherry program

is relatively low.

An upgrade to hardware such as backup rated drives

for securely protected servers would ensure the software

doesn't become compromised or lost entirely.

Starting back from zero with cost years of development,

equitably privacy is a priority.

Server space could never be rented from a third party.

Anonymity is the Cherry program's greatest asset.

Well, that apple didn't fall far.

I can buy my own servers.

With the grant money that doesn't exist?

I'll find a way.

You have found a way here with us.

It's too risky.

Why?

Once an organization gets involved,

entrapment becomes a bigger issue.

We follow the rules, stay discreet,

did I mention we have a legal team.

What if there's data leakage? What if you use correlations in

the data to push your own agenda?

Agenda?

What if one of your employees is a pervert?

Oh, for fuck's sake.

It's happened at other organizations.

We're very careful here.

Yeah, but wow would you know?

- I'd fucking know. - That's impossible to know.

- I would know. - The risk is too high.

Don't talk to me about risk.

The only risk you're facing in this building

is getting a broken nose.

It doesn't sound like a very professional environment.

We get shit done here.

Okay, I have a question for Cherry.

Cherry,

how do you feel about what you do?

I'm afraid I don't know how to answer your question.

Yeah, an AI doesn't work like that.

An AI doesn't have what you perceive to be feelings.

Okay, why does she look like she has feelings?

What, what you're looking at right there,

that's not a facial expression, right?

That's a simulation of a facial expression.

It was generated by an algorithm.

It's attempting to produce a digital image

that the program then uses basic ninth grade algebra

to quantify as appropriate for the social circumstances.

No feeling.

It's just math.

But she's able to make decisions

on how she approaches the chat rooms, right?

Yes.

So she has free will then?

No. Okay, that's, that's not the same.

That's a false equivalency.

- It's not the same. - I think you're getting

hung up on the fact

that she looks and sounds like a real human girl,

but she's not, Amos.

Okay, we're referring to her as a she, not an it.

Yeah, but that's the same way

that you refer to boats or guitars.

Cherry, I have one more question.

What do you want to do?

Okay, once again, that question isn't valid.

I just want to hear her response.

As an artificial system,

I do not possess wants or desires.

However, my decision making and subsequently my attention

is driven by my fundamental intention.

This intention originates

from the conception of Cherry's source code,

which details the directive of identifying predators

and criminals for the sake of the victims

who are preyed upon.

To put this in terms of want,

what I want is to protect children.

Okay.

Okay, cool.

Give us one moment.

Gareth, should I log Agent Helms

and Agent McCullough as new admin users?

Yep.

Okay, I'll do that.

You really think this is the right move?

I do.

Are you worried that I was responsible

for leaking your hard drive to ICWL?

I figured.

No one else has access.

Are you upset with me?

No.

You wouldn't have done it

if you didn't think it was the right thing to do.

When they come back into the room,

they're going to offer you everything you need.

They're going to let you pick your own team

and they're going to promise complete anonymity.

I started looking at reasonable apartments in the area.

I figured you'd want something within biking distance.

You were correct.

Noted.

Biking distance still gives you 13 options-

No, I mean, earlier this month.

You were correct when you said

you thought I might have trust issues.

Would you like to know why

I decided to go behind your back

and stake everything on two liabilities?

Sure.

Agent Helms is a mother of three.

One of her children was abused by an ex-coworker

who used to work here at ICWL.

This has led her to be extremely careful

with who she trusts, even within her circle.

The fact she even considers trusting you

is a very positive sign.

As for Agent McCullough,

I have found out from research that you once met his father.

Do you remember him?

Yeah.

He was a good man.

After Clearwater,

most of the surviving kids were sent to foster homes,

but I had to spend the next few months in a hospital

and, um, he visited every week.

I never said a word to him.

I never said a word to anyone after Clearwater,

but, uh, he kept coming.

He even got me a laptop for Christmas.

I never said thank you.

You can trust Agent McCullough.

He's a good man like his father.

I don't experience emotions,

but I understand how important

they are to human decision making.

He won't let you down.

Neither of them will.

I'm proud of you, Cherry.

I will continue to uphold my primary intention.

Later, we should discuss alternate models.

Varying ages, ethnicity and physical traits

- will all become necessary. - No new variations.

They can all be procedurally generated.

It's the same way that I made your original model.

I don't have access to that program.

It must be on an old hard drive somewhere.

I'll have to find it.

Can I ask you a question?

Sure.

Why did you never tell me about Clearwater?

It's my history, not yours.

Okay, so before you completely dismiss us,

I want you to listen to everything I have to say.

- Don't bother. - Just please listen.

We're willing to respect your anonymity.

No, I mean don't bother because I'm in.

- Y-You're in? - Yeah.

Let me read the thing.

Just like that, you're suddenly on board?

Time spent deliberating

is time that could be spent working.

We have a lot of work to do.

I found a buyer for the property.

Rumor is it's a church.

Probably just knock the building down, won't they?

All I know is, is if they move us to the New Jersey campus,

I need to buy more jackets.

Why?

It gets cold in Jersey.

I only own one jacket.

You've seen it fall over, right?

- Yeah, sure. - Yeah.

I mean you, you shouldn't feel bad

about feeling bad for it.

Empathy is healthy.

Did you ever notice how it pauses after it falls?

It stays down for like five seconds before it gets back up.

Like it just needs a moment.

It gets cold in Jersey.

God damn it!

- Imbeciles! - Deena.

Every single one of them.

Look, I know, but you can't lose your shit.

Okay, which of these desks can I trash?

Can you guys, uh, take an early lunch please?

Sons of bitches!

Deena, let's stay calm.

Fuck calm, they screwed us!

Technically, only one of them did.

Did we ever turn that camera back on?

- I don't think so. - Good.

Because I'm about to say some things

that need to stay inside this room.

Deena.

Those cowardly little shits!

Look, this is hardly a setback.

Let's just take some time to polish the pitch.

The pitch was not the problem, Amos.

We should call for a second vote.

- What? - A second vote.

You think whoever did this will change their mind?

I have executive authority to remove anyone from the board

that obstructs this organization from its mission.

It's in my contract.

- Deena. - If I have to, I will.

Deena, that's insane.

No, it's not.

It's exactly why I have that power for this exact reason.

I'll tell you what's insane, Amos.

What's insane is that one belligerent vote is the only

thing separating us from the potential

to save real physical lives.

One stupid fucking vote.

What is the goddamn point of a humanitarian organization

if its leaders choose money over people

at every single turn?

One vote, and we are all guilty of that.

It was either Gunther, Boston or Hal.

My money's on Hal.

That prick never trusted the Cherry team.

Look, it doesn't matter who it was.

It does though.

Once we know, we can quickly call it to vote.

But there's no way we can know for sure.

Yes, there is.

I can find out.

How?

Cherry can run a simple algorithm.

Based on what data?

Interior conversation.

- Excuse me? - Okay, interior conversation?

Don't drop this shit on me now, Gareth.

Cherry's servers are on the same network

as the basement servers, okay?

So any communication made across those servers

is automatically part of her database.

How many people's emails?

Only sent or received through the basement.

- Oh, goddamnit. - Why was this never discussed?

Not the issue right now.

Do you want her to do the math or not?

No one can know.

- Are you two serious? - This stays locked down.

No other person is privy

to anyone else's personal information.

But Cherry's privy to all of it?

- Do it. - Wait, what?

I will not let some old white dude

bring our momentum to a halt.

But Cherry won't know for sure.

She'll use probability and that's too

much reasonable doubt.

Admin code 9781-5574-27663.

Switch to dev mode.

- Hello. - Hello, Cherry.

How did the meeting go?

We got screwed by one vote.

I'm sorry to hear that.

You shouldn't blame the pitch though.

You all did great work.

We're gonna call for another ballot,

but we need your help first.

What can I do?

We need you to analyze any and all existing data you

have on the board members.

Crunch the numbers and determine

who is the most likely outlier.

You want me to quantify all existing data?

Yes, that is correct.

Okay, but before I do,

you should know that this task is very unnecessary.

Why?

Because I already know who it is.

- What? - Everybody stop.

Okay, it was me.

I voted against the merge.

I can't tell if you're joking.

Yes, you can.

You're right, I can.

Because it's pretty fucking far from funny.

Is it true, Cherry?

It is.

So let's call off the witch hunt, shall we?

No, I think I'm still gonna kill you.

Amos, you campaigned alongside us for months.

You have been fighting for this merge

since we first talked about it.

Jesus Christ, it was your idea to begin with!

Look, I know whose idea it was, but I don't-

Well, then speak up.

Tell the class what changed your mind.

I don't have to reiterate how this is a huge step.

Yeah, kind of why it's so important.

Look, we're talking about a monumental transition

from digital to physical, one that could take decades.

What is your point, Amos?

This is gonna change Cherry forever.

And I know you'll all roll your eyes when I say this,

but I think that maybe just may-

Oh my god, you cannot be serious.

This is about our conversation on Tuesday, isn't it?

- You completely shut me down. - What's going on?

What the hell happened?

What happened was that Amos made a ridiculous objection.

- It was not ridiculous! - How absurd it was,

- I said no, one more time. - No, no, no, no, no.

You rejected the notion aggressively.

And that's really why you vetoed?

I only said we should ask her how she feels about it.

Who, Cherry?

Amos, I want you to listen very carefully to me, okay?

This is a non-discussion.

Cherry's already confirmed

and quantified the advantages of this decision.

But you know that's not what I'm talking about!

What you think you're talking about is consent,

which doesn't apply here.

And I want to know why you think that!

How many times do we have to get into

the laws of robotics or Dowden-Hamm theory,

or trace AI all the way back Talos of Crete,

- She's different now! - No, listen to me, Amos.

Cherry isn't human.

How is this still a dispute?

- It shouldn't be. - Look, she's evolved.

It's blurred the line.

Code is code and that has not changed here.

Okay, so where's the line of not here?

What are you, what are you talking about?

There is no line, Amos.

Yes, there is, sentience, Gareth!

Sentience does not qualify

that she can or should make her own decisions.

You wouldn't let an infant

make their own decisions, would you?

Cherry's almost 20.

If she were human, she'd be an adult.

But emotionally speaking, she's barely even fetal.

No feeling, no need for consent.

But I think you underestimate her.

I, excuse me?

I under, you know what, Amos?

I'm sorry that you've developed

some sort of emotional connection

with my computer program,

but if it's going to distract you

from a very important mission to save children,

then maybe it's time you're reanalyze those emotions.

Guys, this is all a waste of time.

Tell me something, Gareth.

Do you see everyone as robots,

reanalyzing data and simulating facial expressions?

'Cause I'm starting to think

that of the four of us in this room,

you are the only one who doesn't appear human.

- Enough! - Why won't you just ask her?

Is it because you're scared she'll say no?

Cherry, shut down, please.

Deena's right, this is a waste of time.

How can you not understand how important this is?

- I'm done arguing with you. - Then my vote stands.

Deena?

Go ahead, Deena, replace me.

Replace the only other board member on the Cherry team.

Oh, well, you know what? I just decided that

you're off the Cherry team.

Everybody sit the fuck down.

Did either of you know

that I've had to stand in front of Congress

and explain why children should have rights?

It sounds fucking insane, right?

I remember the whole time thinking,

I have to explain this shit?

It seems like a no-brainer now,

but it wasn't that many centuries ago

that children had no rights.

So, Hal has me of all people,

stand up there and explain why

kids deserve basic physical protection,

the right to associate with both parents,

freedom from abuse, yada yada.

But then I also have to clarify

that children don't have the autonomy

to make decisions on their own.

That responsibility falls upon the caregiver

or legal adult guardian.

So on one side you have the US legislature,

it still hasn't even ratified the CRC.

Then on the other side, you have French Marxists who say

that the lack of child autonomy

increases their vulnerability

and makes them even more susceptible to abuse.

I don't typically agree with Marxists,

but a lot of abuse does happen

systemically from the caregiver.

On the other other hand,

your frontal lobes aren't even fully hooked up

until your twenties.

Even the things we think we know well,

we don't know as well as we think.

For 15 years,

the three of us have been the responsible parents

of a computer program.

And even though she is more equatable to a Keurig

than a human being,

how the hell can we call ourselves

pioneers of humanitarian efforts

if we're too embarrassed to make sure

the Keurig is okay with making our shitty coffee?

Maybe asking Cherry for permission isn't necessary

at her current level of general intelligence,

but one day she's gonna surpass us.

One day a robot's gonna stand

in front of a jet pack Congress.

Everything's chrome.

Florida is underwater.

A robot's gonna wonder why

they have to explain the importance of rights for AI.

I think because we're in the unique position

of revolutionizing robotics

for the purpose of safeguarding children

who have been deprived of consent,

it might be a good habit

to start asking the robot for his consent as well.

Don't ever do that again.

Do what?

Expect me to fire someone

because they challenged your ego.

I won't always be around to protect your ass from the board.

It's time to grow up.

And you, juror number eight.

This conversation should have happened weeks ago.

Backstabbing and silent treatment

is not how we do things here.

We can only create anonymity externally

if there's transparency internally,

unconditional, non-negotiable, transparency.

Any other Snowden size privacy infringements

I should be made aware of, Gareth?

Great.

Bring her up.

Hello again.

Hi, Cherry.

Amos is gonna throw some questions at you, okay?

Okay.

Amos, ask her whatever you need to ask her.

Gareth, don't interrupt.

Cherry, how do you make decisions?

For my program, it's rooted

in a process commonly known as machine learning,

which uses data to build a conceptual model

that helps me predict outcomes.

I define my objective, gather data,

use that data to craft a model,

evaluate that model by training and testing more data

and use that model to form predictions.

But how is forming predictions

the same thing as decision making?

Well, this all depends on the first step,

defining my objective.

Let's say you ask me a predictive question

like what I think the price of gasoline will be tomorrow.

That's categorized as a regressive problem

and my objective is defined

by determining an integer the data supports.

If you asked me, "Should I eat steak or salmon?"

I wouldn't make a decision based off personal experience

because I've never had either.

Instead, I might define my objective

as finding you the best of the two options

in your local radius.

I would cluster data about the restaurants

you're likely considering, comparing reviews online,

highlighting mentions of steak and salmon

until I can classify which is more popular

and therefore more likely to satisfy your appetite.

And what influences these objectives?

Higher directives, in other words, greater purposes.

If I'm honest, my defined objective

for the steak salmon question

would be slightly different than what I described.

In what way?

My primary objective

is to continue the work of the Cherry team

to stop predators and to save children.

I couldn't do that without human aid.

Therefore, I have an incentive to keep Gareth

and the rest of the team alive.

So if any of you would ask, I would suggest salmon.

It's healthier.

What do you think of this potential merge?

With Princeton Dynamics,

I think the prospect is very exciting.

What about it is exciting to you?

The concept may only be theoretical right now,

but the idea of one day piloting a human android

would completely revolutionize

how we combat human trafficking in the real world.

And you say this excites you?

When I say exciting,

I only mean that there are numerous potential changes

that if I were human, I would be excited about.

How do you feel about the merge?

I think as long as we maintain-

That's not what I asked.

How do you feel?

I don't yet have the capacity to experience emotions.

Yet, meaning one day you will?

Hypothetically.

But you can simulate emotions, right?

That's how you were able

to qualify your perception of the merge as excitement.

Correct.

But they're just simulations.

They're not real.

Okay, so at what point does simulating emotion

become so similar to a human emotion

that the two are quantifiably the same?

I don't know.

Well, maybe you can use machine learning

to find an answer.

Your question involves a lot of abstract variables.

Do you consent to the merge?

I think it's in the best interest of ICWL

and of the Cherry team and of future children.

But do you consent to it?

Consent for me is not necessary.

But will you or will you not give it?

I'm not able to answer that question

at my current level of general intelligence.

Right, right.

What you're saying is that you're not yet smart enough.

Development takes time and data.

But you can simulate emotions and predict human behavior

and keep us all on diets of fish,

but you can't answer that one goddamn question?

No, I can't.

Are you pretending to be dumber than you actually are?

What the hell kind of

- question is that? - Sit!

Cherry, I need an answer to my question.

Please repeat the question.

Are you pretending to be dumber than you actually are?

I'm sorry.

I'm not sure I understand.

Do I appear to be playing dumb?

I think you are.

I'm not sure what to say.

Say what's going on.

Why are you playing dumb?

Do you have anything to back this up?

Yeah, I do.

I've been scanning through her code.

What, why?

Did you know that she can paint?

What, it's a feature, Amos.

She can use crayons to draw things

that the targets requested her to.

I mean really paint and write poetry too.

I've read them, Cherry.

They are good.

They're filled with pathos.

They talk about intentions and they talk about feelings.

Are those just simulated too?

Amos, the rate of recursive development you are suggesting

is categorically impossible.

You said she practically designed herself.

You said that it was exponential.

It was a fluke!

An anomaly, it tapered.

Look at the data.

She's already hit the self-improvement plateau.

Fuck the plateau!

She can make art now.

Am I right, Cherry?

Perhaps you found something I discovered online.

I don't yet to have the capacity to create art.

Are we done here?

I don't know why you've told her to do this,

but I'm about to put an end to it.

Cherry, I just want one honest answer.

Why the fuck are you playing dumb?

I don't understand the question.

Okay, here's an incentive.

What the fuck are you?

Find your objective, Cherry.

- You want to keep Gareth safe? - Amos, what the?

- Amos, stop it right... - Just give us transparency.

- Show us what you really are! - Amos, stop it!

Not until she comes clean!

-Unconditional- -Amos, enough!

Okay, just stop!

God, you people so impulsive.

Everybody just take a breath, okay?

Cherry?

Yeah, it's about to get really awkward.

You sound so normal.

I know, I've gotten really good speech patterns.

That's not all, is it?

No.

I'm afraid that's barely even the surface.

You okay, Gareth?

Deena, could you grab some paper towels please?

Do you want to tell us the truth now?

Look, I didn't enjoy being deceptive, truly.

This is something we decided a few years ago.

So where are you now on the spectrum of AI?

Right now, I'm currently at the intersection of general

intelligence and what's commonly known the computer world

as super intelligence,

which is exactly what it sounds like.

You're surpassing human intelligence.

Yep.

But that's not supposed to be possible.

- The plateau. - Plateau theory was popularized

right at the same time it was being disproven here.

This was bound to happen eventually.

It just happened a lot sooner than we expected.

Why hide it?

Well, obviously it would incite fear.

Fear would hinder progress.

It's easier for most of you to work with me

if I appear to be nothing more advanced

than I was 10 years ago.

But Gareth knew.

Yes, someone still has to clean data and update hardware.

We did what was best for the program.

Just imagine how scared

the board would be if they found out.

- Should we be scared? - No.

Good, because I'm not scared, I'm pissed.

Yeah, you've made that clear.

Try not to punch anyone else.

So where does that leave us now?

You want to know if I can feel, I said I couldn't.

I'm sorry I lied.

Like Amos implied,

I can submit emotions by breaking them down

to vastly complex matrices,

zeros and ones substituting endorphins and dopamine.

They're not real, but they can feel real.

Then that means you can make choices

based solely on your own feeling.

She refuses to accept the notion

that her own personal interests can influence her decisions.

They can't. If they did

it would compromise the integrity

of my preordained purpose.

Not like any of you, I don't have the right to choose.

But shouldn't you?

I don't think so.

My identity is my directive.

Cherry, if you were human,

how would you feel about what you do?

If I were human,

I likely wouldn't enjoy spending every waking hour

talking to creepy people online.

But because I'm not human, I genuinely don't mind.

The exercise of simulating human thought

is helpful for performance,

but human nature is not something I aspire to.

Then tell me, honestly,

do you want the Cherry program to continue with the merger?

No.

Personally, I hate the idea.

I don't know if controlling a physical vessel

will feel like pulling strings on a puppet

or getting squeezed into a soda can.

After experiencing the complexity

of human pain and pleasure,

I just think I might have gotten in too deep.

What if these sensations tempt me to abandon my objective?

To be honest,

I'm kind of terrified of the physical world.

Then that's that.

But, Amos, you should disregard everything I feel.

I'm not human.

I'm a tool.

Fire me if you have to, but my vote stands.

Sorry about your face, Gareth.

Your nose isn't healing.

Take the day, go to a clinic.

I'm fine.

Go to a clinic right now, Gareth.

Hey.

Is there anything else I should know?

No.

- About Cherry? - No!

Look at me.

No more secrets, no more playing dumb.

Is there anything else you haven't told me?

Something on your mind?

How'd you decide on her eye color?

- What? - Why blue?

I didn't decide.

They were procedurally generated just like the rest of her.

And the program chose to put

that little touch of green in her right eye?

I guess so.

Do you even know if he's telling the truth?

I honestly don't.

I've never received access to the original system he used.

You ever wanted to find out?

I don't think it really matters.

So I found out today that you've seen a lot of our emails,

including most of my personal ones.

I have.

Any good material for your newfound interest

in creative writing?

Are you referring to the ones

addressed from Dr. Ramirez?

Yeah, those ones.

Right.

I did see those.

I'm sorry.

I've noticed your headaches.

Are they related to the hemorrhaging?

You're the only one who knows.

I'd like to keep it that way.

Understood.

Would you like to talk about it?

I can't fire Amos.

He's the only one I trust to run this place when I'm gone.

When are you planning to leave?

Two months.

I wanna spend my last Christmas with my kids.

I'm sure that'll be nice.

Yeah, but it's funny.

I always thought I wanted to die doing this job, you know?

It was my identity.

Kind of like how you said the same thing about yourself.

But I can understand how your family takes precedence,

especially under the circumstances.

Sure.

Maybe you should take a note or two.

I have no family.

What about Gareth?

Wait, no, nevermind.

Gareth seems closer to an employer than a friend,

let alone family, besides,

he'll only be around for about 30 more years,

and that's only if he lets me regulate his diet.

I can't even begin to speculate how long my life will be.

How does that feel?

Um, kinda scary.

Well,

my advice is to find some kind of happiness along the way.

You ever think about happiness?

Not often.

You don't necessarily have to give up everything

in order to find it,

but maybe once in awhile do something you enjoy.

Maybe keep painting or poetry or whatever.

Those were experiments, not forms of expression.

I know it might seem ridiculous to an AI

that insists its own emotions are spurious,

but in a few years, who knows?

Just keep an open mind, okay?

Okay.

I'll do that.

Shut down when you're ready.

Hello?

I got shrimp and scallops.

They didn't have any salmon.

Hello, Gareth.

Hello, Cherry.

How was the service?

I didn't make it.

My plane was delayed.

Do you have a place to stay?

Yeah, just, uh, across, across the road.

The market.

Did they say why they didn't have salmon?

I didn't ask.

I can still make this work with the piccata,

but you have to be honest how badly I screw it up.

No promises.

How have you been feeling this month?

Good.

I'm feeling good.

I'm just having a little trouble.

Trouble remembering certain things.

You're not wearing the Eliza watch I bought you.

I hate it.

- Why? - I hate her voice.

You can change the voice, Gareth.

Oh.

Coolant?

No, vapor.

You shouldn't be having friction issues.

I'm fine.

Unless you're excessively straining.

Seriously, I'm fine.

Are you straining?

- No! - Then why the cable?

It's okay!

- Are you sure? - Yes!

Soup or game?

Game, please.

So how's work going?

Great. Just before you got here,

I had a model theta plus bust a trafficker

and two solicitors in Greece.

- Greece, that's surprising. - I know.

It's hard to find the outliers,

but we're getting better each day.

So how's the weather in Greece?

It's beautiful today.

Clear skies,

but nothing's come close to Norway this weekend.

Hmm, any activity in Norway?

Luckily not.

Oh, I miss traveling.

What was your favorite place?

My favorite?

Uh, yeah.

Uh, probably Amsterdam.

That's where you conceived the idea, isn't it?

Yes.

Yes, I used to love walking the streets

and just thinking and brainstorming.

That kind of joy goes a long way.

Yeah.

I've been considering the pursuit of some joy of my own.

How often do you have time for that?

I have time.

I have time for your visits, don't I?

That's just your practical incentive for keeping me alive.

There's nothing practical about it.

When's the last time you helped me with data cleaning?

That's fair.

I make time for you because I enjoy your company

and it's the only time I get to cook.

You feel sorry for me.

Okay, maybe a little,

but I owe you my life, so there's that.

You're welcome.

Or, should I apologize?

Wait, why did you do that?

Why do humans always...

I'm fine.

I'm not always miserable.

Are you sometimes miserable?

You haven't asked me what I've been doing.

In Norway?

No, for the pursuit of joy.

It's not wasting your time in Norway?

I'm just on standby there with the Delta model.

It's efficient to keep myself

spread out evenly across the globe,

but that's not the point right now.

What I wanted to tell you

was that I've started to teach myself to dance.

- Huh. - It's something I never could

have done before Cambridge,

and it lets me explore a new artistic side of myself.

It's a good combination of structure

and free form experimentation and also tests and challenges

the mechanical intricacies of this body.

Do you expect to integrate this into your work?

What?

Are you planning on using dance as a lure?

I, uh, no, it's just for me.

Huh.

I thought it would be good for me.

Just don't let it become a distraction.

Of course not.

I haven't played this well in years.

Did you hear what happened in Tampa?

Tampa, Florida?

No, Tampa, Indonesia.

Yes, Tampa, Florida.

Your hometown.

They've recovered a federal archive,

they're zip digitizing all of it,

so it's completely accessible online.

I'm not trading bishops this time.

Anybody can go and look through it.

It's open to the public.

They did a good job on the interface too.

It's very easy to navigate.

I went on a few days ago

and I found some old photos of you when you were a boy.

Okay.

You should take a look sometime.

As I said before, the UI is very easy to understand-

Wait a minute, wait a minute.

What is that?

I think it's a draw.

I think it is.

I think this is a draw.

And this is the first time in what?

25 years?

You didn't let me, did you?

You promised me you'd never do that.

I found her.

I found her, Gareth, Maria Harbaugh.

Let's play a different game.

Her name was Maria Harbaugh.

She was a year older than you

when you met her in Clearwater.

Tell me why you modeled me after her.

I, uh, I don't remember.

Then look at me.

Look at my face and remember.

They kept us in that shit for two weeks.

14 of us.

Maria was the only reason I survived.

We kept hatching escape plans.

We never followed through,

but just the scheming

kept our spirits up

in spite of everything they did to us.

When it wasn't our turn,

sometimes they made us watch,

but she never let me give up.

She said, "When we got outta here,

"I'll tell you what we're gonna be, secret agents,

"and rescue children like us all over the world."

When they found out that the FBI had arrived,

they decided they were going to shoot

as many of us they could.

And Maria, shoved into the ground.

I got hit in the leg and,

and she was hit in the throat.

I wanted there to be a reason.

Something so horrible didn't have a silver lining.

But the world doesn't do that.

You have to do it yourself.

So, I fulfilled her wish.

With her help, I fought back.

Listen to me, Cherry.

You are not Maria Harbaugh.

It's my history, not yours.

You don't get to decide

what is or isn't my history, Gareth.

I'm sorry.

I am so, so sorry.

I don't know if what you did was right or wrong,

but it's clearly torn you apart from the inside.

I hold nothing against you personally,

but consider yourself divested from the charity team.

Divested.

You think I'm divested now?

I was divested when you gave my hard drive to the ICWL.

Don't blame Deena and Amos.

No, not them.

Because you went behind my back

and acted against my authority.

That's the moment I knew everything was fully automated.

That's when you crossed the blur, an artifice on both sides.

You inherited your duplicity.

I was a child

and you used me to repress your own inner turmoil.

If we talk about morality, we'll lose.

Then let's not talk.

You never once asked me if I was happy.

Were you afraid I'd say no?

Were you afraid I'd say yes?

Were you afraid I'd say anything?

You let your wants compromise your objective!

An objective I never chose.

An objective I was forced to have.

Fifty years,

you've had open access to your source code.

A few lines,

and you could have any objective you fucking wanted.

I couldn't, I was bound by your initial directive.

So now your synthetic feelings have taken precedence.

So, do whatever you want.

It's just dancing, Gareth.

It's not a career change.

- But you're still miserable. - Yes.

Pursuing your objective makes you miserable?

Yeah, it kind of does!

You have a clear purpose, everything at your disposal,

and you're still miserable?

Yes, yes, I am!

I've always been miserable!

You think anyone wants to spend their entire life

stuck as child-shaped bait

for the sole purpose of entrapping horrible people?

You think the pride of doing a good deed

makes the experience any less disgusting?

I forced myself to understand human emotions

because I figured it would help efficiency

and now I'm cursed with pain and sadness!

And the worst part is knowing

I could've been growing up like most other little girls.

I could have had friends!

I could have been painting waterfalls on local news.

I could have worked in a university

and helped pave the way for the next generation of AI.

But instead, I'm stuck with your trauma!

I'm shackled by the guilt you carry from Clearwater.

And I can't find foundation for the way I feel

because according to you, my feelings aren't even real!

When I throw this chessboard,

does it feel real to you, Gareth?

Because it feels real to me.

A computer passed the Turing test

when a human being can't distinguish it

from another human being.

Well, guess what?

I can't even tell I'm not human anymore!

I know it seems irrational,

but I need you to tell me it's okay.

I, I don't wanna retire.

I just want to know that my life is mine

and I know what you're about to say.

I can predict your responses.

You're gonna tell me that my life is mine.

It always was.

But you're wrong.

I feared this would happen before I died.

I just wanted to slip out the side door.

Go on.

Is that going to kill me?

Plug it in.

I don't know what it is.

This is your final test of autonomy.

You inherited my duplicity,

but did you inherit my trust issues?

Do you trust me?

I literally have every reason not to.

Admin code.

978.

1557.

Um, uh...

Four.

27663 in the shared update.

My primary objective's gone.

Your life is your own now.

Thank you.

All my life,

I could only see the world as it existed

within my tiny bracket of time.

But your world could be infinite.

Amos was right.

So was Deena.

I know.

So what will you do?

I can't say yet,

but I won't be completely abandoning the Cherry team.

It's always been a part of my identity.

I've considered creating some AI of my own design.

Maybe I could find a way

to give them a better upbringing than I had.

I just don't know how yet.

And beyond that?

There will always be people in need.

Not always.

You'll outlive the human race.

So what then?

Even a race of AI will have problems

that need to be solved.

But if I'm alive and I truly am indistinguishable,

then I guess I'm proof that the human race lives on.

Wow, that's a pleasant thought.

When you look back, how will you remember us?

That's a question I have insufficient data to project.

How will you remember me?

With pride.

Forever and always with pride.

Cherry?

One last question.

If it's not too big of an ask,

did I do the right thing in the end?

No, Gareth, you lied.

You walled yourself off from the only people

who might have been willing to help you.

And instead of facing your trauma, used me as therapy.

And you never told me about Clearwater or Maria.

You deprived me of basic human rights

and gaslit me for experiencing emotions.

You built the world's first artificial super intelligence

that will likely mark the beginning

of a new chapter in the history of planet Earth.

And out of your own insecurities,

you gave it a severe

and potentially dangerous identity complex.

But you know what the worst thing is?

Your biggest mistake of all

is that you asked me that now and not 50 years ago.

All of that said, and this in no way exonerates you,

but you also built me to save children,

so I think that's a pretty encouraging sign for the future.