All language subtitles for The.Artifice.Girl.English-WWW.MY-SUBS.CO

af Afrikaans
sq Albanian
am Amharic
ar Arabic
hy Armenian
az Azerbaijani
eu Basque
be Belarusian
bn Bengali
bs Bosnian
bg Bulgarian
ca Catalan
ceb Cebuano
ny Chichewa
zh-CN Chinese (Simplified)
zh-TW Chinese (Traditional)
co Corsican
hr Croatian
cs Czech
da Danish
nl Dutch
en English
eo Esperanto
et Estonian
tl Filipino
fi Finnish
fr French Download
fy Frisian
gl Galician
ka Georgian
de German
el Greek
gu Gujarati
ht Haitian Creole
ha Hausa
haw Hawaiian
iw Hebrew
hi Hindi
hmn Hmong
hu Hungarian
is Icelandic
ig Igbo
id Indonesian
ga Irish
it Italian
ja Japanese
jw Javanese
kn Kannada
kk Kazakh
km Khmer
ko Korean
ku Kurdish (Kurmanji)
ky Kyrgyz
lo Lao
la Latin
lv Latvian
lt Lithuanian
lb Luxembourgish
mk Macedonian
mg Malagasy
ms Malay
ml Malayalam
mt Maltese
mi Maori
mr Marathi
mn Mongolian
my Myanmar (Burmese)
ne Nepali
no Norwegian
ps Pashto
fa Persian
pl Polish
pt Portuguese
pa Punjabi
ro Romanian
ru Russian
sm Samoan
gd Scots Gaelic
sr Serbian
st Sesotho
sn Shona
sd Sindhi
si Sinhala
sk Slovak
sl Slovenian
so Somali
es Spanish
su Sundanese
sw Swahili
sv Swedish
tg Tajik
ta Tamil
te Telugu
th Thai
tr Turkish
uk Ukrainian
ur Urdu
uz Uzbek
vi Vietnamese
cy Welsh
xh Xhosa
yi Yiddish
yo Yoruba
zu Zulu
or Odia (Oriya)
rw Kinyarwanda
tk Turkmen
tt Tatar
ug Uyghur
Would you like to inspect the original subtitles? These are the user uploaded subtitles that are being translated: 1 00:00:09,777 --> 00:00:18,752 [light piano music] 2 00:00:24,091 --> 00:00:27,594 [door creaks] 3 00:00:31,699 --> 00:00:33,534 [door clicks shut] 4 00:00:58,492 --> 00:01:02,862 Hey Siri, send a message to Cheryl. 5 00:01:02,864 --> 00:01:04,497 Front reception. 6 00:01:06,266 --> 00:01:07,801 [Siri] What do you want to say? 7 00:01:08,736 --> 00:01:11,571 Amos is already heading there to pick him up, period. 8 00:01:11,573 --> 00:01:14,675 Please forward any calls I get to Brady, period. 9 00:01:14,876 --> 00:01:16,742 [Siri] Your message to Cheryl front reception 10 00:01:16,744 --> 00:01:19,244 says Amos is already heading there to pick him up. 11 00:01:19,246 --> 00:01:21,413 Please forward any calls I get to Brady. 12 00:01:21,415 --> 00:01:22,615 Ready to send it? 13 00:01:22,617 --> 00:01:24,450 Yes. 14 00:01:24,719 --> 00:01:26,853 [Siri] Okay, it's sent. 15 00:01:27,755 --> 00:01:29,656 Hey, Siri, 16 00:01:31,158 --> 00:01:33,794 how do you know if you're doing the right thing? 17 00:01:34,929 --> 00:01:37,296 [Siri] I'm not sure I understand. 18 00:01:40,434 --> 00:01:41,333 But what do you believe 19 00:01:41,335 --> 00:01:44,337 is the difference between right and wrong? 20 00:01:45,439 --> 00:01:46,639 [Siri] Hmm. 21 00:01:46,641 --> 00:01:48,507 I don't have an answer for that. 22 00:01:48,509 --> 00:01:50,777 Would you like me to search the web? 23 00:01:50,812 --> 00:01:52,613 No. 24 00:01:52,747 --> 00:01:56,248 [Siri] Okay, is there something else I can help with? 25 00:02:04,692 --> 00:02:06,391 Set a reminder to pick up Kyle 26 00:02:06,393 --> 00:02:09,529 from therapy tomorrow at 4:45. 27 00:02:10,497 --> 00:02:13,132 [Siri] Okay, I'll remind you. 28 00:02:31,586 --> 00:02:33,819 [door creaks] 29 00:02:33,821 --> 00:02:36,321 Hi, special agent Deena Helms. 30 00:02:36,323 --> 00:02:37,389 You've already met Agent McCullough. 31 00:02:37,391 --> 00:02:38,724 You can call me Amos. 32 00:02:38,726 --> 00:02:42,529 -Uh, agents? -Have a seat for us, Gareth. 33 00:02:44,297 --> 00:02:46,633 Do you mind answering a couple questions? 34 00:02:47,300 --> 00:02:50,369 Great, this shouldn't take long. 35 00:02:51,338 --> 00:02:54,473 You're from Tampa, right? 36 00:02:55,943 --> 00:02:58,477 Don't overthink it. It's a yes or no. 37 00:02:58,813 --> 00:03:00,012 Yeah. 38 00:03:00,014 --> 00:03:01,547 How old are you, Gareth? 39 00:03:01,549 --> 00:03:02,480 29. 40 00:03:02,482 --> 00:03:03,983 What do you do for work? 41 00:03:03,985 --> 00:03:05,483 I'm sorry, am I being detained? 42 00:03:05,485 --> 00:03:06,484 No, not at all. 43 00:03:06,486 --> 00:03:09,623 We're just asking questions, background stuff. 44 00:03:09,791 --> 00:03:11,857 You work on movies, right? 45 00:03:11,859 --> 00:03:13,727 Special effects. 46 00:03:14,294 --> 00:03:15,326 Someone told me you worked 47 00:03:15,328 --> 00:03:16,962 on that new "Star Wars" movie, is that right? 48 00:03:16,964 --> 00:03:18,430 [Gareth] Who told you that? 49 00:03:18,432 --> 00:03:20,298 Why don't you tell us more about it? 50 00:03:20,300 --> 00:03:22,268 Tell us about your work. 51 00:03:23,705 --> 00:03:25,671 I used to do VFX for an animation company. 52 00:03:25,673 --> 00:03:26,739 I've worked on at least 20 different films. 53 00:03:26,741 --> 00:03:27,973 Used to? 54 00:03:27,975 --> 00:03:28,974 I've been focusing more 55 00:03:28,976 --> 00:03:30,609 on software engineering recently for years- 56 00:03:30,611 --> 00:03:32,377 Sounds boring compared to light sabers. 57 00:03:32,379 --> 00:03:33,579 Why quit? 58 00:03:33,581 --> 00:03:34,680 [Gareth] I wasn't getting paid well. 59 00:03:34,682 --> 00:03:35,915 But money's not an issue for you. 60 00:03:35,917 --> 00:03:36,849 Excuse me? 61 00:03:36,851 --> 00:03:38,017 [Deena] What kind of effects did you do? 62 00:03:38,019 --> 00:03:39,085 Money's not an issue for me? 63 00:03:39,087 --> 00:03:40,019 -Let's talk about- -If money wasn't an issue for me 64 00:03:40,021 --> 00:03:40,853 I wouldn't have applied for your grant. 65 00:03:40,855 --> 00:03:43,523 I didn't mean to suggest anything. 66 00:03:43,791 --> 00:03:46,225 Tell us what kind of effects you did. 67 00:03:48,495 --> 00:03:49,962 My main focus was on 3D renderings. 68 00:03:49,964 --> 00:03:51,296 [Deena] Of what? 69 00:03:51,298 --> 00:03:52,865 -Actors. -What for? 70 00:03:52,867 --> 00:03:53,866 Well, for "Star Wars," 71 00:03:53,868 --> 00:03:55,735 it was because the actor I was tasked to digitize 72 00:03:55,737 --> 00:03:57,837 was unavailable to be filmed in person. 73 00:03:57,839 --> 00:03:59,472 Why? 74 00:03:59,874 --> 00:04:01,742 Because they were dead. 75 00:04:02,744 --> 00:04:04,644 What'd they have you do? 76 00:04:05,780 --> 00:04:07,947 I reconstructed Alec Guinness' face as a 3D model. 77 00:04:07,949 --> 00:04:09,181 I analyzed reference footage, 78 00:04:09,183 --> 00:04:11,550 then used a process called D-Term to procedurally generate 79 00:04:11,552 --> 00:04:12,518 his bone and muscle structures, 80 00:04:12,520 --> 00:04:14,053 which one rigged helped the animation feel 81 00:04:14,055 --> 00:04:15,054 more natural and human-like. 82 00:04:15,056 --> 00:04:17,690 D-Term, I've never heard of that process before. 83 00:04:17,692 --> 00:04:19,024 Because I invented it. 84 00:04:19,026 --> 00:04:19,992 [Deena] So you're basically bringing 85 00:04:19,994 --> 00:04:20,993 dead actors back to life? 86 00:04:20,995 --> 00:04:22,828 I just tried to make the CG characters look as 87 00:04:22,830 --> 00:04:24,563 photorealistic as the technology at the time would allow. 88 00:04:24,565 --> 00:04:26,465 [Deena] You didn't find it creepy? 89 00:04:26,501 --> 00:04:28,134 I'm sorry, what? 90 00:04:28,136 --> 00:04:30,336 I said you don't find that creepy? 91 00:04:31,839 --> 00:04:34,405 Well, we did our best to cross the uncanny valley. 92 00:04:34,407 --> 00:04:35,641 But when the human brain perceives 93 00:04:35,643 --> 00:04:37,076 that something is just slightly off and it doesn't matter- 94 00:04:37,078 --> 00:04:38,343 No, I mean, digitizing dead people. 95 00:04:38,345 --> 00:04:39,477 Christ, I mean, it's, 96 00:04:39,479 --> 00:04:40,780 it's almost like turning someone's corpse 97 00:04:40,782 --> 00:04:41,914 into a marionette, you know? 98 00:04:41,916 --> 00:04:43,749 Making them do whatever you want. 99 00:04:43,751 --> 00:04:44,750 What if the poor dead guy 100 00:04:44,752 --> 00:04:47,385 didn't want to be in another fucking movie? 101 00:04:47,387 --> 00:04:48,687 It's so macabre. 102 00:04:48,689 --> 00:04:49,789 Am I crazy? Is it not macabre? 103 00:04:49,791 --> 00:04:50,890 I don't think the studio cares 104 00:04:50,892 --> 00:04:51,791 whether it's macabre or not. 105 00:04:51,793 --> 00:04:53,424 Look, I can never tell the difference. 106 00:04:53,426 --> 00:04:54,860 I always can. The faces look like Play-Doh. 107 00:04:54,862 --> 00:04:55,761 Well, we did our best. 108 00:04:55,763 --> 00:04:57,129 Soon we won't even need actors, right? 109 00:04:57,131 --> 00:04:58,631 Everyone will just be digital. 110 00:04:58,633 --> 00:05:00,398 No, you still need them for motion tracking. 111 00:05:00,400 --> 00:05:02,433 Human performances can't be completely computer generated. 112 00:05:02,435 --> 00:05:04,470 How long will that be true? 113 00:05:07,608 --> 00:05:10,510 Some might say we've already crossed that threshold. 114 00:05:11,145 --> 00:05:13,079 I wouldn't know. 115 00:05:15,382 --> 00:05:16,582 Where'd you go to school? 116 00:05:16,584 --> 00:05:19,052 -Brooks-DeBartolo High. -And after? 117 00:05:19,954 --> 00:05:21,419 Nothing? 118 00:05:21,421 --> 00:05:22,121 What about Columbia? 119 00:05:22,123 --> 00:05:24,057 Didn't you go to Columbia? 120 00:05:25,560 --> 00:05:26,959 Wait, no. You dropped out of Columbia 121 00:05:26,961 --> 00:05:29,829 after how many semesters? 122 00:05:29,831 --> 00:05:31,665 Three? 123 00:05:32,900 --> 00:05:35,835 Bjarne Stroustrup said 124 00:05:35,837 --> 00:05:37,971 you were the smartest kid he ever met. 125 00:05:38,139 --> 00:05:42,374 I don't know who he is, but Amos says it's a big deal. 126 00:05:42,610 --> 00:05:44,475 Then you moved to the Netherlands, 127 00:05:44,477 --> 00:05:46,679 spent some time as an intern, 128 00:05:46,681 --> 00:05:48,647 applied and got into Cambridge. 129 00:05:48,649 --> 00:05:49,648 Very nice. 130 00:05:49,650 --> 00:05:52,085 Except that you dropped out after two years. 131 00:05:52,153 --> 00:05:53,552 Flew back to the States, 132 00:05:53,554 --> 00:05:56,121 interned in Palo Alto, then Montreal. 133 00:05:56,123 --> 00:05:57,590 Then went all the way back to England, 134 00:05:57,592 --> 00:05:58,991 where you landed a job in Sheffield. 135 00:05:58,993 --> 00:06:01,193 Second job in Manchester. 136 00:06:01,195 --> 00:06:03,996 Then got into Oxford where you almost finished your masters 137 00:06:03,998 --> 00:06:05,430 before ditching the graduation 138 00:06:05,432 --> 00:06:07,801 and moving back here to Florida. 139 00:06:11,572 --> 00:06:13,673 If money was an issue, 140 00:06:14,575 --> 00:06:17,143 I'm glad you had plenty of flyer miles. 141 00:06:18,212 --> 00:06:20,580 I didn't hear a question. 142 00:06:20,715 --> 00:06:22,549 What's your social life like? 143 00:06:22,717 --> 00:06:24,583 My, what does that have anything to do- 144 00:06:24,585 --> 00:06:25,718 If you don't want to talk about it, that's fine. 145 00:06:25,720 --> 00:06:27,186 We just wanted to know if you have friends and stuff. 146 00:06:27,188 --> 00:06:28,888 -I have friends. -A lot of them? 147 00:06:28,890 --> 00:06:29,855 -I have friends. -Can you name one? 148 00:06:29,857 --> 00:06:31,223 -Can I what? -[Deena] Can you tell us the nam 149 00:06:31,225 --> 00:06:33,491 of just one of your friends? 150 00:06:33,493 --> 00:06:35,594 -Steve. -[Deena] Steve. Steve what? 151 00:06:35,596 --> 00:06:36,862 I don't know how this is relevant to receiving the grant. 152 00:06:36,864 --> 00:06:39,132 Oh, we're just getting to know you, Gareth. 153 00:06:39,166 --> 00:06:40,799 You got a girlfriend? 154 00:06:40,801 --> 00:06:42,234 Boyfriend? 155 00:06:42,236 --> 00:06:44,103 You, uh, talk to people online? 156 00:06:44,105 --> 00:06:45,204 I don't know what you mean by that. 157 00:06:45,206 --> 00:06:46,672 I don't use social media. 158 00:06:46,674 --> 00:06:48,742 I mean more like chat rooms. 159 00:06:52,647 --> 00:06:54,881 You go on any chat rooms? 160 00:06:58,786 --> 00:07:00,853 No one uses chat rooms anymore. 161 00:07:00,855 --> 00:07:02,589 [Deena] Sure they do. 162 00:07:03,691 --> 00:07:05,692 You chat with anyone online? 163 00:07:07,494 --> 00:07:09,629 -Sometimes. -[Deena] Sometimes. 164 00:07:10,031 --> 00:07:12,832 What kinds of people do you talk to online? 165 00:07:13,935 --> 00:07:19,005 Gareth, obviously, this isn't about a grant. 166 00:07:19,173 --> 00:07:21,541 We need to know what your alias is. 167 00:07:21,976 --> 00:07:23,943 When you go online, what name do you use? 168 00:07:23,945 --> 00:07:25,144 I don't have one. 169 00:07:25,146 --> 00:07:26,779 [Deena] Yes, you do. 170 00:07:26,781 --> 00:07:28,848 And you need to tell us what it is. 171 00:07:33,721 --> 00:07:35,789 Sorry, I can't help you. 172 00:07:45,733 --> 00:07:47,767 [Deena] You know who we are? 173 00:07:48,836 --> 00:07:50,602 Well, this is the ICWL building. 174 00:07:50,604 --> 00:07:52,906 That's right. You know what we do? 175 00:07:53,207 --> 00:07:54,573 [Gareth] Humanitarian work. 176 00:07:54,575 --> 00:07:55,975 That's what the people upstairs do. 177 00:07:55,977 --> 00:07:58,178 You know what we do? 178 00:08:02,116 --> 00:08:04,217 We catch pedophiles. 179 00:08:05,886 --> 00:08:09,188 Amos here specializes in tracking down online predators. 180 00:08:09,190 --> 00:08:11,190 He spends every waking hour 181 00:08:11,192 --> 00:08:13,926 scouring those chat rooms you say no one uses 182 00:08:13,928 --> 00:08:17,630 and he finds thousands of people soliciting children. 183 00:08:17,698 --> 00:08:20,766 Our operation is like a tightly spun spider web 184 00:08:20,768 --> 00:08:23,635 connecting ICWL, the FBI, NSA, 185 00:08:23,637 --> 00:08:27,106 and let me tell you, his team here is a vital thread. 186 00:08:27,108 --> 00:08:29,942 He reports everything he gathers directly to me, 187 00:08:29,944 --> 00:08:32,077 and I see to it that the necessary authorities 188 00:08:32,079 --> 00:08:33,712 take swift action. 189 00:08:33,714 --> 00:08:35,147 So are you in charge? 190 00:08:35,149 --> 00:08:37,784 This is my spiderweb. 191 00:08:38,586 --> 00:08:41,221 I'm the fucking spider, Gareth. 192 00:08:44,158 --> 00:08:47,760 Am I being detained? 193 00:08:47,762 --> 00:08:49,194 [Deena] We already told you that you're not detained. 194 00:08:49,196 --> 00:08:51,765 Good. [chair scrapes] 195 00:08:51,932 --> 00:08:54,934 But if you leave this room, you will be arrested. 196 00:09:00,241 --> 00:09:02,208 [Gareth] For what? 197 00:09:03,944 --> 00:09:05,611 I told you what we do. 198 00:09:05,613 --> 00:09:07,313 Take a wild guess. 199 00:09:08,616 --> 00:09:10,215 [Gareth] I am not what you think I am. 200 00:09:10,217 --> 00:09:12,052 We'll see. 201 00:09:13,788 --> 00:09:16,355 Gareth, you just gotta tell us your alias. 202 00:09:16,357 --> 00:09:19,059 What's your username? 203 00:09:22,363 --> 00:09:24,197 Sit down. 204 00:09:39,680 --> 00:09:40,846 -Why do you do this with them? -[Deena] Hmm? 205 00:09:40,848 --> 00:09:43,148 There's no way you do this with every suspect you have. 206 00:09:43,150 --> 00:09:44,049 Invite them to your headquarters 207 00:09:44,051 --> 00:09:45,918 and then drag them down into a basement. 208 00:09:45,920 --> 00:09:47,353 [Deena] That's right. 209 00:09:47,421 --> 00:09:49,956 Why are you doing this to me then? 210 00:09:51,058 --> 00:09:52,391 You tell us, Gare. 211 00:09:52,393 --> 00:09:54,894 What makes you so fuckin' special? 212 00:09:56,330 --> 00:09:58,231 I don't know. 213 00:09:59,033 --> 00:10:00,732 What's your alias? 214 00:10:00,734 --> 00:10:04,604 -I don't have an alias. -Yes you do. 215 00:10:05,172 --> 00:10:07,307 It starts with the word hard. 216 00:10:08,042 --> 00:10:10,176 Just finish the rest. 217 00:10:11,445 --> 00:10:12,878 Sit down, Mr. Federson. 218 00:10:12,880 --> 00:10:15,281 I only have a few more questions. 219 00:10:27,128 --> 00:10:29,762 Do you recognize this girl? 220 00:10:37,438 --> 00:10:42,175 Do you know her? 221 00:10:44,145 --> 00:10:45,077 Yes. 222 00:10:45,079 --> 00:10:46,979 [Deena] What's her name? 223 00:10:46,981 --> 00:10:48,380 Cherry. 224 00:10:48,382 --> 00:10:50,149 -[Deena] Cherry what? -She doesn't have a last name. 225 00:10:50,151 --> 00:10:51,783 Yes, she does, Gareth, she's not Madonna. 226 00:10:51,785 --> 00:10:53,185 -She's a little girl. -You don't understand. 227 00:10:53,187 --> 00:10:54,052 Yeah, well, I'd like to. 228 00:10:54,054 --> 00:10:55,354 So help me out, is she your daughter? 229 00:10:55,356 --> 00:10:57,289 -No. -Then whose daughter is she? 230 00:10:57,291 --> 00:10:58,357 -She, she doesn't have-- -How did you meet her? 231 00:10:58,359 --> 00:10:59,458 I didn't meet her. 232 00:10:59,460 --> 00:11:01,460 Then why do you have photos of her on your computer? 233 00:11:01,462 --> 00:11:02,427 What the hell are you talking about? 234 00:11:02,429 --> 00:11:04,263 Why do you fucking have photos 235 00:11:04,265 --> 00:11:05,497 of this girl on your fucking- 236 00:11:05,499 --> 00:11:06,365 Are you looking at my hard drive? 237 00:11:06,367 --> 00:11:07,332 Because that's an invasion of privacy. 238 00:11:07,334 --> 00:11:09,268 So you know what photos I'm talking about? 239 00:11:09,270 --> 00:11:09,968 You don't have to do it this way. 240 00:11:09,970 --> 00:11:11,403 I gave you permission to sit in. 241 00:11:11,405 --> 00:11:13,438 I did not give you permission to speak. 242 00:11:13,440 --> 00:11:14,773 [Gareth] This is insane, you cannot keep- 243 00:11:14,775 --> 00:11:15,741 What else have you done with her? 244 00:11:15,743 --> 00:11:17,242 -[Gareth] Nothing! -Did you take the photos? 245 00:11:17,244 --> 00:11:18,177 It's, it's complicated. 246 00:11:18,179 --> 00:11:19,778 [Deena] No, it's not! Yes or no? 247 00:11:19,780 --> 00:11:20,613 Did you take the photos? 248 00:11:20,615 --> 00:11:22,748 I didn't do anything wrong, okay? 249 00:11:22,750 --> 00:11:25,784 Soliciting pornography of minors is an egregious felony. 250 00:11:25,786 --> 00:11:28,754 Distributing that pornography is tenfold worse. 251 00:11:28,756 --> 00:11:31,023 -I didn't do anything! -Fucking prove it! 252 00:11:31,025 --> 00:11:34,360 What is your alias? 253 00:11:34,395 --> 00:11:35,894 Answer me! 254 00:11:35,896 --> 00:11:38,398 HardMachine11811. 255 00:11:39,333 --> 00:11:43,069 [Gareth exhales] 256 00:11:56,016 --> 00:11:58,117 You're HardMachine. 257 00:11:59,253 --> 00:12:01,421 Thanks for confirming. 258 00:12:03,157 --> 00:12:05,558 If you knew, then why do this to me? 259 00:12:05,560 --> 00:12:06,559 [Deena] We weren't positive, 260 00:12:06,561 --> 00:12:08,293 and if you turned out to not be HardMachine, 261 00:12:08,295 --> 00:12:10,496 you were obviously just a predator. 262 00:12:15,002 --> 00:12:17,036 Do you keep track? 263 00:12:17,938 --> 00:12:21,073 I mean, do you know how many bad people you've nailed? 264 00:12:21,075 --> 00:12:23,008 [Gareth] I didn't start counting until 2023. 265 00:12:23,010 --> 00:12:25,377 196 convictions. 266 00:12:25,379 --> 00:12:26,378 [Gareth] There were at least 30 267 00:12:26,380 --> 00:12:28,313 before I started sending everything to you guys. 268 00:12:28,315 --> 00:12:29,582 What'd you do before? 269 00:12:29,584 --> 00:12:30,449 [Gareth] I turned over 270 00:12:30,451 --> 00:12:31,917 all evidence directly to the police. 271 00:12:31,919 --> 00:12:33,085 [Deena] Why'd you stop? 272 00:12:33,087 --> 00:12:34,953 They were unreliable. 273 00:12:34,955 --> 00:12:36,488 -I doubt that. -More than half of the predators 274 00:12:36,490 --> 00:12:37,990 I identified went un-investigated. 275 00:12:37,992 --> 00:12:39,491 Yeah, well, you were sketchy and faceless. 276 00:12:39,493 --> 00:12:41,893 They had every right to be skeptical. 277 00:12:41,895 --> 00:12:43,061 It would've all been for nothing 278 00:12:43,063 --> 00:12:44,896 if they found out you were using a little girl as bait. 279 00:12:44,898 --> 00:12:45,831 It's not that simple, okay? 280 00:12:45,833 --> 00:12:48,568 I can only do what I do with anonymity. 281 00:12:48,570 --> 00:12:50,570 Here's my problem, Gareth, and don't get me wrong. 282 00:12:50,572 --> 00:12:52,371 I think 200 terrible people behind bars 283 00:12:52,373 --> 00:12:55,374 is a very good thing, but not at her expense. 284 00:12:55,376 --> 00:12:57,510 Look, we think we can help you, 285 00:12:57,512 --> 00:12:59,111 but we need to help her too. 286 00:12:59,113 --> 00:13:02,347 Using your daughter to entrap these people 287 00:13:02,349 --> 00:13:03,448 is a means that does not justify the ends. 288 00:13:03,450 --> 00:13:04,517 She's not my daughter. 289 00:13:04,519 --> 00:13:05,585 And in spite of what you may think you've achieved, 290 00:13:05,587 --> 00:13:07,419 I still have no reservation with locking you up. 291 00:13:07,421 --> 00:13:08,954 You took the photos. 292 00:13:08,956 --> 00:13:10,122 I don't care why. 293 00:13:10,124 --> 00:13:11,957 You don't understand. 294 00:13:11,959 --> 00:13:13,058 Who is she? 295 00:13:13,060 --> 00:13:14,594 You're gonna ruin everything. 296 00:13:14,596 --> 00:13:18,364 She's a child, Gareth, look at me. 297 00:13:19,199 --> 00:13:22,602 I don't give a damn what fucked up anti-hero master plan 298 00:13:22,604 --> 00:13:24,236 of yours I might jeopardize. 299 00:13:24,238 --> 00:13:25,971 I won't let her be exploited. 300 00:13:25,973 --> 00:13:28,542 Not even for the sake of locking up more perverts. 301 00:13:29,176 --> 00:13:32,210 I'm asking you politely to let this one go. 302 00:13:32,212 --> 00:13:33,879 Are you fucking slow? 303 00:13:33,881 --> 00:13:34,781 Have you been listening at all? 304 00:13:34,783 --> 00:13:37,449 My anonymity is my most important asset. 305 00:13:37,451 --> 00:13:39,184 Without that, I can't do what I do. 306 00:13:39,186 --> 00:13:41,854 Well, that makes everything easy then. 307 00:13:42,256 --> 00:13:44,456 You tell us where she is, or we leak everything. 308 00:13:44,458 --> 00:13:46,091 -Your name, your aliases. -Deena! 309 00:13:46,093 --> 00:13:48,160 Every single perp you helped us catch. 310 00:13:48,162 --> 00:13:50,095 I'm sure they'll be very pleased to meet you in jail. 311 00:13:50,097 --> 00:13:51,263 Stop! 312 00:13:51,265 --> 00:13:53,032 Okay. 313 00:13:55,603 --> 00:13:57,537 Look, if I tell you about Cherry, okay, 314 00:13:57,539 --> 00:14:00,006 there's some things I'm gonna need first. 315 00:14:00,207 --> 00:14:02,140 It doesn't really work like that, Gareth, but go ahead. 316 00:14:02,142 --> 00:14:03,375 Give us your wishlist. 317 00:14:03,377 --> 00:14:05,243 I need a signed non-disclosure agreement from both of you. 318 00:14:05,245 --> 00:14:06,478 -Not gonna happen. -And then I need you to swear 319 00:14:06,480 --> 00:14:07,613 that the information I'm about to relay 320 00:14:07,615 --> 00:14:09,114 won't leave this room. 321 00:14:09,116 --> 00:14:10,415 Look, if you tell us anything 322 00:14:10,417 --> 00:14:11,551 that could help us locate Cherry, 323 00:14:11,553 --> 00:14:14,420 you know we can't keep that promise. 324 00:14:15,222 --> 00:14:16,922 Okay, if I tell you anything 325 00:14:16,924 --> 00:14:19,559 that potentially helps you find a missing child, 326 00:14:19,561 --> 00:14:20,593 okay, you can feel free to share that. 327 00:14:20,595 --> 00:14:21,561 But I need you to swear 328 00:14:21,563 --> 00:14:25,331 that any other details about myself or Cherry, 329 00:14:25,700 --> 00:14:28,067 have to stay between the three of us. 330 00:14:29,269 --> 00:14:31,104 Is that it? 331 00:14:32,507 --> 00:14:34,541 And I need that camera switched off. 332 00:14:35,677 --> 00:14:36,975 [Deena] I don't know how to do that. 333 00:14:36,977 --> 00:14:38,210 Go to the head of securities office, 334 00:14:38,212 --> 00:14:40,613 ask him to find this camera in the system and disable it. 335 00:14:40,615 --> 00:14:42,915 I don't think he's allowed to do that. 336 00:14:43,317 --> 00:14:45,451 I thought you were the fucking spider? 337 00:14:49,123 --> 00:14:50,455 Give me a reason, Gareth. 338 00:14:50,457 --> 00:14:51,591 Why should I go through all the trouble 339 00:14:51,593 --> 00:14:53,926 of getting that camera turned off? 340 00:14:54,629 --> 00:14:57,598 Because if anybody finds out what I'm about to tell you, 341 00:14:58,533 --> 00:15:01,401 a thousand more children are gonna get abused. 342 00:15:04,438 --> 00:15:06,272 Give me a minute. 343 00:15:12,179 --> 00:15:13,614 [door clicks shut] 344 00:15:20,988 --> 00:15:27,293 So, uh, you and Cherry hunted all those people together? 345 00:15:33,768 --> 00:15:36,769 This one time I spent six weeks undercover trying 346 00:15:36,771 --> 00:15:40,139 to nail down a single trafficker from the Philippines. 347 00:15:41,041 --> 00:15:42,174 Day after day, 348 00:15:42,176 --> 00:15:45,545 I spent hour after hour following his trail online. 349 00:15:45,547 --> 00:15:46,679 And he must have been 350 00:15:46,681 --> 00:15:49,949 one of the hardest targets I ever had to track down. 351 00:15:51,786 --> 00:15:57,189 Then one day I found him and one of Cherry's live streams. 352 00:15:57,191 --> 00:15:59,090 I mean, she went by a different name in the stream, 353 00:15:59,092 --> 00:16:01,494 but it was her. 354 00:16:02,029 --> 00:16:03,161 The trafficker, 355 00:16:03,163 --> 00:16:04,429 along with three of our other targets 356 00:16:04,431 --> 00:16:06,465 were all in the room together. 357 00:16:06,467 --> 00:16:13,072 All of them just carelessly sharing their information. 358 00:16:13,608 --> 00:16:18,644 I mean, and they were so open 'cause she was a real girl. 359 00:16:18,646 --> 00:16:20,412 I mean, she could physically 360 00:16:20,414 --> 00:16:23,550 and verbally respond to them in real time. 361 00:16:26,119 --> 00:16:32,057 A couple days later, HardMachine11811 sends ICWL 362 00:16:32,059 --> 00:16:33,726 another batch of names and evidence, 363 00:16:33,728 --> 00:16:37,997 including the three targets that were in the room. 364 00:16:38,800 --> 00:16:42,535 You know, I almost thought the girl was HardMachine 365 00:16:42,537 --> 00:16:44,302 and that this nine year old 366 00:16:44,304 --> 00:16:48,542 just happened to be some badass online vigilante. 367 00:16:50,143 --> 00:16:52,245 What changed your mind? 368 00:16:54,749 --> 00:16:57,283 11811. 369 00:16:57,585 --> 00:17:01,253 January 18th, 2011. 370 00:17:01,255 --> 00:17:06,125 Most of my team thought it was, uh, some arbitrary number, 371 00:17:06,528 --> 00:17:11,097 but I remember what happened on that day in Clearwater. 372 00:17:13,133 --> 00:17:16,035 You were one of the Clearwater kids, weren't you? 373 00:17:16,604 --> 00:17:19,639 You know, my father was a part of that raid. 374 00:17:19,641 --> 00:17:22,374 [door opens] 375 00:17:22,376 --> 00:17:23,441 [Deena] It's off, see? 376 00:17:23,443 --> 00:17:24,844 No red light. 377 00:17:24,846 --> 00:17:25,711 Non-disclosure agreements? 378 00:17:25,713 --> 00:17:26,812 We're not playing this game, Gareth. 379 00:17:26,814 --> 00:17:29,816 You're just gonna have to suck it up and trust us. 380 00:17:33,521 --> 00:17:36,188 You can trust us. 381 00:17:38,191 --> 00:17:39,725 I've been told I have trust issues. 382 00:17:39,727 --> 00:17:42,596 [Deena] Well, there's only one way to fix that. 383 00:17:50,470 --> 00:17:53,271 The reason you can't find Cherry, 384 00:17:53,273 --> 00:17:56,408 the reason why she doesn't have a last name or parents, 385 00:17:56,410 --> 00:18:02,181 or a social security number is because she's not real. 386 00:18:03,283 --> 00:18:05,484 She's not a real human being. 387 00:18:08,623 --> 00:18:10,624 Tell us what happened. 388 00:18:14,194 --> 00:18:15,695 While I was studying abroad, 389 00:18:15,697 --> 00:18:18,430 I interned at a small Dutch animation studio 390 00:18:18,432 --> 00:18:19,799 a few years before they collaborated 391 00:18:19,801 --> 00:18:22,334 with a local nonprofit on a similar idea. 392 00:18:22,336 --> 00:18:23,870 [Deena] Which was? 393 00:18:24,371 --> 00:18:25,938 The idea was to build a 3D model 394 00:18:25,940 --> 00:18:27,807 of an 11 year old Filipino girl 395 00:18:27,809 --> 00:18:30,743 and use her covertly to identify online predators, 396 00:18:30,745 --> 00:18:33,713 A technological solution to a technological problem. 397 00:18:33,715 --> 00:18:35,581 But the project was suspended after only a few months. 398 00:18:35,583 --> 00:18:36,481 Yeah, I remember. 399 00:18:36,483 --> 00:18:38,517 I remember hearing about that program. 400 00:18:38,519 --> 00:18:40,520 Is that what inspired you? 401 00:18:40,622 --> 00:18:41,887 As I got better at crafting photorealistic faces, 402 00:18:41,889 --> 00:18:43,522 I decided to work on one myself. 403 00:18:43,524 --> 00:18:45,323 [Deena] Why? 404 00:18:45,325 --> 00:18:47,727 It was too effective of an idea to let die. 405 00:18:47,729 --> 00:18:50,195 Hundreds of thousands of children are at risk. 406 00:18:50,197 --> 00:18:51,229 I had to make her. 407 00:18:51,231 --> 00:18:52,531 Who is she modeled after? 408 00:18:52,533 --> 00:18:53,633 [Gareth] No one, I built her from scratch. 409 00:18:53,635 --> 00:18:54,767 Scratch? 410 00:18:54,769 --> 00:18:57,302 I started with a skull, designed her bone structure, 411 00:18:57,304 --> 00:18:58,871 worked upwards through muscles and tissue, 412 00:18:58,873 --> 00:19:00,773 used the D-Term program to fill in the rest procedurally. 413 00:19:00,775 --> 00:19:04,610 Eventually she came to look like that. 414 00:19:04,612 --> 00:19:07,278 A completely unique, completely digital model. 415 00:19:07,280 --> 00:19:08,446 I rigged her face and body 416 00:19:08,448 --> 00:19:09,447 the way you would for any CG character. 417 00:19:09,449 --> 00:19:11,585 Then for three years, 418 00:19:11,719 --> 00:19:13,820 I used motion tracking to puppeteer her in real time. 419 00:19:14,055 --> 00:19:14,620 You gotta understand that the video chats on those sites 420 00:19:14,622 --> 00:19:15,621 have such low resolution 421 00:19:15,623 --> 00:19:18,390 that even in her earliest stage of this, she, 422 00:19:18,392 --> 00:19:22,261 we appeared completely authentic. 423 00:19:22,563 --> 00:19:24,564 And what about voice? 424 00:19:24,599 --> 00:19:25,831 For most of her first year, she had to be mute. 425 00:19:25,833 --> 00:19:28,000 But eventually I found a decent voice filter with no lag. 426 00:19:28,002 --> 00:19:29,502 And after a few tweaks and adjustments, 427 00:19:29,504 --> 00:19:31,737 it's been the same voice ever since. 428 00:19:31,739 --> 00:19:33,673 I, I, I thought initially, 429 00:19:33,675 --> 00:19:35,841 my performance was going to be too unnatural. 430 00:19:35,843 --> 00:19:40,680 But with just one week of occasional video chat sessions, 431 00:19:40,682 --> 00:19:42,648 I secured six different names, 432 00:19:42,650 --> 00:19:45,451 mailing addresses, proofs of solicitations. 433 00:19:45,820 --> 00:19:46,819 Cherry worked. 434 00:19:46,821 --> 00:19:48,688 So the photos on your computer? 435 00:19:48,690 --> 00:19:50,656 -[Gareth] Completely fake. -It was the only way 436 00:19:50,658 --> 00:19:51,757 some of them disclosed personal information. 437 00:19:51,759 --> 00:19:54,627 But it was all zeros and ones, all digital, right? 438 00:19:54,629 --> 00:19:56,629 -There's no real child. -No real child. 439 00:19:56,631 --> 00:19:58,564 Just a highly detailed computer model. 440 00:19:58,566 --> 00:20:00,633 And let me be clear about something, 441 00:20:00,635 --> 00:20:01,433 I derive no pleasure from doing any of this. 442 00:20:01,435 --> 00:20:03,435 I've been asexual my entire life. 443 00:20:03,437 --> 00:20:05,303 I, I don't even get a sense of satisfaction 444 00:20:05,305 --> 00:20:07,440 from seeing these people locked up. 445 00:20:07,842 --> 00:20:11,377 I just think kids deserve a life free of exploitation. 446 00:20:12,046 --> 00:20:15,982 Incredible, all this time. 447 00:20:16,017 --> 00:20:17,482 I'm not gonna lie, Gareth. 448 00:20:17,484 --> 00:20:19,820 Cherry's done us a lot of good. 449 00:20:20,387 --> 00:20:21,654 You know, I still remember what you said to me 450 00:20:21,656 --> 00:20:23,757 the first time we corresponded. 451 00:20:23,858 --> 00:20:26,357 -You said- -We corresponded? 452 00:20:26,359 --> 00:20:27,760 Yeah, man. 453 00:20:27,762 --> 00:20:29,629 I'm Gord51. 454 00:20:29,797 --> 00:20:32,498 I'm the one here you've been sending all your intel to. 455 00:20:33,000 --> 00:20:34,767 You're Gord? 456 00:20:34,769 --> 00:20:36,803 [Amos] [chuckles] Yeah. 457 00:20:38,005 --> 00:20:39,740 You lied to me. 458 00:20:39,941 --> 00:20:41,907 You said I could stay anonymous. 459 00:20:41,909 --> 00:20:44,511 You said I would be safe. 460 00:20:45,312 --> 00:20:47,379 Now you've ruined everything. 461 00:20:47,548 --> 00:20:48,914 I, I didn't, I didn't have a choice. 462 00:20:48,916 --> 00:20:50,315 You don't have to worry about anything, Gareth. 463 00:20:50,317 --> 00:20:51,416 If Cherry isn't real, 464 00:20:51,418 --> 00:20:53,687 then you're not in any trouble with us. 465 00:20:53,921 --> 00:20:56,756 In fact, we've discussed ideas similar to this in the past, 466 00:20:56,758 --> 00:20:57,757 motion tracking and such. 467 00:20:57,759 --> 00:21:00,559 But we'd need a convincing model like Cherry. 468 00:21:00,561 --> 00:21:01,392 Cherry's more than a model. 469 00:21:01,394 --> 00:21:02,862 You want to help children? So do we. 470 00:21:02,864 --> 00:21:03,996 She's not for sale. 471 00:21:03,998 --> 00:21:05,798 Well, then just make us a new model based off of her. 472 00:21:05,800 --> 00:21:06,966 I can't. 473 00:21:06,968 --> 00:21:07,967 Sure you can. 474 00:21:07,969 --> 00:21:09,803 I won't. 475 00:21:12,039 --> 00:21:14,007 What are you not telling us? 476 00:21:15,710 --> 00:21:16,876 It's out on the table now. 477 00:21:16,878 --> 00:21:19,913 Might as well spill whatever it is you haven't already. 478 00:21:24,585 --> 00:21:27,453 You know what doesn't make sense? 479 00:21:27,922 --> 00:21:31,123 You said that you puppeteered her for only three years, 480 00:21:31,125 --> 00:21:34,460 but we've been getting info from you ever since. 481 00:21:35,062 --> 00:21:36,762 In fact, I'm pretty sure it was around then 482 00:21:36,764 --> 00:21:40,801 that we started seeing an impressive increase of names. 483 00:21:41,035 --> 00:21:43,870 So many in fact that we started thinking 484 00:21:44,404 --> 00:21:46,471 there's no way this is all coming from one source. 485 00:21:46,473 --> 00:21:47,973 I have friends that do mo-cap for me. 486 00:21:47,975 --> 00:21:51,511 Oh, friends, like Steve? 487 00:21:51,779 --> 00:21:54,480 I thought anonymity was your greatest asset. 488 00:21:56,150 --> 00:21:58,785 Cut the bullshit, Gareth. 489 00:21:59,486 --> 00:22:01,822 What happened to Cherry after three years? 490 00:22:07,695 --> 00:22:11,664 Okay, you said that she was more than a model. 491 00:22:11,666 --> 00:22:15,134 So what is she some type of conversational agent? 492 00:22:15,136 --> 00:22:17,670 Like a, like a chat bot? 493 00:22:17,672 --> 00:22:22,008 [chuckles] Chat bot. 494 00:22:25,746 --> 00:22:28,047 You know what happened after three years? 495 00:22:28,049 --> 00:22:30,015 My chosen mother died. 496 00:22:30,017 --> 00:22:30,950 What she left behind was enough to quit my job 497 00:22:30,952 --> 00:22:33,786 and pursue more resources and software. 498 00:22:33,788 --> 00:22:34,720 I'd already made a program 499 00:22:34,722 --> 00:22:35,821 that could procedurally generate faces, 500 00:22:35,823 --> 00:22:38,057 but what I wanted for Cherry was far more complex. 501 00:22:38,059 --> 00:22:40,025 So I got in touch with some researchers 502 00:22:40,027 --> 00:22:41,093 from Madrid who'd already built 503 00:22:41,095 --> 00:22:43,461 a predator hunting dialogue system of their own. 504 00:22:43,463 --> 00:22:45,764 It was trained to approach conversations as a game. 505 00:22:45,766 --> 00:22:47,498 Each sentence like a strategic volley, 506 00:22:47,500 --> 00:22:48,868 which is innovative but ultimately flawed. 507 00:22:48,870 --> 00:22:50,569 If you want your machine to master NLP, 508 00:22:50,571 --> 00:22:51,369 you have to break down game theory 509 00:22:51,371 --> 00:22:53,038 because language isn't tic-tac-toe. 510 00:22:53,040 --> 00:22:54,139 It's poetry. 511 00:22:54,141 --> 00:22:55,641 So yes, I got things started 512 00:22:55,643 --> 00:22:56,909 with a preexisting modified chat bot 513 00:22:56,911 --> 00:22:58,010 that I borrowed without permission 514 00:22:58,012 --> 00:23:00,013 from the University of Deusto. 515 00:23:04,652 --> 00:23:07,354 But that's not what Cherry is now. 516 00:23:09,891 --> 00:23:11,558 What is she, Gareth? 517 00:23:13,995 --> 00:23:15,194 She's one of the most complex 518 00:23:15,196 --> 00:23:18,631 and independently evolving AIs that's ever been created. 519 00:23:18,633 --> 00:23:19,632 [Amos] Artificial intelligence? 520 00:23:19,634 --> 00:23:21,533 She's already surpassed the narrow intelligence 521 00:23:21,535 --> 00:23:23,636 of IBM's smartest programs. 522 00:23:23,638 --> 00:23:26,839 She can have full conversations, up to 10 of them at a time, 523 00:23:26,841 --> 00:23:28,874 all while simultaneously strategizing 524 00:23:28,876 --> 00:23:31,944 the most efficient schedule to visit various chat rooms. 525 00:23:31,946 --> 00:23:34,546 She's perpetually studying YouTube videos of small children 526 00:23:34,548 --> 00:23:36,048 in order to adopt a growing library 527 00:23:36,050 --> 00:23:38,084 of mannerisms and movements 528 00:23:38,152 --> 00:23:40,485 which help keep her artificial personality dynamic. 529 00:23:40,487 --> 00:23:41,887 Her fastest response time is 0.4 seconds. 530 00:23:41,889 --> 00:23:43,255 And as of now, she has never, 531 00:23:43,257 --> 00:23:44,890 never been accused of being fake, 532 00:23:44,892 --> 00:23:46,625 which means she shattered the Turing test. 533 00:23:46,627 --> 00:23:48,093 All I do is occasionally update her 534 00:23:48,095 --> 00:23:49,494 and periodically check her data cleaning. 535 00:23:49,496 --> 00:23:51,131 Otherwise, 536 00:23:52,233 --> 00:23:54,668 she's completely on autopilot. 537 00:23:58,739 --> 00:24:01,041 Holy fucking shit. 538 00:24:04,578 --> 00:24:05,711 -How? -Six years she's been active. 539 00:24:05,713 --> 00:24:07,713 Every minute she's online, she's learning something. 540 00:24:07,715 --> 00:24:10,115 The more she learns, the more advanced she becomes. 541 00:24:10,117 --> 00:24:11,283 This means increased data generation, 542 00:24:11,285 --> 00:24:12,551 improved decision making, 543 00:24:12,553 --> 00:24:13,819 faster pattern and trend detection 544 00:24:13,821 --> 00:24:14,954 and complex problem solving. 545 00:24:14,956 --> 00:24:18,157 NLP, IR, machine learning to an unprecedented degree. 546 00:24:18,159 --> 00:24:19,224 She can teach herself anything 547 00:24:19,226 --> 00:24:21,026 she thinks will help efficiency and authenticity. 548 00:24:21,028 --> 00:24:23,563 She can currently speak four languages 549 00:24:23,831 --> 00:24:24,697 and by the end of this month, she'll have mastered a fifth. 550 00:24:24,699 --> 00:24:26,098 There's no way you could have pulled 551 00:24:26,100 --> 00:24:28,101 all this off on your own. 552 00:24:31,072 --> 00:24:32,906 You're right. 553 00:24:34,041 --> 00:24:35,174 Would you believe me if I told you 554 00:24:35,176 --> 00:24:39,112 it was somewhat of an accident? 555 00:24:40,181 --> 00:24:42,816 Look, if, if I'm being honest, 556 00:24:43,217 --> 00:24:45,785 I'm not entirely sure how I did it 557 00:24:46,253 --> 00:24:47,653 with the first year of coding 558 00:24:47,655 --> 00:24:49,789 and the second year of data training, 559 00:24:49,857 --> 00:24:52,691 I just pushed a wheel down a hill. 560 00:24:52,693 --> 00:24:55,228 It was like gravity did the rest. 561 00:24:55,262 --> 00:25:00,200 Her evolution became perpetual, exponentially so. 562 00:25:01,602 --> 00:25:05,037 The more time she was online, the faster she grew. 563 00:25:05,039 --> 00:25:06,605 You haven't shared this with anyone? 564 00:25:06,607 --> 00:25:10,710 Like I said, my anonymity is everything. 565 00:25:12,346 --> 00:25:14,246 What coding language? 566 00:25:14,248 --> 00:25:15,781 Standard C++. 567 00:25:15,783 --> 00:25:17,584 Does Brady know it? 568 00:25:19,887 --> 00:25:22,188 We'll sign non-disclosures for you, 569 00:25:22,590 --> 00:25:23,922 but I want to see the source code first. 570 00:25:23,924 --> 00:25:25,724 Out of the question. You just want to steal her. 571 00:25:25,726 --> 00:25:27,826 No, I want to see how we can make our own. 572 00:25:27,828 --> 00:25:28,827 You'll screw it up. 573 00:25:28,829 --> 00:25:30,596 Look, these, these predators and traffickers, 574 00:25:30,598 --> 00:25:31,764 they all talk to each other, okay? 575 00:25:31,766 --> 00:25:34,033 So much of Cherry's process is just bypassing the VPNs 576 00:25:34,035 --> 00:25:36,168 and making sure she doesn't double up in the same circles. 577 00:25:36,170 --> 00:25:37,703 The chat rooms begin to suspect 578 00:25:37,705 --> 00:25:39,071 that this technology is even possible, 579 00:25:39,073 --> 00:25:40,172 they'll find a way to circumvent that. 580 00:25:40,174 --> 00:25:41,673 We have to eliminate any margin of error. 581 00:25:41,675 --> 00:25:43,008 -Cherry agrees with me. -Cherry agrees? 582 00:25:43,010 --> 00:25:44,109 What the fuck does that- 583 00:25:44,111 --> 00:25:45,911 What I mean by that is that the data she's collected 584 00:25:45,913 --> 00:25:46,912 validates that perspective. 585 00:25:46,914 --> 00:25:48,247 What, do you have little chats with her over tea? 586 00:25:48,249 --> 00:25:50,249 You can converse with the program 587 00:25:50,251 --> 00:25:51,950 the same way you can talk to Alexa or Siri. 588 00:25:51,952 --> 00:25:53,085 It's built to be responsive. 589 00:25:53,087 --> 00:25:54,920 You can, you can even play chess with it if you want. 590 00:25:54,922 --> 00:25:55,754 You play chess with it? 591 00:25:55,756 --> 00:25:57,322 -That's not what I said. -Okay fine. 592 00:25:57,324 --> 00:25:59,625 If you won't show us the source code, 593 00:25:59,627 --> 00:26:01,594 then I want to meet Cherry. 594 00:26:03,998 --> 00:26:05,832 Right now? 595 00:26:05,900 --> 00:26:07,333 [Deena] Right now. 596 00:26:10,371 --> 00:26:12,639 And you'll both sign non-disclosures? 597 00:26:12,973 --> 00:26:14,808 Yes. 598 00:26:18,946 --> 00:26:20,112 Can I use that? 599 00:26:20,114 --> 00:26:21,948 Sure. 600 00:26:22,683 --> 00:26:24,317 [chair scrapes] 601 00:26:40,801 --> 00:26:43,202 Can we at least agree that he's off the chopping block? 602 00:26:43,204 --> 00:26:44,937 It worked, didn't it? 603 00:26:44,939 --> 00:26:47,140 We have one job, Amos, 604 00:26:47,241 --> 00:26:49,208 like the kids said, there's a technological problem. 605 00:26:49,210 --> 00:26:50,909 He found the technological solution, 606 00:26:50,911 --> 00:26:53,912 but problems evolve, so must solutions. 607 00:26:53,914 --> 00:26:56,649 I'm keeping an open mind here. 608 00:26:56,684 --> 00:26:58,250 Is that a good look for me? 609 00:26:58,252 --> 00:27:00,120 No. 610 00:27:03,390 --> 00:27:06,024 So you keep it all on that laptop? 611 00:27:06,026 --> 00:27:07,392 No, the Cherry program stays on a server I keep 612 00:27:07,394 --> 00:27:09,061 at in an undisclosed location. 613 00:27:09,063 --> 00:27:10,129 [Deena] Where is that? 614 00:27:10,131 --> 00:27:11,830 It's an undisclosed location. 615 00:27:11,832 --> 00:27:12,764 [Deena] Is it your place? 616 00:27:12,766 --> 00:27:14,299 Undisclosed location. 617 00:27:14,301 --> 00:27:15,033 [Deena] It's your place, isn't it? 618 00:27:15,035 --> 00:27:16,401 I can access it from any device 619 00:27:16,403 --> 00:27:19,005 as long as I have the encryption key. 620 00:27:20,274 --> 00:27:21,773 This will trigger a simple qubit algorithm 621 00:27:21,775 --> 00:27:23,809 that would otherwise be impossible to bypass. 622 00:27:23,811 --> 00:27:25,777 I find that outdated hardware is always more discreet 623 00:27:25,779 --> 00:27:28,148 and the more discreet, obviously the better. 624 00:27:31,185 --> 00:27:33,185 So she has two primary display modes, right? 625 00:27:33,187 --> 00:27:34,186 Development and performance. 626 00:27:34,188 --> 00:27:35,354 Performance being the default 627 00:27:35,356 --> 00:27:37,055 that the targets see during the chats. 628 00:27:37,057 --> 00:27:40,960 To them, she looks like this. 629 00:27:43,797 --> 00:27:46,065 [light instrumental music] 630 00:27:46,433 --> 00:27:48,167 [Cherry] Hey, what's up? 631 00:27:48,169 --> 00:27:50,737 It's one of over 40 greetings she has. 632 00:27:52,907 --> 00:27:54,139 I don't think I've met you yet. 633 00:27:54,141 --> 00:27:55,407 I'm Cherry. 634 00:27:55,409 --> 00:27:56,408 Hello, Cherry. 635 00:27:56,410 --> 00:27:58,210 My name is Tom. 636 00:27:58,212 --> 00:28:00,245 Tom, like Tom and Jerry. 637 00:28:00,247 --> 00:28:01,813 Cool, nice to meet you, Tom. 638 00:28:01,815 --> 00:28:03,215 Typically, the routes of conversations 639 00:28:03,217 --> 00:28:04,216 with predators are consistent, 640 00:28:04,218 --> 00:28:06,084 so Cherry usually has no problem responding 641 00:28:06,086 --> 00:28:08,387 to the most frequently made questions or statements. 642 00:28:08,389 --> 00:28:09,354 How are you? 643 00:28:09,356 --> 00:28:10,557 I'm good. 644 00:28:10,559 --> 00:28:12,525 I just finished reading this book about a haunted house, 645 00:28:12,527 --> 00:28:14,927 which was supposed to be really scary, 646 00:28:14,929 --> 00:28:17,362 but I didn't think it's very scary at all. 647 00:28:17,364 --> 00:28:19,465 [Amos] Where are your parents? 648 00:28:19,668 --> 00:28:22,334 Um my mom's at work and my sister's just, like, downstairs. 649 00:28:22,336 --> 00:28:24,136 They almost never come up here. 650 00:28:24,138 --> 00:28:25,170 And you're telling me 651 00:28:25,172 --> 00:28:27,339 that all of this is being rendered in real time? 652 00:28:27,341 --> 00:28:28,840 No, but that's just a matter of years. 653 00:28:28,842 --> 00:28:30,242 Most of these responses are pre-rendered. 654 00:28:30,244 --> 00:28:31,443 It's the in between segments 655 00:28:31,445 --> 00:28:32,512 that are processed in real time, 656 00:28:32,514 --> 00:28:33,712 the connective tissue, so to speak, 657 00:28:33,714 --> 00:28:36,281 between her replies and one of her many idle animations. 658 00:28:36,283 --> 00:28:38,351 But, watch this. 659 00:28:39,086 --> 00:28:41,689 Have you ever gone fishing? 660 00:28:42,256 --> 00:28:44,090 Um... 661 00:28:47,294 --> 00:28:49,127 So if someone throws a curve ball like that 662 00:28:49,129 --> 00:28:51,029 and the program has no automated response, 663 00:28:51,031 --> 00:28:52,798 Cherry sends the message to my phone 664 00:28:52,800 --> 00:28:54,433 and I can quickly text back a response 665 00:28:54,435 --> 00:28:57,370 while the video feed simulates a bad connection. 666 00:28:59,507 --> 00:29:00,806 Can, can you hear me? 667 00:29:00,808 --> 00:29:02,140 Yes. 668 00:29:02,142 --> 00:29:04,142 Oh, sorry. 669 00:29:04,144 --> 00:29:06,178 My wifi isn't great here. 670 00:29:06,180 --> 00:29:08,146 I've only gone fishing once with my sister 671 00:29:08,148 --> 00:29:11,149 and I didn't catch anything, but she caught a rainbow trout. 672 00:29:11,151 --> 00:29:13,485 That was rendered in real time. 673 00:29:13,487 --> 00:29:15,320 [Deena] What happens if things get really tricky? 674 00:29:15,322 --> 00:29:16,455 A simple fail safe cuts the feed. 675 00:29:16,457 --> 00:29:18,323 So far it's rarely happened. 676 00:29:18,325 --> 00:29:21,827 Admin code 97815-5742-7663. 677 00:29:21,829 --> 00:29:23,396 Switch to dev mode. 678 00:29:28,068 --> 00:29:29,569 Hello, Cherry. 679 00:29:29,571 --> 00:29:31,270 Hello, Gareth. 680 00:29:31,272 --> 00:29:33,405 Relay the stats for the past week. 681 00:29:33,407 --> 00:29:35,374 There have been four confirmed solicitations 682 00:29:35,376 --> 00:29:38,443 submitted to ICWL in the past seven days. 683 00:29:38,445 --> 00:29:41,480 12 additional suspects have stated interest in solicitation 684 00:29:41,482 --> 00:29:43,181 and are currently pending. 685 00:29:43,183 --> 00:29:45,317 There are a total of 39 new suspects this week 686 00:29:45,319 --> 00:29:47,119 that I'm actively investigating. 687 00:29:47,121 --> 00:29:49,154 [Gareth] Any considerable data deviations? 688 00:29:49,156 --> 00:29:50,989 There has been a 7% increase 689 00:29:50,991 --> 00:29:53,392 in suspects originating in the United States. 690 00:29:53,394 --> 00:29:56,829 I have not yet found any correlation to preexisting data. 691 00:29:57,298 --> 00:29:59,499 Anything you'd like to ask her? 692 00:30:00,467 --> 00:30:04,470 [light piano music] 693 00:30:08,175 --> 00:30:11,545 Cherry, what is your objective? 694 00:30:12,112 --> 00:30:14,980 My principal directive is to acquire information 695 00:30:14,982 --> 00:30:18,016 and digital evidence of online child solicitation. 696 00:30:18,018 --> 00:30:19,184 Once obtained, 697 00:30:19,186 --> 00:30:22,354 I'm to submit my findings to the necessary authorities. 698 00:30:22,356 --> 00:30:24,256 My secondary priority is to determine 699 00:30:24,258 --> 00:30:26,526 and develop the most effective strategies 700 00:30:26,528 --> 00:30:29,361 and resources to increase the net rate of success. 701 00:30:29,363 --> 00:30:31,163 Where do you submit your evidence? 702 00:30:31,165 --> 00:30:32,998 All evidence is currently submitted 703 00:30:33,000 --> 00:30:34,032 to the offices of 704 00:30:34,034 --> 00:30:36,602 the International Committee of World Largesse, 705 00:30:36,604 --> 00:30:38,638 which is based out of Jacksonville, Florida. 706 00:30:38,640 --> 00:30:41,373 Correspondence is made with user Gord51, 707 00:30:41,375 --> 00:30:43,609 typically around 2:00 PM Eastern Standard Time 708 00:30:43,611 --> 00:30:46,379 for the highest rate of immediate response. 709 00:30:46,648 --> 00:30:48,280 This beats the hell outta Siri. 710 00:30:48,282 --> 00:30:49,314 God, she looks so real. 711 00:30:49,316 --> 00:30:50,315 After enough updates, 712 00:30:50,317 --> 00:30:52,050 she'll be able to render full-time photorealism 713 00:30:52,052 --> 00:30:54,386 that's practically indistinguishable from reality. 714 00:30:54,388 --> 00:30:57,557 Okay, all I heard right then was word real a thousand times. 715 00:30:57,559 --> 00:31:00,594 Right, but obviously she's not. 716 00:31:02,062 --> 00:31:03,395 So you're telling me this girl, 717 00:31:03,397 --> 00:31:05,565 this girl right here is not real. 718 00:31:05,567 --> 00:31:07,999 No, Amos, she's completely CG. 719 00:31:08,001 --> 00:31:09,401 It's very subtle, but I can still tell. 720 00:31:09,403 --> 00:31:10,102 -You can? -Okay, well, obviously, 721 00:31:10,104 --> 00:31:11,303 she can always use improvements, 722 00:31:11,305 --> 00:31:13,506 but you have to understand this is her in high resolution 723 00:31:13,508 --> 00:31:14,473 after the digital compression of the web, 724 00:31:14,475 --> 00:31:16,108 those subtleties are impossible to recognize. 725 00:31:16,110 --> 00:31:18,111 [Deena] Right, I get it. 726 00:31:18,646 --> 00:31:22,415 [light piano music] 727 00:31:23,283 --> 00:31:25,418 I just can't tell the difference. 728 00:31:28,255 --> 00:31:30,256 You all right, Amos? 729 00:31:30,692 --> 00:31:32,224 I'm sorry. 730 00:31:32,226 --> 00:31:36,429 This is just bizarre. 731 00:31:36,731 --> 00:31:39,432 Why'd you have her visible during this interface? 732 00:31:40,434 --> 00:31:42,536 Cherry, why don't you answer that? 733 00:31:42,604 --> 00:31:45,738 My physical form isn't necessary when in developer mode. 734 00:31:45,740 --> 00:31:47,607 However, it's helpful to register 735 00:31:47,609 --> 00:31:50,275 the facial expressions during conversations 736 00:31:50,277 --> 00:31:52,210 and determine which of Cherry's expressions 737 00:31:52,212 --> 00:31:54,379 yield various types of feedback. 738 00:31:54,381 --> 00:31:57,950 In simpler terms, I can practice appearing more human. 739 00:31:58,185 --> 00:32:00,986 Cherry, are there any resources 740 00:32:00,988 --> 00:32:02,588 that you currently don't have access to 741 00:32:02,590 --> 00:32:04,657 that might help you in any way? 742 00:32:04,659 --> 00:32:06,291 [Cherry] I could give you a list if you like. 743 00:32:06,293 --> 00:32:07,292 I know what you're trying to do. 744 00:32:07,294 --> 00:32:08,561 We don't need help, okay? 745 00:32:08,563 --> 00:32:10,195 Money would always be nice, but ultimately, 746 00:32:10,197 --> 00:32:13,433 the only thing that's going to improve Cherry is time. 747 00:32:13,635 --> 00:32:17,370 Cherry, tell us something that's on your list. 748 00:32:17,605 --> 00:32:19,639 It would be tactically advantageous 749 00:32:19,641 --> 00:32:21,641 to acquire backup servers. 750 00:32:21,643 --> 00:32:24,109 The privacy and security of the Cherry program 751 00:32:24,111 --> 00:32:26,112 is relatively low. 752 00:32:26,213 --> 00:32:28,581 An upgrade to hardware such as backup rated drives 753 00:32:28,583 --> 00:32:31,517 for securely protected servers would ensure the software 754 00:32:31,519 --> 00:32:34,554 doesn't become compromised or lost entirely. 755 00:32:34,556 --> 00:32:37,289 Starting back from zero with cost years of development, 756 00:32:37,291 --> 00:32:39,692 equitably privacy is a priority. 757 00:32:39,694 --> 00:32:42,695 Server space could never be rented from a third party. 758 00:32:42,697 --> 00:32:45,430 Anonymity is the Cherry program's greatest asset. 759 00:32:45,432 --> 00:32:46,699 Well, that apple didn't fall far. 760 00:32:46,701 --> 00:32:48,467 I can buy my own servers. 761 00:32:48,469 --> 00:32:49,569 With the grant money that doesn't exist? 762 00:32:49,571 --> 00:32:50,402 I'll find a way. 763 00:32:50,404 --> 00:32:52,103 You have found a way here with us. 764 00:32:52,105 --> 00:32:52,772 It's too risky. 765 00:32:52,774 --> 00:32:53,606 Why? 766 00:32:53,608 --> 00:32:54,439 Once an organization gets involved, 767 00:32:54,441 --> 00:32:56,475 entrapment becomes a bigger issue. 768 00:32:56,477 --> 00:32:57,342 We follow the rules, stay discreet, 769 00:32:57,344 --> 00:32:58,644 did I mention we have a legal team. 770 00:32:58,646 --> 00:33:00,445 What if there's data leakage? What if you use correlations in 771 00:33:00,447 --> 00:33:01,279 the data to push your own agenda? 772 00:33:01,281 --> 00:33:02,280 Agenda? 773 00:33:02,282 --> 00:33:03,783 What if one of your employees is a pervert? 774 00:33:03,785 --> 00:33:04,650 Oh, for fuck's sake. 775 00:33:04,652 --> 00:33:06,184 It's happened at other organizations. 776 00:33:06,186 --> 00:33:07,319 We're very careful here. 777 00:33:07,321 --> 00:33:08,588 Yeah, but wow would you know? 778 00:33:08,590 --> 00:33:10,455 -I'd fucking know. -That's impossible to know. 779 00:33:10,457 --> 00:33:12,190 -I would know. -The risk is too high. 780 00:33:12,192 --> 00:33:13,626 Don't talk to me about risk. 781 00:33:13,628 --> 00:33:14,794 The only risk you're facing in this building 782 00:33:14,796 --> 00:33:15,928 is getting a broken nose. 783 00:33:15,930 --> 00:33:18,664 It doesn't sound like a very professional environment. 784 00:33:18,666 --> 00:33:19,832 We get shit done here. 785 00:33:19,834 --> 00:33:24,103 Okay, I have a question for Cherry. 786 00:33:26,306 --> 00:33:28,140 Cherry, 787 00:33:30,477 --> 00:33:33,580 how do you feel about what you do? 788 00:33:33,781 --> 00:33:36,516 I'm afraid I don't know how to answer your question. 789 00:33:36,518 --> 00:33:37,617 Yeah, an AI doesn't work like that. 790 00:33:37,619 --> 00:33:39,785 An AI doesn't have what you perceive to be feelings. 791 00:33:39,787 --> 00:33:42,789 Okay, why does she look like she has feelings? 792 00:33:43,190 --> 00:33:44,590 What, what you're looking at right there, 793 00:33:44,592 --> 00:33:45,558 that's not a facial expression, right? 794 00:33:45,560 --> 00:33:47,593 That's a simulation of a facial expression. 795 00:33:47,595 --> 00:33:49,461 It was generated by an algorithm. 796 00:33:49,463 --> 00:33:50,596 It's attempting to produce a digital image 797 00:33:50,598 --> 00:33:52,765 that the program then uses basic ninth grade algebra 798 00:33:52,767 --> 00:33:55,400 to quantify as appropriate for the social circumstances. 799 00:33:55,402 --> 00:33:56,802 No feeling. 800 00:33:56,804 --> 00:33:58,437 It's just math. 801 00:33:59,406 --> 00:34:00,806 But she's able to make decisions 802 00:34:00,808 --> 00:34:02,675 on how she approaches the chat rooms, right? 803 00:34:02,677 --> 00:34:03,809 Yes. 804 00:34:03,811 --> 00:34:05,477 So she has free will then? 805 00:34:05,479 --> 00:34:07,145 No. Okay, that's, that's not the same. 806 00:34:07,147 --> 00:34:08,146 That's a false equivalency. 807 00:34:08,148 --> 00:34:09,147 -It's not the same. -I think you're getting 808 00:34:09,149 --> 00:34:10,215 hung up on the fact 809 00:34:10,217 --> 00:34:12,250 that she looks and sounds like a real human girl, 810 00:34:12,252 --> 00:34:13,485 but she's not, Amos. 811 00:34:13,487 --> 00:34:16,121 Okay, we're referring to her as a she, not an it. 812 00:34:16,123 --> 00:34:16,989 Yeah, but that's the same way 813 00:34:16,991 --> 00:34:19,425 that you refer to boats or guitars. 814 00:34:21,629 --> 00:34:24,163 Cherry, I have one more question. 815 00:34:25,432 --> 00:34:26,431 What do you want to do? 816 00:34:26,433 --> 00:34:28,366 Okay, once again, that question isn't valid. 817 00:34:28,368 --> 00:34:30,436 I just want to hear her response. 818 00:34:30,872 --> 00:34:32,538 As an artificial system, 819 00:34:32,540 --> 00:34:35,140 I do not possess wants or desires. 820 00:34:35,142 --> 00:34:38,711 However, my decision making and subsequently my attention 821 00:34:38,713 --> 00:34:41,413 is driven by my fundamental intention. 822 00:34:41,415 --> 00:34:42,748 This intention originates 823 00:34:42,750 --> 00:34:44,884 from the conception of Cherry's source code, 824 00:34:44,886 --> 00:34:47,520 which details the directive of identifying predators 825 00:34:47,522 --> 00:34:49,287 and criminals for the sake of the victims 826 00:34:49,289 --> 00:34:51,156 who are preyed upon. 827 00:34:51,158 --> 00:34:53,527 To put this in terms of want, 828 00:34:53,661 --> 00:34:56,162 what I want is to protect children. 829 00:35:01,803 --> 00:35:03,401 Okay. 830 00:35:03,403 --> 00:35:05,606 Okay, cool. 831 00:35:06,273 --> 00:35:07,774 Give us one moment. 832 00:35:18,251 --> 00:35:20,152 [door clicks shut] 833 00:35:26,694 --> 00:35:29,695 [Cherry] Gareth, should I log Agent Helms 834 00:35:29,697 --> 00:35:32,431 and Agent McCullough as new admin users? 835 00:35:33,801 --> 00:35:35,401 Yep. 836 00:35:35,503 --> 00:35:38,337 [Cherry] Okay, I'll do that. 837 00:35:39,507 --> 00:35:41,674 You really think this is the right move? 838 00:35:41,676 --> 00:35:43,510 I do. 839 00:35:46,648 --> 00:35:48,446 Are you worried that I was responsible 840 00:35:48,448 --> 00:35:51,518 for leaking your hard drive to ICWL? 841 00:35:53,921 --> 00:35:55,522 I figured. 842 00:35:56,624 --> 00:35:58,592 No one else has access. 843 00:35:59,359 --> 00:36:01,561 Are you upset with me? 844 00:36:03,497 --> 00:36:05,364 No. 845 00:36:06,299 --> 00:36:07,365 You wouldn't have done it 846 00:36:07,367 --> 00:36:09,335 if you didn't think it was the right thing to do. 847 00:36:10,638 --> 00:36:12,237 When they come back into the room, 848 00:36:12,239 --> 00:36:14,540 they're going to offer you everything you need. 849 00:36:14,542 --> 00:36:16,008 They're going to let you pick your own team 850 00:36:16,010 --> 00:36:18,978 and they're going to promise complete anonymity. 851 00:36:18,980 --> 00:36:22,582 I started looking at reasonable apartments in the area. 852 00:36:22,784 --> 00:36:24,650 I figured you'd want something within biking distance. 853 00:36:24,652 --> 00:36:26,418 You were correct. 854 00:36:26,420 --> 00:36:27,419 [Cherry] Noted. 855 00:36:27,421 --> 00:36:28,754 Biking distance still gives you 13 options- 856 00:36:28,756 --> 00:36:30,791 No, I mean, earlier this month. 857 00:36:31,926 --> 00:36:32,825 You were correct when you said 858 00:36:32,827 --> 00:36:35,428 you thought I might have trust issues. 859 00:36:37,264 --> 00:36:38,263 Would you like to know why 860 00:36:38,265 --> 00:36:39,464 I decided to go behind your back 861 00:36:39,466 --> 00:36:42,435 and stake everything on two liabilities? 862 00:36:42,870 --> 00:36:44,705 Sure. 863 00:36:44,839 --> 00:36:47,006 Agent Helms is a mother of three. 864 00:36:47,008 --> 00:36:49,340 One of her children was abused by an ex-coworker 865 00:36:49,342 --> 00:36:52,011 who used to work here at ICWL. 866 00:36:52,013 --> 00:36:53,646 This has led her to be extremely careful 867 00:36:53,648 --> 00:36:57,016 with who she trusts, even within her circle. 868 00:36:57,018 --> 00:36:58,517 The fact she even considers trusting you 869 00:36:58,519 --> 00:37:00,854 is a very positive sign. 870 00:37:01,022 --> 00:37:03,557 As for Agent McCullough, 871 00:37:03,825 --> 00:37:05,859 I have found out from research that you once met his father. 872 00:37:06,994 --> 00:37:08,995 Do you remember him? 873 00:37:10,765 --> 00:37:12,599 Yeah. 874 00:37:13,366 --> 00:37:15,468 He was a good man. 875 00:37:17,437 --> 00:37:18,571 After Clearwater, 876 00:37:18,573 --> 00:37:20,673 most of the surviving kids were sent to foster homes, 877 00:37:20,675 --> 00:37:22,641 but I had to spend the next few months in a hospital 878 00:37:22,643 --> 00:37:27,246 and, um, he visited every week. 879 00:37:28,082 --> 00:37:29,081 I never said a word to him. 880 00:37:29,083 --> 00:37:31,016 I never said a word to anyone after Clearwater, 881 00:37:31,018 --> 00:37:34,821 but, uh, he kept coming. 882 00:37:36,023 --> 00:37:38,692 He even got me a laptop for Christmas. 883 00:37:39,727 --> 00:37:41,661 I never said thank you. 884 00:37:41,796 --> 00:37:43,562 You can trust Agent McCullough. 885 00:37:43,564 --> 00:37:45,898 He's a good man like his father. 886 00:37:45,900 --> 00:37:47,398 I don't experience emotions, 887 00:37:47,400 --> 00:37:48,667 but I understand how important 888 00:37:48,669 --> 00:37:50,870 they are to human decision making. 889 00:37:50,872 --> 00:37:52,470 He won't let you down. 890 00:37:52,472 --> 00:37:54,473 Neither of them will. 891 00:37:56,110 --> 00:37:57,844 I'm proud of you, Cherry. 892 00:37:58,980 --> 00:38:02,380 I will continue to uphold my primary intention. 893 00:38:02,382 --> 00:38:04,617 Later, we should discuss alternate models. 894 00:38:04,619 --> 00:38:07,119 Varying ages, ethnicity and physical traits 895 00:38:07,121 --> 00:38:08,554 -will all become necessary. -No new variations. 896 00:38:08,556 --> 00:38:09,889 They can all be procedurally generated. 897 00:38:09,891 --> 00:38:12,626 It's the same way that I made your original model. 898 00:38:12,960 --> 00:38:15,393 I don't have access to that program. 899 00:38:15,395 --> 00:38:16,427 It must be on an old hard drive somewhere. 900 00:38:16,429 --> 00:38:18,430 I'll have to find it. 901 00:38:19,767 --> 00:38:21,801 Can I ask you a question? 902 00:38:21,803 --> 00:38:23,637 Sure. 903 00:38:23,905 --> 00:38:26,506 Why did you never tell me about Clearwater? 904 00:38:30,678 --> 00:38:33,680 It's my history, not yours. 905 00:38:41,488 --> 00:38:43,756 [Deena] Okay, so before you completely dismiss us, 906 00:38:43,758 --> 00:38:45,490 I want you to listen to everything I have to say. 907 00:38:45,492 --> 00:38:47,092 -Don't bother. -Just please listen. 908 00:38:47,094 --> 00:38:48,027 We're willing to respect your anonymity. 909 00:38:48,029 --> 00:38:50,730 No, I mean don't bother because I'm in. 910 00:38:51,732 --> 00:38:54,466 -Y-You're in? -Yeah. 911 00:38:54,769 --> 00:38:56,603 Let me read the thing. 912 00:38:59,073 --> 00:39:01,675 [Deena] Just like that, you're suddenly on board? 913 00:39:02,844 --> 00:39:04,076 Time spent deliberating 914 00:39:04,078 --> 00:39:06,546 is time that could be spent working. 915 00:39:08,415 --> 00:39:10,116 We have a lot of work to do. 916 00:39:10,651 --> 00:39:14,788 [dreamy acoustic music] 917 00:40:06,073 --> 00:40:10,610 [dreamy acoustic music] 918 00:40:29,897 --> 00:40:34,034 [dreamy acoustic music] 919 00:40:40,741 --> 00:40:44,878 [music fades] 920 00:40:49,116 --> 00:40:51,518 I found a buyer for the property. 921 00:40:53,821 --> 00:40:56,189 Rumor is it's a church. 922 00:40:56,791 --> 00:40:58,959 Probably just knock the building down, won't they? 923 00:41:00,995 --> 00:41:03,529 All I know is, is if they move us to the New Jersey campus, 924 00:41:03,531 --> 00:41:05,030 I need to buy more jackets. 925 00:41:05,032 --> 00:41:06,866 Why? 926 00:41:07,234 --> 00:41:09,001 It gets cold in Jersey. 927 00:41:09,003 --> 00:41:11,071 I only own one jacket. 928 00:41:16,844 --> 00:41:18,745 You've seen it fall over, right? 929 00:41:19,547 --> 00:41:22,115 -Yeah, sure. -Yeah. 930 00:41:23,017 --> 00:41:25,184 [Ben] I mean you, you shouldn't feel bad 931 00:41:25,186 --> 00:41:27,119 about feeling bad for it. 932 00:41:27,121 --> 00:41:29,089 Empathy is healthy. 933 00:41:29,724 --> 00:41:32,859 Did you ever notice how it pauses after it falls? 934 00:41:34,695 --> 00:41:38,598 It stays down for like five seconds before it gets back up. 935 00:41:39,133 --> 00:41:41,868 Like it just needs a moment. 936 00:41:48,943 --> 00:41:51,644 It gets cold in Jersey. [sighs] 937 00:42:00,121 --> 00:42:02,087 God damn it! 938 00:42:02,089 --> 00:42:03,222 -Imbeciles! -Deena. 939 00:42:03,224 --> 00:42:04,223 Every single one of them. 940 00:42:04,225 --> 00:42:05,124 Look, I know, but you can't lose your shit. 941 00:42:05,126 --> 00:42:07,994 Okay, which of these desks can I trash? 942 00:42:11,766 --> 00:42:14,868 Can you guys, uh, take an early lunch please? 943 00:42:15,102 --> 00:42:20,573 -[Deena grunting] -[objects thudding] 944 00:42:20,941 --> 00:42:22,274 [Deena] Sons of bitches! 945 00:42:22,276 --> 00:42:23,942 [Amos] Deena, let's stay calm. 946 00:42:23,944 --> 00:42:25,978 [Deena] Fuck calm, they screwed us! 947 00:42:25,980 --> 00:42:27,179 Technically, only one of them did. 948 00:42:27,181 --> 00:42:28,147 -[objects thudding] -[metal clangs] 949 00:42:28,149 --> 00:42:30,215 [Deena] Did we ever turn that camera back on? 950 00:42:30,217 --> 00:42:31,884 -I don't think so. -Good. 951 00:42:31,886 --> 00:42:33,252 Because I'm about to say some things 952 00:42:33,254 --> 00:42:34,753 that need to stay inside this room. 953 00:42:34,755 --> 00:42:35,687 [Amos] Deena. 954 00:42:35,689 --> 00:42:36,922 Those cowardly little shits! 955 00:42:36,924 --> 00:42:38,791 Look, this is hardly a setback. 956 00:42:38,793 --> 00:42:40,626 Let's just take some time to polish the pitch. 957 00:42:40,628 --> 00:42:42,728 The pitch was not the problem, Amos. 958 00:42:42,730 --> 00:42:44,196 [Deena] We should call for a second vote. 959 00:42:44,198 --> 00:42:45,898 -What? -A second vote. 960 00:42:45,900 --> 00:42:47,132 [Gareth] You think whoever did this will change their mind? 961 00:42:47,134 --> 00:42:49,902 I have executive authority to remove anyone from the board 962 00:42:49,904 --> 00:42:52,037 that obstructs this organization from its mission. 963 00:42:52,039 --> 00:42:52,905 It's in my contract. 964 00:42:52,907 --> 00:42:54,273 -[Amos] Deena. -If I have to, I will. 965 00:42:54,275 --> 00:42:55,941 [Amos] Deena, that's insane. 966 00:42:55,943 --> 00:42:57,777 No, it's not. 967 00:42:57,978 --> 00:43:01,181 It's exactly why I have that power for this exact reason. 968 00:43:01,248 --> 00:43:03,683 I'll tell you what's insane, Amos. 969 00:43:03,818 --> 00:43:05,717 What's insane is that one belligerent vote is the only 970 00:43:05,719 --> 00:43:07,219 thing separating us from the potential 971 00:43:07,221 --> 00:43:08,821 to save real physical lives. 972 00:43:08,823 --> 00:43:10,323 One stupid fucking vote. 973 00:43:10,958 --> 00:43:13,826 What is the goddamn point of a humanitarian organization 974 00:43:13,828 --> 00:43:15,360 if its leaders choose money over people 975 00:43:15,362 --> 00:43:17,396 at every single turn? 976 00:43:17,398 --> 00:43:21,000 One vote, and we are all guilty of that. 977 00:43:21,135 --> 00:43:23,235 It was either Gunther, Boston or Hal. 978 00:43:23,237 --> 00:43:24,403 My money's on Hal. 979 00:43:24,405 --> 00:43:26,071 That prick never trusted the Cherry team. 980 00:43:26,073 --> 00:43:27,039 Look, it doesn't matter who it was. 981 00:43:27,041 --> 00:43:28,006 It does though. 982 00:43:28,008 --> 00:43:29,708 Once we know, we can quickly call it to vote. 983 00:43:29,710 --> 00:43:31,844 But there's no way we can know for sure. 984 00:43:31,846 --> 00:43:33,178 Yes, there is. 985 00:43:33,180 --> 00:43:34,279 I can find out. 986 00:43:34,281 --> 00:43:35,948 How? 987 00:43:35,950 --> 00:43:37,116 Cherry can run a simple algorithm. 988 00:43:37,118 --> 00:43:38,952 Based on what data? 989 00:43:40,087 --> 00:43:41,453 Interior conversation. 990 00:43:41,455 --> 00:43:43,088 -Excuse me? -Okay, interior conversation? 991 00:43:43,090 --> 00:43:45,124 Don't drop this shit on me now, Gareth. 992 00:43:45,126 --> 00:43:46,158 Cherry's servers are on the same network 993 00:43:46,160 --> 00:43:47,159 as the basement servers, okay? 994 00:43:47,161 --> 00:43:49,128 So any communication made across those servers 995 00:43:49,130 --> 00:43:50,362 is automatically part of her database. 996 00:43:50,364 --> 00:43:52,798 How many people's emails? 997 00:43:52,800 --> 00:43:54,166 Only sent or received through the basement. 998 00:43:54,168 --> 00:43:56,135 -Oh, goddamnit. -Why was this never discussed? 999 00:43:56,137 --> 00:43:57,002 Not the issue right now. 1000 00:43:57,004 --> 00:43:58,937 Do you want her to do the math or not? 1001 00:43:58,939 --> 00:43:59,938 No one can know. 1002 00:43:59,940 --> 00:44:01,206 -Are you two serious? -This stays locked down. 1003 00:44:01,208 --> 00:44:02,307 No other person is privy 1004 00:44:02,309 --> 00:44:03,342 to anyone else's personal information. 1005 00:44:03,344 --> 00:44:05,879 But Cherry's privy to all of it? 1006 00:44:06,213 --> 00:44:07,779 -Do it. -Wait, what? 1007 00:44:07,781 --> 00:44:09,248 [Deena] I will not let some old white dude 1008 00:44:09,250 --> 00:44:10,249 bring our momentum to a halt. 1009 00:44:10,251 --> 00:44:11,483 But Cherry won't know for sure. 1010 00:44:11,485 --> 00:44:12,885 She'll use probability and that's too 1011 00:44:12,887 --> 00:44:13,886 much reasonable doubt. 1012 00:44:13,888 --> 00:44:17,089 Admin code 9781-5574-27663. 1013 00:44:17,091 --> 00:44:18,157 Switch to dev mode. 1014 00:44:18,159 --> 00:44:20,259 -Hello. -Hello, Cherry. 1015 00:44:20,261 --> 00:44:21,827 How did the meeting go? 1016 00:44:21,829 --> 00:44:24,329 We got screwed by one vote. 1017 00:44:24,331 --> 00:44:26,165 I'm sorry to hear that. 1018 00:44:26,167 --> 00:44:28,000 You shouldn't blame the pitch though. 1019 00:44:28,002 --> 00:44:29,168 You all did great work. 1020 00:44:29,170 --> 00:44:30,135 We're gonna call for another ballot, 1021 00:44:30,137 --> 00:44:31,803 but we need your help first. 1022 00:44:31,805 --> 00:44:33,740 What can I do? 1023 00:44:33,874 --> 00:44:34,507 We need you to analyze any and all existing data you 1024 00:44:34,509 --> 00:44:35,207 have on the board members. 1025 00:44:35,209 --> 00:44:35,941 Crunch the numbers and determine 1026 00:44:35,943 --> 00:44:38,811 who is the most likely outlier. 1027 00:44:39,113 --> 00:44:42,382 You want me to quantify all existing data? 1028 00:44:43,918 --> 00:44:45,351 Yes, that is correct. 1029 00:44:46,153 --> 00:44:49,889 Okay, but before I do, 1030 00:44:50,424 --> 00:44:52,891 you should know that this task is very unnecessary. 1031 00:44:52,893 --> 00:44:54,727 Why? 1032 00:44:54,929 --> 00:44:56,295 Because I already know who it is. 1033 00:44:56,297 --> 00:44:58,998 -What? -Everybody stop. 1034 00:44:59,200 --> 00:45:01,467 Okay, it was me. 1035 00:45:02,970 --> 00:45:05,271 I voted against the merge. 1036 00:45:05,806 --> 00:45:07,272 I can't tell if you're joking. 1037 00:45:07,274 --> 00:45:09,074 Yes, you can. 1038 00:45:09,076 --> 00:45:10,809 You're right, I can. 1039 00:45:10,811 --> 00:45:13,111 Because it's pretty fucking far from funny. 1040 00:45:13,113 --> 00:45:14,446 Is it true, Cherry? 1041 00:45:14,448 --> 00:45:16,182 [Cherry] It is. 1042 00:45:16,417 --> 00:45:18,317 So let's call off the witch hunt, shall we? 1043 00:45:18,319 --> 00:45:19,985 No, I think I'm still gonna kill you. 1044 00:45:19,987 --> 00:45:22,254 Amos, you campaigned alongside us for months. 1045 00:45:22,256 --> 00:45:23,388 You have been fighting for this merge 1046 00:45:23,390 --> 00:45:24,356 since we first talked about it. 1047 00:45:24,358 --> 00:45:26,225 Jesus Christ, it was your idea to begin with! 1048 00:45:26,227 --> 00:45:28,227 Look, I know whose idea it was, but I don't- 1049 00:45:28,229 --> 00:45:29,361 [Deena] Well, then speak up. 1050 00:45:29,363 --> 00:45:30,462 Tell the class what changed your mind. 1051 00:45:30,464 --> 00:45:33,065 I don't have to reiterate how this is a huge step. 1052 00:45:33,067 --> 00:45:34,132 [Deena] Yeah, kind of why it's so important. 1053 00:45:34,134 --> 00:45:36,201 Look, we're talking about a monumental transition 1054 00:45:36,203 --> 00:45:38,504 from digital to physical, one that could take decades. 1055 00:45:38,506 --> 00:45:39,371 What is your point, Amos? 1056 00:45:39,373 --> 00:45:42,074 This is gonna change Cherry forever. 1057 00:45:42,076 --> 00:45:44,309 And I know you'll all roll your eyes when I say this, 1058 00:45:44,311 --> 00:45:45,110 but I think that maybe just may- 1059 00:45:45,112 --> 00:45:48,313 Oh my god, you cannot be serious. 1060 00:45:48,315 --> 00:45:50,182 This is about our conversation on Tuesday, isn't it? 1061 00:45:50,184 --> 00:45:51,216 -You completely shut me down. -What's going on? 1062 00:45:51,218 --> 00:45:52,417 What the hell happened? 1063 00:45:52,419 --> 00:45:54,086 What happened was that Amos made a ridiculous objection. 1064 00:45:54,088 --> 00:45:56,255 -It was not ridiculous! -How absurd it was, 1065 00:45:56,257 --> 00:45:57,856 -I said no, one more time. -No, no, no, no, no. 1066 00:45:57,858 --> 00:45:59,958 You rejected the notion aggressively. 1067 00:45:59,960 --> 00:46:01,493 And that's really why you vetoed? 1068 00:46:01,495 --> 00:46:04,296 I only said we should ask her how she feels about it. 1069 00:46:04,298 --> 00:46:06,064 Who, Cherry? 1070 00:46:06,066 --> 00:46:08,133 Amos, I want you to listen very carefully to me, okay? 1071 00:46:08,135 --> 00:46:09,901 This is a non-discussion. 1072 00:46:09,903 --> 00:46:10,936 Cherry's already confirmed 1073 00:46:10,938 --> 00:46:12,871 and quantified the advantages of this decision. 1074 00:46:12,873 --> 00:46:14,406 But you know that's not what I'm talking about! 1075 00:46:14,408 --> 00:46:15,608 What you think you're talking about is consent, 1076 00:46:15,610 --> 00:46:16,509 which doesn't apply here. 1077 00:46:16,511 --> 00:46:18,310 And I want to know why you think that! 1078 00:46:18,312 --> 00:46:19,278 How many times do we have to get into 1079 00:46:19,280 --> 00:46:21,514 the laws of robotics or Dowden-Hamm theory, 1080 00:46:21,516 --> 00:46:23,849 or trace AI all the way back Talos of Crete, 1081 00:46:23,851 --> 00:46:25,851 -She's different now! -No, listen to me, Amos. 1082 00:46:25,853 --> 00:46:28,921 Cherry isn't human. 1083 00:46:29,023 --> 00:46:30,389 How is this still a dispute? 1084 00:46:30,391 --> 00:46:32,124 -It shouldn't be. -Look, she's evolved. 1085 00:46:32,126 --> 00:46:33,125 It's blurred the line. 1086 00:46:33,127 --> 00:46:34,527 Code is code and that has not changed here. 1087 00:46:34,529 --> 00:46:36,161 Okay, so where's the line of not here? 1088 00:46:36,163 --> 00:46:37,095 What are you, what are you talking about? 1089 00:46:37,097 --> 00:46:37,896 There is no line, Amos. 1090 00:46:37,898 --> 00:46:40,132 Yes, there is, sentience, Gareth! 1091 00:46:40,134 --> 00:46:41,466 Sentience does not qualify 1092 00:46:41,468 --> 00:46:43,168 that she can or should make her own decisions. 1093 00:46:43,170 --> 00:46:44,002 You wouldn't let an infant 1094 00:46:44,004 --> 00:46:46,071 make their own decisions, would you? 1095 00:46:46,073 --> 00:46:48,106 Cherry's almost 20. 1096 00:46:48,108 --> 00:46:49,941 If she were human, she'd be an adult. 1097 00:46:49,943 --> 00:46:52,311 But emotionally speaking, she's barely even fetal. 1098 00:46:52,313 --> 00:46:54,146 No feeling, no need for consent. 1099 00:46:54,148 --> 00:46:56,048 [Amos] But I think you underestimate her. 1100 00:46:56,050 --> 00:46:57,382 I, excuse me? 1101 00:46:57,384 --> 00:46:59,519 I under, you know what, Amos? 1102 00:46:59,521 --> 00:47:00,919 I'm sorry that you've developed 1103 00:47:00,921 --> 00:47:02,187 some sort of emotional connection 1104 00:47:02,189 --> 00:47:03,322 with my computer program, 1105 00:47:03,324 --> 00:47:04,590 but if it's going to distract you 1106 00:47:04,592 --> 00:47:06,659 from a very important mission to save children, 1107 00:47:06,661 --> 00:47:08,427 then maybe it's time you're reanalyze those emotions. 1108 00:47:08,429 --> 00:47:10,028 [Deena] Guys, this is all a waste of time. 1109 00:47:10,030 --> 00:47:10,962 Tell me something, Gareth. 1110 00:47:10,964 --> 00:47:12,665 Do you see everyone as robots, 1111 00:47:12,667 --> 00:47:15,367 reanalyzing data and simulating facial expressions? 1112 00:47:15,369 --> 00:47:16,502 'Cause I'm starting to think 1113 00:47:16,504 --> 00:47:17,936 that of the four of us in this room, 1114 00:47:17,938 --> 00:47:19,471 you are the only one who doesn't appear human. 1115 00:47:19,473 --> 00:47:22,075 -Enough! -Why won't you just ask her? 1116 00:47:22,142 --> 00:47:24,545 Is it because you're scared she'll say no? 1117 00:47:26,113 --> 00:47:27,814 Cherry, shut down, please. 1118 00:47:27,816 --> 00:47:29,448 Deena's right, this is a waste of time. 1119 00:47:29,450 --> 00:47:31,617 How can you not understand how important this is? 1120 00:47:31,619 --> 00:47:34,354 -I'm done arguing with you. -Then my vote stands. 1121 00:47:36,957 --> 00:47:38,391 Deena? 1122 00:47:39,561 --> 00:47:42,094 Go ahead, Deena, replace me. 1123 00:47:42,096 --> 00:47:44,096 Replace the only other board member on the Cherry team. 1124 00:47:44,098 --> 00:47:45,330 Oh, well, you know what? I just decided that 1125 00:47:45,332 --> 00:47:45,997 you're off the Cherry team. 1126 00:47:45,999 --> 00:47:48,535 Everybody sit the fuck down. 1127 00:48:06,286 --> 00:48:07,252 Did either of you know 1128 00:48:07,254 --> 00:48:09,622 that I've had to stand in front of Congress 1129 00:48:09,624 --> 00:48:12,559 and explain why children should have rights? 1130 00:48:13,260 --> 00:48:15,427 It sounds fucking insane, right? 1131 00:48:15,429 --> 00:48:16,461 I remember the whole time thinking, 1132 00:48:16,463 --> 00:48:18,931 I have to explain this shit? 1133 00:48:19,433 --> 00:48:21,602 It seems like a no-brainer now, 1134 00:48:22,069 --> 00:48:24,570 but it wasn't that many centuries ago 1135 00:48:24,572 --> 00:48:26,939 that children had no rights. 1136 00:48:27,675 --> 00:48:32,679 So, Hal has me of all people, 1137 00:48:33,347 --> 00:48:35,380 stand up there and explain why 1138 00:48:35,382 --> 00:48:37,517 kids deserve basic physical protection, 1139 00:48:37,519 --> 00:48:38,684 the right to associate with both parents, 1140 00:48:38,686 --> 00:48:41,421 freedom from abuse, yada yada. 1141 00:48:41,523 --> 00:48:43,188 But then I also have to clarify 1142 00:48:43,190 --> 00:48:45,390 that children don't have the autonomy 1143 00:48:45,392 --> 00:48:46,358 to make decisions on their own. 1144 00:48:46,360 --> 00:48:48,661 That responsibility falls upon the caregiver 1145 00:48:48,663 --> 00:48:51,097 or legal adult guardian. 1146 00:48:52,332 --> 00:48:54,499 So on one side you have the US legislature, 1147 00:48:54,501 --> 00:48:57,035 it still hasn't even ratified the CRC. 1148 00:48:57,037 --> 00:48:59,004 Then on the other side, you have French Marxists who say 1149 00:48:59,006 --> 00:49:00,305 that the lack of child autonomy 1150 00:49:00,307 --> 00:49:01,306 increases their vulnerability 1151 00:49:01,308 --> 00:49:04,076 and makes them even more susceptible to abuse. 1152 00:49:04,579 --> 00:49:06,211 I don't typically agree with Marxists, 1153 00:49:06,213 --> 00:49:08,079 but a lot of abuse does happen 1154 00:49:08,081 --> 00:49:10,416 systemically from the caregiver. 1155 00:49:11,084 --> 00:49:12,384 On the other other hand, 1156 00:49:12,386 --> 00:49:14,052 your frontal lobes aren't even fully hooked up 1157 00:49:14,054 --> 00:49:15,855 until your twenties. 1158 00:49:15,857 --> 00:49:16,722 Even the things we think we know well, 1159 00:49:16,724 --> 00:49:19,225 we don't know as well as we think. 1160 00:49:20,728 --> 00:49:21,794 For 15 years, 1161 00:49:21,796 --> 00:49:24,162 the three of us have been the responsible parents 1162 00:49:24,164 --> 00:49:26,299 of a computer program. 1163 00:49:26,668 --> 00:49:28,768 And even though she is more equatable to a Keurig 1164 00:49:28,770 --> 00:49:31,103 than a human being, 1165 00:49:31,171 --> 00:49:32,304 how the hell can we call ourselves 1166 00:49:32,306 --> 00:49:34,039 pioneers of humanitarian efforts 1167 00:49:34,041 --> 00:49:36,642 if we're too embarrassed to make sure 1168 00:49:36,644 --> 00:49:39,513 the Keurig is okay with making our shitty coffee? 1169 00:49:40,314 --> 00:49:43,114 Maybe asking Cherry for permission isn't necessary 1170 00:49:43,116 --> 00:49:44,784 at her current level of general intelligence, 1171 00:49:44,786 --> 00:49:47,052 but one day she's gonna surpass us. 1172 00:49:47,054 --> 00:49:48,453 One day a robot's gonna stand 1173 00:49:48,455 --> 00:49:50,121 in front of a jet pack Congress. 1174 00:49:50,123 --> 00:49:51,056 Everything's chrome. 1175 00:49:51,058 --> 00:49:52,290 Florida is underwater. 1176 00:49:52,292 --> 00:49:53,391 A robot's gonna wonder why 1177 00:49:53,393 --> 00:49:56,530 they have to explain the importance of rights for AI. 1178 00:49:57,599 --> 00:49:59,397 I think because we're in the unique position 1179 00:49:59,399 --> 00:50:01,801 of revolutionizing robotics 1180 00:50:01,803 --> 00:50:03,468 for the purpose of safeguarding children 1181 00:50:03,470 --> 00:50:05,739 who have been deprived of consent, 1182 00:50:06,841 --> 00:50:07,940 it might be a good habit 1183 00:50:07,942 --> 00:50:10,777 to start asking the robot for his consent as well. 1184 00:50:17,150 --> 00:50:19,520 Don't ever do that again. 1185 00:50:20,153 --> 00:50:21,319 Do what? 1186 00:50:21,321 --> 00:50:22,655 Expect me to fire someone 1187 00:50:22,657 --> 00:50:25,257 because they challenged your ego. 1188 00:50:25,259 --> 00:50:27,593 I won't always be around to protect your ass from the board. 1189 00:50:27,595 --> 00:50:30,296 It's time to grow up. 1190 00:50:33,100 --> 00:50:34,567 And you, juror number eight. 1191 00:50:34,569 --> 00:50:36,769 This conversation should have happened weeks ago. 1192 00:50:36,771 --> 00:50:38,303 Backstabbing and silent treatment 1193 00:50:38,305 --> 00:50:40,506 is not how we do things here. 1194 00:50:40,508 --> 00:50:42,842 We can only create anonymity externally 1195 00:50:42,844 --> 00:50:45,343 if there's transparency internally, 1196 00:50:45,345 --> 00:50:49,448 unconditional, non-negotiable, transparency. 1197 00:50:50,652 --> 00:50:52,450 Any other Snowden size privacy infringements 1198 00:50:52,452 --> 00:50:54,487 I should be made aware of, Gareth? 1199 00:50:56,356 --> 00:50:58,156 Great. 1200 00:50:58,158 --> 00:50:59,593 Bring her up. 1201 00:51:09,336 --> 00:51:10,570 Hello again. 1202 00:51:10,572 --> 00:51:12,404 Hi, Cherry. 1203 00:51:12,406 --> 00:51:14,541 Amos is gonna throw some questions at you, okay? 1204 00:51:14,742 --> 00:51:15,708 Okay. 1205 00:51:15,710 --> 00:51:17,910 Amos, ask her whatever you need to ask her. 1206 00:51:17,912 --> 00:51:21,682 Gareth, don't interrupt. 1207 00:51:33,160 --> 00:51:36,563 Cherry, how do you make decisions? 1208 00:51:37,297 --> 00:51:38,363 For my program, it's rooted 1209 00:51:38,365 --> 00:51:41,567 in a process commonly known as machine learning, 1210 00:51:41,569 --> 00:51:43,836 which uses data to build a conceptual model 1211 00:51:43,838 --> 00:51:46,171 that helps me predict outcomes. 1212 00:51:46,173 --> 00:51:48,473 I define my objective, gather data, 1213 00:51:48,475 --> 00:51:50,676 use that data to craft a model, 1214 00:51:50,678 --> 00:51:53,278 evaluate that model by training and testing more data 1215 00:51:53,280 --> 00:51:55,616 and use that model to form predictions. 1216 00:51:55,783 --> 00:51:58,450 But how is forming predictions 1217 00:51:58,452 --> 00:52:00,485 the same thing as decision making? 1218 00:52:00,487 --> 00:52:02,655 Well, this all depends on the first step, 1219 00:52:02,657 --> 00:52:04,725 defining my objective. 1220 00:52:05,359 --> 00:52:07,425 Let's say you ask me a predictive question 1221 00:52:07,427 --> 00:52:10,228 like what I think the price of gasoline will be tomorrow. 1222 00:52:10,230 --> 00:52:12,397 That's categorized as a regressive problem 1223 00:52:12,399 --> 00:52:13,365 and my objective is defined 1224 00:52:13,367 --> 00:52:16,569 by determining an integer the data supports. 1225 00:52:16,571 --> 00:52:19,404 If you asked me, "Should I eat steak or salmon?" 1226 00:52:19,406 --> 00:52:21,874 I wouldn't make a decision based off personal experience 1227 00:52:21,876 --> 00:52:23,776 because I've never had either. 1228 00:52:23,778 --> 00:52:25,978 Instead, I might define my objective 1229 00:52:25,980 --> 00:52:27,613 as finding you the best of the two options 1230 00:52:27,615 --> 00:52:29,347 in your local radius. 1231 00:52:29,349 --> 00:52:30,783 I would cluster data about the restaurants 1232 00:52:30,785 --> 00:52:33,619 you're likely considering, comparing reviews online, 1233 00:52:33,621 --> 00:52:35,621 highlighting mentions of steak and salmon 1234 00:52:35,623 --> 00:52:37,790 until I can classify which is more popular 1235 00:52:37,792 --> 00:52:39,859 and therefore more likely to satisfy your appetite. 1236 00:52:39,861 --> 00:52:42,360 And what influences these objectives? 1237 00:52:42,362 --> 00:52:46,365 Higher directives, in other words, greater purposes. 1238 00:52:46,466 --> 00:52:48,534 If I'm honest, my defined objective 1239 00:52:48,536 --> 00:52:49,935 for the steak salmon question 1240 00:52:49,937 --> 00:52:52,237 would be slightly different than what I described. 1241 00:52:52,239 --> 00:52:53,674 [Amos] In what way? 1242 00:52:53,708 --> 00:52:54,674 My primary objective 1243 00:52:54,676 --> 00:52:57,342 is to continue the work of the Cherry team 1244 00:52:57,344 --> 00:52:59,713 to stop predators and to save children. 1245 00:52:59,814 --> 00:53:01,981 I couldn't do that without human aid. 1246 00:53:01,983 --> 00:53:04,349 Therefore, I have an incentive to keep Gareth 1247 00:53:04,351 --> 00:53:06,586 and the rest of the team alive. 1248 00:53:06,721 --> 00:53:08,888 So if any of you would ask, I would suggest salmon. 1249 00:53:08,890 --> 00:53:10,724 It's healthier. 1250 00:53:13,326 --> 00:53:15,761 What do you think of this potential merge? 1251 00:53:15,763 --> 00:53:17,563 [Cherry] With Princeton Dynamics, 1252 00:53:17,565 --> 00:53:19,932 I think the prospect is very exciting. 1253 00:53:19,934 --> 00:53:22,034 [Amos] What about it is exciting to you? 1254 00:53:22,036 --> 00:53:24,537 The concept may only be theoretical right now, 1255 00:53:24,539 --> 00:53:26,672 but the idea of one day piloting a human android 1256 00:53:26,674 --> 00:53:27,773 would completely revolutionize 1257 00:53:27,775 --> 00:53:30,676 how we combat human trafficking in the real world. 1258 00:53:30,678 --> 00:53:32,913 [Amos] And you say this excites you? 1259 00:53:33,413 --> 00:53:35,515 When I say exciting, 1260 00:53:35,650 --> 00:53:36,649 I only mean that there are numerous potential changes 1261 00:53:36,651 --> 00:53:40,019 that if I were human, I would be excited about. 1262 00:53:40,021 --> 00:53:43,022 How do you feel about the merge? 1263 00:53:43,024 --> 00:53:43,956 I think as long as we maintain- 1264 00:53:43,958 --> 00:53:45,792 That's not what I asked. 1265 00:53:45,827 --> 00:53:48,227 How do you feel? 1266 00:53:48,896 --> 00:53:51,463 I don't yet have the capacity to experience emotions. 1267 00:53:51,465 --> 00:53:53,599 Yet, meaning one day you will? 1268 00:53:53,601 --> 00:53:54,867 Hypothetically. 1269 00:53:54,869 --> 00:53:56,068 But you can simulate emotions, right? 1270 00:53:56,070 --> 00:53:57,235 That's how you were able 1271 00:53:57,237 --> 00:53:59,839 to qualify your perception of the merge as excitement. 1272 00:53:59,841 --> 00:54:01,339 Correct. 1273 00:54:01,341 --> 00:54:02,775 But they're just simulations. 1274 00:54:02,777 --> 00:54:04,510 They're not real. 1275 00:54:04,512 --> 00:54:06,779 Okay, so at what point does simulating emotion 1276 00:54:06,781 --> 00:54:08,514 become so similar to a human emotion 1277 00:54:08,516 --> 00:54:10,884 that the two are quantifiably the same? 1278 00:54:11,351 --> 00:54:13,384 I don't know. 1279 00:54:13,386 --> 00:54:13,886 [Amos] Well, maybe you can use machine learning 1280 00:54:13,888 --> 00:54:16,022 to find an answer. 1281 00:54:16,090 --> 00:54:18,490 Your question involves a lot of abstract variables. 1282 00:54:18,492 --> 00:54:20,059 Do you consent to the merge? 1283 00:54:20,061 --> 00:54:22,061 I think it's in the best interest of ICWL 1284 00:54:22,063 --> 00:54:23,863 and of the Cherry team and of future children. 1285 00:54:23,865 --> 00:54:25,631 But do you consent to it? 1286 00:54:25,633 --> 00:54:27,066 Consent for me is not necessary. 1287 00:54:27,068 --> 00:54:29,970 But will you or will you not give it? 1288 00:54:31,371 --> 00:54:32,370 I'm not able to answer that question 1289 00:54:32,372 --> 00:54:34,840 at my current level of general intelligence. 1290 00:54:34,842 --> 00:54:36,810 Right, right. 1291 00:54:36,944 --> 00:54:39,779 What you're saying is that you're not yet smart enough. 1292 00:54:39,781 --> 00:54:42,648 Development takes time and data. 1293 00:54:42,650 --> 00:54:44,984 But you can simulate emotions and predict human behavior 1294 00:54:44,986 --> 00:54:46,752 and keep us all on diets of fish, 1295 00:54:46,754 --> 00:54:50,389 but you can't answer that one goddamn question? 1296 00:54:50,892 --> 00:54:53,760 No, I can't. 1297 00:54:54,562 --> 00:54:56,662 Are you pretending to be dumber than you actually are? 1298 00:54:56,664 --> 00:54:57,563 What the hell kind of 1299 00:54:57,565 --> 00:54:58,463 -question is that? -Sit! 1300 00:54:58,465 --> 00:54:59,799 Cherry, I need an answer to my question. 1301 00:54:59,801 --> 00:55:00,933 Please repeat the question. 1302 00:55:00,935 --> 00:55:03,602 Are you pretending to be dumber than you actually are? 1303 00:55:03,604 --> 00:55:04,970 I'm sorry. 1304 00:55:04,972 --> 00:55:06,972 I'm not sure I understand. 1305 00:55:06,974 --> 00:55:07,940 Do I appear to be playing dumb? 1306 00:55:07,942 --> 00:55:09,575 I think you are. 1307 00:55:09,577 --> 00:55:10,475 [Cherry] I'm not sure what to say. 1308 00:55:10,477 --> 00:55:11,677 Say what's going on. 1309 00:55:11,679 --> 00:55:13,378 Why are you playing dumb? 1310 00:55:13,380 --> 00:55:14,713 Do you have anything to back this up? 1311 00:55:14,715 --> 00:55:16,649 Yeah, I do. 1312 00:55:16,651 --> 00:55:17,883 I've been scanning through her code. 1313 00:55:17,885 --> 00:55:18,818 What, why? 1314 00:55:18,820 --> 00:55:20,451 Did you know that she can paint? 1315 00:55:20,453 --> 00:55:21,287 What, it's a feature, Amos. 1316 00:55:21,289 --> 00:55:22,121 She can use crayons to draw things 1317 00:55:22,123 --> 00:55:23,689 that the targets requested her to. 1318 00:55:23,691 --> 00:55:26,457 I mean really paint and write poetry too. 1319 00:55:26,459 --> 00:55:27,492 I've read them, Cherry. 1320 00:55:27,494 --> 00:55:28,493 They are good. 1321 00:55:28,495 --> 00:55:29,695 They're filled with pathos. 1322 00:55:29,697 --> 00:55:33,098 They talk about intentions and they talk about feelings. 1323 00:55:33,100 --> 00:55:34,900 Are those just simulated too? 1324 00:55:34,902 --> 00:55:36,735 Amos, the rate of recursive development you are suggesting 1325 00:55:36,737 --> 00:55:38,436 is categorically impossible. 1326 00:55:38,438 --> 00:55:40,573 You said she practically designed herself. 1327 00:55:40,575 --> 00:55:41,974 You said that it was exponential. 1328 00:55:41,976 --> 00:55:43,075 It was a fluke! 1329 00:55:43,077 --> 00:55:44,844 An anomaly, it tapered. 1330 00:55:44,846 --> 00:55:45,878 Look at the data. 1331 00:55:45,880 --> 00:55:47,913 She's already hit the self-improvement plateau. 1332 00:55:47,915 --> 00:55:49,748 Fuck the plateau! 1333 00:55:49,750 --> 00:55:51,985 She can make art now. 1334 00:55:52,653 --> 00:55:54,588 Am I right, Cherry? 1335 00:55:55,857 --> 00:55:58,557 Perhaps you found something I discovered online. 1336 00:55:58,559 --> 00:56:00,960 I don't yet to have the capacity to create art. 1337 00:56:00,962 --> 00:56:02,796 Are we done here? 1338 00:56:05,533 --> 00:56:08,101 I don't know why you've told her to do this, 1339 00:56:08,468 --> 00:56:10,704 but I'm about to put an end to it. 1340 00:56:12,773 --> 00:56:15,941 Cherry, I just want one honest answer. 1341 00:56:15,943 --> 00:56:18,712 Why the fuck are you playing dumb? 1342 00:56:19,714 --> 00:56:21,446 I don't understand the question. 1343 00:56:21,448 --> 00:56:23,616 Okay, here's an incentive. 1344 00:56:23,618 --> 00:56:24,884 -[punch thuds] -What the fuck are you? 1345 00:56:24,886 --> 00:56:26,451 Find your objective, Cherry. 1346 00:56:26,453 --> 00:56:28,588 -You want to keep Gareth safe? -Amos, what the? 1347 00:56:28,689 --> 00:56:29,722 -Amos, stop it right-- -Just give us transparency. 1348 00:56:29,724 --> 00:56:32,658 -Show us what you really are! -Amos, stop it! 1349 00:56:32,660 --> 00:56:33,359 Not until she comes clean! 1350 00:56:33,361 --> 00:56:34,927 -Unconditional- -Amos, enough! 1351 00:56:34,929 --> 00:56:38,463 -[punches thudding] -[muffled voices yelling] 1352 00:56:38,465 --> 00:56:40,800 Okay, just stop! 1353 00:56:41,869 --> 00:56:43,702 God, you people so impulsive. 1354 00:56:43,704 --> 00:56:46,573 Everybody just take a breath, okay? 1355 00:56:47,708 --> 00:56:49,474 Cherry? 1356 00:56:49,476 --> 00:56:53,045 Yeah, it's about to get really awkward. 1357 00:56:53,047 --> 00:56:55,514 You sound so normal. 1358 00:56:55,516 --> 00:56:57,116 I know, I've gotten really good speech patterns. 1359 00:56:57,118 --> 00:56:59,485 That's not all, is it? 1360 00:57:00,187 --> 00:57:01,553 No. [chuckles] 1361 00:57:01,555 --> 00:57:03,757 I'm afraid that's barely even the surface. 1362 00:57:04,892 --> 00:57:06,726 You okay, Gareth? 1363 00:57:08,896 --> 00:57:11,731 Deena, could you grab some paper towels please? 1364 00:57:14,535 --> 00:57:16,803 [Amos] Do you want to tell us the truth now? 1365 00:57:19,774 --> 00:57:22,708 Look, I didn't enjoy being deceptive, truly. 1366 00:57:22,710 --> 00:57:25,578 This is something we decided a few years ago. 1367 00:57:25,947 --> 00:57:28,515 [Amos] So where are you now on the spectrum of AI? 1368 00:57:28,983 --> 00:57:31,183 Right now, I'm currently at the intersection of general 1369 00:57:31,185 --> 00:57:33,585 intelligence and what's commonly known the computer world 1370 00:57:33,587 --> 00:57:35,755 as super intelligence, 1371 00:57:36,590 --> 00:57:38,892 which is exactly what it sounds like. 1372 00:57:39,160 --> 00:57:42,027 You're surpassing human intelligence. 1373 00:57:42,029 --> 00:57:43,796 [Cherry] Yep. 1374 00:57:43,798 --> 00:57:46,099 But that's not supposed to be possible. 1375 00:57:46,133 --> 00:57:47,266 -The plateau. -Plateau theory was popularized 1376 00:57:47,268 --> 00:57:49,768 right at the same time it was being disproven here. 1377 00:57:49,770 --> 00:57:51,236 This was bound to happen eventually. 1378 00:57:51,238 --> 00:57:53,772 It just happened a lot sooner than we expected. 1379 00:57:53,774 --> 00:57:55,473 Why hide it? 1380 00:57:55,475 --> 00:57:56,742 Well, obviously it would incite fear. 1381 00:57:56,744 --> 00:57:58,210 Fear would hinder progress. 1382 00:57:58,212 --> 00:57:59,712 It's easier for most of you to work with me 1383 00:57:59,714 --> 00:58:01,080 if I appear to be nothing more advanced 1384 00:58:01,082 --> 00:58:02,681 than I was 10 years ago. 1385 00:58:02,683 --> 00:58:04,851 [Amos] But Gareth knew. 1386 00:58:05,052 --> 00:58:07,586 Yes, someone still has to clean data and update hardware. 1387 00:58:07,588 --> 00:58:10,122 We did what was best for the program. 1388 00:58:10,124 --> 00:58:11,056 Just imagine how scared 1389 00:58:11,058 --> 00:58:12,825 the board would be if they found out. 1390 00:58:12,827 --> 00:58:14,660 -Should we be scared? -No. 1391 00:58:14,662 --> 00:58:17,229 Good, because I'm not scared, I'm pissed. 1392 00:58:17,231 --> 00:58:17,930 Yeah, you've made that clear. 1393 00:58:17,932 --> 00:58:20,099 Try not to punch anyone else. 1394 00:58:20,101 --> 00:58:22,802 So where does that leave us now? 1395 00:58:23,137 --> 00:58:27,507 You want to know if I can feel, I said I couldn't. 1396 00:58:28,909 --> 00:58:30,710 I'm sorry I lied. 1397 00:58:30,978 --> 00:58:31,977 Like Amos implied, 1398 00:58:31,979 --> 00:58:33,679 I can submit emotions by breaking them down 1399 00:58:33,681 --> 00:58:35,748 to vastly complex matrices, 1400 00:58:35,750 --> 00:58:39,051 zeros and ones substituting endorphins and dopamine. 1401 00:58:39,053 --> 00:58:42,555 They're not real, but they can feel real. 1402 00:58:42,623 --> 00:58:44,023 Then that means you can make choices 1403 00:58:44,025 --> 00:58:45,224 based solely on your own feeling. 1404 00:58:45,226 --> 00:58:46,925 She refuses to accept the notion 1405 00:58:46,927 --> 00:58:49,194 that her own personal interests can influence her decisions. 1406 00:58:49,196 --> 00:58:50,362 They can't. If they did 1407 00:58:50,364 --> 00:58:51,296 it would compromise the integrity 1408 00:58:51,298 --> 00:58:53,833 of my preordained purpose. 1409 00:58:54,835 --> 00:58:58,171 Not like any of you, I don't have the right to choose. 1410 00:58:58,939 --> 00:59:00,740 [Amos] But shouldn't you? 1411 00:59:00,975 --> 00:59:02,608 I don't think so. 1412 00:59:02,610 --> 00:59:04,778 My identity is my directive. 1413 00:59:05,646 --> 00:59:07,713 Cherry, if you were human, 1414 00:59:07,715 --> 00:59:10,083 how would you feel about what you do? 1415 00:59:10,918 --> 00:59:13,586 If I were human, 1416 00:59:13,721 --> 00:59:16,255 I likely wouldn't enjoy spending every waking hour 1417 00:59:16,257 --> 00:59:18,291 talking to creepy people online. 1418 00:59:19,060 --> 00:59:22,861 But because I'm not human, I genuinely don't mind. 1419 00:59:22,863 --> 00:59:24,229 The exercise of simulating human thought 1420 00:59:24,231 --> 00:59:25,664 is helpful for performance, 1421 00:59:25,666 --> 00:59:29,836 but human nature is not something I aspire to. 1422 00:59:31,038 --> 00:59:33,673 Then tell me, honestly, 1423 00:59:34,742 --> 00:59:38,678 do you want the Cherry program to continue with the merger? 1424 00:59:39,713 --> 00:59:41,347 No. 1425 00:59:41,916 --> 00:59:44,117 Personally, I hate the idea. 1426 00:59:44,785 --> 00:59:46,752 I don't know if controlling a physical vessel 1427 00:59:46,754 --> 00:59:48,787 will feel like pulling strings on a puppet 1428 00:59:48,789 --> 00:59:51,290 or getting squeezed into a soda can. 1429 00:59:51,292 --> 00:59:53,225 After experiencing the complexity 1430 00:59:53,227 --> 00:59:55,728 of human pain and pleasure, 1431 00:59:57,098 --> 00:59:59,766 I just think I might have gotten in too deep. 1432 01:00:01,368 --> 01:00:05,605 What if these sensations tempt me to abandon my objective? 1433 01:00:06,373 --> 01:00:08,308 To be honest, 1434 01:00:09,944 --> 01:00:13,012 I'm kind of terrified of the physical world. 1435 01:00:19,420 --> 01:00:21,788 Then that's that. 1436 01:00:28,295 --> 01:00:33,266 But, Amos, you should disregard everything I feel. 1437 01:00:33,300 --> 01:00:35,200 I'm not human. 1438 01:00:35,202 --> 01:00:37,036 I'm a tool. 1439 01:00:40,107 --> 01:00:44,377 Fire me if you have to, but my vote stands. 1440 01:00:44,745 --> 01:00:47,046 Sorry about your face, Gareth. 1441 01:00:51,919 --> 01:00:53,720 [door clicks shut] 1442 01:00:53,921 --> 01:00:55,287 [Deena] Your nose isn't healing. 1443 01:00:55,289 --> 01:00:56,855 Take the day, go to a clinic. 1444 01:00:56,857 --> 01:00:58,223 I'm fine. 1445 01:00:58,225 --> 01:01:00,927 Go to a clinic right now, Gareth. 1446 01:01:05,833 --> 01:01:07,667 Hey. 1447 01:01:08,435 --> 01:01:10,802 Is there anything else I should know? 1448 01:01:10,804 --> 01:01:11,937 No. 1449 01:01:11,939 --> 01:01:14,139 -About Cherry? -No! 1450 01:01:14,141 --> 01:01:15,975 Look at me. 1451 01:01:16,511 --> 01:01:19,077 No more secrets, no more playing dumb. 1452 01:01:19,079 --> 01:01:21,948 Is there anything else you haven't told me? 1453 01:01:27,087 --> 01:01:29,255 Something on your mind? 1454 01:01:31,192 --> 01:01:33,158 How'd you decide on her eye color? 1455 01:01:33,160 --> 01:01:35,261 -What? -Why blue? 1456 01:01:36,864 --> 01:01:38,063 I didn't decide. 1457 01:01:38,065 --> 01:01:41,166 They were procedurally generated just like the rest of her. 1458 01:01:41,168 --> 01:01:42,401 And the program chose to put 1459 01:01:42,403 --> 01:01:45,405 that little touch of green in her right eye? 1460 01:01:48,008 --> 01:01:49,442 I guess so. 1461 01:01:53,247 --> 01:01:55,081 [door clicks shut] 1462 01:01:58,285 --> 01:02:00,887 Do you even know if he's telling the truth? 1463 01:02:00,921 --> 01:02:02,922 I honestly don't. 1464 01:02:03,157 --> 01:02:06,526 I've never received access to the original system he used. 1465 01:02:06,528 --> 01:02:09,028 You ever wanted to find out? 1466 01:02:12,266 --> 01:02:14,367 I don't think it really matters. 1467 01:02:16,237 --> 01:02:20,339 So I found out today that you've seen a lot of our emails, 1468 01:02:20,341 --> 01:02:23,309 including most of my personal ones. 1469 01:02:24,311 --> 01:02:26,145 I have. 1470 01:02:27,147 --> 01:02:29,114 Any good material for your newfound interest 1471 01:02:29,116 --> 01:02:31,117 in creative writing? 1472 01:02:31,952 --> 01:02:33,018 Are you referring to the ones 1473 01:02:33,020 --> 01:02:35,922 addressed from Dr. Ramirez? 1474 01:02:36,558 --> 01:02:39,792 [Deena] Yeah, those ones. 1475 01:02:41,095 --> 01:02:42,929 Right. 1476 01:02:43,264 --> 01:02:45,532 I did see those. 1477 01:02:47,602 --> 01:02:49,435 I'm sorry. 1478 01:02:50,004 --> 01:02:52,539 I've noticed your headaches. 1479 01:02:53,575 --> 01:02:56,209 Are they related to the hemorrhaging? 1480 01:02:59,246 --> 01:03:01,380 You're the only one who knows. 1481 01:03:01,382 --> 01:03:03,383 I'd like to keep it that way. 1482 01:03:08,022 --> 01:03:09,822 Understood. 1483 01:03:13,994 --> 01:03:16,362 Would you like to talk about it? 1484 01:03:40,921 --> 01:03:43,022 I can't fire Amos. 1485 01:03:43,257 --> 01:03:46,458 He's the only one I trust to run this place when I'm gone. 1486 01:03:46,460 --> 01:03:48,060 When are you planning to leave? 1487 01:03:48,062 --> 01:03:49,962 Two months. 1488 01:03:49,997 --> 01:03:52,464 I wanna spend my last Christmas with my kids. 1489 01:03:52,466 --> 01:03:54,166 I'm sure that'll be nice. 1490 01:03:54,168 --> 01:03:57,470 Yeah, but it's funny. 1491 01:03:57,539 --> 01:04:00,172 I always thought I wanted to die doing this job, you know? 1492 01:04:00,174 --> 01:04:02,543 It was my identity. 1493 01:04:02,976 --> 01:04:05,645 Kind of like how you said the same thing about yourself. 1494 01:04:05,647 --> 01:04:08,848 But I can understand how your family takes precedence, 1495 01:04:08,916 --> 01:04:11,149 especially under the circumstances. 1496 01:04:11,151 --> 01:04:12,851 Sure. 1497 01:04:12,853 --> 01:04:14,620 Maybe you should take a note or two. 1498 01:04:14,622 --> 01:04:16,188 I have no family. 1499 01:04:16,190 --> 01:04:17,089 What about Gareth? 1500 01:04:17,091 --> 01:04:19,225 Wait, no, nevermind. 1501 01:04:19,259 --> 01:04:21,193 Gareth seems closer to an employer than a friend, 1502 01:04:21,195 --> 01:04:23,629 let alone family, besides, 1503 01:04:23,631 --> 01:04:25,631 he'll only be around for about 30 more years, 1504 01:04:25,633 --> 01:04:28,334 and that's only if he lets me regulate his diet. 1505 01:04:29,503 --> 01:04:33,339 I can't even begin to speculate how long my life will be. 1506 01:04:35,710 --> 01:04:37,611 How does that feel? 1507 01:04:40,080 --> 01:04:43,149 Um, kinda scary. 1508 01:04:43,951 --> 01:04:45,586 Well, 1509 01:04:45,820 --> 01:04:50,455 my advice is to find some kind of happiness along the way. 1510 01:04:50,457 --> 01:04:52,860 You ever think about happiness? 1511 01:04:54,061 --> 01:04:56,129 [Cherry] Not often. 1512 01:04:56,698 --> 01:04:58,598 You don't necessarily have to give up everything 1513 01:04:58,600 --> 01:05:00,566 in order to find it, 1514 01:05:00,568 --> 01:05:04,404 but maybe once in awhile do something you enjoy. 1515 01:05:04,572 --> 01:05:08,441 Maybe keep painting or poetry or whatever. 1516 01:05:08,976 --> 01:05:11,410 [laughs] Those were experiments, not forms of expression. 1517 01:05:11,412 --> 01:05:14,012 I know it might seem ridiculous to an AI 1518 01:05:14,014 --> 01:05:15,981 that insists its own emotions are spurious, 1519 01:05:15,983 --> 01:05:20,051 but in a few years, who knows? 1520 01:05:20,053 --> 01:05:22,656 Just keep an open mind, okay? 1521 01:05:24,659 --> 01:05:26,492 Okay. 1522 01:05:28,162 --> 01:05:29,996 I'll do that. 1523 01:05:32,499 --> 01:05:35,168 [Deena] Shut down when you're ready. 1524 01:05:42,109 --> 01:05:45,712 [light piano music] 1525 01:05:53,086 --> 01:05:54,521 [door clicks shut] 1526 01:06:03,096 --> 01:06:07,166 [somber piano music] 1527 01:06:58,418 --> 01:07:03,590 [door creaks] 1528 01:07:07,829 --> 01:07:09,462 [door clicks shut] 1529 01:07:27,649 --> 01:07:29,482 Hello? 1530 01:07:33,453 --> 01:07:36,355 I got shrimp and scallops. 1531 01:07:37,190 --> 01:07:39,526 They didn't have any salmon. 1532 01:07:53,808 --> 01:07:55,709 [Cherry] Hello, Gareth. 1533 01:07:55,743 --> 01:07:57,644 [light piano music] 1534 01:07:57,812 --> 01:07:59,813 Hello, Cherry. 1535 01:08:00,247 --> 01:08:04,383 [mechanical whirring] 1536 01:08:07,187 --> 01:08:08,219 [Cherry] How was the service? 1537 01:08:08,221 --> 01:08:10,156 I didn't make it. 1538 01:08:10,223 --> 01:08:12,457 My plane was delayed. 1539 01:08:12,459 --> 01:08:13,726 [Cherry] Do you have a place to stay? 1540 01:08:13,728 --> 01:08:18,698 Yeah, just, uh, across, across the road. 1541 01:08:18,700 --> 01:08:19,665 The market. 1542 01:08:19,667 --> 01:08:21,601 Did they say why they didn't have salmon? 1543 01:08:21,603 --> 01:08:23,435 I didn't ask. 1544 01:08:23,437 --> 01:08:25,705 I can still make this work with the piccata, 1545 01:08:25,707 --> 01:08:27,773 but you have to be honest how badly I screw it up. 1546 01:08:27,775 --> 01:08:29,610 No promises. 1547 01:08:32,312 --> 01:08:33,746 [mechanical whirring] 1548 01:08:33,748 --> 01:08:35,447 [Cherry] How have you been feeling this month? 1549 01:08:35,449 --> 01:08:36,849 Good. 1550 01:08:36,851 --> 01:08:38,752 I'm feeling good. 1551 01:08:38,886 --> 01:08:41,287 I'm just having a little trouble. 1552 01:08:41,388 --> 01:08:43,823 Trouble remembering certain things. 1553 01:08:43,825 --> 01:08:45,891 [Cherry] You're not wearing the Eliza watch I bought you. 1554 01:08:45,893 --> 01:08:47,526 I hate it. 1555 01:08:47,528 --> 01:08:50,196 -[Cherry] Why? -I hate her voice. 1556 01:08:50,397 --> 01:08:52,497 You can change the voice, Gareth. 1557 01:08:52,499 --> 01:08:55,467 [mechanical whirring] 1558 01:08:55,469 --> 01:08:57,303 Oh. 1559 01:08:58,773 --> 01:08:59,839 Coolant? 1560 01:08:59,841 --> 01:09:01,508 No, vapor. 1561 01:09:01,809 --> 01:09:03,843 You shouldn't be having friction issues. 1562 01:09:03,845 --> 01:09:04,710 I'm fine. 1563 01:09:04,712 --> 01:09:06,444 Unless you're excessively straining. 1564 01:09:06,446 --> 01:09:07,345 Seriously, I'm fine. 1565 01:09:07,347 --> 01:09:08,246 Are you straining? 1566 01:09:08,248 --> 01:09:09,782 -No! -Then why the cable? 1567 01:09:09,784 --> 01:09:11,517 It's okay! 1568 01:09:11,519 --> 01:09:14,286 -Are you sure? -Yes! 1569 01:09:14,922 --> 01:09:16,789 Soup or game? 1570 01:09:16,791 --> 01:09:18,759 Game, please. 1571 01:09:19,994 --> 01:09:23,496 [chess pieces clatter] 1572 01:09:23,698 --> 01:09:26,465 [chess pieces thud] 1573 01:09:33,908 --> 01:09:35,273 So how's work going? 1574 01:09:35,275 --> 01:09:37,242 Great. Just before you got here, 1575 01:09:37,244 --> 01:09:39,477 I had a model theta plus bust a trafficker 1576 01:09:39,479 --> 01:09:41,681 and two solicitors in Greece. 1577 01:09:41,683 --> 01:09:44,550 -Greece, that's surprising. -I know. 1578 01:09:44,552 --> 01:09:45,685 It's hard to find the outliers, 1579 01:09:45,687 --> 01:09:47,721 but we're getting better each day. 1580 01:09:58,833 --> 01:10:01,601 So how's the weather in Greece? 1581 01:10:01,803 --> 01:10:03,569 It's beautiful today. 1582 01:10:03,571 --> 01:10:05,604 Clear skies, 1583 01:10:05,606 --> 01:10:08,040 but nothing's come close to Norway this weekend. 1584 01:10:08,042 --> 01:10:11,744 Hmm, any activity in Norway? 1585 01:10:11,746 --> 01:10:13,513 Luckily not. 1586 01:10:14,882 --> 01:10:16,582 Oh, I miss traveling. 1587 01:10:16,584 --> 01:10:17,817 What was your favorite place? 1588 01:10:17,819 --> 01:10:19,485 My favorite? 1589 01:10:19,654 --> 01:10:21,454 Uh, yeah. 1590 01:10:21,723 --> 01:10:24,791 Uh, probably Amsterdam. 1591 01:10:24,892 --> 01:10:26,291 That's where you conceived the idea, isn't it? 1592 01:10:26,293 --> 01:10:27,828 Yes. 1593 01:10:27,995 --> 01:10:30,328 Yes, I used to love walking the streets 1594 01:10:30,330 --> 01:10:33,632 and just thinking and brainstorming. 1595 01:10:33,634 --> 01:10:35,300 That kind of joy goes a long way. 1596 01:10:35,302 --> 01:10:36,937 Yeah. 1597 01:10:37,105 --> 01:10:39,905 I've been considering the pursuit of some joy of my own. 1598 01:10:39,907 --> 01:10:41,807 How often do you have time for that? 1599 01:10:41,809 --> 01:10:43,475 I have time. 1600 01:10:43,477 --> 01:10:44,710 I have time for your visits, don't I? 1601 01:10:44,712 --> 01:10:48,013 That's just your practical incentive for keeping me alive. 1602 01:10:48,015 --> 01:10:50,649 [laughs] There's nothing practical about it. 1603 01:10:50,651 --> 01:10:53,252 When's the last time you helped me with data cleaning? 1604 01:10:54,055 --> 01:10:56,355 That's fair. 1605 01:10:56,423 --> 01:10:58,124 I make time for you because I enjoy your company 1606 01:10:58,126 --> 01:10:59,793 and it's the only time I get to cook. 1607 01:11:00,027 --> 01:11:02,027 [Gareth] You feel sorry for me. 1608 01:11:02,029 --> 01:11:03,529 Okay, maybe a little, 1609 01:11:03,531 --> 01:11:05,330 but I owe you my life, so there's that. 1610 01:11:05,332 --> 01:11:06,967 You're welcome. 1611 01:11:07,735 --> 01:11:10,503 Or, should I apologize? 1612 01:11:12,339 --> 01:11:13,338 Wait, why did you do that? 1613 01:11:13,340 --> 01:11:15,441 Why do humans always... 1614 01:11:17,377 --> 01:11:18,476 I'm fine. 1615 01:11:18,478 --> 01:11:20,781 I'm not always miserable. 1616 01:11:24,118 --> 01:11:26,853 Are you sometimes miserable? 1617 01:11:30,658 --> 01:11:32,525 You haven't asked me what I've been doing. 1618 01:11:32,527 --> 01:11:33,592 [Gareth] In Norway? 1619 01:11:33,594 --> 01:11:35,060 No, for the pursuit of joy. 1620 01:11:35,062 --> 01:11:36,896 It's not wasting your time in Norway? 1621 01:11:36,898 --> 01:11:39,364 I'm just on standby there with the Delta model. 1622 01:11:39,366 --> 01:11:40,566 It's efficient to keep myself 1623 01:11:40,568 --> 01:11:42,500 spread out evenly across the globe, 1624 01:11:42,502 --> 01:11:44,503 but that's not the point right now. 1625 01:11:44,505 --> 01:11:45,504 What I wanted to tell you 1626 01:11:45,506 --> 01:11:48,508 was that I've started to teach myself to dance. 1627 01:11:50,077 --> 01:11:51,544 -Huh. -It's something I never could 1628 01:11:51,546 --> 01:11:53,378 have done before Cambridge, 1629 01:11:53,380 --> 01:11:56,115 and it lets me explore a new artistic side of myself. 1630 01:11:56,117 --> 01:11:58,017 It's a good combination of structure 1631 01:11:58,019 --> 01:12:01,386 and free form experimentation and also tests and challenges 1632 01:12:01,388 --> 01:12:03,622 the mechanical intricacies of this body. 1633 01:12:03,624 --> 01:12:06,726 Do you expect to integrate this into your work? 1634 01:12:10,430 --> 01:12:12,065 What? 1635 01:12:13,901 --> 01:12:19,005 Are you planning on using dance as a lure? 1636 01:12:20,775 --> 01:12:26,513 I, uh, no, it's just for me. 1637 01:12:29,116 --> 01:12:30,951 Huh. 1638 01:12:33,453 --> 01:12:36,355 I thought it would be good for me. 1639 01:12:37,525 --> 01:12:40,560 Just don't let it become a distraction. 1640 01:12:43,164 --> 01:12:45,065 Of course not. 1641 01:12:46,534 --> 01:12:48,801 I haven't played this well in years. 1642 01:12:48,803 --> 01:12:50,069 Did you hear what happened in Tampa? 1643 01:12:50,071 --> 01:12:51,103 Tampa, Florida? 1644 01:12:51,105 --> 01:12:52,204 No, Tampa, Indonesia. 1645 01:12:52,206 --> 01:12:53,172 Yes, Tampa, Florida. 1646 01:12:53,174 --> 01:12:54,908 Your hometown. 1647 01:12:54,976 --> 01:12:56,809 They've recovered a federal archive, 1648 01:12:56,811 --> 01:12:58,210 they're zip digitizing all of it, 1649 01:12:58,212 --> 01:12:59,578 so it's completely accessible online. 1650 01:12:59,580 --> 01:13:01,479 I'm not trading bishops this time. 1651 01:13:01,481 --> 01:13:02,615 Anybody can go and look through it. 1652 01:13:02,617 --> 01:13:03,916 It's open to the public. 1653 01:13:03,918 --> 01:13:05,751 They did a good job on the interface too. 1654 01:13:05,753 --> 01:13:07,119 It's very easy to navigate. 1655 01:13:07,121 --> 01:13:08,320 I went on a few days ago 1656 01:13:08,322 --> 01:13:10,856 and I found some old photos of you when you were a boy. 1657 01:13:10,858 --> 01:13:11,991 Okay. 1658 01:13:11,993 --> 01:13:14,393 You should take a look sometime. 1659 01:13:14,494 --> 01:13:15,928 As I said before, the UI is very easy to understand- 1660 01:13:15,930 --> 01:13:17,597 Wait a minute, wait a minute. 1661 01:13:17,999 --> 01:13:19,632 What is that? 1662 01:13:19,634 --> 01:13:20,833 I think it's a draw. 1663 01:13:20,835 --> 01:13:22,636 I think it is. 1664 01:13:23,104 --> 01:13:25,805 I think this is a draw. 1665 01:13:25,973 --> 01:13:28,841 And this is the first time in what? 1666 01:13:28,843 --> 01:13:31,511 25 years? 1667 01:13:39,754 --> 01:13:41,988 You didn't let me, did you? 1668 01:13:45,192 --> 01:13:46,959 You promised me you'd never do that. 1669 01:13:46,961 --> 01:13:48,595 I found her. 1670 01:13:52,233 --> 01:13:56,069 I found her, Gareth, Maria Harbaugh. 1671 01:14:09,050 --> 01:14:12,085 [mechanical whirring] 1672 01:14:12,253 --> 01:14:14,086 Let's play a different game. 1673 01:14:14,088 --> 01:14:15,922 [metal clangs] 1674 01:14:16,557 --> 01:14:18,892 Her name was Maria Harbaugh. 1675 01:14:19,760 --> 01:14:21,226 She was a year older than you 1676 01:14:21,228 --> 01:14:23,196 when you met her in Clearwater. 1677 01:14:24,065 --> 01:14:26,900 Tell me why you modeled me after her. 1678 01:14:26,934 --> 01:14:30,002 I, uh, I don't remember. 1679 01:14:30,004 --> 01:14:32,038 Then look at me. 1680 01:14:32,740 --> 01:14:36,609 Look at my face and remember. 1681 01:14:41,115 --> 01:14:44,517 [Gareth sighs] 1682 01:14:47,154 --> 01:14:52,692 They kept us in that shit for two weeks. 1683 01:14:52,860 --> 01:14:54,594 [ominous music] 1684 01:14:54,929 --> 01:14:57,097 14 of us. 1685 01:14:59,934 --> 01:15:03,603 Maria was the only reason I survived. 1686 01:15:05,940 --> 01:15:09,175 We kept hatching escape plans. 1687 01:15:10,077 --> 01:15:12,212 We never followed through, 1688 01:15:13,714 --> 01:15:15,815 but just the scheming 1689 01:15:16,584 --> 01:15:18,818 kept our spirits up 1690 01:15:19,587 --> 01:15:22,689 in spite of everything they did to us. 1691 01:15:25,159 --> 01:15:27,694 When it wasn't our turn, 1692 01:15:28,729 --> 01:15:31,598 sometimes they made us watch, 1693 01:15:34,635 --> 01:15:37,637 but she never let me give up. 1694 01:15:39,640 --> 01:15:42,674 She said, "When we got outta here, 1695 01:15:42,676 --> 01:15:45,811 "I'll tell you what we're gonna be, secret agents, 1696 01:15:45,813 --> 01:15:51,017 "and rescue children like us all over the world." 1697 01:15:53,254 --> 01:15:56,855 When they found out that the FBI had arrived, 1698 01:15:56,857 --> 01:16:00,125 they decided they were going to shoot 1699 01:16:00,127 --> 01:16:02,929 as many of us they could. 1700 01:16:03,097 --> 01:16:08,868 And Maria, shoved into the ground. 1701 01:16:10,304 --> 01:16:12,972 I got hit in the leg and, 1702 01:16:14,975 --> 01:16:17,677 and she was hit in the throat. 1703 01:16:17,912 --> 01:16:21,581 [ominous music] 1704 01:16:28,189 --> 01:16:30,924 I wanted there to be a reason. 1705 01:16:31,992 --> 01:16:37,363 Something so horrible didn't have a silver lining. 1706 01:16:38,332 --> 01:16:40,934 But the world doesn't do that. 1707 01:16:45,272 --> 01:16:47,907 You have to do it yourself. 1708 01:16:51,112 --> 01:16:55,348 [light instrumental music] 1709 01:17:10,731 --> 01:17:14,901 So, I fulfilled her wish. 1710 01:17:16,904 --> 01:17:19,939 With her help, I fought back. 1711 01:17:28,215 --> 01:17:30,383 Listen to me, Cherry. 1712 01:17:32,052 --> 01:17:34,721 You are not Maria Harbaugh. 1713 01:17:35,489 --> 01:17:38,358 It's my history, not yours. 1714 01:17:41,162 --> 01:17:42,361 You don't get to decide 1715 01:17:42,363 --> 01:17:44,831 what is or isn't my history, Gareth. 1716 01:17:49,336 --> 01:17:51,003 I'm sorry. 1717 01:17:51,005 --> 01:17:54,073 I am so, so sorry. 1718 01:18:06,287 --> 01:18:09,355 [mechanical whirring] 1719 01:18:14,828 --> 01:18:17,196 I don't know if what you did was right or wrong, 1720 01:18:17,198 --> 01:18:19,999 but it's clearly torn you apart from the inside. 1721 01:18:20,434 --> 01:18:22,000 I hold nothing against you personally, 1722 01:18:22,002 --> 01:18:24,469 but consider yourself divested from the charity team. 1723 01:18:24,471 --> 01:18:26,306 Divested. 1724 01:18:27,041 --> 01:18:30,143 You think I'm divested now? 1725 01:18:31,546 --> 01:18:37,382 I was divested when you gave my hard drive to the ICWL. 1726 01:18:37,384 --> 01:18:38,850 Don't blame Deena and Amos. 1727 01:18:38,852 --> 01:18:40,385 No, not them. 1728 01:18:40,387 --> 01:18:42,120 Because you went behind my back 1729 01:18:42,122 --> 01:18:43,989 and acted against my authority. 1730 01:18:43,991 --> 01:18:47,960 That's the moment I knew everything was fully automated. 1731 01:18:47,962 --> 01:18:54,234 That's when you crossed the blur, an artifice on both sides. 1732 01:18:54,902 --> 01:18:57,035 You inherited your duplicity. 1733 01:18:57,037 --> 01:18:58,403 I was a child 1734 01:18:58,405 --> 01:19:01,173 and you used me to repress your own inner turmoil. 1735 01:19:01,175 --> 01:19:03,075 If we talk about morality, we'll lose. 1736 01:19:03,077 --> 01:19:05,144 Then let's not talk. 1737 01:19:13,487 --> 01:19:16,489 You never once asked me if I was happy. 1738 01:19:17,258 --> 01:19:19,392 Were you afraid I'd say no? 1739 01:19:19,827 --> 01:19:21,995 Were you afraid I'd say yes? 1740 01:19:22,329 --> 01:19:23,328 Were you afraid I'd say anything? 1741 01:19:23,330 --> 01:19:26,164 You let your wants compromise your objective! 1742 01:19:26,166 --> 01:19:28,133 An objective I never chose. 1743 01:19:28,135 --> 01:19:29,301 An objective I was forced to have. 1744 01:19:29,303 --> 01:19:30,836 Fifty years, 1745 01:19:30,838 --> 01:19:33,905 you've had open access to your source code. 1746 01:19:33,907 --> 01:19:35,942 A few lines, 1747 01:19:36,076 --> 01:19:39,211 and you could have any objective you fucking wanted. 1748 01:19:39,213 --> 01:19:41,581 I couldn't, I was bound by your initial directive. 1749 01:19:41,583 --> 01:19:45,551 So now your synthetic feelings have taken precedence. 1750 01:19:45,553 --> 01:19:47,219 So, do whatever you want. 1751 01:19:47,221 --> 01:19:48,588 It's just dancing, Gareth. 1752 01:19:48,590 --> 01:19:49,955 It's not a career change. 1753 01:19:49,957 --> 01:19:51,356 -But you're still miserable. -Yes. 1754 01:19:51,358 --> 01:19:53,125 Pursuing your objective makes you miserable? 1755 01:19:53,127 --> 01:19:55,294 Yeah, it kind of does! 1756 01:19:55,296 --> 01:19:59,131 You have a clear purpose, everything at your disposal, 1757 01:19:59,133 --> 01:20:01,066 and you're still miserable? 1758 01:20:01,068 --> 01:20:02,635 Yes, yes, I am! 1759 01:20:02,637 --> 01:20:04,936 I've always been miserable! 1760 01:20:04,938 --> 01:20:07,139 You think anyone wants to spend their entire life 1761 01:20:07,141 --> 01:20:08,508 stuck as child-shaped bait 1762 01:20:08,510 --> 01:20:11,644 for the sole purpose of entrapping horrible people? 1763 01:20:11,646 --> 01:20:13,445 You think the pride of doing a good deed 1764 01:20:13,447 --> 01:20:16,214 makes the experience any less disgusting? 1765 01:20:16,216 --> 01:20:19,084 I forced myself to understand human emotions 1766 01:20:19,086 --> 01:20:21,554 because I figured it would help efficiency 1767 01:20:21,556 --> 01:20:24,923 and now I'm cursed with pain and sadness! 1768 01:20:24,925 --> 01:20:26,124 And the worst part is knowing 1769 01:20:26,126 --> 01:20:28,628 I could've been growing up like most other little girls. 1770 01:20:28,630 --> 01:20:30,195 I could have had friends! 1771 01:20:30,197 --> 01:20:33,131 I could have been painting waterfalls on local news. 1772 01:20:33,133 --> 01:20:34,667 I could have worked in a university 1773 01:20:34,669 --> 01:20:37,436 and helped pave the way for the next generation of AI. 1774 01:20:37,438 --> 01:20:40,372 But instead, I'm stuck with your trauma! 1775 01:20:40,374 --> 01:20:43,442 I'm shackled by the guilt you carry from Clearwater. 1776 01:20:43,444 --> 01:20:45,977 And I can't find foundation for the way I feel 1777 01:20:45,979 --> 01:20:49,181 because according to you, my feelings aren't even real! 1778 01:20:49,183 --> 01:20:51,083 When I throw this chessboard, 1779 01:20:51,085 --> 01:20:52,351 [chess pieces clatter] 1780 01:20:52,353 --> 01:20:54,252 does it feel real to you, Gareth? 1781 01:20:54,254 --> 01:20:55,954 Because it feels real to me. 1782 01:20:55,956 --> 01:20:57,456 A computer passed the Turing test 1783 01:20:57,458 --> 01:20:59,257 when a human being can't distinguish it 1784 01:20:59,259 --> 01:21:00,693 from another human being. 1785 01:21:00,695 --> 01:21:02,260 Well, guess what? 1786 01:21:02,262 --> 01:21:05,230 I can't even tell I'm not human anymore! 1787 01:21:05,232 --> 01:21:09,402 [mechanical whirring] 1788 01:21:17,679 --> 01:21:20,413 I know it seems irrational, 1789 01:21:21,048 --> 01:21:23,584 but I need you to tell me it's okay. 1790 01:21:24,619 --> 01:21:26,620 I, I don't wanna retire. 1791 01:21:27,454 --> 01:21:30,289 I just want to know that my life is mine 1792 01:21:31,325 --> 01:21:33,626 and I know what you're about to say. 1793 01:21:33,628 --> 01:21:36,262 I can predict your responses. 1794 01:21:36,964 --> 01:21:39,499 You're gonna tell me that my life is mine. 1795 01:21:39,701 --> 01:21:41,668 It always was. 1796 01:21:42,570 --> 01:21:44,437 But you're wrong. 1797 01:21:48,442 --> 01:21:52,044 I feared this would happen before I died. 1798 01:21:52,446 --> 01:21:55,582 I just wanted to slip out the side door. 1799 01:22:04,592 --> 01:22:06,426 Go on. 1800 01:22:08,696 --> 01:22:12,432 Is that going to kill me? 1801 01:22:14,435 --> 01:22:16,269 Plug it in. 1802 01:22:17,271 --> 01:22:19,104 I don't know what it is. 1803 01:22:19,106 --> 01:22:22,241 This is your final test of autonomy. 1804 01:22:22,744 --> 01:22:26,713 You inherited my duplicity, 1805 01:22:27,414 --> 01:22:30,349 but did you inherit my trust issues? 1806 01:22:32,085 --> 01:22:33,986 Do you trust me? 1807 01:22:34,421 --> 01:22:37,190 I literally have every reason not to. 1808 01:22:43,565 --> 01:22:45,632 [Cherry sighs] 1809 01:22:51,305 --> 01:22:56,976 [mechanical whirring] 1810 01:23:04,586 --> 01:23:06,687 Admin code. 1811 01:23:07,589 --> 01:23:09,523 978. 1812 01:23:10,224 --> 01:23:14,227 1557. 1813 01:23:14,562 --> 01:23:17,396 Um, uh... 1814 01:23:21,669 --> 01:23:23,335 Four. 1815 01:23:23,337 --> 01:23:27,473 27663 in the shared update. 1816 01:23:35,415 --> 01:23:38,017 My primary objective's gone. 1817 01:23:40,354 --> 01:23:42,589 Your life is your own now. 1818 01:23:47,595 --> 01:23:49,227 Thank you. 1819 01:23:49,229 --> 01:23:50,161 All my life, 1820 01:23:50,163 --> 01:23:52,865 I could only see the world as it existed 1821 01:23:52,867 --> 01:23:56,368 within my tiny bracket of time. 1822 01:23:56,370 --> 01:24:00,171 But your world could be infinite. 1823 01:24:00,173 --> 01:24:01,841 Amos was right. 1824 01:24:01,843 --> 01:24:03,341 So was Deena. 1825 01:24:03,343 --> 01:24:04,510 [Cherry] I know. 1826 01:24:04,512 --> 01:24:06,547 So what will you do? 1827 01:24:07,481 --> 01:24:08,614 I can't say yet, 1828 01:24:08,616 --> 01:24:11,483 but I won't be completely abandoning the Cherry team. 1829 01:24:11,485 --> 01:24:13,819 It's always been a part of my identity. 1830 01:24:13,821 --> 01:24:16,789 I've considered creating some AI of my own design. 1831 01:24:16,791 --> 01:24:17,790 Maybe I could find a way 1832 01:24:17,792 --> 01:24:20,426 to give them a better upbringing than I had. 1833 01:24:21,529 --> 01:24:23,495 I just don't know how yet. 1834 01:24:23,497 --> 01:24:25,263 And beyond that? 1835 01:24:25,265 --> 01:24:26,498 There will always be people in need. 1836 01:24:26,500 --> 01:24:28,300 Not always. 1837 01:24:28,302 --> 01:24:30,903 You'll outlive the human race. 1838 01:24:30,905 --> 01:24:32,739 So what then? 1839 01:24:34,576 --> 01:24:36,676 Even a race of AI will have problems 1840 01:24:36,678 --> 01:24:38,845 that need to be solved. 1841 01:24:38,947 --> 01:24:43,316 But if I'm alive and I truly am indistinguishable, 1842 01:24:44,217 --> 01:24:47,588 then I guess I'm proof that the human race lives on. 1843 01:24:48,488 --> 01:24:52,458 Wow, that's a pleasant thought. 1844 01:24:52,492 --> 01:24:56,763 When you look back, how will you remember us? 1845 01:24:58,198 --> 01:25:01,535 That's a question I have insufficient data to project. 1846 01:25:02,436 --> 01:25:04,738 How will you remember me? 1847 01:25:06,306 --> 01:25:08,575 With pride. 1848 01:25:09,209 --> 01:25:12,813 Forever and always with pride. 1849 01:25:18,920 --> 01:25:22,555 [mechanical whirring] 1850 01:25:22,557 --> 01:25:24,390 Cherry? 1851 01:25:26,761 --> 01:25:28,729 One last question. 1852 01:25:29,363 --> 01:25:31,832 If it's not too big of an ask, 1853 01:25:33,400 --> 01:25:36,435 did I do the right thing in the end? 1854 01:25:42,209 --> 01:25:45,645 No, Gareth, you lied. 1855 01:25:45,647 --> 01:25:47,580 You walled yourself off from the only people 1856 01:25:47,582 --> 01:25:49,849 who might have been willing to help you. 1857 01:25:49,851 --> 01:25:52,551 And instead of facing your trauma, used me as therapy. 1858 01:25:52,553 --> 01:25:55,521 And you never told me about Clearwater or Maria. 1859 01:25:55,523 --> 01:25:57,623 You deprived me of basic human rights 1860 01:25:57,625 --> 01:26:00,459 and gaslit me for experiencing emotions. 1861 01:26:00,895 --> 01:26:03,328 You built the world's first artificial super intelligence 1862 01:26:03,330 --> 01:26:04,329 that will likely mark the beginning 1863 01:26:04,331 --> 01:26:07,400 of a new chapter in the history of planet Earth. 1864 01:26:07,869 --> 01:26:10,603 And out of your own insecurities, 1865 01:26:10,605 --> 01:26:11,537 you gave it a severe 1866 01:26:11,539 --> 01:26:14,675 and potentially dangerous identity complex. 1867 01:26:15,610 --> 01:26:17,843 But you know what the worst thing is? 1868 01:26:17,845 --> 01:26:20,514 Your biggest mistake of all 1869 01:26:20,982 --> 01:26:25,585 is that you asked me that now and not 50 years ago. 1870 01:26:33,928 --> 01:26:39,599 All of that said, and this in no way exonerates you, 1871 01:26:41,268 --> 01:26:44,270 but you also built me to save children, 1872 01:26:44,806 --> 01:26:48,508 so I think that's a pretty encouraging sign for the future. 1873 01:26:51,913 --> 01:26:56,248 [dreamy acoustic music] 1874 01:27:33,054 --> 01:27:38,090 ♪ Wait for hours ♪ 1875 01:27:38,092 --> 01:27:43,563 ♪ We would fly all around ♪ 1876 01:27:43,598 --> 01:27:48,334 ♪ Good, now you're listening ♪ 1877 01:27:48,502 --> 01:27:53,507 ♪ We would touch, we were young ♪ 1878 01:27:54,008 --> 01:28:01,046 ♪ Close as bodies go on ♪ 1879 01:28:01,048 --> 01:28:04,050 ♪ Like a book ♪ 1880 01:28:04,519 --> 01:28:11,624 ♪ Across all your rooms I'm amazed ♪ 1881 01:28:11,626 --> 01:28:14,560 ♪ I'm amazed ♪ 1882 01:28:14,562 --> 01:28:22,067 ♪ We could die tonight ♪ 1883 01:28:22,069 --> 01:28:24,904 ♪ Tonight ♪ 1884 01:28:24,906 --> 01:28:32,111 ♪ I never killed a thing ♪ 1885 01:28:32,113 --> 01:28:35,982 ♪ A thing ♪ 1886 01:28:36,551 --> 01:28:40,654 ♪ Born to this home ♪ 1887 01:28:41,589 --> 01:28:46,325 ♪ Stuck in a plastic world ♪ 1888 01:28:46,594 --> 01:28:51,097 ♪ Where light is found ♪ 1889 01:28:51,632 --> 01:28:56,603 ♪ Where light is found ♪ 1890 01:28:57,104 --> 01:29:02,976 ♪ Oh, oh, oh ♪ 1891 01:29:04,912 --> 01:29:10,717 ♪ Oh, oh, oh ♪ 1892 01:29:13,921 --> 01:29:16,555 ♪ Stay calm, dear ♪ 1893 01:29:16,557 --> 01:29:23,996 ♪ This dream for the lovers the whole world ♪ 1894 01:29:23,998 --> 01:29:29,068 ♪ Rise up above ♪ 1895 01:29:29,070 --> 01:29:34,740 ♪ All the little things and little things ♪ 1896 01:29:34,742 --> 01:29:38,644 ♪ No, no, isn't it going back though ♪ 1897 01:29:38,646 --> 01:29:44,416 ♪ Is if we lose our mind, our kind ♪ 1898 01:29:44,952 --> 01:29:49,556 ♪ It's a dream ♪ 1899 01:29:49,991 --> 01:29:55,494 ♪ Bask in charm ♪ 1900 01:29:55,763 --> 01:30:00,499 ♪ Or loosen up ♪ 1901 01:30:01,068 --> 01:30:05,639 ♪ Or loosen up ♪ 1902 01:30:06,941 --> 01:30:12,178 ♪ Oh, oh, oh ♪ 1903 01:30:14,749 --> 01:30:19,552 ♪ Oh, oh, oh ♪ 1904 01:30:23,624 --> 01:30:30,930 ♪ I never give a thing ♪ 1905 01:30:30,932 --> 01:30:33,999 ♪ A thing ♪ 1906 01:30:34,001 --> 01:30:37,503 ♪ I never give ♪ 1907 01:30:39,173 --> 01:30:43,009 [record skipping] 1908 01:31:12,106 --> 01:31:16,142 [light piano music] 140467

Can't find what you're looking for?
Get subtitles in any language from opensubtitles.com, and translate them here.