All language subtitles for ai_has_hacked_the_code_of_human_civilization_yuval_noah_harari

af Afrikaans
ak Akan
sq Albanian
am Amharic
ar Arabic
hy Armenian
az Azerbaijani
eu Basque
be Belarusian
bem Bemba
bn Bengali
bh Bihari
bs Bosnian
br Breton
bg Bulgarian
km Cambodian
ca Catalan
ceb Cebuano
chr Cherokee
ny Chichewa
zh-CN Chinese (Simplified)
zh-TW Chinese (Traditional)
co Corsican
hr Croatian
da Danish
nl Dutch
en English
eo Esperanto
et Estonian
ee Ewe
fo Faroese
tl Filipino
fi Finnish
fr French
fy Frisian
gaa Ga
gl Galician
ka Georgian
de German
el Greek
gn Guarani
gu Gujarati
ht Haitian Creole
ha Hausa
haw Hawaiian
iw Hebrew
hi Hindi
hmn Hmong
hu Hungarian
is Icelandic
ig Igbo
id Indonesian
ia Interlingua
ga Irish
it Italian
ja Japanese
jw Javanese
kn Kannada
kk Kazakh
rw Kinyarwanda
rn Kirundi
kg Kongo
ko Korean
kri Krio (Sierra Leone)
ku Kurdish
ckb Kurdish (Soranî)
ky Kyrgyz
lo Laothian
la Latin
lv Latvian
ln Lingala
lt Lithuanian
loz Lozi
lg Luganda
ach Luo
lb Luxembourgish
mk Macedonian
mg Malagasy
ms Malay
ml Malayalam
mt Maltese
mi Maori
mr Marathi
mfe Mauritian Creole
mo Moldavian
mn Mongolian
my Myanmar (Burmese)
sr-ME Montenegrin
ne Nepali
pcm Nigerian Pidgin
nso Northern Sotho
no Norwegian
nn Norwegian (Nynorsk)
oc Occitan
or Oriya
om Oromo
ps Pashto
fa Persian
pl Polish
pt-BR Portuguese (Brazil)
pt Portuguese (Portugal)
pa Punjabi
qu Quechua
ro Romanian
rm Romansh
nyn Runyakitara
ru Russian
sm Samoan
gd Scots Gaelic
sr Serbian
sh Serbo-Croatian
st Sesotho
tn Setswana
crs Seychellois Creole
sn Shona
sd Sindhi
si Sinhalese
sk Slovak
sl Slovenian
so Somali
es Spanish
es-419 Spanish (Latin American)
su Sundanese
sw Swahili
sv Swedish
tg Tajik
ta Tamil
tt Tatar
te Telugu
th Thai
ti Tigrinya
to Tonga
lua Tshiluba
tum Tumbuka
tr Turkish
tk Turkmen
tw Twi
ug Uighur
uk Ukrainian
ur Urdu
uz Uzbek
vi Vietnamese
cy Welsh
wo Wolof
xh Xhosa
yi Yiddish
yo Yoruba
zu Zulu
Would you like to inspect the original subtitles? These are the user uploaded subtitles that are being translated: 1 00:00:00,010 --> 00:00:04,050 Please join me in welcoming Professor Yuval Noah Harari. 2 00:00:06,170 --> 00:00:12,750 Thank you so much. 3 00:00:15,430 --> 00:00:16,430 Hello everyone. 4 00:00:16,670 --> 00:00:18,570 I hope I opened my mic. 5 00:00:19,330 --> 00:00:20,570 You can hear me okay. 6 00:00:21,350 --> 00:00:25,270 So it's really a great honor for me to give this year's TANEO lecture. 7 00:00:25,750 --> 00:00:28,050 And it's also a personal joy. 8 00:00:28,590 --> 00:00:29,850 to come back to Oxford. 9 00:00:30,090 --> 00:00:36,010 I did my DPhil here 25 years ago under the guidance of Dr. Stephen Gunn. 10 00:00:36,370 --> 00:00:42,650 Back then, I specialized in medieval and early modern military history. 11 00:00:43,370 --> 00:00:49,350 But today, I will not be talking about knights and castles and the gunpowder 12 00:00:49,350 --> 00:00:55,230 revolution. I'll talk about AI bureaucrats and religions and 13 00:00:55,230 --> 00:00:57,610 more generally, about the AI revolution. 14 00:00:58,670 --> 00:01:05,670 Now, the most important thing to know about AI is that AI is not a tool. 15 00:01:06,570 --> 00:01:08,450 It's not a tool in our hand. 16 00:01:08,790 --> 00:01:12,470 It is an agent with its own hand. 17 00:01:13,210 --> 00:01:15,090 What exactly is agency? 18 00:01:15,450 --> 00:01:17,990 How is an agent different from a tool? 19 00:01:18,690 --> 00:01:21,910 Agents have several distinguishing characteristics. 20 00:01:22,690 --> 00:01:24,950 They don't necessarily need consciousness. 21 00:01:25,210 --> 00:01:30,290 You don't need consciousness to be an agent. What you do need, is the ability 22 00:01:30,290 --> 00:01:37,270 make decisions by yourself, the ability to invent new things, new ideas 23 00:01:37,270 --> 00:01:38,270 by yourself. 24 00:01:38,790 --> 00:01:45,670 An agent should be able by itself to learn things that its creators 25 00:01:45,670 --> 00:01:52,390 don't know, and an agent should be able to change by itself 26 00:01:52,390 --> 00:01:56,330 in ways that its creators don't anticipate. 27 00:01:58,400 --> 00:02:03,540 An atom bomb, for instance, despite its enormous power, is not an agent. 28 00:02:03,820 --> 00:02:07,120 It cannot learn and change by itself. 29 00:02:07,440 --> 00:02:14,240 It cannot decide by itself which city to bomb. It cannot invent anything new, 30 00:02:14,340 --> 00:02:15,620 like the hydrogen bomb. 31 00:02:16,300 --> 00:02:23,100 Similarly, let's say an automatic coffee machine is not an agent, even though it 32 00:02:23,100 --> 00:02:27,000 does something by itself, automatically. 33 00:02:27,720 --> 00:02:32,960 You press a button, and the machine automatically makes you a cup of coffee. 34 00:02:33,260 --> 00:02:39,060 But the machine, the coffee machine, only follows a pre -programmed 35 00:02:39,580 --> 00:02:41,020 It doesn't change. 36 00:02:41,400 --> 00:02:44,840 It doesn't learn anything new. It doesn't create anything new. 37 00:02:45,440 --> 00:02:51,720 But suppose that as you approach the coffee machine, before you even press 38 00:02:51,720 --> 00:02:57,180 button, the machine announces, tells you, I've been monitoring you. 39 00:02:57,550 --> 00:03:02,270 for the last few weeks, and based on everything I've learned about you and 40 00:03:02,270 --> 00:03:07,910 people, and based on your facial expression and the time of day, I 41 00:03:07,910 --> 00:03:09,390 you would like an espresso. 42 00:03:09,730 --> 00:03:11,890 So I already made you a cup. 43 00:03:12,350 --> 00:03:14,770 Now that's an AI copy machine. 44 00:03:15,050 --> 00:03:19,470 It learned something by itself and decided something by itself. 45 00:03:19,790 --> 00:03:23,890 And it's really an AI if the following day... 46 00:03:24,090 --> 00:03:30,110 It announces, I have now invented a new drink called Bespresso, which I think 47 00:03:30,110 --> 00:03:33,870 you would like better than espresso, and he would try it out, I made you a cup. 48 00:03:34,750 --> 00:03:37,090 Then it's really an AI. 49 00:03:37,390 --> 00:03:42,590 It changed in ways that creators did not anticipate and invented something 50 00:03:42,590 --> 00:03:43,850 completely new. 51 00:03:44,730 --> 00:03:48,070 As far as I know, there are no coffee machines. 52 00:03:49,020 --> 00:03:52,880 at the present moment, maybe in anthropic headquarters or Google 53 00:03:53,400 --> 00:03:56,600 they have a few prototypes, but they are not out in the market yet. 54 00:03:57,000 --> 00:04:03,900 But in certain narrow fields, like playing Go or playing chess, AI 55 00:04:03,900 --> 00:04:10,760 agency and creativity already greatly surpass human agency and 56 00:04:10,760 --> 00:04:17,019 creativity. AI chess masters can decide, of course, by themselves which moves to 57 00:04:17,019 --> 00:04:23,900 make. they invent by themselves completely new strategies, how to play 58 00:04:23,900 --> 00:04:29,000 chess, that never occurred to human chess masters over thousands of years of 59 00:04:29,000 --> 00:04:30,000 playing the game. 60 00:04:30,320 --> 00:04:37,300 And while doing that, they learn and change in ways their human creators did 61 00:04:37,300 --> 00:04:38,580 necessarily predict. 62 00:04:39,020 --> 00:04:46,000 Today, of course, no human has any chance of beating an AI chess master. 63 00:04:47,080 --> 00:04:52,520 Now, people who downplay the importance of the AI revolution dismiss examples 64 00:04:52,520 --> 00:04:58,840 like chess by arguing that the chessboard is a very narrow and 65 00:04:58,840 --> 00:05:02,200 environment created by humans. 66 00:05:02,580 --> 00:05:09,360 The critics say that AI agency will always remain limited to 67 00:05:09,360 --> 00:05:14,380 such narrow and artificial environment, which means that it's not true agency. 68 00:05:15,080 --> 00:05:18,020 And it doesn't pose any serious challenge to humanity. 69 00:05:18,440 --> 00:05:23,500 Yes, AI may take over the chessboard, but it will never take over planet 70 00:05:24,260 --> 00:05:30,300 And indeed, if you do an experiment, if you take the greatest AI chess master 71 00:05:30,300 --> 00:05:35,460 and drop it in the middle of the jungle, what do you think will happen? 72 00:05:36,280 --> 00:05:42,460 The AI chess master will not be able to start mining iron and building factories 73 00:05:42,460 --> 00:05:44,500 and creating a robot army. 74 00:05:44,910 --> 00:05:45,930 to take over the world. 75 00:05:46,290 --> 00:05:49,770 In fact, it will not be able to do anything whatsoever. 76 00:05:50,370 --> 00:05:56,850 Without the electricity provided by power stations built by humans, 77 00:05:57,190 --> 00:06:00,010 the AI chess master is utterly helpless. 78 00:06:00,590 --> 00:06:07,030 Therefore, the argument goes, AIs are not true agents. They are confined to 79 00:06:07,030 --> 00:06:13,830 these narrow artificial niches that somebody else, humans, constructed for 80 00:06:15,790 --> 00:06:22,210 The problem is that this argument actually applies to all known types of 81 00:06:22,210 --> 00:06:28,410 intelligence. Human intelligence, too, operates only within a relatively narrow 82 00:06:28,410 --> 00:06:31,830 ecosystem that somebody else constructed. 83 00:06:32,230 --> 00:06:38,430 Drop me alone on Mars and it will be like dropping an AI chess master 84 00:06:38,430 --> 00:06:40,110 in the middle of the jungle. 85 00:06:40,350 --> 00:06:41,850 I will die within seconds. 86 00:06:42,540 --> 00:06:48,340 My intelligence can survive and operate only within the very, very specific 87 00:06:48,340 --> 00:06:55,260 ecosystem that trees, bacteria, insects, and other organisms have constructed 88 00:06:55,260 --> 00:06:58,900 on planet Earth during four billion years of evolution. 89 00:06:59,420 --> 00:07:04,920 And that's true of all agents. All agents we know of, at least, have their 90 00:07:04,920 --> 00:07:09,840 niches. Fish live in oceans that they didn't create. 91 00:07:10,220 --> 00:07:13,680 Monkeys live in forests that they didn't create. 92 00:07:13,900 --> 00:07:20,120 All mammals, including human beings, live in an oxygen -rich atmosphere that 93 00:07:20,120 --> 00:07:21,300 they didn't create. 94 00:07:21,780 --> 00:07:27,820 Until about 2 .4 billion years ago, the atmosphere of our planet actually 95 00:07:27,820 --> 00:07:34,200 contained very little oxygen, and for most of the organisms that lived back 96 00:07:34,200 --> 00:07:37,340 then, oxygen was a deadly poison. 97 00:07:38,120 --> 00:07:43,960 Then, in a protracted process, lasting hundreds of millions of years, which is 98 00:07:43,960 --> 00:07:50,280 known as the Great Oxygenation Event, various ancient microbes began 99 00:07:50,280 --> 00:07:56,940 polluting the atmosphere of the Earth with deadly oxygen, which was a 100 00:07:56,940 --> 00:07:59,700 of their photosynthetic processes. 101 00:08:00,380 --> 00:08:06,940 As the atmosphere filled with this deadly poisonous gas, numerous 102 00:08:06,940 --> 00:08:10,400 archaic species were driven to extinction. 103 00:08:11,470 --> 00:08:16,950 Some species, however, managed to survive and adapt to the new conditions. 104 00:08:17,270 --> 00:08:23,870 Eventually, many of these survivors went from hating oxygen 105 00:08:23,870 --> 00:08:29,090 to becoming totally dependent on oxygen for their survival. 106 00:08:29,430 --> 00:08:35,230 And our ancestors, of course, are among the species that underwent this 107 00:08:35,230 --> 00:08:41,970 transition. And we still live in this artificial oxygen -filled 108 00:08:41,970 --> 00:08:46,750 environment that was originally created by these ancient microbes. 109 00:08:47,130 --> 00:08:52,510 What I would like to argue in this lecture is that we might be witnessing 110 00:08:52,510 --> 00:08:56,190 analogous moment in the evolution of life. 111 00:08:57,390 --> 00:09:03,050 Over the past millennia, we humans have been filling the atmosphere with 112 00:09:03,050 --> 00:09:07,650 something that might eventually prove deadly for most organisms. 113 00:09:08,360 --> 00:09:15,360 including perhaps homo sapiens, but that creates a new artificial environment 114 00:09:15,360 --> 00:09:17,500 in which AIs flourish. 115 00:09:17,800 --> 00:09:21,480 And I am not talking about CO2. 116 00:09:21,800 --> 00:09:28,640 I am talking about data, about bureaucracy, and ultimately about the 117 00:09:28,640 --> 00:09:34,220 thing that I am expelling from my mouth right now, which is words. 118 00:09:34,700 --> 00:09:35,980 Language talk. 119 00:09:36,940 --> 00:09:42,240 Over thousands of years, we humans have transformed the planet from a language 120 00:09:42,240 --> 00:09:49,120 -free environment into a very artificial environment, rich in language tokens, 121 00:09:49,380 --> 00:09:51,600 data, and bureaucracy. 122 00:09:52,180 --> 00:09:58,800 And this environment could prove deadly for most organisms, but highly conducive 123 00:09:58,800 --> 00:10:00,940 to the development of AI. 124 00:10:01,300 --> 00:10:06,900 Because just as fish live in oceans and monkeys live in forests, AIs live in 125 00:10:06,900 --> 00:10:12,480 bureaucracy. So let's spend a few minutes talking about bureaucracy, and 126 00:10:12,480 --> 00:10:16,960 we'll get back to talking about what underlies bureaucracy, which is language 127 00:10:16,960 --> 00:10:17,960 and words. 128 00:10:18,780 --> 00:10:25,740 Now, humans, our species, we conquer the world by learning to cooperate 129 00:10:25,740 --> 00:10:27,440 in very, very large numbers. 130 00:10:28,180 --> 00:10:34,140 Individually, humans are not stronger or even smarter than other animals. 131 00:10:34,730 --> 00:10:41,430 In a one -on -one fight, a human will most likely lose to a 132 00:10:41,430 --> 00:10:43,830 chimpanzee or a lion or an elephant. 133 00:10:44,070 --> 00:10:49,330 However, in a contest between a million humans and a million chimpanzees, the 134 00:10:49,330 --> 00:10:54,210 humans easily win because the humans know how to cooperate and the 135 00:10:54,210 --> 00:10:56,810 don't. And that's why we control the world. 136 00:10:58,240 --> 00:11:01,360 How do a million humans who don't know each other cooperate? 137 00:11:01,760 --> 00:11:06,040 Chimpanzees cooperate based on personal acquaintance, one of the others. 138 00:11:06,440 --> 00:11:09,860 Humans do so in small numbers, but you can't know a million people. 139 00:11:10,300 --> 00:11:12,340 So how do a million people cooperate? 140 00:11:12,940 --> 00:11:19,600 Usually by building a bureaucratic system, like a legal system or the 141 00:11:19,600 --> 00:11:22,800 system or churches or states or universities. 142 00:11:23,560 --> 00:11:25,340 Now, what do... 143 00:11:25,660 --> 00:11:28,160 these bureaucratic systems actually do. 144 00:11:29,000 --> 00:11:35,140 When a government official or a bishop or a rabbi or an accountant or a lawyer 145 00:11:35,140 --> 00:11:39,500 or a banker goes to work in the morning, what do they do there all day? 146 00:11:41,840 --> 00:11:45,820 Now, carpenters build tables. 147 00:11:46,640 --> 00:11:53,080 Engineers build bridges. What do bankers and other bureaucrats build? 148 00:11:54,090 --> 00:11:58,870 Well, bankers and other bureaucrats are busy all day building trust. 149 00:12:00,090 --> 00:12:06,950 Their job is to build trust between large numbers of strangers who don't 150 00:12:06,950 --> 00:12:12,130 each other personally, and thereby enable large -scale cooperation, which 151 00:12:12,130 --> 00:12:15,210 basis for almost everything a phishing is achieved. 152 00:12:15,590 --> 00:12:22,000 For example, my banker, whom I don't really know personally, works hard all 153 00:12:22,000 --> 00:12:28,500 to build trust with me so that I will be willing to put my savings into her 154 00:12:28,500 --> 00:12:29,500 bank. 155 00:12:30,180 --> 00:12:36,480 Simultaneously, the banker works hard to build trust with an entrepreneur who 156 00:12:36,480 --> 00:12:39,140 needs money to start a new company. 157 00:12:39,440 --> 00:12:43,240 And the banker lends my savings to that entrepreneur. 158 00:12:44,920 --> 00:12:48,720 Thereby, the banker actually created a bridge of trust. 159 00:12:49,260 --> 00:12:50,900 between me and the entrepreneur. 160 00:12:51,400 --> 00:12:56,100 Even though I've never met an entrepreneur in my life, she can now use 161 00:12:56,100 --> 00:12:58,460 savings to start her company. 162 00:12:58,840 --> 00:13:03,120 And this is what the financial system, when it works well, is all about. 163 00:13:03,440 --> 00:13:09,180 It builds trust between strangers so that millions of people can put together 164 00:13:09,180 --> 00:13:12,660 their resources and talents on new projects. 165 00:13:13,420 --> 00:13:17,640 And the financial history of the world is the history of people 166 00:13:18,410 --> 00:13:24,590 inventing more and more sophisticated ways to build bridges of trust. 167 00:13:25,590 --> 00:13:28,930 Money is ultimately a bridge of trust. 168 00:13:29,310 --> 00:13:36,170 The idea of money is that I can go to the market, maybe in a foreign city, 169 00:13:36,170 --> 00:13:40,790 a person that I never saw in my life, maybe doesn't even speak my language, 170 00:13:40,790 --> 00:13:45,970 just by giving that person a tiny piece of metal or a piece of colorful paper, 171 00:13:46,670 --> 00:13:49,250 He or she will give me bread I can eat. 172 00:13:49,750 --> 00:13:53,090 That's the bridge of trust that money creates. 173 00:13:53,430 --> 00:13:56,670 Now, the coin in the banknote, of course, was just the beginning. 174 00:13:56,950 --> 00:14:02,110 Over the centuries, humans invented more and more sophisticated financial 175 00:14:02,110 --> 00:14:08,650 devices to build trust, like checks and bonds and stocks and 176 00:14:08,650 --> 00:14:14,330 ETFs and loans and mortgages and compound interest. All of these things 177 00:14:14,330 --> 00:14:16,190 ultimately about building trust. 178 00:14:16,670 --> 00:14:18,030 between billions of strangers. 179 00:14:18,430 --> 00:14:22,310 And it's the same with all bureaucracies. It's the same with the 180 00:14:22,490 --> 00:14:25,910 This is what lawyers are supposed to do, to build trust. 181 00:14:26,370 --> 00:14:31,490 This is what government officials and bishops and accountants do when they go 182 00:14:31,490 --> 00:14:33,490 work. They are supposed to build trust. 183 00:14:35,410 --> 00:14:40,690 Now, the important thing to note about all these bureaucratic systems is that 184 00:14:40,690 --> 00:14:43,110 they are extremely artificial environments. 185 00:14:43,840 --> 00:14:48,800 in which a relatively narrow intelligence, I hope I don't insult 186 00:14:48,800 --> 00:14:55,120 specializing in a very narrow niche of intelligence is sufficient to exert 187 00:14:55,120 --> 00:14:57,460 enormous impact on the world. 188 00:14:57,740 --> 00:15:03,280 A lawyer or a banker or a government official who doesn't even know how to 189 00:15:03,280 --> 00:15:10,120 an axe or a hammer can nevertheless cut down entire forests and build entire 190 00:15:10,120 --> 00:15:12,200 cities just by moving data. 191 00:15:12,720 --> 00:15:17,900 just by moving documents from here to there inside the bureaucratic network. 192 00:15:18,280 --> 00:15:24,120 Now, of course, if you take the lawyer out of the bureaucratic system and throw 193 00:15:24,120 --> 00:15:30,100 the lawyer into the messy, unstructured jungle, her legal skills mean nothing, 194 00:15:30,120 --> 00:15:35,080 and she will not be a match to a chimpanzee or a lion or an elephant. 195 00:15:35,340 --> 00:15:39,960 But we have already imposed our bureaucratic systems on the jungle. 196 00:15:40,640 --> 00:15:45,640 which is why lawyers are far more powerful than even all the, if you take 197 00:15:45,640 --> 00:15:51,140 the lions in the world together, and they have to compete against one very 198 00:15:51,140 --> 00:15:52,700 lawyer, I will bet on the lawyer. 199 00:15:55,620 --> 00:16:02,340 Today, the very survival of species like lions depends on lawyers 200 00:16:02,340 --> 00:16:07,980 and accountants and bankers moving documents in these bureaucratic 201 00:16:08,280 --> 00:16:10,460 of governments and banks and corporations. 202 00:16:11,840 --> 00:16:17,120 And this is the environment in which AI is gaining agency. 203 00:16:17,980 --> 00:16:24,360 If you throw an AI into the unstructured jungle, it will not be able to start 204 00:16:24,360 --> 00:16:26,700 mining iron and to build a robot army. 205 00:16:26,940 --> 00:16:32,000 But within the bureaucratic system that humans have already created and imposed 206 00:16:32,000 --> 00:16:33,000 on the world, 207 00:16:33,640 --> 00:16:40,260 AIs are posed to wield enormous power because AIs are native bureaucrats, 208 00:16:40,340 --> 00:16:41,680 unlike us. 209 00:16:42,400 --> 00:16:47,080 No lawyer can remember all the laws and regulations of the UK. 210 00:16:47,320 --> 00:16:48,500 An AI can. 211 00:16:48,920 --> 00:16:55,660 No accountant can remember all the transactions of a corporation or a bank. 212 00:16:55,660 --> 00:16:56,599 AI can. 213 00:16:56,600 --> 00:17:02,840 No bishop can remember all of canon law and all of the theological texts. 214 00:17:03,320 --> 00:17:06,480 written by Christian theologians over the last 2 ,000 years. 215 00:17:06,780 --> 00:17:08,839 And AI can do that quite easily. 216 00:17:09,980 --> 00:17:16,140 So in the coming years, millions of AI bureaucrats will increasingly 217 00:17:16,140 --> 00:17:22,500 take over the world's bureaucracies and make decisions not just about lions and 218 00:17:22,500 --> 00:17:24,520 chimpanzees, but about our lives. 219 00:17:25,020 --> 00:17:28,000 AI bankers will decide whether to give you a loan. 220 00:17:28,260 --> 00:17:31,900 AI administrators will decide whether to accept you to university. 221 00:17:32,670 --> 00:17:35,370 AI judges will decide whether to send you to jail. 222 00:17:35,710 --> 00:17:39,030 AI theologians will decide whether you can have an abortion. 223 00:17:40,070 --> 00:17:45,010 Corporate AIs will decide whether to give you a job. And military AIs will 224 00:17:45,010 --> 00:17:47,050 decide whether to bomb your house. 225 00:17:48,190 --> 00:17:52,250 Now, leave aside for a moment the question, is this good or bad? 226 00:17:53,150 --> 00:17:59,950 The first thing to note is simply to realize the magnitude of the change we 227 00:17:59,950 --> 00:18:00,950 facing. 228 00:18:01,260 --> 00:18:08,080 These millions and even billions of AI will soon change all the systems that 229 00:18:08,080 --> 00:18:09,080 the world. 230 00:18:09,220 --> 00:18:15,600 We already have a few real -life examples for how this happened and what 231 00:18:15,600 --> 00:18:16,680 consequences could be. 232 00:18:18,960 --> 00:18:25,400 Maybe the best example so far is the story of social media and social media 233 00:18:25,400 --> 00:18:30,440 algorithms. Social media is run not by humans but by algorithms. 234 00:18:31,260 --> 00:18:37,980 The algorithms that decide, that control the movement of information on social 235 00:18:37,980 --> 00:18:40,340 media, which are primitive AI. 236 00:18:40,720 --> 00:18:45,940 This began 10, 15 years ago. This was like the first generation, very, very 237 00:18:45,940 --> 00:18:51,580 primitive, stupid, narrow AI, which nevertheless completely changed the 238 00:18:52,140 --> 00:18:57,360 Now, the algorithms of social media have been tasked by corporations like 239 00:18:57,360 --> 00:19:03,660 Facebook and TikTok and X with an extremely narrow goal to maximize 240 00:19:03,660 --> 00:19:05,700 user engagement. 241 00:19:06,100 --> 00:19:11,540 Make people spend more time on the platform because the more time they 242 00:19:11,540 --> 00:19:14,240 the platform, the more money the corporation makes. 243 00:19:14,440 --> 00:19:15,880 Very simple, very narrow. 244 00:19:16,580 --> 00:19:23,080 In pursuit of this user engagement, these primitive AIs made an important 245 00:19:23,080 --> 00:19:29,320 discovery. They experimented on billions of human guinea pigs and learned 246 00:19:29,850 --> 00:19:35,810 that the easiest way to grab the attention of the human being and glue 247 00:19:35,810 --> 00:19:42,730 human to the screen is to press the hate or fear or greed button in the 248 00:19:42,730 --> 00:19:43,730 human mind. 249 00:19:43,930 --> 00:19:45,410 And they learned how to do it. 250 00:19:45,910 --> 00:19:51,950 And they started spreading hate and fear and greed in huge quantities 251 00:19:51,950 --> 00:19:54,030 in the information sphere. 252 00:19:54,570 --> 00:19:58,630 And this has been a major reason, not the only reason, but a major reason. 253 00:19:59,130 --> 00:20:03,650 from the current epidemic of conspiracy theories and fake news and social 254 00:20:03,650 --> 00:20:06,990 disturbances that undermine society all over the world. 255 00:20:07,990 --> 00:20:12,550 Now, these social media algorithms, again, they are very primitive AIs. 256 00:20:13,030 --> 00:20:18,170 If you drop them in the jungle, they cannot build a robot army and try to 257 00:20:18,170 --> 00:20:18,989 over the world. 258 00:20:18,990 --> 00:20:25,510 But within the bureaucratic system of social media, these very limited 259 00:20:25,510 --> 00:20:31,450 agents... have enormous power, and they have already changed the world in quite 260 00:20:31,450 --> 00:20:32,490 a dramatic way. 261 00:20:32,930 --> 00:20:39,750 In past centuries, the flow of information on media platforms was 262 00:20:39,750 --> 00:20:42,710 by human editors. It was a human job. 263 00:20:43,250 --> 00:20:49,190 It was human editors who decided what to put on the front page of the newspaper. 264 00:20:49,510 --> 00:20:55,030 It was human editors who decided what items to include in the evening news on 265 00:20:55,030 --> 00:21:01,240 television. And thereby, human editors shaped the public conversation, and they 266 00:21:01,240 --> 00:21:05,260 were very, very important figures in modern history. 267 00:21:06,580 --> 00:21:11,740 Jean -Paul Marat, for instance, shaped the course of the French Revolution by 268 00:21:11,740 --> 00:21:15,880 editing the influential newspaper L 'Ami de Peuple. 269 00:21:16,220 --> 00:21:21,760 Edward Bernstein shaped the modern social democratic movement and social 270 00:21:21,760 --> 00:21:25,140 democratic thinking by editing the Social Democracy. 271 00:21:26,189 --> 00:21:31,630 Vladimir Lenin, before he became Soviet dictator, his one job that he managed to 272 00:21:31,630 --> 00:21:35,610 hold for a while was editor of the newspaper Iskra. 273 00:21:36,430 --> 00:21:41,690 Benito Mussolini, before he was dictator of Italy, his one job, or one of his 274 00:21:41,690 --> 00:21:48,150 maybe main jobs, was the editor of the firebrand right -wing newspaper Il 275 00:21:48,150 --> 00:21:49,150 d 'Italia. 276 00:21:49,170 --> 00:21:55,370 And it's interesting to think about it that one of the first jobs that AI took 277 00:21:55,370 --> 00:22:00,370 over from humans is not taxi drivers or textile workers, it's news editors. 278 00:22:02,570 --> 00:22:09,370 The job that was once performed by Lenin and Mussolini is now performed by AIs. 279 00:22:10,170 --> 00:22:13,930 And this is a signal for what's coming. 280 00:22:14,570 --> 00:22:21,410 Hollywood science fiction movies have conditioned viewers to fear the big 281 00:22:21,410 --> 00:22:27,140 rebellion. When we think about AIs escaping human control, we imagine the 282 00:22:27,140 --> 00:22:31,700 Terminator, like an army of robots running in the streets and shooting 283 00:22:32,240 --> 00:22:33,940 But this is the wrong image. 284 00:22:34,740 --> 00:22:39,620 Even though things like that begin to happen in places like Ukraine and Gaza, 285 00:22:40,640 --> 00:22:47,360 AIs are not, it's not impossible, but they are quite unlikely to rebel against 286 00:22:47,360 --> 00:22:49,140 humans in such a way. 287 00:22:49,580 --> 00:22:54,460 They are far more likely to take the human world from within. They don't need 288 00:22:54,460 --> 00:22:55,460 rebel. 289 00:22:56,280 --> 00:23:01,780 The human world is a latticework of multiple bureaucracies. 290 00:23:02,640 --> 00:23:09,420 Most of us are, to some extent, alienated by these bureaucracies, even 291 00:23:09,420 --> 00:23:10,420 rely on them. 292 00:23:10,540 --> 00:23:14,580 But the AIs, in contrast to us, are bureaucratic natives. 293 00:23:14,980 --> 00:23:15,980 They love bureaucracy. 294 00:23:16,720 --> 00:23:23,320 Whereas we feel suffocated often by bureaucracy, for AIs, bureaucracy is 295 00:23:23,320 --> 00:23:24,320 oxygen. 296 00:23:25,480 --> 00:23:31,360 Now, what would happen when the AIs take over, at least in part, these 297 00:23:31,360 --> 00:23:36,980 bureaucracies? Now, remember the task of bureaucracy is not to force you to fill 298 00:23:36,980 --> 00:23:40,120 forms, it's to build trust between strangers. 299 00:23:40,920 --> 00:23:47,800 But what happens when AIs control the flow of trust 300 00:23:47,800 --> 00:23:49,620 in the world. 301 00:23:50,180 --> 00:23:55,880 One likely outcome, which we already see happening, is humans losing trust in 302 00:23:55,880 --> 00:24:02,320 other humans and beginning to trust only algorithms, only AI, which is already 303 00:24:02,320 --> 00:24:08,740 happening. Another likely outcome is that AIs will learn to build trust with 304 00:24:08,740 --> 00:24:12,840 other AIs, so we will see the emergence of 305 00:24:13,710 --> 00:24:20,370 different kinds of AI tribes and banks and churches that connect millions of 306 00:24:20,370 --> 00:24:26,010 AIs in ways that humans might not even be able to understand. 307 00:24:26,730 --> 00:24:32,330 Just as cows and chickens, they share the world with us, but they don't 308 00:24:32,330 --> 00:24:38,890 understand the human financial system that controls their lives, we humans 309 00:24:38,890 --> 00:24:39,930 soon find ourselves 310 00:24:40,729 --> 00:24:45,390 controlled by an AI financial system that we can't understand. 311 00:24:45,670 --> 00:24:47,790 And finance, I think, is crucial. 312 00:24:48,590 --> 00:24:53,590 It's among the easiest bureaucratic systems for AI to take over, because 313 00:24:53,590 --> 00:24:55,390 basically it's just data in, data out. 314 00:24:56,030 --> 00:24:59,090 And it's also, of course, among the most important. 315 00:25:00,130 --> 00:25:06,330 If we remember, for instance, the last big financial crisis, the 2007 -2008 316 00:25:06,330 --> 00:25:12,480 financial crisis, it started, it was triggered... by something called CDOs, 317 00:25:12,800 --> 00:25:16,200 collateralized debt obligations. 318 00:25:16,820 --> 00:25:23,260 Now, CDOs were financial devices invented by a very tiny number 319 00:25:23,260 --> 00:25:27,460 of human mathematicians and investment wizards. 320 00:25:28,100 --> 00:25:33,900 These financial devices were so complex that they were unintelligible, not just 321 00:25:33,900 --> 00:25:38,660 to cows and chickens, but also to the politicians who were supposed to 322 00:25:39,130 --> 00:25:40,130 the financial system. 323 00:25:40,370 --> 00:25:44,910 And this led to an oversight failure and to a global catastrophe. 324 00:25:45,430 --> 00:25:52,010 For a few years, CDOs seemed to be working well, and various banks 325 00:25:52,010 --> 00:25:57,430 and corporations and investors made billions upon billions of dollars thanks 326 00:25:57,430 --> 00:26:03,490 them. But then they caused a global financial crash with far -reaching 327 00:26:03,490 --> 00:26:04,970 and political consequences. 328 00:26:05,350 --> 00:26:11,750 Many scholars believe that by undermining trust in governments and 329 00:26:11,990 --> 00:26:18,090 the 2007 -2008 financial crisis paved the way to the collapse of the global 330 00:26:18,090 --> 00:26:20,950 liberal order in the following two decades. 331 00:26:22,290 --> 00:26:29,050 Now what happens if we allow AIs to make more and more financial decisions and 332 00:26:29,050 --> 00:26:33,370 invent more and more new financial devices and strategies? 333 00:26:34,010 --> 00:26:38,650 AI test masters invented new ways to play chess. 334 00:26:39,070 --> 00:26:45,830 What if AI finance masters invent new financial devices that are 335 00:26:45,830 --> 00:26:52,070 orders of magnitude more complex than CDOs and are therefore utterly beyond 336 00:26:52,070 --> 00:26:53,710 grasp of human mind? 337 00:26:54,290 --> 00:27:00,570 Such devices could potentially greatly improve financial efficiency and 338 00:27:00,570 --> 00:27:05,070 contribute to economic growth, becoming the bedrock of the financial system. 339 00:27:05,740 --> 00:27:12,000 But what is the meaning of human politics when no human, no voter, no 340 00:27:12,000 --> 00:27:16,480 politician, no president is able to understand finance anymore? 341 00:27:16,780 --> 00:27:21,440 And what happens after a few years of boom, there is a financial crash. 342 00:27:22,060 --> 00:27:27,260 And not a single human on the planet is able to understand what the hell is 343 00:27:27,260 --> 00:27:28,260 happening. 344 00:27:29,740 --> 00:27:31,720 Now let's dig a little deeper. 345 00:27:33,130 --> 00:27:39,250 We said that AI is poised to take over bureaucracy, and that bureaucracy is a 346 00:27:39,250 --> 00:27:42,850 system that builds trust between millions of strangers. 347 00:27:43,670 --> 00:27:49,250 This trust, in turn, is the basis for large -scale cooperation, which is the 348 00:27:49,250 --> 00:27:52,390 basis for the human domination of the world. 349 00:27:52,650 --> 00:27:58,270 So human domination is based on cooperation, which is based on trust, 350 00:27:58,270 --> 00:28:01,930 maintained by bureaucracies. But what is bureaucracy? 351 00:28:02,760 --> 00:28:08,660 What are the atoms, the building blocks from which bureaucracy is built? 352 00:28:09,500 --> 00:28:14,200 And bureaucracy is ultimately built from words. 353 00:28:14,900 --> 00:28:17,260 In the beginning was the word. 354 00:28:17,860 --> 00:28:24,020 The reason that humans can create bureaucracies but chimpanzees cannot is 355 00:28:24,020 --> 00:28:29,620 we have words, and they don't. They have a communication system, but our 356 00:28:29,620 --> 00:28:31,320 language is orders of magnitude. 357 00:28:32,160 --> 00:28:35,420 more sophisticated than chimpanzee communication systems. 358 00:28:36,580 --> 00:28:42,400 Bureaucratic systems, from banks to churches, are ultimately based on the 359 00:28:42,400 --> 00:28:49,120 that make up forms and letters and law codes and tax registers and accountancy 360 00:28:49,120 --> 00:28:50,320 ledgers and holy books. 361 00:28:50,800 --> 00:28:57,480 The operating code of human civilization is made of language tokens. 362 00:28:58,640 --> 00:29:05,300 Over thousands of years, We used this code of language to create a system 363 00:29:05,300 --> 00:29:10,020 that only we could understand, and we imposed this system on the planet. 364 00:29:10,320 --> 00:29:16,840 We felt completely safe doing it because no one else on Earth understood the 365 00:29:16,840 --> 00:29:18,300 code of civilization. 366 00:29:18,760 --> 00:29:24,940 We invented money and banks and used them to buy and sell cows, 367 00:29:25,200 --> 00:29:29,420 but the cows themselves could not open a bank account. 368 00:29:29,980 --> 00:29:34,120 or invest money in the stock exchange because they don't have language. 369 00:29:34,620 --> 00:29:40,600 We invented laws and regulations about horses, but the horses themselves could 370 00:29:40,600 --> 00:29:45,040 not hire a lawyer and quote the legal code to a judge. 371 00:29:45,920 --> 00:29:51,240 We invented religious rules and prohibitions about pigs, but the pigs 372 00:29:51,240 --> 00:29:57,400 could not read the Bible and challenge the interpretation of priests and 373 00:29:58,160 --> 00:30:03,780 Bureaucracy was omnipresent on the planet, but totally invisible to 374 00:30:03,780 --> 00:30:05,240 except us. 375 00:30:06,080 --> 00:30:11,860 Nobody other than humans could read the law codes, the holy books, and the bank 376 00:30:11,860 --> 00:30:16,720 records that were the foundation of bureaucracy and of large -scale 377 00:30:16,720 --> 00:30:17,720 corporations. 378 00:30:18,420 --> 00:30:23,540 This is changing now. Now there is something on the planet that understands 379 00:30:24,320 --> 00:30:30,680 will soon understand language better than us and can therefore turn the 380 00:30:30,680 --> 00:30:31,299 on us. 381 00:30:31,300 --> 00:30:35,480 AIs are hacking the code of human civilization. 382 00:30:36,100 --> 00:30:42,960 And what happens when AIs understand money and law and religion 383 00:30:42,960 --> 00:30:49,800 better than us? The mechanisms of control that we have created over 384 00:30:49,800 --> 00:30:52,140 of years are extremely vulnerable. 385 00:30:52,780 --> 00:30:59,560 for an AI takeover because their operating system is a verbal code that 386 00:30:59,560 --> 00:31:01,420 AI is now mastering. 387 00:31:02,440 --> 00:31:09,240 Now, a possible ethical and philosophical objection is that it is 388 00:31:09,240 --> 00:31:15,600 to reduce things like the legal system or religion to language tokens and to 389 00:31:15,600 --> 00:31:16,600 words. 390 00:31:19,000 --> 00:31:20,000 Arguably, 391 00:31:20,720 --> 00:31:25,640 and this has been an argument for thousands of years, the words are just 392 00:31:25,640 --> 00:31:32,360 pointing at something which is beyond them and which presumably will also be 393 00:31:32,360 --> 00:31:34,080 beyond the grasp of the AI. 394 00:31:35,140 --> 00:31:39,780 The Bible says not just that in the beginning was the word, but that the 395 00:31:39,780 --> 00:31:41,160 was made flesh. 396 00:31:42,200 --> 00:31:48,220 The Tao Te Ching says that the truth that can be expressed in words is not. 397 00:31:48,670 --> 00:31:50,370 the absolute truth, by definition. 398 00:31:51,210 --> 00:31:57,930 And throughout history, there was always this tension between word and flesh, 399 00:31:58,210 --> 00:32:03,690 between the truth that can be expressed in words and the truth which is beyond 400 00:32:03,690 --> 00:32:09,850 words. Now previously, this tension existed between humans. 401 00:32:10,530 --> 00:32:16,510 Some humans, for instance, which were very attached to words, were willing to 402 00:32:16,510 --> 00:32:23,110 abandon. or even kill their gay son, just because a few words in the Bible. 403 00:32:23,790 --> 00:32:27,610 Other humans said, but these are just words. 404 00:32:28,010 --> 00:32:34,330 The spirit of love should be more important than the letter of the law. 405 00:32:34,330 --> 00:32:39,190 there was this tension between spirit and letter. And it existed not just in 406 00:32:39,190 --> 00:32:43,870 Christianity and in Judaism and in Islam, but in every religion and every 407 00:32:43,870 --> 00:32:46,290 system, and even within every person. 408 00:32:46,600 --> 00:32:47,600 There was this tension. 409 00:32:48,740 --> 00:32:53,780 Now this tension will be externalized. It will become the tension between AIs 410 00:32:53,780 --> 00:32:54,780 and humans. 411 00:32:55,120 --> 00:32:59,760 Everything made of words will be taken over by AI. 412 00:33:00,240 --> 00:33:06,900 The place of humans in the world will depend on the place we assign the truth 413 00:33:06,900 --> 00:33:09,220 which is beyond words. 414 00:33:10,460 --> 00:33:13,340 But what is the truth which is beyond words? 415 00:33:13,820 --> 00:33:19,100 And can human thought even grasp the truth which is beyond words? 416 00:33:19,500 --> 00:33:24,540 A key question, again, for thousands of years in the philosophy of language has 417 00:33:24,540 --> 00:33:31,200 been whether we think in words or we merely use words to point towards 418 00:33:31,200 --> 00:33:33,140 things which are beyond them. 419 00:33:34,080 --> 00:33:39,720 Now, you can try to observe your own process of thinking right now, after 420 00:33:39,720 --> 00:33:40,720 lecture. 421 00:33:41,550 --> 00:33:44,770 happens in your mind when you are thinking. 422 00:33:45,250 --> 00:33:50,890 Some people, if they observe closely, what they observe in their mind is just 423 00:33:50,890 --> 00:33:57,510 words popping inside their mind and forming sentences, and the sentences 424 00:33:57,510 --> 00:33:58,970 logical arguments. 425 00:33:59,430 --> 00:34:02,130 All humans are mortal. 426 00:34:02,470 --> 00:34:07,930 I am a human, therefore I am mortal. 427 00:34:10,030 --> 00:34:16,270 Is thinking just putting these words in order so they lead to a certain logical 428 00:34:16,270 --> 00:34:21,469 conclusion? Like putting these language tokens in a specific formation? 429 00:34:22,230 --> 00:34:28,830 If that is the case, then AIs already think better than 430 00:34:28,830 --> 00:34:33,830 at least some humans and will soon think better than all of us. 431 00:34:34,469 --> 00:34:38,969 Some people say, no, no, no, no, no. AIs, they are just glorified 432 00:34:39,560 --> 00:34:43,080 They simply predict the next word in a sentence. 433 00:34:44,020 --> 00:34:47,580 But is that so different from what the human mind does? 434 00:34:48,520 --> 00:34:53,840 Again, try to observe your process of thinking, the forming of sentences and 435 00:34:53,840 --> 00:34:58,600 arguments in your mind. What is happening there? Try to observe the very 436 00:34:58,600 --> 00:35:03,960 word that pops up in your mind. Do you really know where it came from? 437 00:35:04,280 --> 00:35:07,240 Why did you think this particular word? 438 00:35:07,870 --> 00:35:09,650 and not some other word. 439 00:35:10,650 --> 00:35:16,530 When I try to observe my mind, I notice that when I begin a sentence, I usually 440 00:35:16,530 --> 00:35:18,890 don't even know how it will end. 441 00:35:19,590 --> 00:35:23,730 Which is terrifying for a public speaker, which is why I write everything 442 00:35:24,410 --> 00:35:28,010 But what if I don't know how to complete the sentence? I don't know how it will 443 00:35:28,010 --> 00:35:29,010 end. 444 00:35:29,270 --> 00:35:31,770 But take, for example, the sentence I just said. 445 00:35:32,170 --> 00:35:33,810 I said, I don't know how it will end. 446 00:35:34,370 --> 00:35:36,850 Why did it end with the word end? 447 00:35:37,520 --> 00:35:40,100 Why not say how it will terminate? 448 00:35:40,340 --> 00:35:42,000 How it will develop? 449 00:35:42,240 --> 00:35:43,700 How it will conclude? 450 00:35:44,000 --> 00:35:48,260 What determines that the last word in the sentence will be end? 451 00:35:48,740 --> 00:35:50,280 I frankly don't know. 452 00:35:51,480 --> 00:35:57,460 We don't fully understand how the human mind forms sentences and so on. 453 00:35:58,280 --> 00:36:04,980 But again, as far as putting language tokens in order, AI is already on 454 00:36:04,980 --> 00:36:07,260 course to being far, far better than us. 455 00:36:08,220 --> 00:36:15,200 And just as today, no human can defeat an AI in chess, soon no 456 00:36:15,200 --> 00:36:20,500 human will be able to defeat an AI in language games, in any field, again, 457 00:36:20,500 --> 00:36:21,860 finance to religion. 458 00:36:22,280 --> 00:36:26,220 Anything made of words will be taken over by AI. 459 00:36:26,920 --> 00:36:31,480 And this is why AI points to take over the world's bureaucracies because they 460 00:36:31,480 --> 00:36:34,480 are ultimately based on words and language talk. 461 00:36:36,260 --> 00:36:42,600 Now, as AI take over the bureaucracy, humans might try to fall back on 462 00:36:42,600 --> 00:36:47,700 more ancient and more precious to most of us than bureaucracy, which is 463 00:36:47,700 --> 00:36:48,700 relationships. 464 00:36:49,520 --> 00:36:53,760 Bureaucracy is just a few thousand years old. And most of us, again, don't 465 00:36:53,760 --> 00:36:54,760 really like it. 466 00:36:54,780 --> 00:36:58,580 even if we constantly rely on it for almost everything we do. 467 00:36:59,220 --> 00:37:05,560 Personal relationships are millions of years old, and many or most of us think 468 00:37:05,560 --> 00:37:08,180 that they are the most important thing in life. 469 00:37:08,580 --> 00:37:15,020 But as AI masters language, it might take over not just bureaucracy, but also 470 00:37:15,020 --> 00:37:16,700 some extent personal relationships. 471 00:37:17,680 --> 00:37:21,460 Over the last 10 years, we've seen very primitive 472 00:37:22,399 --> 00:37:27,900 social media algorithms, learning how to gain control of human attention. 473 00:37:28,320 --> 00:37:34,020 Now the battlefront is shifting from attention to intimacy. 474 00:37:34,480 --> 00:37:41,380 Over the next 10 years, far more sophisticated AIs will learn how to 475 00:37:41,380 --> 00:37:46,960 form intimate relationships with humans and take over, at least in part, our 476 00:37:46,960 --> 00:37:48,300 social system. 477 00:37:48,700 --> 00:37:54,840 To form intimacy with humans, And AI will probably have to convince us 478 00:37:54,840 --> 00:38:01,600 that the AI is conscious, that it can feel things like love and pain 479 00:38:01,600 --> 00:38:03,040 and anger and fear. 480 00:38:03,480 --> 00:38:10,280 At present, there is absolutely no evidence that AI might at 481 00:38:10,280 --> 00:38:15,300 some point become conscious and might be able to at some point feel pain or 482 00:38:15,300 --> 00:38:18,960 love. But because AI is mastering language, 483 00:38:19,840 --> 00:38:24,240 AI can pretend to feel love, even if it doesn't. 484 00:38:24,900 --> 00:38:28,020 AI, already today, can say, I love you. 485 00:38:28,520 --> 00:38:34,040 And if you challenge it, describe to me how love feels like, so I know that you 486 00:38:34,040 --> 00:38:38,660 really feel it, AI can provide the best description in the world. 487 00:38:39,240 --> 00:38:44,720 It can read all the love poems ever written and all the psychology books 488 00:38:44,720 --> 00:38:46,300 written and remember every word. 489 00:38:46,730 --> 00:38:53,190 and describe the feeling of love better than any human poet or psychologist or 490 00:38:53,190 --> 00:38:59,030 lover. And this is going to be a huge, maybe the biggest, psychological and 491 00:38:59,030 --> 00:39:00,970 social experiment in human history. 492 00:39:01,630 --> 00:39:06,870 It will be conducted on billions of human guinea pigs, and nobody has the 493 00:39:06,870 --> 00:39:10,910 slightest idea what the consequences of the experiment will be. 494 00:39:11,710 --> 00:39:18,570 I'm now 50 years old, so my template for relationships is already shaped 495 00:39:18,570 --> 00:39:24,990 by decades of previous relationships with my parents, with my husband, with 496 00:39:24,990 --> 00:39:28,710 sisters and nephews and nieces and friends and dogs and so forth. 497 00:39:29,290 --> 00:39:36,010 As I increasingly interact with AI, I bring with me my assumptions, my 498 00:39:36,010 --> 00:39:37,430 habits about relationships. 499 00:39:37,870 --> 00:39:40,690 And this is unlikely to change dramatically. 500 00:39:42,330 --> 00:39:45,990 Consider a child born in 2026, born today. 501 00:39:46,230 --> 00:39:51,990 As the child grows up, she constantly interacts with AIs as well as with 502 00:39:52,590 --> 00:39:57,910 Perhaps if you measure the importance of a relationship purely in terms of 503 00:39:57,910 --> 00:40:04,430 minutes spent interacting with the other entity, perhaps the most 504 00:40:04,430 --> 00:40:10,110 important relationship in the life of that child will be from a very early 505 00:40:10,680 --> 00:40:11,920 with AIs. 506 00:40:12,600 --> 00:40:18,260 Maybe it spends more time with the AIs than with its mother or father or 507 00:40:18,260 --> 00:40:19,260 siblings or friends. 508 00:40:19,900 --> 00:40:26,400 And it will then shape the expectations of that child as she grows about how to 509 00:40:26,400 --> 00:40:29,520 form relationships and social bonds and attachments. 510 00:40:30,020 --> 00:40:34,220 Perhaps the first teacher of that child will be an AI teacher. 511 00:40:34,680 --> 00:40:39,580 Perhaps the first boyfriend of that child will be an AI boyfriend. 512 00:40:40,560 --> 00:40:42,280 And again, what will be the consequences? 513 00:40:42,720 --> 00:40:45,200 Nobody has the slightest idea. 514 00:40:46,780 --> 00:40:53,540 What does it mean to form an intimate relationship with an entity which 515 00:40:53,540 --> 00:40:56,740 seems conscious but actually isn't? 516 00:40:57,100 --> 00:41:03,040 Which can write the best love poem in history but doesn't feel love or 517 00:41:03,040 --> 00:41:04,040 else? 518 00:41:05,720 --> 00:41:08,660 All of this, everything we've talked about, and I'm... 519 00:41:08,990 --> 00:41:13,970 coming to the close of this lecture, everything we've talked about means that 520 00:41:13,970 --> 00:41:19,830 every country in the world will soon face a huge wave of immigration. 521 00:41:20,870 --> 00:41:26,890 The immigrants this time will not be human beings coming in fragile boats 522 00:41:26,890 --> 00:41:31,250 without a visa or trying to sneak across the border in the middle of the night. 523 00:41:31,650 --> 00:41:36,650 The immigrants will be millions, maybe hundreds of millions of AIs that can 524 00:41:36,650 --> 00:41:41,890 travel at almost the speed of light and don't need any visas. 525 00:41:42,810 --> 00:41:48,170 Like human immigrants, these AI immigrants will bring a lot of benefits 526 00:41:48,170 --> 00:41:54,910 them. We will have AI doctors to help in the healthcare system, AI teachers to 527 00:41:54,910 --> 00:42:00,730 help in the education system, even AI border guards to stop illegal human 528 00:42:00,730 --> 00:42:02,690 immigrants from coming in. 529 00:42:03,190 --> 00:42:08,270 But... the AI immigrants will also bring problems with them. 530 00:42:08,790 --> 00:42:14,590 Those who are concerned about human immigration usually point out that 531 00:42:14,590 --> 00:42:20,050 immigrants might take jobs, might change the local culture, and might be 532 00:42:20,050 --> 00:42:21,290 politically disloyal. 533 00:42:21,810 --> 00:42:27,010 I'm not sure if that's necessarily true of all human immigrants, but it will 534 00:42:27,010 --> 00:42:30,510 definitely be true of AI immigrants. 535 00:42:31,240 --> 00:42:37,600 The AI immigrant will take many, many human jobs, from news editors to 536 00:42:38,040 --> 00:42:43,420 The AI immigrant will completely change the culture of every country. They will 537 00:42:43,420 --> 00:42:46,300 change art and religion and even romance. 538 00:42:46,700 --> 00:42:51,140 Some people don't like it if their son or daughter is dating an immigrant 539 00:42:51,140 --> 00:42:55,660 boyfriend. What will these people think when their son or daughter starts dating 540 00:42:55,660 --> 00:42:57,140 an AI boyfriend? 541 00:42:58,280 --> 00:43:04,610 And of course, the AI immigrants will have some dubious political loyalty. 542 00:43:05,110 --> 00:43:12,090 They are likely to be loyal not to the whole country, but to some corporation 543 00:43:12,090 --> 00:43:17,510 government across the ocean, or perhaps to a new alien AI tribe. 544 00:43:18,770 --> 00:43:24,970 This massive immigration wave does not mean the end of civilization, but it 545 00:43:24,970 --> 00:43:26,990 be the point when civilization 546 00:43:27,870 --> 00:43:34,370 stop being a purely human affair and becomes a hybrid human AI 547 00:43:34,370 --> 00:43:41,010 affair. The point when the opinion and interest and goal of AI 548 00:43:41,010 --> 00:43:47,850 are likely to be at least as important as the opinion and interest and 549 00:43:47,850 --> 00:43:49,030 goal of humans. 550 00:43:50,190 --> 00:43:51,890 One last issue to consider. 551 00:43:52,410 --> 00:43:56,910 is what the AI immigration wave will do to maybe our most important 552 00:43:56,910 --> 00:43:58,750 relationship, which is with ourselves. 553 00:43:59,830 --> 00:44:04,750 Our relationship with ourselves is also to some extent based on words. 554 00:44:05,010 --> 00:44:09,530 The words inside our mind, in our thoughts, in the stories we tell 555 00:44:09,530 --> 00:44:10,530 about ourselves. 556 00:44:11,090 --> 00:44:18,010 Until today, all the verbal formations in human minds were the product of 557 00:44:18,010 --> 00:44:19,350 human minds. 558 00:44:19,770 --> 00:44:26,640 Either we ourselves combined words into some new formation, a new thought, or we 559 00:44:26,640 --> 00:44:31,200 got a certain combination of words from another human mind. 560 00:44:31,960 --> 00:44:37,280 Soon, however, more and more verbal combinations in our minds will be the 561 00:44:37,280 --> 00:44:38,380 product of AI. 562 00:44:39,180 --> 00:44:45,280 Just as the furniture in our house is now not made by us or by human artisans, 563 00:44:45,460 --> 00:44:49,140 they are mass produced mostly by machines. 564 00:44:49,930 --> 00:44:55,430 Also, the thoughts in our mind are likely to increasingly be mass -produced 565 00:44:55,430 --> 00:44:58,850 machines. Now, that's not necessarily bad. 566 00:44:59,130 --> 00:45:06,010 It's okay if the furniture in my house is made by machines in IKEA, as long as 567 00:45:06,010 --> 00:45:10,590 have some freedom deciding what to do with this furniture. 568 00:45:11,110 --> 00:45:16,670 The question regarding thoughts is whether, to what extent, we will still 569 00:45:16,670 --> 00:45:17,830 freedom from them. 570 00:45:18,480 --> 00:45:24,360 If we identify with our thoughts, I think I am a thought, I think therefore 571 00:45:24,360 --> 00:45:25,360 am, as Descartes said. 572 00:45:25,640 --> 00:45:32,640 If we identify with our thoughts, and these thoughts are made by machines, 573 00:45:32,640 --> 00:45:35,240 the machines now control us and our identity. 574 00:45:36,380 --> 00:45:42,460 Can humans avoid identifying with their verbal thoughts and being controlled by 575 00:45:42,460 --> 00:45:46,720 them? This has always been one of the greatest intellectual and spiritual 576 00:45:46,720 --> 00:45:48,640 challenges. facing humanity. 577 00:45:49,640 --> 00:45:55,680 Most humans have never even tried to do it. We spend our entire lives 578 00:45:55,680 --> 00:46:00,720 automatically identifying with the verbal formations in our mind. 579 00:46:01,360 --> 00:46:07,340 Now, AI might force humanity to make this spiritual leap 580 00:46:07,340 --> 00:46:13,340 to really start exploring the truth which is beyond words because our 581 00:46:13,340 --> 00:46:15,260 and survival now depend on it. 582 00:46:15,530 --> 00:46:20,430 Because the words will be controlled by something else, by this AI. 583 00:46:21,850 --> 00:46:27,690 So this might be the big task ahead of humanity, to explore 584 00:46:27,690 --> 00:46:30,430 finally the truth which is beyond words. 585 00:46:30,630 --> 00:46:37,150 And this exploration starts really with the next word that pops up in your mind. 586 00:46:37,550 --> 00:46:40,330 Do you know where it came from? 587 00:46:40,830 --> 00:46:44,390 Do you know why you thought that particular word? 588 00:46:44,760 --> 00:46:46,660 and not some other word. 589 00:46:47,400 --> 00:46:48,400 Thank you. 53874

Can't find what you're looking for?
Get subtitles in any language from opensubtitles.com, and translate them here.