In this episode, Yuval Noah Harari, renowned historian and author, delves into the profound challenges and transformations facing humanity. He highlights the dangers of advanced technologies like AI, which, unlike any previous technology, can make independent decisions and potentially disempower humans. Harari warns of the risk that financial and political systems become too complex for human understanding, leading to potential manipulation by algorithms. He also discusses the pursuit of immortality, the potential pitfalls of bioengineering, and the urgent need to reestablish a global order based on universal values to prevent escalating conflicts. Additionally, Harari emphasizes the importance of understanding history not to change the past but to shape the future, recognizing that many aspects of our world are human-made and can be changed. Throughout, he advocates for cooperation, a balanced information diet, and reflection as means to maintain agency and navigate the tumultuous changes ahead.
"We are now in a new era of wars, and unless we reestablish order fast, then we are doomed." "I think we are very near the end of our species because people often spend so much effort trying to gain something without understand ending the consequences." "It's the first technology in history that can make decisions by itself and take power away from us to hack human beings, manipulate our behavior, and making all these decisions for us or about us."
These quotes express Harari's concern about the new challenges humanity faces, especially regarding AI's impact on society and the potential existential risks if control and order are not quickly reestablished.
"Much of what we take to be real is fictions." "Money is also a fiction that we created. Corporations are a fiction." "This is at the root of most conflicts and being able to tell the difference between what is a fiction in our own mind and what is the reality."
Harari's quotes underline the role of fiction in enabling large-scale human cooperation and the critical skill of discerning between fictional narratives and reality, especially as fictions can lead to conflicts and manipulation.
"I'm very worried about two things." "AI is nothing like print. It's nothing like the industrial revolution of the 19th century." "Once you can connect directly brains to computers... nobody has any idea what happens next."
These quotes reflect Harari's deep concern about the rapid advancement of AI and the unprecedented challenges it poses, as well as the speculative nature of future technologies like brain-computer interfaces.
"Sapiens in the beginning was the word." "The reason that we controlled the world and not the chimpanzee or the elephants is because we had a much more sophisticated language."
Harari's quotes emphasize the fundamental importance of language and storytelling in human history and the potential risks posed by AI's evolving capabilities to manipulate language and create content autonomously.
"AI could create new kinds of money the same way that cryptocurrencies like bitcoin have been created, simply by somebody telling people a story and enough people finding this story convincing."
The quote highlights the possibility of AI crafting narratives that could lead to the creation of new kinds of money, similar to the emergence of cryptocurrencies.
"What happens to the financial system and even to the political system if AI eventually creates new financial devices that humans cannot understand?"
This quote expresses concern about the implications for the financial and political systems if AI creates financial devices too complex for human understanding.
"This financial crisis, to a large extent, began with these extremely complicated financial devices... And what happens if now AIS comes with even more sophisticated financial devices?"
The quote draws a parallel between past financial crises caused by complex financial instruments and the potential future risk posed by AI-created financial devices.
"What happens if you have an algorithm in charge of your security system, and it alerts you to a massive incoming cyberattack, and you have to react immediately."
This quote raises the issue of AI making urgent security decisions that humans may not have the capacity to understand or evaluate in time.
"But it's obviously nonsensical... even with previous technology, it was possible to a large extent, to predict people's behavior and to manipulate them, and AI just takes it to the next level."
This quote refutes the argument that human free will makes us immune to AI's ability to understand and manipulate us, suggesting that AI enhances capabilities already present in previous technologies.
"The AI is deliberately built, created, trained to fool us... to forge intimate relationships with humans."
The quote emphasizes that AI's ability to mimic intimacy is intentionally designed, which could lead to manipulation and profound effects on human relationships.
"But also the big question what does it mean for the health of our own mind, of our own psyche, if we are in a relationship, or many of our important relationship in life are with non conscious entities."
This quote questions the psychological impact of forming significant relationships with entities that lack consciousness, such as AI, and the potential consequences for human well-being.
"We just don't really know how to translate power into happiness. And this is very clear when you look at the lives of the most powerful people in the world, that there is no correlation between how rich and powerful you are and how happy you are."
This quote underlines the disconnect between having power and achieving happiness, emphasizing that increased power does not guarantee a happier life.
"Another related problem is that we will not get to immortality. We will get to something that maybe should be called, ah, mortality."
This quote highlights the unrealistic nature of true immortality and introduces the concept of "ah-mortality," where life can be extended but is still vulnerable to unforeseen events.
"I think we just shouldn't go there, that we shouldn't invest a lot of resources, efforts in developing these kinds of upgrades and enhancements."
This quote expresses the speaker's belief that humanity should avoid pursuing genetic enhancements that could lead to a divided and unequal society.
"I think many jobs, maybe most jobs will disappear, but new jobs will emerge."
This quote acknowledges the transformative effect of AI on employment while also suggesting that new types of jobs will arise in the future.
"Nobody has any idea... This is the first time in history when we have no idea how the job market or how society would look like in 20 years."
This quote emphasizes the unprecedented uncertainty regarding the future of jobs and the skills that will be necessary.
"We are now in a new era of wars and potentially of imperialism... the relatively peaceful era of the early 21st century, it did not result from some miracle. It resulted from humans making wise decisions in previous decades."
This quote reflects on the recent increase in global conflicts and the need for conscious decisions to maintain peace.
"And if it happens, it is likely to be the kind of like the death blow to what remains of the global order, and he says it openly now."
This quote suggests that certain political leaders' ideologies and potential re-election could have a detrimental effect on the global order and stability.
"If you don't have a system of global norms and values, then very quickly what you have is just global conflict, it's just wars."
This quote emphasizes the necessity of having a system of global norms and values to prevent conflict and wars among nation-states. The absence of such a system leads to competition and conflict.
"Information is the food of the mind, and if you eat too much of it of the wrong kind, you'll get a very sick mind."
Harari compares information to food, suggesting that just as an unhealthy diet can harm the body, consuming too much or the wrong kind of information can lead to an unhealthy mind.
"If you try to keep an organic entity awake and constantly processing information and reacting 24 hours a day, it will very soon collapse."
This quote highlights the human need for rest and the dangers of expecting continuous engagement with information, which can lead to mental and physical collapse.
"According to this measurement, 1 hour of outrage is better than ten minutes of joy and certainly better than 1 hour of sleep."
Harari criticizes the metric of user engagement used by social media and streaming services, pointing out that it often prioritizes negative emotions like outrage over positive experiences like joy or the essential need for sleep.
"If you don't know how to handle boredom, if the minute there is a hint of boredom, you run away to some exciting thing, you will never experience peace of mind."
The quote reflects on the importance of being comfortable with boredom as a prerequisite for peace of mind, suggesting that constantly seeking excitement prevents one from achieving tranquility.
"My objective is to make this the best performing fund in Europe, with a focus on high growth companies that I believe will be the next european unicorns."
Speaker C expresses their ambition for the Flight Fund, highlighting the focus on high-potential companies and the goal of achieving top performance in Europe.
"I don't envy the people who grow up in the 2020s."
This quote reveals Harari's perspective on the current era as less favorable compared to the peaceful and optimistic period during which he grew up.
"The best way to make a difference is to cooperate with other people."
Harari stresses the importance of cooperation in activism, suggesting that collective efforts are more effective than isolated actions in creating change.
"History is not really the study of the past. History is the study of change, of how things change."
This quote captures the essence of history as a discipline focused on understanding change, which is crucial for influencing the present and future.
"I would say that people should consume less information and spend more time reflecting and digesting what they already know, what they already heard."
Harari proposes a global law to reduce information overload and promote reflection, emphasizing the need for balance in information consumption.