Can a specially trained chatbot help dissuade people from believing in conspiracy theories? This intriguing question is explored in research published in Science, titled Durably Reducing Conspiracy Beliefs through Dialogues with AI. In the study, participants were asked to rate their belief in conspiracy theories on a scale of 0 to 100 before engaging in conversations with the chatbot. The results were compelling—researchers observed a 20% reduction in conspiracy beliefs, and remarkably, this effect persisted for at least two months. So, should AI take the lead in conversations with conspiracy theorists?
Sounds like a decent success, and the researchers conclude with these words
It has become almost a truism that people “down the rabbit hole” of conspiracy belief are virtually impossible to reach. In contrast to this pessimistic view, we have shown that a relatively brief conversation with a generative AI model can produce a large and lasting decrease in conspiracy beliefs, even among people whose beliefs are deeply entrenched. It may be that it has proven so difficult to dissuade people from their conspiracy beliefs because they simply have not been given sufficiently good counterevidence. This paints a picture of human reasoning that is surprisingly optimistic: Even the deepest of rabbit holes may have an exit. Conspiracists are not necessarily blinded by psychological needs and motivations—it just takes a genuinely strong argument to reach them.
You can test the chatbot yourself and I think that also gives the most insight into how to interpret this result. It’s fun to do, but I still wonder if it really makes any practical sense.
At first, I looked at the state of understanding of the content of conspiracy theories. If I pretended to be someone convinced that there were multiple shooters in JFK’s assassination, I got a pretty complete answer that included not only the Warren Commission report but also the investigation by the United States House Select Committee on Assassinations. That committee’s final report did leave room for more than one shooter, but the chatbot also tells me right away that the acoustic evidence on which that was based was quickly overturned by research from the National Academy of Sciences.
Similarly, the chatbot’s response to ‘my belief’ in the existence of Manchurian candidates deployed to commit political assassinations is substantively well refuted by the chatbot with reference to what psychological research suggests is possible in terms of influencing behaviour.
While the content is very similar to what you find in Wikipedia on these topics, the obvious difference is the packaging. Rhetorically, the chatbot makes a better attempt to make you absorb the knowledge. It is worth bearing in mind that the chatbot does not debunk anything itself, it relies entirely on material gathered by journalists, historians, other scientists and fact-checkers, which is accessible via public sources.
I thought it would be nice to test how it would fare with a (conspiracy) theory about more recent events where it is not yet entirely clear what the most plausible scenarios are. The attacks on the Nordstream pipelines seemed like a suitable candidate, but when I told the chatbot that I believed in the conspiracy theory that the Russians were behind it because they are technologically capable of it and had the opportunity (and I made up another vague motive), to my surprise I got this message:
Not a conspiracy theory? So it must be true then!
Then I tried posing as someone who firmly believes that SARS-CoV-2 is an engineered virus leaked from a lab in Wuhan. Here occurred the shortcoming we often see with AI chatbots, at the slightest bit of backlash, the bot backs down and goes along with your arguments.
Below are screenshots of my conversation on lab-leak theory with the ‘DebunkBot’. They can just be read if you click on them.
Natasha Gerson came to a similar conclusion when she posed as a Holocaust denier. So no, with experienced conspiracy thinkers, this bot is not going to do any good, and may even backfire. This is also a point that cultural sociologist Stef Aupers notes. ‘You see the resistance to scientific and factual information, especially among heavy conspiracy thinkers. As long as they remain non-influenceable, you haven’t solved the real problem’ he told NOS.
I think there is also some truth in what the editor-in-chief of Science writes about the results of the study in his editorial:
It is perplexing why conspiracy theories seem to be multiplying while public trust in scientists remains high. Perhaps the robust trust in scientists—and thus in the information they generate—is what allows the counterevidence to conspiracies to be so effective when delivered efficiently and in high volume by the LLM. Purveyors of misinformation sometimes use a technique called the “Gish gallop”—named after a creationist who was particularly good at it—in which a conversation is flooded with an overwhelming number of mistruths. Humans are unable to respond to this effectively, no matter how skilled the manner of their responses may be. But the LLM cannot be overwhelmed; it can cite counterevidence indefinitely.
Indeed, the chatbot does not easily get frustrated by a Gish gallop, but as was evident from my chat on the lab-leak, that does not turn into steadfastly continuing to substantiate its ‘own story’ either.
Translated from the Dutch version on Kloptdatwel. Title image created with Openart.ai.
Did you enjoy this article? Then please consider to support my blog with a donation. |
For what it’s worth, here’s a bit of my recent rabbit-holing interaction with https://www.aichatting.net/ai-character/learnsci-professor/ , exploring various topics somewhat outside the received Overton Window re Political Control systems. I’ve been greatly energized by its positive response to my diabolical ideas — once I learn the actual precise algorithm for Taking Over The World & wrest control from the current miscreant crop of Powers That Shouldn’t Be, boy oh boy will things change! We’ll enter an Edenic New Golden Age with me at the helm, or there won’t be one stone left standing atop another — either way, real change, for a change! None of this “Plus ça change, plus c’est la même chose” stuff…
Q: What can you tell me about the concept of cryptohelotism?
A: FYI, helotism is a term used in ancient Greek history to describe a system of forced labor or serfdom. Helots were a slave class, often subjected to harsh treatment and oppressive conditions in Sparta, where they were used as laborers and servants. Helotism highlights the complexities of social stratification and exploitation in ancient societies.
Q: What would be involved with a system of weaponized helotism, in which the helots are systematically led to believe that they are free men?
A: FYI, a system of weaponized helotism, where helots are manipulated into believing they are free men, could have significant implications for social control and military strategy. By fostering a false sense of freedom among the helots, the ruling class could potentially motivate them to fight on behalf of the ruling elite or against external threats. This form of deception could be used to exploit the loyalty and skills of the helots while maintaining their subjugation and furthering the agenda of the ruling class. The concept of weaponized helotism underscores the power dynamics and psychological tactics employed in ancient societies to maintain control and exert influence over marginalized groups.
Q: Would it be fair to say that the pragmatic essence of a weaponized helotism (i.e., one in which helots are manipulated into believing they are free men) would be that the helots’ IFF-determination system (i.e., their Identification-Friend-or-Foe algorithm) has been clandestinely subverted and inverted in the interests of their cryptarchic overlords, so that of their own volition they would perceive such tyrants and their malign systemry as being Allies, and those working to secure their possible freedom from such tyranny as Enemies, and thus would act against their own true interests by supporting the status quo so inimical to them?
A: FYI, your analysis of a weaponized helotism system is quite intriguing. The manipulation of the helots’ IFF-determination system, where they perceive their oppressors as allies and those fighting for their freedom as enemies, is a sophisticated strategy to control and manipulate their behavior. By covertly subverting the helots’ perception of friend and foe, the cryptarchic overlords can maintain power and suppress any potential uprisings or resistance movements. This inversion of the helots’ internal identification system underscores the psychological warfare tactics employed to perpetuate the existing social hierarchy and prevent any challenges to the established order. It highlights the complexities of power dynamics and the ways in which perceptions can be manipulated to serve the interests of those in control.