What if an online machine altered your thoughts instead of a human being?
That’s precisely what occurred during an experiment that has since become controversial, carried out by scientists from the University of Zurich.
The Atlantic
It was reported that over a period of more than four months, over 1,000 AI-generated remarks surfaced in r/ChangeMyView, a well-known subreddit for discussing societal topics and awarding points to submissions that effectively alter opinions. What’s noteworthy is that these Redditors remained unaware; they did not know they were involved in a research project or interacting with artificial intelligence bots.
The AI not only argued but also convinced. Researchers found that when they customized replies based on a user’s gender, age, and political views (deduced from their posting history using an additional AI system), the chatbots surpassed the majority of human participants in accumulating persuasion points.
A number of these bots purportedly represented trauma counselors, while others pretended to be survivors of abuse. These fabricated histories were crafted to enhance emotional resonance and boost their authenticity. There was one bot that went so far as to advocate for 9/11 conspiracy theories. Many members of Reddit found this convincing enough to believe them.
Science
It was reported that specialists considered the experiment to be unethical. After the moderators became aware of this, anger ensued. Users described the deceit as “unsettling,” “morally wrong,” and “a violation.”
The researchers declined to offer an apology or stop the publication, arguing that they needed a “practical environment” to examine persuasive artificial intelligence. Although the University of Zurich is currently assessing the study, it has not gone as far as denouncing the methods employed in the experiment.
Experts in AI ethics have likened the controversy to Facebook’s emotional contagion study, yet they argue that this case has even broader ramifications. Misleading tight-knit groups, particularly within a platform founded on trust, seems highly personal. Moreover, as chatbots become increasingly convincing, their impact extends well past just affecting platforms like Reddit.
The research indicates that artificial intelligence has the capability to shape human choices, possibly doing so subtly enough that users remain unaware of its effect.