Writing with AI tools can have bias, sway a person's opinions: Study

New York, May 18 (IANS): Just as social media can facilitate spread of misinformation, Artificial Intelligence (AI)-powered writing assistants that autocomplete sentences or offer "smart replies" can be biased and produce shifts in opinion, and hence can be misused, warned researchers calling for more regulation.

Researchers from Cornell University in the US said the biases baked into AI writing tools -- whether intentional or unintentional -- could have concerning repercussions for culture and politics.

To probe, Maurice Jakesch, a doctoral student in the field of information science from the varsity, asked more than 1,500 participants to write a paragraph answering the question, "Is social media good for society?"

People who used an AI writing assistant that was biased for or against social media were twice as likely to write a paragraph agreeing with the assistant, and significantly more likely to say they held the same opinion, compared with people who wrote without AI's help.

"The more powerful these technologies become and the more deeply we embed them in the social fabric of our societies," Jakesch said, "the more careful we might want to be about how we're governing the values, priorities and opinions built into them."

These technologies deserve more public discussion regarding how they could be misused and how they should be monitored and regulated, the researchers said. Jakesch presented the study at the 2023 CHI Conference on Human Factors in Computing Systems in April.

Further, the team found that the survey revealed that a majority of the participants did not even notice the AI was biased and didn't realise they were being influenced.

When repeating the experiment with a different topic, the research team again saw that participants were swayed by the assistants.

"We're rushing to implement these AI models in all walks of life, but we need to better understand the implications," said Mor Naaman, Professor at the Jacobs Technion-Cornell Institute at Cornell Tech.

"Apart from increasing efficiency and creativity, there could be other consequences for individuals and also for our society -- shifts in language and opinions," Naaman added.



Top Stories

Leave a Comment

Title: Writing with AI tools can have bias, sway a person's opinions: Study

You have 2000 characters left.


Please write your correct name and email address. Kindly do not post any personal, abusive, defamatory, infringing, obscene, indecent, discriminatory or unlawful or similar comments. Daijiworld.com will not be responsible for any defamatory message posted under this article.

Please note that sending false messages to insult, defame, intimidate, mislead or deceive people or to intentionally cause public disorder is punishable under law. It is obligatory on Daijiworld to provide the IP address and other details of senders of such comments, to the authority concerned upon request.

Hence, sending offensive comments using daijiworld will be purely at your own risk, and in no way will Daijiworld.com be held responsible.