Persona Distortions from AI Writing

Researchers investigated how AI writing create persona distortions. The study found writers using AI came across as more opinionated, more competent, and more positive. Their perceived demographic profile shifted toward more privileged groups:

If AI writing assistance shifts the perceived extremity of political opinions, making writers seem more moderate or more radical, it could fuel misperceptions of public opinion, deepen partisan animosity, and reduce willingness to engage across ideological lines. If it elevates perceived writing quality or apparent expertise, it could lend unearned credibility to weak arguments and misinformation by decoupling surface fluency from genuine competence. If it inflates or dampens the emotional or moral tone of text, it could amplify outrage-driven content and intergroup hostility, or suppress mobilization around genuine grievances. And if it shifts inferences about a writer’s demographic background – such as their perceived education, race, age, or gender – it could mask identity signals that writers intend to convey, distort evaluations of competence, and alter the personal and professional opportunities writers are offered. These distortions need not be dramatic to matter: at the scale of billions of user requests for AI writing assistance, even modest systematic shifts in how writers are perceived could accumulate into widespread misattribution of credibility, stance, and identity.