Truth from the machine: artificial intelligence and the materialization of identity

When AI is seen as a source of truth and scientific knowledge, it may lend public legitimacy to harmful ideas about identity.

Access the Article

Critics now articulate their worries about the technologies, social practices and mythologies that comprise Artificial Intelligence (AI) in many domains. In this paper, we investigate the intersection of two domains of criticism: identity and scientific knowledge. On one hand, critics of AI in public policy emphasise its potential to discriminate on the basis of identity. On the other hand, critics of AI in scientific realms worry about how it may reorient or disorient research practices and the progression of scientific inquiry. We link the two sets of concerns—around identity and around knowledge—through a series of case studies. In our case studies, about autism and homosexuality, AI figures as part of scientific attempts to find, and fix, forms of identity. Our case studies are instructive: they show that when AI is deployed in scientific research about identity and personality, it can naturalise and reinforce biases. The identity-based and epistemic concerns about AI are not distinct. When AI is seen as a source of truth and scientific knowledge, it may lend public legitimacy to harmful ideas about identity.

Related Resources

Allen Lab Fellow Spotlight: City Charters Are Deliberative Democracy’s Friends

Commentary

Allen Lab Fellow Spotlight: City Charters Are Deliberative Democracy’s Friends

Allen Lab Fellow Tyler Fisher examines the untapped potential of city charters as a vehicle for deliberative democracy, arguing that advocates should work to embed tools like citizen assemblies, participatory budgeting, and town meetings directly into the governing architecture of cities, institutionalizing deliberative democracy one municipality at a time.

More on this Issue

Work in the Age of AI: Reflections from After Neoliberalism

Commentary

Work in the Age of AI: Reflections from After Neoliberalism

Allen Lab member Charlie Covit reflects on the After Neoliberalism conference and examines the intersection of artificial intelligence and the future of work, arguing that AI forces a democratic reckoning with the meaning of labor itself and that an economy which generates abundance while stripping citizens of purpose and dignity undermines the very foundation of democratic life.

AI models appear to recognize moral complexity — then ignore it, new study by researchers affiliated with Harvard Kennedy School’s Allen Lab finds
Outstretched hands holding a graphic of a scale and the outlines of two heads.

Media Release

AI models appear to recognize moral complexity — then ignore it, new study by researchers affiliated with Harvard Kennedy School’s Allen Lab finds

New study published in AI and Ethics introduces a new ethical-moral intelligence framework for AI and finds that leading AI models mimic human moral concern while making decisions that reveal a hidden value hierarchy. 

Artificial Intelligence and Democracy: Campaigns, Elections, Movements, and Deliberation
The U.S. Capitol with a digital grid overlay.

Article

Artificial Intelligence and Democracy: Campaigns, Elections, Movements, and Deliberation

A new chapter in APSA Preprints by Archon Fung, Winthrop Laflin McCormack Professor of Citizenship and Self-Government and Director of the Ash Center, Bailey Flanigan, former postdoctoral fellow at the Ash Center and co-authors explores how generative AI is reshaping four dimensions of democratic practice—political campaigns, election administration, social movements, and citizen deliberation. The authors argue that AI’s ultimate democratic impact will depend less on the technology itself, and more on how institutions and leaders implement and regulate it.