Biases in Administrative Service Encounters: Transitioning from Human to Artificial Intelligence
This project aims to analyze communicative biases in public service encounters to assess the impact of transitioning from human to AI agents, enhancing service delivery while safeguarding democratic legitimacy.
Projectdetails
Introduction
Artificial intelligence (AI) holds the potential to assist or even replace civil servants in citizen-state interactions, which refer to those instances in which citizens seek or receive assistance, information, or support from a public agency. In Germany alone, around 130 to 150 million such public service encounters (PSE) occur each year, with the current proportion of digital encounters, facilitated through email or chatbots, standing at 41 percent. This is only the beginning of a revolution that will accelerate due to technological innovation and scarcity in human resources.
Project Goal
The goal of this project is to study the consequences of shifting from human to AI-powered conversational agents in PSE.
Research Context
Paradoxically, while the transition to artificial encounters is already taking place in practice, we still lack understanding of what happens during conventional human encounters. This prevents researchers from evaluating the consequences of shifting from one venue to the other.
Research Questions
Therefore, the project’s main research questions are:
- How can we conceptualize and measure communicative biases in PSE?
- What biases emerge in the verbal communication of humans and AI agents in PSE?
- How does variation in communication affect citizen perceptions of the encounter?
Potential Impact
AI has the potential to improve service delivery, but there are also risks for the legitimacy of democracy. Without further research, the introduction of AI threatens to merely shift biases from one venue (civil servants) to another (AI agents).
Project Contributions
As its ground-breaking contributions, the project:
- Develops natural language processing tools to operationalize verbal communication.
- Collects data from human encounters in PSE and realizes experiments on AI-based encounters.
- Analyzes such data to formulate and test a theory about communicative biases in PSE.
- Produces and disseminates urgently needed practical insights on the application of AI conversational agents in the public sector.
Financiële details & Tijdlijn
Financiële details
Subsidiebedrag | € 1.954.746 |
Totale projectbegroting | € 1.954.746 |
Tijdlijn
Startdatum | 1-5-2025 |
Einddatum | 30-4-2030 |
Subsidiejaar | 2025 |
Partners & Locaties
Projectpartners
- ZEPPELIN UNIVERSITAT GEMEINNUTZIGE GMBHpenvoerder
Land(en)
Vergelijkbare projecten binnen European Research Council
Project | Regeling | Bedrag | Jaar | Actie |
---|---|---|---|---|
MANUNKIND: Determinants and Dynamics of Collaborative ExploitationThis project aims to develop a game theoretic framework to analyze the psychological and strategic dynamics of collaborative exploitation, informing policies to combat modern slavery. | ERC STG | € 1.497.749 | 2022 | Details |
Elucidating the phenotypic convergence of proliferation reduction under growth-induced pressureThe UnderPressure project aims to investigate how mechanical constraints from 3D crowding affect cell proliferation and signaling in various organisms, with potential applications in reducing cancer chemoresistance. | ERC STG | € 1.498.280 | 2022 | Details |
Uncovering the mechanisms of action of an antiviral bacteriumThis project aims to uncover the mechanisms behind Wolbachia's antiviral protection in insects and develop tools for studying symbiont gene function. | ERC STG | € 1.500.000 | 2023 | Details |
The Ethics of Loneliness and SociabilityThis project aims to develop a normative theory of loneliness by analyzing ethical responsibilities of individuals and societies to prevent and alleviate loneliness, establishing a new philosophical sub-field. | ERC STG | € 1.025.860 | 2023 | Details |
MANUNKIND: Determinants and Dynamics of Collaborative Exploitation
This project aims to develop a game theoretic framework to analyze the psychological and strategic dynamics of collaborative exploitation, informing policies to combat modern slavery.
Elucidating the phenotypic convergence of proliferation reduction under growth-induced pressure
The UnderPressure project aims to investigate how mechanical constraints from 3D crowding affect cell proliferation and signaling in various organisms, with potential applications in reducing cancer chemoresistance.
Uncovering the mechanisms of action of an antiviral bacterium
This project aims to uncover the mechanisms behind Wolbachia's antiviral protection in insects and develop tools for studying symbiont gene function.
The Ethics of Loneliness and Sociability
This project aims to develop a normative theory of loneliness by analyzing ethical responsibilities of individuals and societies to prevent and alleviate loneliness, establishing a new philosophical sub-field.
Vergelijkbare projecten uit andere regelingen
Project | Regeling | Bedrag | Jaar | Actie |
---|---|---|---|---|
Human collaboration with AI agents in national health governance: organizational circumstances under which data analysts and medical experts follow or deviate from AI.This project aims to explore the socio-cultural dynamics of AI in health governance across six countries to develop a theory on ethical AI intervention and its impact on national health policies. | ERC STG | € 1.499.961 | 2023 | Details |
Conveying Agent Behavior to People: A User-Centered Approach to Explainable AIDevelop adaptive and interactive methods to enhance user understanding of AI agents' behavior in sequential decision-making contexts, improving transparency and user interaction. | ERC STG | € 1.470.250 | 2023 | Details |
Developing Bias Auditing and Mitigation Tools for Self-Assessment of AI Conformity with the EU AI Act through Statistical MatchingAct.AI aims to enhance AI fairness and compliance with the EU AI Act by providing a versatile, plug-and-play tool for continuous bias monitoring across various data types and industries. | ERC POC | € 150.000 | 2024 | Details |
Participatory Algorithmic Justice: A multi-sited ethnography to advance algorithmic justice through participatory designThis project develops participatory algorithmic justice to address AI harms by centering marginalized voices in research and design interventions for equitable technology solutions. | ERC STG | € 1.472.390 | 2025 | Details |
Human collaboration with AI agents in national health governance: organizational circumstances under which data analysts and medical experts follow or deviate from AI.
This project aims to explore the socio-cultural dynamics of AI in health governance across six countries to develop a theory on ethical AI intervention and its impact on national health policies.
Conveying Agent Behavior to People: A User-Centered Approach to Explainable AI
Develop adaptive and interactive methods to enhance user understanding of AI agents' behavior in sequential decision-making contexts, improving transparency and user interaction.
Developing Bias Auditing and Mitigation Tools for Self-Assessment of AI Conformity with the EU AI Act through Statistical Matching
Act.AI aims to enhance AI fairness and compliance with the EU AI Act by providing a versatile, plug-and-play tool for continuous bias monitoring across various data types and industries.
Participatory Algorithmic Justice: A multi-sited ethnography to advance algorithmic justice through participatory design
This project develops participatory algorithmic justice to address AI harms by centering marginalized voices in research and design interventions for equitable technology solutions.