The centre is part of Simula and exists as its own website. ISF is a research partner and is represented by Bernard Enjolras and Øyvind Bugge Solheim. Enjolras leads work package 9 (WP9), called “AI alignment and human interaction.”
Background WP9
Artificial intelligence (AI) is being integrated into an increasing number of societal institutions — from healthcare and the justice system to education, the labor market, and public administration — and with this development follows a fundamental question: How can we ensure that these systems act in accordance with human values, norms, and goals? This is the core of what is known as the alignment problem. The problem is far more than technical: every technical solution presupposes normative choices about whose values should form the basis, who carries the risk of errors, and who has the authority to intervene.
The challenges can be understood at three levels:
At the micro level — the model level — the issue concerns how AI systems learn and generalize values.
At the meso level — within organizations and institutions — AI alters power relations and decision-making structures: algorithmic management reshapes the relationship between leadership and employees, clinical decision-support systems change physicians’ autonomy, and predictive policing reallocates discretion between street-level officers and centralized units, together contributing to a diffusion of responsibility.
At the macro level — society and democracy — systemic feedback loops arise that are difficult to predict: algorithmic credit scoring reinforces housing segregation, automation polarizes the labor market and concentrates economic power, AI-driven propaganda threatens democratic deliberation, and centralized foundation models risk narrowing cultural diversity into a homogeneous normative perspective.
Approach WP9
Three research questions will be central to work within the theme “AI Alignment”:
- Value pluralism and multi-stakeholder alignment — whose values are actually embedded in today’s systems, and how to design scalable participation mechanisms that are not merely symbolic.
- AI-driven influence and democratic resilience — how persuasive AI-generated content is, which groups are most vulnerable, and what measures can strengthen resilience without threatening freedom of expression.
- Governance and institutional design — how to design governance mechanisms that work in practice, and how to connect technical guarantees at the micro level with institutional robustness and systemic fairness.