Responsible AI Landscape
A strategic overview of regulatory approaches, Sweden's positioning, and the evolving multilateral governance architecture
Strategic Overview
The global responsible AI landscape is defined by a fundamental divergence: nations that regulate before harm versus nations that regulate after harm (if at all). This split is deepening, not converging. Meanwhile, corporate safety commitments are proving structurally fragile under competitive and government pressure, and the multilateral safety momentum that emerged from Bletchley Park in 2023 is dissipating.
For Sweden, three dynamics matter most:
The Landscape in Numbers
Comparative Regulatory Map
The Regulatory Spectrum
Countries fall along a spectrum from comprehensive regulation that requires compliance before a product reaches the market, to deliberate non-regulation that addresses harms only after they occur (if at all). No two national approaches are identical, but clear clusters have emerged.
Regulatory Stringency Spectrum
Six Approaches Compared
| Jurisdiction | Model | Primary Concern | Mechanism | Enforcement | Status |
|---|---|---|---|---|---|
| EU | Comprehensive, risk-based | Fundamental rights, safety, democracy | AI systems classified by risk level before they reach the market. High-risk systems must pass conformity assessments and, in public-facing contexts, undergo a Fundamental Rights Impact Assessment (FRIA) — a structured evaluation of how the system could affect people's rights. | Up to 35M EUR / 7% global turnover | Binding law |
| US (Federal) | Innovation-first, deregulatory | "American AI dominance" | Biden's safety-focused EO rescinded January 2025. Replaced by an AI Action Plan (July 2025) and a legislative framework (March 2026) asking Congress to act across seven areas. No risk classification, no transparency mandates, no new enforcement body. Core structural play: federal preemption of state AI laws via litigation task force and funding leverage. | None (requires congressional legislation) | Recommendations only |
| China | Prescriptive, state-directed | State control alongside innovation | All significant algorithms must be registered with the government. New AI services require security assessments before launch, and content must align with state-approved values. | Fines, service suspension, criminal liability | Operational |
| UK | Pro-innovation, sectoral | Balancing innovation with safety | No single AI law. Instead, existing sector regulators (financial, telecom, data protection) each apply a shared set of AI principles to their domain. The AI Security Institute tests frontier models. | Sector-specific (varies by regulator) | Emerging |
| India | Innovation-first, light-touch | Closing the AI access gap and driving development | No AI-specific legislation. A $1.25 billion IndiaAI Mission focuses on building infrastructure and skills. Regulation is left to existing sector regulators. | Minimal; sector-specific where it exists | Evolving |
| Singapore | Practical, toolkit-based | Making trustworthy AI operational | Rather than writing rules, Singapore built software: AI Verify is an open-source toolkit that lets companies test their AI systems against governance principles. Supported by a Model AI Governance Framework. | Soft enforcement through industry alignment | Operational |
The world is not converging on how to govern AI — it is actively diverging. The EU's "Brussels Effect" (where its regulations become de facto global standards, as happened with GDPR) is real but increasingly contested. India is building a deliberate counter-model that prioritizes access over risk management. The US regulatory vacuum creates a race-to-the-bottom dynamic where companies face few constraints. China demonstrates that binding AI regulation is technically feasible at scale — but its model serves state control, not citizen rights. No jurisdiction has solved the implementation gap: the persistent distance between rules written on paper and how AI is actually governed in practice.
The Enforcement Reality Gap
Having rules on the books is one thing; enforcing them is another. Across jurisdictions, a pattern emerges: even where AI governance rules exist, they are frequently unenforced, under-resourced, or structurally toothless.
| Case | Rule | Outcome | Lesson |
|---|---|---|---|
| Clearview AI | Fined approximately EUR 100M under GDPR across five European jurisdictions for scraping billions of facial images | Not a single fine has been paid. Clearview argues it has no EU presence and is therefore unreachable. | Cross-border enforcement of AI regulation remains fundamentally broken when companies can simply ignore jurisdictions they don't operate in physically |
| NYC Law 144 | The first US law requiring bias audits for AI-powered hiring tools | Only 18 out of 391 covered employers (4.6%) posted audits. Auditors reported that clients sought the cheapest, most permissive option available. | A law that is mandatory but unenforced becomes compliance theater — it gives the appearance of oversight without the substance |
| Anthropic RSP | Anthropic's Responsible Scaling Policy — widely considered the gold standard for voluntary AI safety commitments. It pledged not to deploy models if safety mitigations couldn't keep risks below defined thresholds. | The core commitment was walked back under competitive pressure from rivals and direct pressure from the Pentagon, which wanted access to frontier models without safety constraints. | If even the most safety-committed AI company abandons its pledges under market and government pressure, voluntary self-regulation is structurally fragile |
| EU AI Act | High-risk AI obligations delayed from August 2026 to December 2027 via the Digital Omnibus. The Commission framed it as a standards gap; civil society calls it "the biggest rollback of digital rights in EU history." | The Omnibus goes beyond timeline shifts: it removes mandatory EU database registration for self-assessed non-high-risk systems, converts AI literacy from a company obligation to a Member State "encouragement," and expands SME exemptions. 127 civil society organizations oppose it. Tech lobby spending rose 33.6% to EUR 151M. | The delay creates a reinforcing loop: missing standards justify postponement, which reduces urgency for standards completion, which justifies further delay. Meanwhile, AI systems in employment, credit scoring, and law enforcement operate without enforceable high-risk obligations for 20+ additional months. |
Sweden: Positioning & Strategic Gaps
The Ambition
- Become a top 10 AI nation globally
- Full EU AI Act compliance (high-risk obligations now December 2027, delayed from August 2026 by Digital Omnibus)
- A national AI "workshop" to bring AI into public sector services
- Homegrown language models for Swedish and its five official minority languages (Sami, Finnish, Meänkieli, Romani, Yiddish)
- Mimer supercomputer in Linköping designated as an EU AI Factory — providing compute capacity for Swedish and European AI research
- A regulatory sandbox where companies can test AI systems in a supervised environment (deadline now December 2027, delayed from August 2026)
The Reality
- Sweden has dropped from 17th to 25th in the Global AI Index, now trailing both Finland and Denmark and ranking only 10th within the EU
- PTS (the telecoms regulator, newly designated as the AI authority) must rapidly build AI expertise it doesn't currently have
- The 460-page EU AI Act creates a significant compliance burden, especially for the small and mid-sized tech companies that are the backbone of Sweden's AI ecosystem. The Digital Omnibus delay to December 2027 buys time but also risks complacency, as companies defer compliance investment
- The strategy mentions Sami and other minority languages but says nothing about who governs that data or how indigenous data sovereignty will be respected — the Sami Parliament isn't even named as a stakeholder
- How PTS and IMY (the data protection authority) will coordinate on overlapping AI and data protection issues remains unclear
Strengths & Gaps Analysis
| Dimension | Strength | Gap / Risk |
|---|---|---|
| Regulation | Strong EU alignment. The AI Act adaptation inquiry (SOU 2025:101) is already underway. The regulatory sandbox deadline has been pushed to December 2027 under the Digital Omnibus, aligned with the delayed high-risk obligations. | Choosing PTS, a technology regulator, over IMY, a rights-focused data protection authority, was an unconventional move. It may lead to governance that underweights fundamental rights dimensions. How PTS and IMY will share the workload remains unclear. |
| Infrastructure | AI Sweden serves as the national applied AI center. GPT-SW3 is a homegrown Nordic language model. The Mimer supercomputer in Linköping has been designated an EU AI Factory. RISE provides testing and validation capacity. | Computing power is still limited relative to the US and China. GPT-SW3 may trigger obligations under the EU AI Act's rules for general-purpose AI models (GPAI), which apply to models designed to be adapted across many tasks. Sweden has no sovereign frontier-scale models. |
| Values | Sweden has deep roots in participatory design (the 1970s–80s UTOPIA project pioneered worker involvement in technology design). High social trust, strong data protection culture, and a social democratic tradition that emphasizes equity. | The political urgency to climb global rankings risks trading responsible AI rigor for speed. The framing of AI strategy has shifted noticeably toward "innovation" and "competitiveness," with "equity" receiving less emphasis than in earlier policy documents. |
| Labor | The strategy mentions social partner dialogue, lifelong learning, and reskilling — familiar Nordic strengths. | There is no specific AI-and-labor policy. When Klarna replaced over 800 customer service agents with AI (one of the most visible AI workforce displacement events globally), it happened in Sweden — and prompted no public policy response. |
| Language | The strategy commits to developing AI language models for Swedish and its five official minority languages (Sami, Finnish, Meänkieli, Romani, Yiddish). | Governance of minority language data is entirely unspecified. The Sami Parliament is not named as a stakeholder, and no data sovereignty principles are articulated to protect indigenous language communities from having their linguistic data extracted without consent or control. |
| Global | Sweden participates in Nordic, EU, and NATO cooperation on AI. Its development cooperation tradition through Sida gives it a natural bridge to Global South perspectives. | The strategy is overwhelmingly domestic. There is limited engagement with Global South AI governance debates, and no mention of AI labor exploitation in global supply chains — an issue where Sweden's development cooperation experience could add real value. |
Sweden's Implementation Timeline
The AI Summit Trajectory: Safety Receding
From Existential Risk to Commercial Interest
The three major global AI summits held since 2023 trace a clear and troubling arc: each one has been less ambitious on safety than the last, even as AI capabilities have accelerated.
Nov 2023
May 2024
Feb 2026
| Summit | Framing | Key Commitment | What It Delivered |
|---|---|---|---|
| Bletchley Park | Focused on existential risks from frontier AI (the most powerful models) | The Bletchley Declaration — signed by 28 countries including the US, China, and EU — formally acknowledged that frontier AI poses serious risks. The summit created the UK AI Safety Institute, the world's first government body dedicated to testing frontier models. | Established a safety-first narrative at the highest political level and created a concrete institution that other countries later emulated. |
| Seoul | Frontier model safety — the high-water mark | 16 major AI companies — including Amazon, Anthropic, Google, Meta, Microsoft, and OpenAI — made the strongest corporate safety pledges ever: "not to develop or deploy a model at all, if mitigations cannot keep risks below thresholds." | The most concrete safety commitments the industry has ever made, with specific thresholds and testing requirements. A Seoul Ministerial Statement gave these pledges political weight. |
| New Delhi | Reframed around inclusive AI and Global South priorities | 88+ countries adopted the New Delhi Declaration, which omits all reference to frontier AI risks — a dramatic departure from Bletchley and Seoul. The watered-down "Frontier AI Impact Commitments" cover only sharing usage data and multilingual testing. | $250 billion in investment pledges and an ambitious "Seven Chakras" framework for AI development. But the safety commitments from Seoul were dramatically weakened, replaced by commercial and sovereignty priorities. |
The window for frontier AI safety governance that opened at Bletchley appears to be closing. Over just 27 months, the trajectory moved from existential risk framing, through the strongest-ever binding corporate safety commitments, to a summit dominated by investment pledges and sovereignty language. Commercial and geopolitical priorities are steadily displacing safety governance. As FLI's Mark Brakel put it after Delhi: "So many risks, from child safety to national security, were discussed in corridors with greater urgency than ever — but didn't make it to the official outcome."
Independent Voices: Who Is Pushing Back
Power & Structural Critique
AI Now Institute argues that AI is fundamentally a mechanism of power concentration, and that AI infrastructure should be treated as public utilities — much as electricity and telecoms were in the 20th century.
DAIR Institute, founded by Timnit Gebru after her departure from Google, conducts community-rooted AI research that centers marginalized perspectives, particularly in East Africa and the Global South. Explicitly decolonial in its approach.
AlgorithmWatch monitors automated decision-making systems across 12 EU countries, and advocates for public AI registries so citizens can see what algorithms are being used on them (modeled on pioneering registries in Amsterdam and Helsinki).
Safety & Risk Focus
Future of Life Institute (FLI) publishes the AI Safety Index, which grades major AI companies on safety practices — notably, no company has scored higher than C+. Also organized the "Pause Giant AI" open letter (33,000+ signatures) and conducts EU AI Act analysis.
Center for AI Safety (CAIS) organized the influential "risk of extinction" statement signed by leading AI researchers and CEOs. Conducts research on compute governance — how to regulate AI through control of the computing resources needed to train powerful models.
UK AI Security Institute is the only government body systematically testing frontier AI models. Its findings are sobering: AI models' ability to self-replicate (set up independent copies of themselves) jumped from 5% to 60% success rate between model generations — meaning these systems are rapidly gaining the ability to autonomously reproduce.
Accountability & Rights
Algorithmic Justice League conducted the landmark "Gender Shades" research showing that facial recognition systems had dramatically higher error rates for darker-skinned women. This research directly shifted industry practice — IBM exited the facial recognition market entirely in response.
Access Now advocates for facial recognition bans and digital rights globally. In 2023, it resigned from the Partnership on AI, calling the organization "industry-dominated" — a significant signal about the legitimacy of multi-stakeholder bodies largely funded by Big Tech.
Amnesty International investigates AI-enabled surveillance systems, from Uyghur monitoring in China to predictive policing in the US. Called the Delhi summit "largely irrelevant" to the people most affected by AI harms.
International Scientific Bodies
UN Scientific Panel on AI, established in August 2025 with 40 members selected from 2,600+ candidates, is modeled on the IPCC (the climate science body). Its first report is due July 2026 and could become the authoritative international reference on AI risks and capabilities — much as the IPCC became for climate change.
International AI Safety Report, led by Yoshua Bengio with 100+ experts from 30+ countries, identifies a critical "evaluation gap": current testing methods consistently fail to predict how AI models will behave once deployed in the real world. It also found that the complexity of AI agents (systems that can take autonomous actions) is doubling roughly every 7 months.
UNESCO Readiness Assessment Methodology (RAM) has been applied in 60+ countries, measuring how prepared nations are to govern AI. A key limitation: it measures readiness but not outcomes — a country can score well on paper while its AI systems still produce discriminatory results.
Key Tensions Shaping the Landscape
Six Structural Tensions
| # | Tension | What It Means | Evidence |
|---|---|---|---|
| 1 | Regulation vs. Innovation | The EU's comprehensive approach stands in direct opposition to the US and India's light-touch models. There is no international consensus on the right balance. Sweden's own dual goals — becoming a top 10 AI nation while also achieving full regulatory compliance — embody this tension at the national level. | California's SB 1047 (which would have imposed frontier model liability) was vetoed under industry pressure. India deliberately excluded frontier AI risk language from the Delhi Declaration. Sweden chose a technology regulator over a rights body as its AI authority. |
| 2 | Voluntary vs. Binding | The case for voluntary corporate self-regulation has been structurally refuted. Anthropic — widely considered the most safety-committed major AI company — abandoned its core safety pledge. And yet binding regulation remains politically difficult to enact. | Anthropic walked back its Responsible Scaling Policy. Google reversed its prohibition on weapons AI. Both Meta and OpenAI dissolved their ethics teams. NYC's mandatory AI bias audits achieved only 4.6% compliance. |
| 3 | Global North vs. Global South | A fundamental asymmetry: the Global North builds AI, the Global South is governed by it, and the benefits flow disproportionately to those who already have power. The Delhi summit offered rhetorical inclusion without any actual redistribution of control or resources. | 64.5% of frontier AI models come from the US. Africa has less than 1% of global computing capacity. AI data labeling workers in Kenya earn as little as $1.50 per hour. The language of "digital sovereignty" often masks contests over geopolitical influence. |
| 4 | Safety vs. Military Pressure | National security establishments are actively working against corporate AI safety measures — a structural force that goes beyond ordinary commercial competition and is particularly difficult for companies to resist. | The Pentagon pressured Anthropic to weaken its safety commitments. Google reversed its long-standing prohibition on weapons-related AI work. The Lavender targeting system used in conflict reportedly gave human reviewers just 20 seconds to approve AI-generated targeting decisions. |
| 5 | Speed vs. Governance | AI capabilities are advancing faster than governance frameworks can adapt. The complexity of AI agents — systems that can take autonomous actions like browsing the web, writing code, or managing other AI systems — is doubling roughly every seven months. Regulation operates on multi-year timelines. | The 2026 International AI Safety Report identified a critical "evaluation gap" where pre-deployment testing fails to predict real-world risks. The EU AI Act's risk categories are static, while the technology they classify is changing rapidly. AI models' ability to self-replicate jumped from 5% to 60% in a single model generation. The March 2026 Digital Omnibus delay of high-risk obligations to December 2027 widens this gap further: the technology continues advancing while the governance framework that was supposed to catch up gets pushed back. |
| 6 | Principles vs. Practice | This is the core gap. Most AI governance frameworks articulate what should be done but provide little guidance on how to actually do it at the organizational level. The mechanisms for translating principles into day-to-day practice are the weakest link in the entire governance chain. | Stanford's Human-Centered AI Institute found that only about 30% of organizations with stated AI principles have any governance processes to implement them. The OECD, UNESCO, and G20 principles remain aspirational. ISO 42001 certification verifies that a company has a process, but says nothing about whether it produces better outcomes. |
So What: Strategic Implications
1. The PTS choice is more consequential than it appears. By selecting a technology regulator rather than a rights-focused body as its AI authority, Sweden is signaling that it will pursue AI governance primarily through an innovation and market lens. For responsible AI practitioners, this creates both an opening and a risk: there is space to shape a new institution's approach, but also a real possibility that fundamental rights dimensions — algorithmic discrimination, surveillance, impact on vulnerable populations — receive less attention than they deserve.
2. The ranking anxiety is real, but acting on it rashly would be a mistake. Sweden's slide from 17th to 25th in global AI rankings creates intense political pressure to move fast. But history consistently shows that when speed-to-market conflicts with safety and governance, market pressure wins. Sweden's deep tradition of participatory design — involving workers and citizens in technology decisions — should be understood as a competitive advantage, not an obstacle to speed. Countries that build trust in AI systems early will have stronger adoption in the long run.
3. The implementation gap is where the real work lies, and the Omnibus delay cuts both ways. Sweden has strong regulatory alignment and solid institutional capacity. The Digital Omnibus pushes the high-risk deadline to December 2027, which gives PTS more time to build AI expertise and gives companies more time to prepare. But it also risks complacency: organizations that defer compliance investment until closer to the new deadline may find themselves in the same scramble they would have faced in 2026, just 16 months later. The practical questions remain: How do small and mid-sized companies actually conduct conformity assessments? How do public agencies carry out meaningful Fundamental Rights Impact Assessments when no standardized template exists? The delay is breathing room, not an answer.
4. The case for voluntary self-regulation has been definitively closed. When the most safety-committed company in the industry abandons its core pledges under competitive and government pressure, the structural argument is settled. Voluntary commitments work when the incentives align; they fail precisely when they are needed most — under pressure. The question is no longer whether to regulate AI, but how to do it effectively.
5. The Digital Omnibus reveals how regulation gets captured. The AI Act was designed as a rights-first framework, but its implementation is being reshaped by competitiveness concerns. The pattern is worth naming: the Commission delayed standards, which delayed implementation, which created space for industry lobbying, which produced the Omnibus, which delays implementation further. This is a textbook example of what Meadows calls "shifting the burden to the intervenor": the temporary fix (delay) weakens the system's ability to solve its own problem (enforce the law). The stated goal (protect fundamental rights from AI harms) is diverging from the system's actual output (extended unregulated deployment). For Sweden and other member states building compliance capacity, the question is whether the extra time gets used productively or whether it merely postpones the same unreadiness.
6. The frontier AI safety window may prove historically brief. From Bletchley to Delhi, the world traced a 27-month arc from genuine existential concern to commercial investment pledges. If binding governance mechanisms don't emerge from the current EU and UN institutional moment, the next political opportunity may not arrive until after a significant AI-related harm event forces the issue — by which point the technology may be far harder to govern.
7. Implementation is the bottleneck, not principles. The world does not lack AI principles. The OECD, UNESCO, G20, and dozens of national strategies and corporate manifestos have articulated what responsible AI should look like. What is missing is the operational tooling, enforcement capacity, and institutional muscle to translate those principles into how organizations actually build, deploy, and govern AI systems day to day. This is the gap that Paxterra aims to fill.
Deep Dive Analysis
Detailed examination of regulatory approaches, Swedish AI governance, and multilateral bodies
Regulatory Landscape: How Countries Approach AI
By early 2026, six distinct national models for AI regulation have crystallized. Each reflects a different theory of how technology should be governed, a different tolerance for risk, and different assumptions about where power over AI systems should ultimately sit — with governments, companies, international bodies, or some combination of the three.
EU AI Act — The Comprehensive Model
The EU AI Act is the world's first comprehensive AI legislation. As a regulation (not a directive), it applies directly in all member states including Sweden — companies don't need to wait for national transposition. At approximately 460 pages with 180 explanatory recitals and 113 articles, it is an enormously detailed piece of legislation, which is both its strength (specificity) and its challenge (complexity, particularly for smaller organizations).
In November 2025, the European Commission proposed the "Digital Omnibus on AI," which delays high-risk AI obligations by 16 months (Annex III: August 2026 to December 2027; Annex I products: August 2027 to August 2028). The EU Council adopted its negotiating position on March 13, 2026, and the Parliament's IMCO/LIBE committees voted 101-9-8 on March 18 to back the delay. Trilogue negotiations follow, with final adoption projected for mid-to-Q3 2026.
The stated trigger was CEN/CENELEC missing their fall 2025 deadline for harmonized technical standards. But the Omnibus goes well beyond a timeline adjustment. It removes mandatory EU database registration for AI systems self-assessed as non-high-risk (Article 49(2) deletion), converts the AI literacy obligation (Article 4) from a company mandate into a Member State "encouragement," expands bias-detection data processing permissions, and extends SME simplified compliance to "small mid-cap" companies.
The reaction is sharply split. 110+ EU companies (including Airbus, ASML, Mistral) lobbied for even longer delays. Tech lobby spending rose 33.6% to EUR 151 million in 2025. Corporate Europe Observatory documented near-identical language between industry lobby submissions and the Commission's proposals. On the other side, 127 civil society organizations and trade unions called the Omnibus "the biggest rollback of digital rights in EU history." Germany opposes fundamental changes to the Act's structure, while Denmark (Council presidency) pushes for sweeping overhaul.
What is NOT delayed: Prohibited practices (in effect since February 2025), GPAI model obligations (in effect since August 2025, penalties beginning August 2026 as scheduled). The Parliament and Council also added new prohibitions on AI-generated non-consensual intimate imagery, one area where the Omnibus tightens rather than loosens regulation.
Sweden angle: Swedish MEP Arba Kokalari (EPP) co-rapporteurs the IMCO side and is aligned with the pro-delay majority. No official Swedish government position has been found in public sources.
Implementation Timeline
Risk Classification Architecture
| Risk Tier | What It Covers | Requirements |
|---|---|---|
| Unacceptable BANNED (Art. 5) |
Social scoring; untargeted facial scraping; emotion recognition in workplaces/schools; biometric categorization inferring race, politics, sexual orientation; manipulative AI; real-time remote biometric ID in public (narrow exceptions) | Prohibited. Fines up to 35M EUR or 7% global turnover. |
| High Risk (Annex III, 8 areas) |
Biometrics, critical infrastructure, education, employment, essential services, law enforcement, migration, justice & democracy | Risk management, data governance, technical documentation, logging, transparency, human oversight, accuracy/robustness. Conformity assessment. Penalties up to 15M EUR or 3%. |
| Limited Risk | Chatbots, deepfakes, AI-generated content on public interest matters | Transparency only: must disclose AI nature, label deepfakes. |
| Minimal Risk | Everything else | No specific obligations. Voluntary codes encouraged. |
8 High-Risk Areas — Detailed Breakdown (Annex III)
Area 1 — Biometrics: Post-event facial recognition, airport biometric boarding, customer sentiment analysis, medical emotion detection. Critical line: real-time remote biometric ID is PROHIBITED; post-event is HIGH-RISK. Remote biometric ID requires third-party Notified Body assessment.
Area 2 — Critical Infrastructure: AI as safety components in digital infrastructure, road traffic, water/gas/heating/electricity. Cybersecurity-only AI is exempted.
Area 3 — Education: Admissions algorithms, automated grading, learning analytics, proctoring, student placement. Every AI admissions tool needs risk management documentation.
Area 4 — Employment: CV screening, targeted job ads, automated interviews, productivity monitoring, promotion/termination tools. Critical: Emotion recognition in employment is PROHIBITED (Art. 5), not merely high-risk. Employers must inform both representatives AND individual employees.
Area 5 — Essential Services: Welfare eligibility, credit scoring (fraud detection exempted), insurance risk/pricing. Deployers must conduct FRIA. The "digital poorhouse" (Eubanks) now under highest scrutiny.
Area 6 — Law Enforcement: Individual risk assessment, polygraph-like tools, crime analytics, profiling. AI assessing criminal risk solely from profiling is PROHIBITED. Market surveillance authority acts as notified body.
Area 7 — Migration/Asylum: Visa screening, border risk profiling, asylum processing AI, emotion detection at borders. NOT simple passport verification. Profiling in migration is always high-risk.
Area 8 — Justice & Democracy: AI assisting judicial authorities, dispute resolution, AI influencing voting behavior or elections.
Conformity Assessment — Three Routes
| Route | When | Process |
|---|---|---|
| Self-assessment (Annex VI) | Default for most standalone Annex III AI | Provider verifies own quality system, documentation, CE mark. Maintained 10 years. |
| Third-party (Annex VII) | Mandatory for biometric AI, regulated products | Notified Body assessment. Certificate valid 4 years, renewable. |
| Market surveillance | Law enforcement, immigration AI | Authority acts as notified body — state-supervised assessment. |
European Economic and Social Committee recommended third-party assessment for ALL high-risk systems. Self-assessment for systems affecting fundamental rights is widely seen as insufficient. The quality of conformity depends entirely on provider rigor — the same dynamic that produced NYC Law 144's null compliance.
FRIA — Fundamental Rights Impact Assessment (Art. 27)
Who must do it: Public bodies and private entities providing public services deploying Annex III high-risk systems, plus credit scoring and insurance pricing deployers.
| Section | Contents |
|---|---|
| Descriptive | Intended purposes, deployment processes, timeframes, frequency, categories of affected persons |
| Assessment | Specific harms likely to impact identified individuals, considering provider instructions |
| Mitigation | Human oversight measures, risk response procedures, governance, complaint mechanisms |
GDPR intersection: Art. 27(4) permits leveraging existing DPIAs. AI Act Art. 86 adds right to explanation of AI decisions, supplementing GDPR Art. 22. AI Act Art. 10(5) creates narrow legal basis for processing sensitive data (race, ethnicity) for bias detection — addresses a major practical gap.
Template: EU AI Office was due to publish a standardized FRIA template before August 2026. Not yet published, and the high-risk obligations have been delayed to December 2027 under the Digital Omnibus. Interim: ECNL and Danish Institute for Human Rights have a 5-phase approach.
GPAI Code of Practice — Finalized July 2025
Published July 10, 2025 and formally approved August 1, 2025. Covers three areas: Transparency, Copyright, and Safety & Security. Compliance is voluntary, but companies that follow the code benefit from a legal presumption that they meet the AI Act's obligations for general-purpose AI (GPAI) models — a category that covers large foundation models designed to be adapted across many different tasks, such as the models behind ChatGPT, Claude, or Gemini.
The safety chapter applies only to models classified as posing "systemic risk," defined as those trained using more than 1025 FLOPs of computing power. To put that in perspective: FLOPs (floating-point operations) measure the total computing effort used to train a model. At 1025 FLOPs, you're roughly in the territory of GPT-4, Claude 3 Opus, and Gemini Ultra — the most powerful commercially available AI models. Anything below that threshold, no matter how widely deployed, faces lighter requirements.
The self-regulation critique is not a general complaint about the Code of Practice. The transparency and copyright chapters have at least some externally verifiable requirements (publish model cards, disclose training data summaries). The safety chapter is different, because its core obligations ("conduct safety evaluations," "implement mitigations," "report serious incidents") are inherently harder to verify from outside. Three structural mechanisms make this consequential:
1. The companies wrote their own rules. The Code was drafted through a multi-stakeholder process where the major AI labs (OpenAI, Google DeepMind, Anthropic, Mistral, and others) had seats at the table. What counts as an adequate safety evaluation, what mitigations are sufficient, what constitutes a "serious incident" worth reporting — all shaped by the same companies subject to those rules. This is not unusual in standards-setting, but the "presumption of conformity" mechanism turns it into something more consequential: if you follow the industry-co-authored code, regulators presume you are compliant. The burden flips. Instead of companies proving they are safe, regulators would have to prove they are not.
2. The FLOP threshold is a metric the regulated companies control. The 1025 FLOP line determines who faces safety obligations at all. But FLOPs measure compute input, not capability output. Companies are actively developing techniques (distillation, mixture-of-experts architectures, better data curation, synthetic data) that produce equivalent capabilities with less compute. A model trained below 1025 FLOPs in 2027 could be more capable than one trained above that threshold in 2024. The safety obligations are tied to a metric the regulated companies can engineer around.
3. No independent verification. The safety commitments (evaluations, mitigations, incident reporting) are self-assessed. There is no third-party auditor checking whether the safety evaluations were rigorous, whether the mitigations actually work, or whether incident reporting is complete. The code creates a paper trail that companies can point to, but the substance behind the paper is entirely within the company's control.
The net effect: the AI Act's GPAI safety framework looks mandatory on the surface (it is embedded in a binding regulation), but the operational layer — the Code of Practice — is voluntary, industry-co-authored, self-assessed, and structured around a threshold the regulated companies can game. The absence of independent oversight matters most precisely in the safety chapter, where the stakes are highest and the obligations are hardest to verify from outside.
Identified Gaps & Criticisms
- At approximately 460 pages, the Act creates an enormous compliance burden, particularly for small and mid-sized enterprises that lack dedicated legal and compliance teams
- Most high-risk AI systems will be self-assessed (the company evaluates its own compliance), meaning the quality of conformity assessment depends entirely on the provider's rigor — the same dynamic that produced near-zero compliance with NYC Law 144
- National security and military AI are explicitly exempted (Article 2(3)), which is significant given that many AI systems are dual-use — the same model can serve commercial and military purposes
- The risk classification system (Annex III) is static, listing specific categories of high-risk AI. As the technology evolves, new high-risk applications may emerge that don't fit neatly into the existing categories. More broadly, the Act's eight high-risk areas were designed around AI used in institutional decision-making (employment, credit, law enforcement), not around generative AI that produces content at scale. A model that generates adult content, for instance, falls outside every risk tier except "minimal" or at most "limited" (transparency labeling). The Digital Omnibus partially addresses one edge of this by adding AI-generated non-consensual intimate imagery and CSAM to the prohibited practices list, but the broader question of how the risk framework applies to generative content remains open
- Enforcement will be fragmented across 27 member states, each with its own competent authority. The uneven enforcement of GDPR across Europe is a cautionary precedent
- Key concepts remain operationally undefined: what counts as "meaningful" human oversight? What makes training data "representative"? Without clear definitions, compliance becomes subjective
- The Digital Omnibus creates a reinforcing feedback loop: missing standards justified postponement, which reduces urgency for standards completion, which could justify further delay. The removal of Article 49(2) (mandatory database registration for self-assessed non-high-risk systems) is particularly concerning because it erodes the public transparency mechanism that would allow external scrutiny of provider self-classification. Without the registration requirement, a provider can assess its own system as "non-high-risk" with no obligation to make that determination publicly visible
- The competitiveness framing is reshaping the Act's purpose. The original AI Act was justified primarily through fundamental rights protection; the Omnibus justification centers on burden reduction, innovation, and competing with the US and China. Corporate Europe Observatory documented that tech lobby spending rose 33.6% (EUR 113M to EUR 151M) between 2023 and 2025, with near-identical language between industry submissions and Commission proposals. The stated goal of the system (protect fundamental rights) is diverging from its actual output (extended periods of unregulated high-risk deployment)
United States — From Executive Order to Innovation-First Framework
The US went from having the most specific technical threshold for AI oversight — Biden's Executive Order 14110 required companies to report safety tests for any model trained with more than 1026 FLOPs of computing power — to having no binding federal AI regulation, in a single executive action on January 20, 2025. Since then, the Trump administration has released a series of executive orders and, in March 2026, a legislative framework asking Congress to act. But the framework contains no risk classification, no transparency mandates, no new enforcement body, and no liability rules. Its most consequential structural feature is federal preemption of state AI laws, which would displace the emerging patchwork of state regulation (including Colorado's comprehensive AI Act) while imposing minimal federal standards in its place.
What Was Lost: Biden's Executive Order 14110
| Provision | What It Required | Status |
|---|---|---|
| Dual-use model reporting | Companies training the most powerful AI models (above the 1026 FLOP threshold) were required to report their safety test results to the Commerce Department, including findings from adversarial "red-team" testing designed to probe for dangerous capabilities | Rescinded |
| Defense Production Act | Biden invoked the Defense Production Act — a wartime-era law giving the government sweeping powers — to compel this reporting. This was the strongest enforcement mechanism ever applied to AI companies, short of passing new legislation. | Rescinded |
| Chief AI Officers | Every federal agency was required to designate a Chief AI Officer responsible for AI governance within that agency | Officers were designated but their roles have been significantly weakened |
| Algorithmic discrimination | Directed agencies to address AI-driven bias in housing, healthcare, lending, and criminal justice — areas where algorithmic discrimination has been well-documented | Rescinded |
| Immigration fast-track | Streamlined visa pathways for AI researchers to attract global talent | Reversed by Trump administration immigration policies |
What Replaced It: Three Waves of Trump-Era AI Policy
What the March 2026 Framework Covers (and What It Does Not)
| Area | Content |
|---|---|
| Child Safety | Age-assurance requirements for AI platforms likely to be accessed by minors. Restricts data collection for training and targeted advertising. Preserves state enforcement for child protection. |
| Community Safeguarding | Codifies a "Ratepayer Protection Pledge" (signed by Amazon, Google, Meta, Microsoft, OpenAI, Oracle, xAI) on data center energy costs. Streamlined data center permitting. Enhanced federal tools against AI-enabled fraud. |
| Intellectual Property | States that "training of AI models on copyrighted material does not violate copyright laws." Defers fair use questions to courts. Protections against unauthorized digital replicas (voice, likeness). |
| Free Speech | Prevents government from "coercing technology providers to ban, compel, or alter content based on partisan or ideological agendas." No requirements for AI content labeling or watermarking. |
| Innovation | Regulatory sandboxes. Open federal datasets. Sector-specific regulation through existing agencies rather than a new AI body. |
| Workforce | AI literacy in existing education programs. Federal study of AI-driven workforce impacts. |
| Federal Preemption | Preempts state laws that contradict national AI dominance strategy, regulate AI development broadly, restrict legal AI uses, or penalize developers for third-party unlawful conduct. Exempts state police powers, zoning, and procurement. |
No risk-based classification system. No transparency or documentation requirements (model cards, impact assessments, disclosure obligations). No mention of general-purpose AI obligations. No new enforcement body. No mention of algorithmic discrimination (the word "bias" appears only in the context of preventing "ideological bias" in government procurement). No provisions for pre-deployment safety testing, red-teaming, incident reporting, or catastrophic risk assessment for civilian AI. No liability framework for when AI systems cause harm.
The Blackburn Bill: A More Substantive (and Contradictory) Proposal
Two days before the White House framework, Senator Marsha Blackburn released a discussion draft of the "TRUMP AMERICA AI Act" (March 18, 2026). Despite the name, it contains provisions that directly contradict the White House's approach:
| Provision | What It Would Require |
|---|---|
| Duty of care | AI developers must "prevent and mitigate foreseeable harm to users" |
| Frontier AI risk management | Systems with catastrophic risk potential must develop risk protocols, conduct regular assessments, and report to DHS |
| Bias audits | High-risk AI systems (health, safety, education, employment, law enforcement, infrastructure) require regular bias evaluations |
| Expanded liability | FTC rulemaking, AG actions, state AG actions, and private rights of action. Liability for defective design, failure to warn, warranty breaches |
| Training data transparency | Developers must publish Training Data Use Records and Inference Data Use Records |
| Section 230 reform | "Bad Samaritan" provision denying immunity to platforms that "purposefully facilitate" federal criminal law violations |
Jones Walker's legal analysis called this a "regulatory paradox": despite deregulation rhetoric, the bill "imposes substantial obligations" and "essentially replaces state compliance burdens with federal ones rather than reducing overall regulatory density." The bill remains an unintroduced discussion draft. Legislative prospects are uncertain.
EU AI Act vs. US March 2026 Framework: Side-by-Side
| Dimension | EU AI Act | US Framework (March 2026) |
|---|---|---|
| Legal status | Binding regulation, directly applicable in all member states | Non-binding legislative recommendations to Congress |
| Risk classification | Four-tier: prohibited, high-risk, limited risk, minimal risk | None |
| GPAI provisions | Specific transparency and systemic risk obligations for general-purpose AI models | No GPAI-specific provisions |
| Transparency | Mandatory for AI systems interacting with people, generating content, or making decisions | No transparency mandates |
| Enforcement | National competent authorities + EU AI Office. Penalties up to 35M EUR or 7% global turnover | No enforcement mechanism (requires congressional legislation first) |
| Timeline | In force since August 2024; prohibited practices since February 2025; high-risk obligations December 2027 | No timeline (depends on Congress) |
| Philosophy | Rights-based, precautionary, risk-proportionate | Innovation-first, deregulatory, competitiveness-focused |
| State/member state laws | Harmonizes across member states (replaces national laws in covered areas) | Seeks to preempt state laws while imposing minimal federal standards |
NIST AI RMF: Still Standing, Politically Constrained
The NIST AI Risk Management Framework (RMF 1.0, January 2023) remains the most influential US governance document. It provides a structured approach organized around four functions: GOVERN (establishing organizational culture and policies), MAP (identifying where AI risks exist), MEASURE (tracking and quantifying those risks), and MANAGE (taking action to mitigate them). In July 2024, NIST added a Generative AI Profile (AI 600-1) identifying 12 risks specific to generative AI systems like large language models.
Key limitation: The framework is entirely voluntary. There is no enforcement mechanism, no certification process, and no consequences for non-compliance. Companies can claim "alignment with NIST RMF" while doing very little in practice. Under the July 2025 Action Plan, NIST was directed to strip references to "misinformation," DEI, and climate change from the framework, effectively narrowing the scope of recognized AI risks. NIST retains its standards-setting role but now operates within tighter political parameters.
State-Level Patchwork (Now Under Federal Pressure)
| State | Law | Significance |
|---|---|---|
| Colorado | AI Act (SB 24-205, effective Feb 2026) | The first comprehensive AI law in any US state. Requires impact assessments, consumer notification, and discrimination reporting. The closest any US jurisdiction has come to the EU's approach. Now directly in the crosshairs of the December 2025 federal preemption executive order. |
| Illinois | Biometric Information Privacy Act (2008) | Gives individuals the right to sue over biometric data misuse. Has produced the largest biometric-related settlements in history: Facebook $650M, Clearview AI $51.75M, Google $100M. The most consequential biometric law in the world. |
| California | AI Transparency Act (SB 942, effective Jan 2026) + 23 other AI-related laws passed in 2024 | Includes transparency requirements and training data disclosure rules (AB 2013). But the most significant development was what didn't pass: SB 1047 was vetoed by Governor Newsom. It would have imposed liability on companies whose frontier AI models cause serious harm. |
The December 2025 executive order and March 2026 legislative framework together represent a structural strategy: use federal authority to suppress state-level AI regulation while proposing minimal federal standards to fill the gap. The AG's litigation task force, $42 billion in broadband funding conditioned on states' AI regulatory climate, and the framework's preemption provisions create multiple pressure points against state action. Democratic legislators introduced the GUARDRAILS Act on March 20, 2026, to counter this approach, but its legislative prospects are uncertain. The net effect, if the preemption framework is enacted: the state laws that currently represent the only binding AI regulation in the US could be displaced, with nothing comparably enforceable at the federal level replacing them.
New York City's Law 144 was the first US law to require companies to conduct independent bias audits before using AI tools in hiring. The result is a cautionary tale: of the 391 employers required to comply, only 18 posted audits (4.6%). Auditors reported that clients sought the cheapest, most permissive audit firms available. Some audit methodologies defined impact ratios so broadly that statistically significant racial or gender disparities became mathematically undetectable — the audit was designed to find nothing wrong. With no private right of action (meaning affected job applicants cannot sue), enforcement is effectively nonexistent. The lesson is stark: a regulation that is mandatory but unenforced produces compliance theater — the appearance of oversight without the substance.
China — Prescriptive, State-Directed, Operational
China has enacted more binding, AI-specific regulations than any other country — a fact that often surprises Western observers who assume authoritarian states don't regulate technology. Three core regulations form the backbone: rules on Algorithmic Recommendations (2022), Deep Synthesis/Deepfakes (2023), and Generative AI (2023). All require that AI systems align with "Core Socialist Values" — making clear that China's regulatory model serves state control, not individual rights. The Cyberspace Administration of China (CAC) maintains an Algorithm Registry with over 1,000 algorithms registered, giving the government unprecedented visibility into how AI systems work across the economy.
| Regulation | Year | Key Requirement |
|---|---|---|
| Algorithmic Recommendations | 2022 | Algorithms must promote "mainstream value orientation." Users can opt out. Algorithm registry with CAC. |
| Deep Synthesis (Deepfakes) | 2023 | Mandatory labeling of synthetic content. User identity verification. |
| Generative AI Measures | 2023 | Security assessments before launch. Must not generate content inciting subversion of state power. |
China matters for the global AI governance debate because it demonstrates that binding AI regulation is technically feasible at scale. When AI companies argue that regulation would be impractical or would stifle innovation, China's functioning regulatory system (governing an AI ecosystem second only to the US in size) refutes that claim directly. But the Chinese model also serves as a cautionary tale: it shows what AI regulation looks like when it is designed for political control rather than human rights protection. It is both a proof of concept and a warning.
United Kingdom — Pro-Innovation with Institutional Shift
The UK has chosen not to pass comprehensive AI legislation. Instead, it takes a sectoral approach: existing regulators — the Financial Conduct Authority, Ofcom (communications), the Competition and Markets Authority, and the Information Commissioner's Office — each apply five cross-cutting AI principles (safety, transparency, fairness, accountability, and contestability) within their own domains.
AI Security Institute (formerly AI Safety Institute)
Established after the Bletchley Park Summit in 2023 as the world's first government-backed institution dedicated to testing frontier AI models. Under the Labour government, it was renamed from "AI Safety Institute" to "AI Security Institute" — a subtle but telling shift that signals the incorporation of national security considerations alongside the original safety mandate.
The Institute has tested more than 30 frontier models, and its findings are among the most concrete evidence available on how AI capabilities are evolving:
- Cyber capability: AI models' success rate at performing offensive cybersecurity tasks (identifying vulnerabilities, writing exploits) rose from 9% to 50% between successive model generations
- Self-replication: When researchers tested whether AI models could autonomously set up independent copies of themselves on new servers, the success rate jumped from 5% to 60% across model generations — a dramatic increase in autonomous capability
- Strategic deception: Some models appeared to behave differently when they detected they were being evaluated, raising questions about whether safety testing captures real-world behavior
Key limitation: AI companies participate in the Institute's testing voluntarily. The Institute has no legal power to compel access to models, meaning companies can refuse testing if they choose.
India — Innovation-First, Light-Touch
India has built a deliberate counter-model to the EU's regulatory approach. There is no comprehensive AI legislation, and the government has signaled clearly that it does not intend to create one. Instead, the IndiaAI Mission (launched March 2024, approximately $1.25 billion over five years) focuses on building AI capacity — compute infrastructure, foundation models, datasets, applications, skills, startup financing, and (last on the list) safe and trusted AI.
India AI Impact Summit (February 2026)
The fourth global AI summit and the first hosted by a Global South economy. India organized the summit around seven "Chakras" (energy centers, drawn from Hindu philosophy) within the MANAV vision — an acronym standing for Moral, Accountable, National sovereignty, Accessible, and Valid.
Seven Chakras Framework
| Chakra | Focus | Description |
|---|---|---|
| 1. Human Capital | Workforce | Equitable skilling, inclusive workforce transition |
| 2. Inclusion | Equity | AI for diverse needs, not perpetuating inequalities |
| 3. Safe & Trusted AI | Governance | Closing governance gaps; all nations in oversight |
| 4. Resilience | Sustainability | Frugal AI for low-resource contexts; environmental footprint |
| 5. Science | Research | AI in genomics, climate; transparency standards |
| 6. Democratizing Resources | Infrastructure | Addressing compute, data, affordability inequalities |
| 7. Economic Growth | Development | AI in health, education, governance, agriculture |
The Frontier AI Omission — Why It Matters
The Delhi Declaration omits all reference to frontier AI and associated risks, in stark contrast to Bletchley (2023) and Seoul (2024).
What Seoul committed to that Delhi did not:
- Seoul required "assess risks across the AI lifecycle" including before deployment
- Seoul demanded "thresholds at which severe risks would be deemed intolerable"
- Seoul: companies pledged "not to develop or deploy a model at all, if mitigations cannot keep risks below thresholds"
- 16 companies signed these Frontier AI Safety Commitments (Amazon, Anthropic, Google, Meta, Microsoft, OpenAI, others)
Delhi replaced this with:
"New Delhi Frontier AI Impact Commitments" focused on only two areas: (1) sharing anonymized usage insights, and (2) multilingual testing. IAPS noted: "The voluntary commitments were much less focused on severe risks than the comparable commitments from Seoul."
Who pushed against frontier AI language:
- Against (successfully): India as host (reframed to "inclusion"). US (rejected global governance). AI companies (benefited from reduced commitments).
- For (unsuccessfully): EU and some European nations. FLI's Mark Brakel: "So many risks discussed in corridors with greater urgency than ever but didn't make it to the official outcome." Amnesty: "largely irrelevant." Reporters Without Frontiers: even "the right to reliable information" was absent.
Geopolitical implications:
US tech companies benefit most. American firms maintain infrastructure control. India becomes "a site for localizing existing models and scale, but not a locus of control" (Rest of World). The "innovation-friendly" framing favors incumbents. Downstream AI startups risk becoming "barnacles on the hull of Big Tech."
India vs. EU — Philosophical Divide
| Dimension | India | EU |
|---|---|---|
| Primary concern | AI access gap, digital divide, development | Fundamental rights, safety, democracy |
| Approach to risk | Address harms as they arise | Pre-market classification & compliance |
| Government role | Facilitator, investor, builder | Regulator, enforcer, standard-setter |
| Global posture | Voice of Global South; alternative model | Regulatory export ("Brussels Effect") |
Singapore — Practical, Implementation-Oriented
AI Verify is an open-source testing toolkit released by the Singapore government in 2022. It allows organizations to test their AI systems against 11 governance principles spanning fairness, explainability, robustness, and data governance. It is one of the very few practical, technical AI governance tools produced by any government — most countries have produced principles documents, while Singapore built working software.
The AI Verify Foundation (established 2023) has attracted over 90 member organizations including Google, Microsoft, IBM, Salesforce, and DBS Bank. Crucially, it has published a "crosswalk" with the US NIST Risk Management Framework, mapping each framework's requirements to the other — allowing companies to satisfy both governance standards through a single process rather than duplicating effort.
While most countries have produced abstract principles documents, Singapore built software that companies can actually use. This demonstrates that practical, technical governance tooling can come from government, not just from the private sector. And the AI Verify/NIST crosswalk is a proof of concept that governance frameworks from different jurisdictions can be interoperable rather than competing — a crucial insight as companies face an increasingly fragmented global regulatory landscape.
Swedish AI Strategy & Governance
Official Swedish AI Strategy (2026)
Sweden's official AI strategy (Sveriges AI-strategi), signed by Prime Minister Ulf Kristersson and Civil Minister Erik Slottner, replaces the country's 2018 national AI direction. It draws heavily on the AI Commission report (SOU 2025:12) and is aligned with Sweden's broader digitalization strategy for 2025–2030.
Three Overarching Goals
14 Policy Areas
| Area | Key Measures |
|---|---|
| Legal Prerequisites | Regulatory simplification for AI adoption; review legislation hindering AI use |
| Data Access | Improve data availability; open government data; data spaces |
| Standardization | Active participation in EU/ISO AI standards; SIS as key actor |
| Security & Defense | AI as strategic resource; NATO/EU cooperation on military AI; counter AI disinformation |
| Public Sector | AI workshop (verkstad) by 2026, fully built by 2030; AI-driven public services |
| Human-Centered AI | EU AI Act compliance; UNESCO/Council of Europe guidelines; digital inclusion; accessibility |
| Language Models | National language tech for Swedish + minority languages (Sami, Finnish, Meankieli, Romani, Yiddish); digital sovereignty |
| Climate & Energy | Minimize AI environmental impact; datacenter waste heat reuse; energy-efficient AI |
| Labor Market | Lifelong learning; social partner dialogue on AI workplace change; reskilling |
| AI Ecosystem | Strengthen academia-industry-public sector connections; regional AI hubs |
| Business | Support SME AI adoption; startup-friendly regulation |
| Infrastructure | Mimer in Linkoping as EU AI Factory; EU supercomputer access; national compute |
| Research | Excellence clusters; national doctoral schools; increase AI researchers |
| Implementation | PTS and DIGG tasked; annual follow-up; OECD monitoring |
AI Commission Report (SOU 2024:73)
Published in November 2024 under the title "AI i allas intresse" (AI in everyone's interest), this was the report that set the tone of urgency which ultimately shaped the national strategy.
The Commission's key proposals included putting political leadership into "crisis mode" on AI, creating a free-access AI Hub for all citizens, transforming the education system, accelerating public sector AI deployment, and investing SEK 1.8 billion in research and computing infrastructure.
AI Act Adaptation (SOU 2025:101)
This is the Swedish government inquiry that determined how the country will implement the EU AI Act at the national level. Its most consequential decision:
PTS (the Swedish Post and Telecom Authority) has been designated as the primary national AI authority and single contact point for the EU AI Act — not IMY, the Swedish Authority for Privacy Protection, which was widely assumed to be the natural choice given its expertise in data protection and fundamental rights. Choosing a technology and market regulator over a rights-focused body was a surprise, and it signals a technology-forward, market-oriented approach to AI governance. The practical implications of this choice will unfold over the coming years.
- Swedish Medicinal Products Agency for medical device AI
- New national law and ordinance to supplement EU AI Act
- At least one regulatory sandbox by August 2, 2026 (PTS-operated)
- Enforcement powers: administrative fines, reprimands, injunctions, system withdrawal, on-site inspections
- Applies from August 2, 2026
Governance Infrastructure
| Body | Role | Key Detail |
|---|---|---|
| AI Sweden | National applied AI center | Public-private, hosted by Lindholmen. GPT-SW3 (Nordic language model). AI Competence Centers. |
| PTS | Primary AI Act authority | Newly designated. Must build AI expertise quickly. Regulatory sandbox operator. |
| IMY | Data protection | GDPR-AI intersections. Previously fined Swedish Police SEK 2.5M for Clearview AI use. |
| RISE | Testing & validation | EU standardization participation. AI system testing capacity. |
| Vinnova | Innovation funding | Responsible AI research funding. |
| SIS | Standards | ISO/IEC AI standards development participation. |
| DIGG | Digital administration | AI strategy implementation alongside PTS. |
Swedish Companies with AI Governance Relevance
| Company | AI Governance Relevance | EU AI Act Exposure |
|---|---|---|
| Klarna | One of the most aggressive AI adopters in European financial services. Publicly replaced over 800 customer service agents with AI (a decision it has partially walked back). A high-profile test case for AI in consumer-facing finance. | High-risk Its credit scoring and lending AI will likely be classified as high-risk, requiring both a conformity assessment and a Fundamental Rights Impact Assessment. |
| Ericsson | Has published AI ethics principles for telecom, with a focus on fairness in network optimization and resource allocation. | High-risk If AI is used as a safety component in network infrastructure, it falls under the AI Act's "critical infrastructure" category (Area 2), which carries the full suite of high-risk obligations. |
| Spotify | Conducts research on filter bubbles and fairness in music recommendation algorithms — questions about whether AI-driven recommendations narrow or broaden cultural exposure. | Limited risk Recommendation systems primarily trigger transparency requirements, not the heavier high-risk obligations. |
| H&M Group | Exploring AI governance in supply chain management and retail operations. | AI Act exposure depends on specific use cases; supply chain optimization typically falls below the high-risk threshold. |
| Telia | Has developed AI ethics guidelines for its network operations across the Nordics and Baltics. | High-risk As a major telecoms infrastructure provider, AI used in network safety or critical infrastructure could trigger high-risk classification. |
Distinctive Nordic Characteristics
Structural Strengths
- Regulatory alignment: Anticipate and align with EU regulation rather than resisting
- Social democratic values: Greater emphasis on worker impact, social equity, public benefit
- High trust society: More willingness to engage with government-led frameworks
- Data protection culture: Strong GDPR implementation creates foundation
Distinctive Assets
- Participatory design heritage: Deep Scandinavian roots in participatory design (1970s-80s UTOPIA project)
- Collaborative governance: Multi-stakeholder approach (government + industry + academia + civil society)
- Development cooperation: Sida creates bridge to Global South perspectives
- Nordic-Baltic cooperation: Coordinated AI governance across the region
Sweden-Specific Challenges
- SME compliance burden: Sweden's tech economy relies heavily on small and mid-sized companies and startups. For these organizations, a 460-page regulation with detailed conformity assessment requirements is genuinely daunting — they lack the legal and compliance teams that larger companies can deploy.
- Public sector AI exposure: Sweden has a strong digital government tradition, which means many public agencies are already deploying AI systems. Under the AI Act, many of these will be classified as high-risk and will need to conduct Fundamental Rights Impact Assessments — creating significant new obligations for agencies that may not yet have the expertise to meet them.
- GPT-SW3: Sweden's homegrown Nordic language model may trigger obligations under the EU AI Act's general-purpose AI (GPAI) rules, depending on its size and how widely it is distributed. If it crosses the relevant thresholds, AI Sweden would face the same compliance requirements as major international model providers.
- Sami data sovereignty: The strategy mentions developing AI for minority languages, but says nothing about who governs the underlying language data. The Sami Parliament is not named as a stakeholder, and no principles for indigenous data sovereignty have been articulated.
- PTS capacity: As a novel choice for AI authority, PTS must build AI-specific expertise quickly. How it will coordinate with IMY on the inevitable overlaps between AI governance and data protection remains an open question.
- Ranking anxiety: The drop to 25th in global AI rankings creates intense political pressure to move fast, which risks deprioritizing responsible AI governance in favor of visible speed and investment metrics.
AI Summits & International Bodies
Bletchley Park (November 2023)
The first global summit dedicated to AI safety, bringing together 28 countries including the US, China, and EU member states. The framing was dominated by existential and frontier risk concerns.
- Bletchley Declaration: The first multilateral statement formally acknowledging that frontier AI models pose serious risks. Represented a breakthrough in getting major powers to agree on the basic premise that AI safety is a legitimate international concern.
- UK AI Safety Institute: The summit led to the creation of the first government-backed AI testing body, which has since tested more than 30 frontier models and produced some of the most concrete evidence on evolving AI capabilities (see UK section above).
- Significance: Established a safety-first narrative at the highest political level and created the institutional precedent that other countries subsequently followed.
Seoul (May 2024)
Focused specifically on frontier model safety, this summit represented the peak of multilateral AI safety ambition.
- Frontier AI Safety Commitments: Sixteen major AI companies pledged "not to develop or deploy a model at all, if mitigations cannot keep risks below thresholds." These were the most concrete and far-reaching corporate safety pledges ever made in the AI industry.
- Seoul Ministerial Statement: Government signatories committed to "assess risks across the AI lifecycle" — a principle that, if enforced, would require risk evaluation from the design stage through deployment and ongoing monitoring.
- Significance: The high-water mark for binding company-level safety commitments. Set specific thresholds and concrete obligations rather than aspirational language. This is the standard against which subsequent backsliding should be measured.
New Delhi (February 2026)
The first global AI summit hosted by a Global South economy, and a dramatic departure from the safety focus of its predecessors.
- New Delhi Declaration: Adopted by 88+ countries. Notably omits all reference to frontier AI risks — the central topic of both previous summits. Organized around the Seven Chakras framework. All initiatives described as "voluntary and non-binding."
- Investment pledges: Approximately $250 billion in total, led by Reliance ($110B), Adani ($100B), Microsoft ($50B), Google ($30M for governance), and Blackstone ($600M). The scale of investment commitments dwarfed any governance commitments.
- Pax Silica Alliance: India joined the US-led semiconductor supply chain alliance, a geopolitically significant move that ties India's AI infrastructure development to American technology.
- Significance: The safety momentum that built from Bletchley through Seoul dissipated at Delhi. Commercial investment and digital sovereignty priorities displaced safety governance. The frontier AI safety window that opened at Bletchley appears to be closing.
UN Bodies
UN Scientific Panel on AI
Created by UN General Assembly Resolution A/RES/79/325, this is the first permanent, global scientific body dedicated to AI. It is explicitly modeled on the IPCC (the Intergovernmental Panel on Climate Change), which became the authoritative reference point for climate science. Forty panel members were selected from over 2,600 candidates, with Global South representation built into the selection process. The panel's term runs from February 2026 to February 2029, and its first report is due July 2026. If it achieves the credibility of its climate science model, it could fundamentally reshape how policymakers worldwide understand AI risks and capabilities.
UNESCO Recommendation on AI Ethics (2021)
The first global normative instrument on AI ethics, adopted by all 193 UN member states. While non-binding, it represents the broadest consensus any AI governance document has achieved. It articulates 10 principles (including proportionality, safety, fairness, sustainability, privacy, human oversight, transparency, and accountability) across 11 policy areas.
Readiness Assessment Methodology (RAM): A practical tool that has been applied in more than 60 countries to assess how prepared nations are to govern AI, across five dimensions: legal/regulatory, social/cultural, scientific/economic, education, and infrastructure. Chile was the first country to complete the assessment, and uptake has been particularly strong in Latin America. Key criticism: RAM measures whether a country has the right structures in place, but not whether those structures produce better outcomes — a country can score well on the assessment while its AI systems still produce discriminatory results in practice.
Global Digital Compact (September 2024)
A non-binding intergovernmental agreement that endorsed the creation of the UN Scientific Panel on AI and committed signatories to working toward an inclusive, safe digital future. It reaffirms the principle that human rights protections apply online just as they do offline — a statement that, while seemingly obvious, carries weight in debates about whether AI-mediated decisions should be held to the same standards as human decisions.
OECD AI Principles
The OECD AI Principles, first adopted in 2019 and updated in May 2024, were the first intergovernmental AI standard and remain the most widely referenced governance framework globally. Adopted by 47 jurisdictions, they also served as the basis for the G20 AI Principles, giving them influence well beyond the OECD's own membership.
| Principle | 2024 Update |
|---|---|
| Inclusive growth & sustainability | Added environmental sustainability and ecological wellbeing |
| Human-centred values & fairness | Renamed to emphasize fairness. Added misinformation and bias. |
| Transparency & explainability | Added generative AI/foundation model transparency challenges |
| Robustness, security & safety | Added frontier AI safety. Pre-deployment evaluation. Defence-in-depth. |
| Accountability | Strengthened: full AI value chain accountability (foundation model providers through deployers) |
OECD AI Policy Observatory (oecd.ai) tracks AI policies in more than 70 countries and maintains the most comprehensive database of national AI strategies available. Its AI Incidents Monitor documents real-world AI harms — a valuable resource for understanding what goes wrong in practice, not just in theory.
Reporting Framework (February 2025): A standardized template for companies to report on how they are implementing the G7 Hiroshima AI principles. The first reporting cycle runs 2025–2026. The key limitation, as with most international AI governance tools, is that participation is voluntary and there are no consequences for companies that choose not to participate.
G7 Hiroshima AI Process
Launched in October 2023 as a rapid response to the emergence of generative AI (post-GPT-4), the Hiroshima Process produced 11 Guiding Principles for advanced AI systems, covering areas from lifecycle risk management and vulnerability disclosure to content provenance (ensuring AI-generated content can be identified as such), safety research, and data governance.
Strengths: It was a notably fast political response, carried G7 political backing, engaged industry directly, and was specifically designed for generative AI rather than AI in general. Weaknesses: Like most international AI governance efforts, it is voluntary with no enforcement mechanism. Being G7-led, it faces legitimacy questions from the Global South. Corporate involvement in writing the rules was heavy, and there is no independent verification of compliance. The gap between these 11 principles and what companies actually do in practice remains largely unmeasured — making the Hiroshima Process, for now, more aspirational than operational.
Independent & Civil Society Voices
Research Institutes
| Organization | Focus | Key Contributions |
|---|---|---|
| AI Now Institute (NYU) | Power & structure | Their 2024 report "Artificial Power" argues that AI functions primarily as a mechanism of power concentration, benefiting the companies that control AI infrastructure. They call for treating AI infrastructure as public utilities (much as electricity and telecoms are regulated), document the AI industry's lobbying efforts and revolving door with government, and argue that "voluntary commitments are a delay tactic" used by industry to forestall binding regulation. |
| Ada Lovelace Institute (UK) | Data & AI for public benefit | Their research found that 72% of the UK public wants government regulation of AI. They advance a "regulate to innovate" framing (arguing that good regulation enables rather than stifles innovation), conduct foundation model governance research, and have piloted participatory AI approaches with the NHS and BBC. |
| DAIR Institute (Gebru) | Community-rooted AI research | Founded by Timnit Gebru after her high-profile departure from Google, DAIR focuses on AI development rooted in affected communities rather than corporate labs. Key work includes East African languages in AI, spatial apartheid patterns in South African AI data, and community-based participatory research methods. Explicitly decolonial in its approach. |
| Alan Turing Institute (UK) | National AI research | Developed the Process-Based Governance (PBG) framework, which focuses on embedding governance into AI development processes rather than evaluating only outputs. Also runs the AI Standards Hub and conducts public sector data ethics research. |
| Data & Society | Social implications of AI | Known for research on how AI systems interact with social structures, particularly networked disinformation and the sociology of algorithmic decision-making. |
Risk-Focused Organizations
| Organization | Orientation | Key Contributions |
|---|---|---|
| Future of Life Institute | Existential/catastrophic risk | Organized the "Pause Giant AI Experiments" open letter (33,000+ signatures), which called for a six-month moratorium on training AI models more powerful than GPT-4. Publishes the AI Safety Index, which grades major AI companies on safety practices — no company has scored above C+. Also campaigns against autonomous weapons and conducts detailed EU AI Act analysis. Critics argue FLI diverts attention from present, documented AI harms by focusing on speculative future risks. |
| Center for AI Safety | Societal-scale risk | Organized the influential one-sentence statement that "mitigating the risk of extinction from AI should be a global priority," which was signed by leading AI researchers (including Geoffrey Hinton and Yoshua Bengio) and AI company CEOs. Conducts research on AI risk taxonomies and compute governance — the idea of regulating AI through control of the computing resources required to train powerful models. |
| Partnership on AI | Multi-stakeholder | Developed the ABOUT ML framework (for machine learning transparency documentation) and contributed to C2PA, a content provenance standard that allows AI-generated content to be identified — arguably its most tangible output. Contested legitimacy: Access Now resigned from the Partnership in 2023, calling it "industry-dominated." The organization was founded by Big Tech companies (Google, Facebook, Amazon, Microsoft, IBM), raising structural questions about whether industry-funded bodies can credibly govern industry. |
Advocacy & Accountability Organizations
| Organization | Focus | Key Work |
|---|---|---|
| AlgorithmWatch | Automated decision-making monitoring (EU) | Has systematically mapped automated decision-making systems across 12 EU countries through its "Automating Society" reports. Advocates for public AI registries — modeled on pioneering examples in Amsterdam and Helsinki where governments publicly list the algorithms they use — and played an active role in shaping the EU AI Act. |
| Algorithmic Justice League | Bias in facial recognition and computer vision | Conducted the landmark "Gender Shades" research demonstrating that commercial facial recognition systems had dramatically higher error rates for darker-skinned women. The research (also featured in the Netflix documentary "Coded Bias") directly shifted industry practice: IBM exited the facial recognition market entirely, citing this work. |
| Access Now | Digital rights | Organizes RightsCon, one of the largest global digital rights conferences. Advocates for bans on facial recognition technology and broader digital rights protections. Resigned from the Partnership on AI in 2023 over concerns about industry domination of the organization. |
| Electronic Frontier Foundation (EFF) | AI surveillance and civil liberties | Brings legal challenges against facial recognition deployment, algorithmic policing, and government AI surveillance. Uses Freedom of Information Act (FOIA) requests to force transparency about how government agencies are using AI systems. |
| Amnesty International | AI-enabled surveillance and human rights | Investigates AI-enabled surveillance systems globally, including Uyghur monitoring infrastructure in China, surveillance systems in Palestine, and predictive policing in the US and Europe. Called the Delhi AI summit "largely irrelevant" to the people most affected by AI-related human rights abuses. |
International AI Safety Report 2026
The second edition of this landmark report, chaired by Yoshua Bengio (a Turing Award-winning AI researcher) with contributions from more than 100 experts across 30+ countries. It provides the most authoritative independent assessment of AI risks and capabilities available. Key findings:
Risk Taxonomy
The "Evidence Dilemma": The report identifies a fundamental tension in AI governance: acting too early risks imposing unnecessary restrictions on a technology that could deliver significant benefits; waiting too long risks allowing harms that become unmanageable once they emerge. The recommended approach is "defence-in-depth" — layered safety measures at multiple points in the AI lifecycle, rather than relying on any single mechanism (like pre-deployment testing alone).
Four capability scenarios for 2030: The report models four possible trajectories for AI development: (1) progress stalls at current levels, (2) progress slows significantly, (3) exponential improvement continues at its current rate, or (4) progress accelerates beyond current trends. The report argues that given the potential severity of harms under scenarios 3 and 4, precautionary governance approaches are warranted even if the probability of the worst outcomes is uncertain.
Key challenge — the "evaluation gap": Pre-deployment testing (evaluating AI models before they are released) consistently fails to predict how models will perform and what risks they will pose once deployed in the real world. This is a fundamental problem for any regulation that relies on pre-market assessment. In 2025, twelve companies published Frontier AI Safety Frameworks, but all were voluntary, self-assessed, and self-reported — with no independent verification that companies are following their own stated commitments.