What will happen if AI write the law

gavel over the ai data center image as background
AI write the law

What if AI algorithms, not politicians, write the laws? As South Korea launches its ambitious “Sovereign AI” initiative under President Lee Jae-myung, this once science-fiction idea is starting to feel like a question worth asking.

Could machines craft better laws than humans?

The proposition carries immediate appeal. While human legislators wrestle with personal interests, emotional decision-making, and constituency pressures, AI promises the allure of pure rationality—decisions untainted by the messy realities of human psychology and political calculation.

The Rational Actor Fantasy

The case for algorithmic legislation rests on a familiar critique of human fallibility. Research from Harvard Business School suggests that roughly 75% of Fortune 500 CEO decisions are emotionally driven. If even corporate leaders—arguably selected for analytical thinking—operate from emotion, what does this say about elected officials navigating the complex terrain of public policy?

Proponents envision AI systems analyzing legislative frameworks with mathematical precision, identifying bias patterns that favor particular interests, and generating policy proposals based purely on empirical evidence and logical consistency. The machine legislator, in this vision, becomes democracy’s correction mechanism—a neutral arbiter capable of rising above the factionalism that has long plagued human governance.

But this framing reveals more about our frustrations with democratic messiness than it does about AI’s actual capabilities or appropriate role in society.

The Neutrality Illusion

The dream of neutral AI legislation crumbles upon examination of its foundational assumptions. Three critical requirements expose the fundamental contradiction at its heart:

The Data Problem: Legal AI would require training on existing laws, judicial decisions, and policy outcomes. Yet this historical record is itself the product of centuries of power struggles, cultural biases, and evolving social values. How does one extract “neutral” principles from inherently political artifacts?

The Creator Problem: AI systems reflect the perspectives, blind spots, and implicit assumptions of their creators. The notion that developers, data scientists, and institutions could achieve perfect political neutrality asks us to believe in the existence of humans somehow outside the social and economic systems they inhabit.

The Infrastructure Problem: Even if neutral algorithms were possible, they would require neutral institutions to implement them. Who controls the data centers? Why they defines the optimization parameters? Who determines what constitutes “objective” and “just” outcomes?

These challenges aren’t merely technical hurdles to overcome—they reveal the conceptual impossibility of separating technological tools from the human contexts that shape them.

Beyond Efficiency: What Democracy Actually Does

The appeal of AI legislation stems partly from a misunderstanding of democracy’s purpose. Democratic governance isn’t simply about producing optimal policies through efficient means. It’s a system for managing disagreement, incorporating diverse perspectives, and maintaining legitimacy across different groups with competing interests and values.

The “inefficiencies” of human politics—debate, compromise, coalition-building—aren’t bugs to be fixed but features that reflect democracy’s deeper function: providing peaceful mechanisms for societies to navigate fundamental disagreements about values, priorities, and the nature of justice itself.

When we fantasize about algorithmic governance, we’re often fantasizing about the elimination of politics altogether. But politics isn’t a problem to be solved—it’s the ongoing work of living together despite our differences.

Questions Worth Asking

Rather than asking whether AI should make laws, we might examine more productive questions:

How can AI tools enhance human deliberation without replacing human judgment? What role might algorithmic analysis play in identifying policy blind spots or unintended consequences while preserving democratic accountability?

How do we maintain meaningful citizen participation in governance as technological complexity increases? What new forms of civic engagement might emerging technologies enable?

Most critically: Who benefits when we frame political disagreement as a technical problem requiring technological solutions? What interests are served by depoliticizing inherently political decisions?

The Democratic Imperative

The fundamental question isn’t whether machines can craft better laws than humans—it’s whether we want to live in societies where algorithmic optimization replaces democratic participation. The promise of perfectly rational governance may be seductive, but it ultimately asks us to abandon one of humanity’s most significant achievements: the development of systems that derive legitimacy from collective consent rather than superior force or knowledge.

As South Korea and other nations invest heavily in AI development, the challenge isn’t to build better machine legislators but to strengthen democratic institutions capable of thoughtfully integrating technological capabilities while preserving human agency in shaping our collective future.

The question is not whether AI can govern better than humans but whether we can govern well enough to use AI without losing democracy itself.

Share