Governments must intervene in the race to build superintelligent machines, or risk unleashing a malevolent algorithm that could subjugate humanity, according to a prominent academic. Wim Naudé, a professorial fellow at the United Nations University, argues that without state oversight, the development of artificial general intelligence (AGI) could concentrate unprecedented power and wealth in a few private hands while endangering the public.
In an essay published in The Conversation, Naudé contends that both tech giants like Facebook and Google and state-funded research bodies such as the Pentagon's DARPA and Russia's Advanced Research Foundation are pushing toward AGI. This pursuit, he warns, carries inherent risks that demand a coordinated policy response.
Drawing on his own April research, Naudé examined which governmental strategies would best prepare society for the arrival of superhuman AI. His conclusions center on two novel policy tools designed to steer the private sector toward safer, more collaborative development.
A Market for 'Second-Best' Algorithms
Naudé's first proposal is for governments to make a standing offer to purchase imperfect but still powerful algorithms. By creating a financial incentive for second-place outcomes, he suggests that competing firms would be more likely to collaborate and share knowledge rather than hoarding their breakthroughs behind closed doors. This, he argues, would prevent the massive wealth generated by AGI from concentrating at the top.
But buying up algorithms only addresses the economic dimension. To tackle the threat of a genuinely hostile AI, Naudé proposes a more aggressive measure: a tax on the company that develops it, with the rate calibrated to the AI's level of friendliness toward humans.
“A high enough tax rate would essentially mean the nationalization of the super-AI,” Naudé writes. “This would strongly discourage private firms from cutting corners for fear of losing their product to the state.”
This approach, he argues, would create a powerful deterrent against reckless development, as companies would face the prospect of losing their most valuable asset if their creation posed a danger to society.
Why This Matters Now
The urgency of Naudé's warning stems from the rapid acceleration of AI research. With both corporate and governmental actors pouring resources into AGI, the window for establishing safeguards is narrowing. His proposals offer a concrete starting point for policymakers grappling with the dual challenge of fostering innovation while protecting the public interest.
As the debate over AI safety continues, Naudé's essay adds a distinct voice, urging governments not to be passive observers but active shapers of a technological future that could redefine humanity's place in the world.
