Father Paolo Benanti, an advisor to the Catholic Church on artificial intelligence, warns that the concentration of power among major AI developers risks turning the industry into a cartel, hindering transparent governance and democratic regulation.
- Benanti urges democratic regulation over corporate self-governance in AI.
- He criticizes the reverence for AI superintelligence as misleading and distracting.
- Calls for standards ensuring AI models remain under human control, not bans on innovation.
What happened
Father Paolo Benanti, who advises the Catholic Church on AI, publicly expressed concern about how a few powerful companies are shaping AI development and governance. He cautions against the AI industry framing superintelligence as a complex, exclusive domain only these companies can navigate, which shuts out public discourse and democratic participation.
Benanti contrasts this situation with the need for open, collective debate on AI ethics and regulation. He stresses that ethical decisions should not be confined to corporate boards but debated in the public sphere to ensure balanced governance. He has called out the risk of these companies acting like a cartel, setting rules that protect their market positions rather than broader societal interests.
Why it matters
The warnings from Benanti come at a moment when AI development is rapid and heavily commercialized, with companies like OpenAI and Anthropic positioning for public offerings while pushing for cautious development. The intertwining of corporate incentives with safety rhetoric complicates assessing claims about AI’s capabilities or risks.
By framing AI as a near-divine power, some industry leaders may distort public understanding, creating fear or misplaced reverence rather than fostering rational governance. Benanti’s perspective stresses that AI is fundamentally statistical computation that must be managed transparently to prevent concentration of control and ensure ethical accountability.
What to watch next
Efforts to implement third-party evaluation and regulatory standards for AI models may gain momentum as public and government awareness grows. Discussions on maintaining human oversight over AI and limiting unchecked self-improvement techniques will be critical in shaping future rules.
The Church’s engagement through advisors like Benanti, along with the Pope’s encyclical focused on AI, suggest a unique intersection of ethics, religion, and technology entering the public debate. This evolving landscape will require balancing innovation with public welfare to prevent the AI field from becoming dominated by a cartel-like dynamic.