Sitting alongside Pope Leo XIV at the launch of Magnifica humanitas, the company’s interpretability lead conceded that frontier-lab incentives can pull researchers away from doing the right thing.
Christopher Olah, Anthropic’s co-founder and the head of its interpretability research, used his seat at the Vatican on Monday to make an argument that no leader of a major AI firm has previously made on a platform of that scale: the development of frontier AI cannot be left to frontier AI labs.
Olah spoke at the formal presentation of Pope Leo XIV’s first encyclical, Magnifica humanitas, in the Vatican Synod Hall.
“Every frontier AI lab,” he said, “operates inside a set of incentives and constraints that can sometimes conflict with doing the right thing.”
Even well-intentioned researchers, he added, remain inside those forces. The conclusion he drew was that outside scrutiny, from religious leaders, governments, and civil-society institutions, was essential.
The 💜 of EU tech
The latest rumblings from the EU tech scene, a story from our wise ol' founder Boris, and some questionable AI art. It's free, every week, in your inbox. Sign up now!
The other half of the speech was about labour. Olah told the room that there was “a real possibility” that AI would displace human work “at very large scale”, and that, “if that happens, supporting those displaced will be a moral imperative of historic proportions.”
The line is the most specific public acknowledgement to date by a frontier-lab founder that the technology his company is building may, on its own internal projections, dislodge employment faster than the labour market can re-absorb.
Anthropic’s presence at the Vatican has already become, in the past two weeks, the most visible repositioning of the year for any AI company.
The firm previewed the relationship by announcing a Milan office; it now sits inside the Catholic Church’s most consequential statement on a technology since Leo XIII’s Rerum novarum addressed industrial capital in 1891.
Olah’s specific role, leading the company’s interpretability research, is treated by the firm as its strongest claim to safety credibility: he runs the team trying to reverse-engineer what frontier models are actually doing inside.
The political backdrop is the inverse of the moral one. Anthropic spent the spring at the centre of two separate confrontations with the US government.
The Pentagon ejected the company from its top classified AI work in April over the firm’s own usage restrictions, then signed deals with Nvidia, Microsoft, and AWS in its place.
The Trump administration blocked an expansion of Mythos, the autonomous vulnerability-discovery model that has shaken bank-cybersecurity governance globally. Olah’s appearance on the same stage as the pope, calling for outside oversight, lands as a direct response.
It also lands at a moment of particular commercial weight for the company. Anthropic is in talks to raise $30bn at a $900bn valuation.
The dissonance is sharp on the page, and Olah did not pretend it was not. “Companies like ours,” he told the room, operate under “strong commercial, geopolitical and personal pressures that can be at odds with the broader interests of society.”
The argument was not that Anthropic stands outside those pressures. It was that the answer to them sits outside the lab.
What the encyclical asks of governments and civil society in concrete terms, and what Olah’s invitation will translate into for Anthropic’s relationship with US regulators, is the unresolved part.
Magnifica humanitas does not name policies; it names a framing. Olah’s speech inside the launch did the same. Both, in effect, declined to outsource the next decade’s regulatory architecture to the companies that have spent the last three building the technology it will regulate.
The choice of messenger was not subtle either. Olah is the founder of an AI lab telling an audience including cardinals, the pope, and a watching White House, that AI labs cannot do this alone.
Whether that argument moves practical policy is an open question. That a frontier-lab founder made it from inside the Vatican is itself the news.