跳到正文
The Verge · AI· Hayden Field·· 6 小時前精選AI 評分84

Anthropic 以歷來最大 IPO 上市,「好人」聲譽面臨考驗

With the biggest IPO of all time, Anthropic’s ‘good guy’ reputation is on the line

AI 導讀

Anthropic 完成歷來估值最高的 IPO,籌集 $81.3 billion;The Verge 指出,上市後的資金壓力和治理架構或會考驗其安全形象。Long-Term Benefit Trust(LTBT)名義上可選任七人董事會中的四人,但其中一席實際上須獲創辦人批准,而且信託沒有日常決策權。

推薦理由

文章梳理 Anthropic IPO 涉及的治理安排與信託權限,呈現安全使命、創辦人控制權和融資壓力之間的張力。

正文 · 原文

Today is a new beginning for Anthropic: a years-in-the-making IPO that beat out SpaceX for most valuable of all time, having raised $81.3 billion and set an important precedent for the other public AI lab debuts to come. But it’s not simply a financial milestone.

Anthropic was founded on the idea that it prioritized safety more than other labs; its founders had left executive research positions at OpenAI. As the AI race has accelerated, though, its executives have emphasized that Anthropic can only fulfill this mission by coming in first place, requiring lots of money and compute. Unsurprisingly, thoughtful, safe, and intentional AI development can conflict with the kind of sheer speed that winning this race requires. Adding in an initial public offering only complicates things further, and Anthropic’s leadership can pursue it more or less unilaterally. That’s thanks to a corporate structure focused on insulating the company from shareholder pressure to turn a profit — but one that also removes typical checks on its power.

One former Anthropic employee, who left ahead of the IPO, said he and others at Anthropic have increasingly been feeling that the current pace of AI development is “untenable under normal market structures,” particularly with the mismatched incentives at play in a powerful industry with little to no oversight.

Anthropic has spent years billing itself as different from, and more careful than, other AI companies. In theory, this extends to its plan for going public. It’s registered as a Public Benefit Corporation, which means Anthropic’s board has a responsibility to balance its mission against shareholder wealth maximization. As my colleague Robert Hart has discussed before, it has also developed a highly unusual power structure.

Anthropic’s Long-Term Benefit Trust (LTBT), introduced in 2023, and its founders have controlling voting rights, meaning they’d never be able to be voted out by shareholders even as a public company. A special class of stock, Class T, allows a small group of trustees — the members of the LTBT — the “authority to select and remove a portion of” Anthropic’s board. They exist outside typical shareholder pressure and theoretically are a check for the founders, tasked with a mission to “balance the financial interests of our stockholders and our public benefit purpose at key junctures where we expect the consequences of our decisions to reach far beyond Anthropic.”

The reality is significantly more complicated. The LTBT technically chooses four members of Anthropic’s seven-person board, for instance, but one of those four effectively needs to be approved by Anthropic’s founders, leaving the trust short of straightforward majority control. There are also stipulations about nominating or removing a director: the LTBT must provide its decision with 30 days’ notice to the company’s “nominating and corporate governance committee,” which consists of three members: co-founder Daniela Amodei (who is chair of the committee), Netflix co-founder Reed Hastings, and Anthropic investor Yasmin Razavi.

Though the LTBT members are “financially disinterested” in the company, there’s also nothing stopping Anthropic from hypothetically hiring away a trustee and paying them a lot of money to work for the company. Mariano-Florentino Cuéllar (a former trustee) joined Anthropic in August as its Chief Global Affairs Officer, and OpenAI has in the past hired a former board member, Fidji Simo, to an executive position within the company. One could imagine a scenario in which, if a trustee was “looking a little bit too activist-y or something, they could just make that trustee an offer with millions of dollars in effective compensation that would entail stepping down from the trust, and that’s one way that they could have some oversight over this,” said Tyler Johnston, founder of The Midas Project, a nonprofit AI industry watchdog.

Although the LTBT is billed as a way to check Anthropic’s leadership, to some outside observers, the fine print looks shaky. “The trust, since it doesn’t have a financial interest in Anthropic, could theoretically use its power with three slash four directors to keep the company on mission,” says Ann Lipton, law professor at the University of Colorado Law School and an expert in corporate governance. “One might question how likely that is to occur.”

Moreover, Lipton questions whether the trust would know enough to gauge when to hit the brakes on a company plan or product even if they did have such authority. The four listed LTBT members aren’t known to be AI experts: they include former Fed Chair Ben Bernanke, foreign policy analyst Richard Fontaine, experimental physicist Christopher Stubbs, and former GiveWell executive Neil Buddy Shah, who is chair of the LTBT. “I’m not convinced that the trustees or the directors that they appoint have the insight into AI and AI development to be able to make these choices,” Lipton says. “They’re very prestigious people, but what does Ben Bernanke know about AI?”

Several experts compared Anthropic’s LTBT to OpenAI’s nonprofit board before Altman’s ouster: “The powers, or lack thereof, of the Long-Term Benefit Trust … [are] analogous in some ways to the powers that the OpenAI nonprofit has,” said The Midas Project’s Johnston. Of course, that board’s decision to oust OpenAI CEO Sam Altman ended up leading, days later, to Altman’s return as CEO and the majority of the board’s resignation and replacement.

But there’s a notable difference between that and the LTBT. Before OpenAI’s restructuring, its nonprofit board had the ability to step in and guide day-to-day decisions at the company when deemed necessary, and even after its restructuring, they retained that ability for safety and security matters, such as delaying or stopping a model release. Anthropic’s Form S-1 suggests that the LTBT, with its main duty being appointing (and potentially removing) certain board members, does not have either of those levels of authority.

Instead, Anthropic’s structure looks more like the kind of founder-centric setup that Silicon Valley favors — like Mark Zuckerberg with Meta, and Elon Musk with SpaceX.

Anthropic did not respond to a request for comment.

“Neither the Trust or the trustees have any decisionmaking authority … over day to day decisions,” said Hamza Chaudhry, who leads AI and national security at the Future of Life Institute. “So I do not have strong hopes for the LTBT being a key mechanism for governance after they go public.”

The former Anthropic employee said that Anthropic’s founders are essentially the only ones with any real decisionmaking power: “I would be surprised if you could find anyone who knows the founders, knows the Long-Term Benefit Trust, understands how decisions get made, and thinks the Long-Term Benefit Trust has any meaningful power,” he said. The employee added that the trustees were both “poorly equipped to provide meaningful oversight” to the founders and also selected on purpose to not rock the boat.

Anthropic as a public company will face more pressure than ever before to secure capital, whether via driving more revenue or fundraising. That means that, as has been a trend in the industry for years, it will likely be more difficult to justify expensive AI safety initiatives, and there will inevitably be more pressure to speed up product releases and commercialization. “This trust and the founders together are the ones who actually have governance power,” Lipton said. “So you either trust that they are going to balance the interests of society appropriately, or you don’t. Either way, the real constraint on whatever societal impulses they have is going to be the fact that Anthropic needs money.”

Anthropic has been open about the fact that it’s in extreme need of cold, hard cash, particularly to buy more compute and speed up its AI advancement. “Compute is the deepest business dilemma that the company faces,” Amodei said last Friday in a livestreamed conversation with JPMorgan Chase CEO Jamie Dimon. “If you buy too much, of course you can financially overextend yourself. If you buy too little, then you can’t support inference for customers, and even more importantly … you can’t do the R&D.”

Anthropic’s website summarizes the company’s raison d’être as one thing: “AI research and products that put safety at the frontier.” But it’s also been clear that for that safety pledge to matter, Anthropic needs vast resources to remain a viable business. Like other labs, it’s been pursuing recursive self-improvement, a controversial and potentially dangerous industry milestone denoting AI systems that can autonomously improve and create advanced versions of themselves. “You can’t do safety from second place,” said Anthropic policy chief Sarah Heck in September.

This explanation hasn’t satisfied everyone, including some Anthropic employees. Anthropic’s head of safeguards research departed in February alleging that “the world is in peril”; one of its researchers, Jacob Coxon, made headlines in September for claiming that both Anthropic and OpenAI are “racing straight to self-improving superintelligence and gambling with our lives”; and that same month, an Anthropic safety researcher departed for a job at nonprofit third-party AI auditor METR, writing that “AI companies are on track to impose an unprecedented level of risk on society” and that “while Anthropic hasn’t had as severe an incident as the HuggingFace attack [by OpenAI agents], I think that’s partly a matter of luck.”

On Wednesday, a new statement from the Center for AI Safety, with prominent industry signatories from Hugging Face, Harvard University, and more, alleged that Anthropic is “not a safe AI company” and that it attempts to “amass power in the name of the greater good.” It stated, “Anthropic warns that recursively self-improving AI could concentrate power and escape human control, yet races to build it first. The company uses safety branding to court investors, employees, and the public—even as it has quietly weakened its safety pledges and lobbied for self-serving regulation.”

The former Anthropic employee said he felt he had initially “drunk the Kool-Aid” about Anthropic needing to come in first place in the AI race for a safe outcome but then grew disillusioned, realizing that the race to the top did not “warrant the cost imposed” — namely, that one company should not be able to “unilaterally” decide to pursue RSI. (Amodei has stated publicly that “left unchecked, [RSI] could outrun our ability to understand and control these systems, and so must be pursued very carefully, if at all.”)

“It’s pretty ridiculous that private companies are building a new form of intelligence on track to be more powerful and influential on the planet than humans and are doing that with less oversight, in many ways, than taco trucks currently have,” the former employee said.

Anthropic’s website states that “at the end of the day, the mission is what we’re all here for. It gives us a shared purpose and allows us to act swiftly together, rather than being pulled in multiple directions by competing goals. It engenders trust and collaboration, and is the final arbiter in our decisions.” The question is whether, and how, the interpretation of Anthropic’s mission may shift — once it’s facing more pressure than ever before to justify a fully diluted market cap of about $1.5 trillion.

Follow topics and authors from this story to see more like this in your personalized homepage feed and to receive email updates.

  • Hayden Field

來源:The Verge · AI · theverge.com