Token 費用高企促企業由前沿實驗室轉向開放權重 AI 工廠
Token sticker shock pushes enterprises from frontier labs toward open-weight AI factories
企業正因前沿模型服務的 token 費用,以及數據主權、安全和治理等考慮,轉向可微調並在本地部署的開放權重模型。企業原本預計每人每月的 token 支出不會達 $10,000 至 $20,000。Dell 推出 AI Ecosystem Program,約 60 個合作夥伴已申請或正接受評估。
Token sticker shock pushes enterprises from frontier labs toward open-weight AI factories
![]()
Enterprises have spent the AI boom racing to secure GPUs, but the harder decisions now sit above the hardware. Token bills, data sovereignty and model choice increasingly decide which AI pilots reach production, a shift on display at the SC26 supercomputing conference.
Dell Technologies Inc. has spent the past year pushing its AI Factory beyond servers and storage. Customers now want a full-stack outcome that covers software, open-source tools, models and operations, according to Brad Maltz (pictured), senior director of AI solutions at Dell.
“The hardware’s key, because that drives the tokens,” Maltz said. “You really, truly need a full-stack AI factory view above and beyond just the hardware stack.”
Maltz spoke with theCUBE Research’s John Furrier and Gemma Allen at SC26, during an exclusive broadcast on theCUBE, SiliconANGLE Media’s livestreaming studio. They discussed how token bills and data sovereignty are steering enterprises toward open-weight models and a full-stack AI Factory. The interview came as Dell rolled out AI Factory updates at the conference. (* Disclosure below.)
Why GPUs alone won’t carry AI pilots into production
Many enterprises are still stuck in pilot mode, and coding assistants are often the easiest place to start. Employees have already tried tools from Anthropic PBC and OpenAI Group PBC, so teams want to apply that experience to business use cases. Once those pilots grow, the bill arrives, Maltz explained.
“The token spend right now in the frontier labs and the hyperscalers. That’s a little more than we expected,” Maltz said. “We didn’t expect to spend $10,000, $20,000 per person per month.”
Cost is only one trigger. Data sovereignty, intellectual property leakage, security and governance all have to be addressed before a pilot goes live. That is steering many enterprises toward open-weight models they can fine-tune and run on-premises, including U.S. options such as Nvidia Corp.’s Nemotron, according to Maltz.
“There will always be frontier labs. There will always be open-weight models,” Maltz said. “The question is going to be, do we have enough diversity with the open weights to meet the enterprise use cases?”
To keep pace, Dell launched its AI Ecosystem Program to validate software partners on its AI Factory. About 60 more partners have applied or are under evaluation, and each addition lets Dell solve 10 to 30 more customer problems, Maltz noted. For sovereign deployments, that often means disconnected, on-premises systems that keep models next to the GPUs and data enterprises already control.
“People understand data is the lifeblood of AI,” Maltz said. “It’s the thing that trains the models. It’s the thing the models operate against. It comes from your enterprise business applications.”
Here’s the complete video interview, part of SiliconANGLE’s and theCUBE’s coverage of SC26:
(* Disclosure: Dell Technologies Inc. sponsored this segment of theCUBE. Neither Dell Technologies Inc. nor other sponsors have editorial control over content on theCUBE or SiliconANGLE.)
Photo: SiliconANGLE
A message from John Furrier, co-founder of SiliconANGLE:
Support our mission to keep content open and free by engaging with theCUBE community. Join theCUBE’s Alumni Trust Network, where technology leaders connect, share intelligence and create opportunities.
- 15M+ viewers of theCUBE videos, powering conversations across AI, cloud, cybersecurity and more
- 11.4k+ theCUBE alumni — Connect with more than 11,400 tech and business leaders shaping the future through a unique trusted-based network
SiliconANGLE Media is a recognized leader in digital media innovation, uniting breakthrough technology, strategic insights and real-time audience engagement. As the parent company of SiliconANGLE, theCUBE Network, theCUBE Research, CUBE365, theCUBE AI and theCUBE SuperStudios — with flagship locations in Silicon Valley and the New York Stock Exchange — SiliconANGLE Media operates at the intersection of media, technology and AI.
Founded by tech visionaries John Furrier and Dave Vellante, SiliconANGLE Media has built a dynamic ecosystem of industry-leading digital media brands that reach 15+ million elite tech professionals. Our new proprietary theCUBE AI Video Cloud is breaking ground in audience interaction, leveraging theCUBEai.com neural network to help technology companies make data-driven decisions and stay at the forefront of industry conversations.
來源:SiliconANGLE · siliconangle.com