跳到正文
NVIDIA Technical Blog:Agentic AI / Generative AI· Ekin Karabulut·· 11 天前AI 評分35

Agent Substrate:推進 Kubernetes 支援大規模 Agent 運行

Agent Substrate: Advancing Kubernetes for Agents at Scale

AI 導讀

Agent Substrate 旨在推進 Kubernetes 支援大規模 Agent 運行,應對 Agent 工作負載的特性。每個工作階段配置一個 Pod,會令閒置工作階段持續佔用記憶體;每回合之間刪除 Pod,則會造成數秒冷啟動並遺失 Agent 狀態。

正文

AI agents spend most of their time idle, waiting on a human prompt, a tool result or a model response. Kubernetes wasn’t built for that. Running one Pod per...

AI agents spend most of their time idle, waiting on a human prompt, a tool result or a model response. Kubernetes wasn’t built for that. Running one Pod per session holds memory for sessions that aren’t doing anything, and deleting Pods between turns pays a multi-second cold start every time and loses the agent’s state. RL post-training hits the same wall. Agent Substrate, now donated to the…

Source

來源:NVIDIA Technical Blog:Agentic AI / Generative AI · developer.nvidia.com