Agent Substrate:推進 Kubernetes 支援大規模 Agent 運行
Agent Substrate: Advancing Kubernetes for Agents at Scale
Agent Substrate 旨在推進 Kubernetes 支援大規模 Agent 運行,應對 Agent 工作負載的特性。每個工作階段配置一個 Pod,會令閒置工作階段持續佔用記憶體;每回合之間刪除 Pod,則會造成數秒冷啟動並遺失 Agent 狀態。
AI agents spend most of their time idle, waiting on a human prompt, a tool result or a model response. Kubernetes wasn’t built for that. Running one Pod per...
AI agents spend most of their time idle, waiting on a human prompt, a tool result or a model response. Kubernetes wasn’t built for that. Running one Pod per session holds memory for sessions that aren’t doing anything, and deleting Pods between turns pays a multi-second cold start every time and loses the agent’s state. RL post-training hits the same wall. Agent Substrate, now donated to the…
來源:NVIDIA Technical Blog:Agentic AI / Generative AI · developer.nvidia.com