跳到正文
NVIDIA Technical Blog:Agentic AI / Generative AI· Zhihan Jiang·· 5 天前AI 評分32

NVIDIA Vera Rubin NVL72 在 MLPerf Endpoints v1.0 智能體推理效能領先

NVIDIA Vera Rubin NVL72 Leads Agentic Inference Performance on MLPerf Endpoints v1.0

AI 導讀

NVIDIA Vera Rubin NVL72 在 MLPerf Endpoints v1.0 的智能體推理效能領先。MLPerf Endpoints v1.0 以編碼及企業工作流程評估服務容量與回應速度的平衡;智能體工作負載涉及跨回合累積的對話歷史,以及推理、工具呼叫和回應生成。

正文

Two rows of black data center racks with gold-colored server components against a black background.Agentic workloads are demanding more from inference systems. AI agents carry growing conversation histories across turns and generate a mix of reasoning, tool...Two rows of black data center racks with gold-colored server components against a black background.

Agentic workloads are demanding more from inference systems. AI agents carry growing conversation histories across turns and generate a mix of reasoning, tool calls, and responses. Inference systems must support users at scale while remaining responsive. MLPerf Endpoints v1.0 evaluates this balance between serving capacity and responsiveness using coding and enterprise workflows through API…

Source

來源:NVIDIA Technical Blog:Agentic AI / Generative AI · developer.nvidia.com