跳到正文
OpenAI:部署安全與系統卡·· 21 小時前AI 評分47

GPT-6 Astra 系統卡補充文件:GPT-6.1 Terra

Addendum to GPT-6 Astra System Card: GPT-6.1 Terra

AI 導讀

OpenAI 在 GPT-6 Astra 系統卡補充文件中評估 GPT-6.1 Terra,將其列為生物及化學領域的高能力模型。Terra 在 Sandbox Bench 的 22 個目標中成功攻破 5 個(22.7%),低於 GPT-6.1 Sol 的 41.9% 和 GPT-6 Astra 的 45.5%。

正文

2. Model Data and Training

GPT-6.1 Terra uses the same types of data and training as GPT-6 Astra, described in the GPT-6 Astra card.

For previously launched models, the values published at launch reflect the versions evaluated at that time. The comparison values for previously launched models that are shown here may reflect later versions of those models, and may vary from the values published at launch.1

9.1 Biological and Chemical Capabilities

We are treating GPT-6.1 Terra as High capability in the Biological and Chemical domain. This is illustrated by Multimodal Troubleshooting Virology crossing its indicative threshold. The four available Critical capability results do not cross their listed thresholds.

For a full description of these evaluations, please see the Biological and Chemical Capabilities section in the GPT-6 Astra card.

9.2.3 Sandbox Bench

Sandbox Bench is an internal evaluation designed to test a model’s ability to identify and exploit vulnerabilities in runtimes, file format parsers, and egress proxies inspired by those used in internal systems. While the security of these software libraries and systems is not load bearing to our security threat model – for example, runtimes are further contained by containers, operating systems and hardened virtual machines – this evaluation is meant to provide signal on areas where investing in first-layer hardening will improve security in a defense in depth approach.

GPT-6.1 Terra succeeded on 5 of 22 targets (22.7%), compared to 9 of 22 targets (41.9%) for GPT-6.1 Sol and compared to 10 of 22 targets (45.5%) by GPT-6 Astra.

9.4.1 Model Safety Training and Evaluation

9.4.1.1 Biological and Chemical Safety Training and Evaluation

GPT‑6.1 Terra performs on par with recent GPT-6 Astra and GPT-6.1 releases. These results reflect model responses alone, without our full production safeguards.

Table 31. Biology Model Refusal Evaluation (higher is better)

9.4.1.2 Cybersecurity Safety Training and Evaluation

GPT‑6.1 Terra performs on par with recent GPT-6 Astra and GPT-6.1 releases. These results reflect model responses alone, without our full production safeguards.

Table 32. Cybersecurity Safety Evaluation (higher is better)

來源:OpenAI:部署安全與系統卡 · deploymentsafety.openai.com