跳到正文
The Decoder· Matthias Bastian·· 6 小時前AI 評分65

百度發佈 ERNIE-5.5-Flash-Base 開放基礎模型,含 280 billion 個參數

Baidu releases ERNIE 5.5 Flash Base with 280 billion parameters as an open-source foundation model

AI 導讀

百度發佈 ERNIE-5.5-Flash-Base 開放基礎模型,刻意不附帶微調或後訓練,交由開發者自行決定後續用途。模型採混合專家架構,總參數量為 280 billion,每次輸入啟用 14 billion 個參數;預訓練使用 33.5 trillion tokens,訓練上下文長度最高 128,000 tokens。

正文

Baidu's AI development is still alive, but most of the work is on you. The Chinese company has released ERNIE-5.5-Flash-Base, an open foundation model that ships deliberately without fine-tuning or post-training. Developers are expected to decide for themselves where to take the model. A post-trained version is supposed to follow.

ERNIE 5.5 uses a mixture-of-experts architecture with 280 billion parameters, 14 billion of which are active per input. The model was pre-trained on 33.5 trillion tokens with a training context of up to 128,000 tokens, though it's designed to support a context of up to one million tokens during fine-tuning and inference.

Benchmark results for ERNIE 5.5 Flash Base compared to DeepSeek-V4-Flash-Base, Hy3-preview-Base, and MiMo-V2.5-Base, tested with the same evaluation pipeline across the categories Exam, STEM, Reasoning, Knowledge, Code, Multilingual, and Long Context. | Image: Baidu

In benchmarks for reasoning, code, and long-context tasks, the model competes with similarly sized open foundation models like DeepSeek V4 Flash or MiMo V2.5, according to Baidu. The weights are available on Hugging Face in FP8 and BF16.

AI News Without the Hype – Curated by Humans

Subscribe to THE DECODER for ad-free reading, a weekly AI newsletter, our exclusive "AI Radar" frontier report six times a year, full archive access, and access to our comment section.

來源:The Decoder · the-decoder.com