跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-22AI 評分42

CellTrack-Bench:評測視覺語言模型的顯微細胞追蹤基準

CellTrack-Bench: Microscopic Cell Tracking Benchmark for Vision-Language Models

AI 導讀

CellTrack-Bench 評測視覺語言模型的細胞追蹤能力,並與專用追蹤算法比較,揭示模型在不同成像模態下的推理差距。基準涵蓋四種成像模態、15 個細胞追蹤數據集,共有 1,537 個問題及 9,041 項細胞連結決策。研究評測了 9 個閉源前沿模型和 13 個開放權重模型,並分析其失效模式。

正文

Published on Oct 22

Authors:

,

Abstract

A new benchmark evaluates vision-language models on cell tracking against specialized algorithms, revealing reasoning gaps across diverse imaging modalities.

Large language models have shown outstanding performance on text-first tasks such as coding, math, and writing. Recent efforts are shifting models' training to include scientific problems that often live in highly specialized domains beyond text, such as protein structure and biological images. However, in these scenarios, their general-purpose accuracy compared with specialized algorithms remains in question. One such domain is cell tracking, which requires spatiotemporal awareness of cell dynamics. To evaluate this, we created a new benchmark, CellTrack-Bench, which assesses Vision-Language Models' (VLMs) cell-tracking-related performance against specialized trackers. The full benchmark draws from 15 standard cell-tracking datasets across four imaging modalities and comprises 1,537 problems corresponding to 9,041 cell-linking decisions. We selected a hard subset requiring greater reasoning effort by identifying failures shared across distinct algorithmic trackers. With this proposed dataset, we: (i) evaluated different environment harnesses for VLMs; (ii) benchmarked 9 frontier closed-source models and 13 open-weight models; and (iii) provided a detailed analysis of their failure modes. Code, the stored model outputs, and a pipeline that regenerates the benchmark from the source datasets are available at https://github.com/royerlab/celltrack-bench.

View arXiv page View PDF GitHub 2 Add to collection

Get this paper in your agent:

hf papers read 2610.31566

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.31566 in a model README.md to link it from this page.

Datasets citing this paper 0

No dataset linking this paper

Cite arxiv.org/abs/2610.31566 in a dataset README.md to link it from this page.

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.31566 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co