跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 27 天前AI 評分38

MoveBench:以評分規準評估大語言模型運動與健康教練能力的基準測試

MoveBench: A Rubric-Based Benchmark for Evaluating Large Language Models in Sports and Health Coaching

AI 導讀

MoveBench提出一套專門評估大語言模型在運動與健康教練領域表現的基準測試,重點評估安全性、科學有效性及個人化。研究以 809 條問題及 5,012 項評分規準評估 15 個大語言模型,發現模型表現差異明顯,尤其體現在安全意識、訓練計劃設計及個人化能力。MoveBench提供開放資源及可重現的評估框架。

正文

Published on Oct 26

Authors:

,

,

,

Abstract

MoveBench introduces a specialized benchmark for evaluating large language models on sports and health coaching, emphasizing safety, scientific validity, and personalization across multiple-choice and open-ended tasks.

Despite rapid advances in large language models (LLMs), their deployment in the sports and health domain remains high-risk due to the absence of domain-specific evaluation benchmarks. Existing general-purpose benchmarks (e.g., MMLU and HELM) primarily assess broad knowledge and reasoning capabilities, but fail to capture critical domain requirements such as exercise safety, physiological appropriateness, personalization, and actionable coaching quality. This gap is particularly concerning in fitness and health applications, where incorrect or unsafe recommendations can lead to physical harm. To address this limitation, we introduce MoveBench, the first comprehensive benchmarking framework specifically designed for evaluating LLMs in sports and health coaching. The proposed benchmark integrates heterogeneous task formats, including multiple-choice questions (MCQs) and open-ended question answering (OpenQA), grounded in real-world user scenarios and paired with structured rubrics emphasizing safety compliance, scientific validity, and training logic. Through large-scale evaluation of 15 diverse LLMs on 809 questions with 5,012 rubric-level criteria, our results reveal substantial performance variability, particularly in safety awareness, structured program design, and personalization capability, highlighting a critical gap between knowing and doing. Our work establishes a foundational evaluation standard for sports and health LLM applications and provides a reproducible framework for advancing safe, reliable, and context-aware AI-driven coaching systems. Open resources are available at https://github.com/SatoSakula/MoveBench.

View arXiv page View PDF Project page GitHub Add to collection

Get this paper in your agent:

hf papers read 2610.26185

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.26185 in a model README.md to link it from this page.

Datasets citing this paper 1

KeepaceAI/MoveBench

Viewer •

Updated 31 minutes ago

•

80

•

535

•

2

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.26185 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co