跳到正文
HuggingFace Daily Papers(社區熱門論文)·· 2026-10-07AI 評分61

TouchScale 提出 500 小時人類視覺與觸覺資料集,支援視覺觸覺學習

TouchScale: 500 Hours of Human Vision and Touch for Visual-Tactile Learning

AI 導讀

TouchScale提出一個500小時的人類視覺觸覺資料集,以統一的穿戴式配置同步記錄第一身視角 RGB-D 影片、手腕 RGB 影片及雙手密集觸覺測量。資料涵蓋約2K項預設任務;使用完整數據訓練後,未見觸覺感測器上的零樣本接觸 IoU 由0.134升至0.383,機械人四項真實操作任務的平均成功率由22.5%升至57.5%。研究團隊計劃公開所有同步視覺觸覺錄影及重建物件模型。

正文

Published on Oct 7

Authors:

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

,

Abstract

Large-scale egocentric human interaction data is becoming an important source of physical supervision for embodied learning, yet video alone leaves the contact and pressure that characterize physical interaction unrecorded. Recent visual-tactile datasets provide this missing supervision, but their synchronized tactile data remain far smaller in volume than human video. Moreover, the largest resources often merge recordings from different sensors or annotation procedures, which makes the effect of data scale difficult to isolate. We therefore introduce TouchScale, a 500-hour dataset of contact-rich human interaction recorded with a single unified wearable setup. Its approximately 2K predefined task descriptions span everyday activities and structured manipulation, and each recording temporally aligns egocentric RGB-D video with wrist RGB video and dense full-hand bimanual tactile measurements. Compared with prior tactile data, training on the full TouchScale raises zero-shot contact IoU on data from an unseen tactile sensor from 0.134 to 0.383. Pretraining a visual encoder on TouchScale also yields the highest action recognition accuracy on three benchmarks among the compared visual-tactile datasets. Used for visual-tactile mid-training of a robot policy, TouchScale improves the average real-world success rate across four contact-rich manipulation tasks from 22.5% to 57.5%. With the sensor and collection protocol held fixed, both zero-shot tactile prediction and robot success show an overall upward trend as more TouchScale data is used. These results suggest that human visual-tactile data collected at scale with consistent sensing benefits both perception and robot manipulation. We will publicly release TouchScale, including all synchronized visual-tactile recordings and reconstructed object models, to support future research on scalable visual-tactile learning.

View arXiv page View PDF Project page GitHub Add to collection

Get this paper in your agent:

hf papers read 2610.10288

Don't have the latest CLI?

curl -LsSf https://hf.co/cli/install.sh | bash

Models citing this paper 0

No model linking this paper

Cite arxiv.org/abs/2610.10288 in a model README.md to link it from this page.

Datasets citing this paper 1

2077AIDataFoundation/TouchScale

Viewer •

Updated 3 days ago

•

15.3k

•

2.57k

•

5

Spaces citing this paper 0

No Space linking this paper

Cite arxiv.org/abs/2610.10288 in a Space README.md to link it from this page.

Collections including this paper 0

No Collection including this paper

Add this paper to a collection to link it from this page.

來源:HuggingFace Daily Papers(社區熱門論文) · huggingface.co