跳到正文
BeingBeyond:具身智能研究·· 2025-12-24AI 評分35

UniTacHand:支援人手技能遷移至機械手的統一空間觸覺表徵

UniTacHand: Unified Spatio-Tactile Representation for Human to Robotic Hand Skill Transfer

AI 導讀

UniTacHand 將感測手套與靈巧機械手的觸覺訊號映射至 MANO 的統一 2D 手部空間,以支援人手技能遷移。在人手數據加一次示範的操作任務比較中,UniTacHand 的成功率為 73.3%,高於 UV-Direct 的 63.3%;混合人手與機械人數據協同訓練亦展示零樣本觸覺策略遷移及更高數據效率。

正文

Dec 24, 2025

Chi Zhang / Penglin Cai* / Haoqi Yuan / Chaoyi Xu / Zongqing Lu†

PKU / BeingBeyond

* Equal contribution · † Corresponding author

Contents

Key ConceptVideo DemoExperimentsCitation

We propose UniTacHand, a novel unified representation to align robotic tactile information captured by dexterous hands with human hand touch signals obtained from gloves with sensors.

Key Concept

Enabling robotic hands to achieve human-level dexterous manipulation remains a significant challenge. While tactile sensing is crucial, its application is often hindered by the difficulty of collecting large-scale, real-world robotic tactile data. Learning from human demonstration (LfD) offers a promising alternative, but faces a fundamental mismatch between human haptic gloves and robotic tactile sensors.

To bridge this gap, UniTacHand projects disparate tactile signals onto a morphologically consistent 2D surface space of the MANO hand model. This unification standardizes heterogeneous data structures and embeds tactile signals with spatial context. We demonstrate that our approach achieves zero-shot tactile-based policy transfer and superior data efficiency via co-training on mixed human-robot data.

UniTacHand Framework Overview

UniTacHand Framework Overview. (Left) Stage 1: Projecting tactile data from a human haptic glove or a robotic hand onto the unified MANO UV map. (Right) Stage 2: The contrastive learning framework with reconstruction and adversarial losses to align the latent spaces. The unified pressure UV maps serve as accurate prior knowledge to supervise domain-specific encoders.

Video Demo

Experiments

UV mapping Results: When a hand grasps an object, the activated tactile lattices on the MANO hand are highlighted in red. This achieves the unification of hand actions and spatial tactility, aligning human hands and dexterous hands in a shared tactile space.

UV mapping Results

Results of the tasks: CompliantControl and ObjectClassification. We calculate the accuracy (%) for each method.

TasksPatchMatchUV-DirectUniTacHand (Ours)
CompliantControl10.036.040.0
ObjectClassification
(Human Set)
43.271.659.5
ObjectClassification
(Robot Set)
15.718.938.6

Success rates (%) for manipulation tasks comparing visual-only baselines and robot-only data.

Data SourceMethodSuccess Rate
Robot OnlyR-Visual-Only43.3
R-Visual-Tactile50.0
Human + One-ShotPatchMatch56.7
UV-Direct63.3
UniTacHand (Ours)73.3

Citation

@article{unitachand,
  title={UniTacHand: Unified Spatio-Tactile Representation for Human to Robotic Hand Skill Transfer},
  author={Zhang, Chi and Cai, Penglin and Yuan, Haoqi and Xu, Chaoyi and Lu, Zongqing},
  journal={arXiv preprint arXiv:2512.21233},
  year={2025}
}

來源:BeingBeyond:具身智能研究 · research.beingbeyond.com