{"ID":2861743,"CreatedAt":"2026-06-01T04:54:23.091178241Z","UpdatedAt":"2026-06-01T04:54:23.091178241Z","DeletedAt":null,"paper_url":"https://arxiv.org/abs/2510.02601","arxiv_id":"2510.02601","title":"Ego-Exo 3D Hand Tracking in the Wild with a Mobile Multi-Camera Rig","abstract":"Accurate 3D tracking of hands and their interactions with the world in unconstrained settings remains a significant challenge for egocentric computer vision. With few exceptions, existing datasets are predominantly captured in controlled lab setups, limiting environmental diversity and model generalization. To address this, we introduce a novel marker-less multi-camera system designed to capture precise 3D hands and objects, which allows for nearly unconstrained mobility in genuinely in-the-wild conditions. We combine a lightweight, back-mounted capture rig with eight exocentric cameras, and a user-worn Meta Quest 3 headset, which contributes two egocentric views. We design an ego-exo tracking pipeline to generate accurate 3D hand pose ground truth from this system, and rigorously evaluate its quality. By collecting an annotated dataset featuring synchronized multi-view images and precise 3D hand poses, we demonstrate the capability of our approach to significantly reduce the trade-off between environmental realism and 3D annotation accuracy.","short_abstract":"Accurate 3D tracking of hands and their interactions with the world in unconstrained settings remains a significant challenge for egocentric computer vision. With few exceptions, existing datasets are predominantly captured in controlled lab setups, limiting environmental diversity and model generalization. To address...","url_abs":"https://arxiv.org/abs/2510.02601","url_pdf":"https://arxiv.org/pdf/2510.02601v1","authors":"[\"Patrick Rim\",\"Kun He\",\"Kevin Harris\",\"Braden Copple\",\"Shangchen Han\",\"Sizhe An\",\"Ivan Shugurov\",\"Tomas Hodan\",\"He Wen\",\"Xu Xie\"]","published":"2025-10-02T22:26:03Z","proceeding":"cs.CV","tasks":"[\"cs.CV\"]","methods":"[]","has_code":false}