{"ID":2837753,"CreatedAt":"2026-06-01T04:54:23.091178241Z","UpdatedAt":"2026-06-01T04:54:23.091178241Z","DeletedAt":null,"paper_url":"https://arxiv.org/abs/2511.19426","arxiv_id":"2511.19426","title":"Ref-SAM3D: Bridging SAM3D with Text for Reference 3D Reconstruction","abstract":"SAM3D has garnered widespread attention for its strong 3D object reconstruction capabilities. However, a key limitation remains: SAM3D cannot reconstruct specific objects referred to by textual descriptions, a capability that is essential for practical applications such as 3D editing, game development, and virtual environments. To address this gap, we introduce Ref-SAM3D, a simple yet effective extension to SAM3D that incorporates textual descriptions as a high-level prior, enabling text-guided 3D reconstruction from a single RGB image. Through extensive qualitative experiments, we show that Ref-SAM3D, guided only by natural language and a single 2D view, delivers competitive and high-fidelity zero-shot reconstruction performance. Our results demonstrate that Ref-SAM3D effectively bridges the gap between 2D visual cues and 3D geometric understanding, offering a more flexible and accessible paradigm for reference-guided 3D reconstruction. Code is available at: https://github.com/FudanCVL/Ref-SAM3D.","short_abstract":"SAM3D has garnered widespread attention for its strong 3D object reconstruction capabilities. However, a key limitation remains: SAM3D cannot reconstruct specific objects referred to by textual descriptions, a capability that is essential for practical applications such as 3D editing, game development, and virtual envi...","url_abs":"https://arxiv.org/abs/2511.19426","url_pdf":"https://arxiv.org/pdf/2511.19426v1","authors":"[\"Yun Zhou\",\"Yaoting Wang\",\"Guangquan Jie\",\"Jinyu Liu\",\"Henghui Ding\"]","published":"2025-11-24T18:58:22Z","proceeding":"cs.CV","tasks":"[\"cs.CV\"]","methods":"[]","has_code":false,"code_links":[{"ID":606713,"CreatedAt":"2026-06-01T04:54:23.091178241Z","UpdatedAt":"2026-06-01T04:54:23.091178241Z","DeletedAt":null,"paper_id":2837753,"paper_url":"https://arxiv.org/abs/2511.19426","paper_title":"Ref-SAM3D: Bridging SAM3D with Text for Reference 3D Reconstruction","repo_url":"https://github.com/FudanCVL/Ref-SAM3D","is_official":false,"mentioned_in_paper":false,"mentioned_in_github":true,"github_stars":0}]}