{"ID":2841037,"CreatedAt":"2026-06-01T04:54:23.091178241Z","UpdatedAt":"2026-06-01T04:54:23.091178241Z","DeletedAt":null,"paper_url":"https://arxiv.org/abs/2511.12662","arxiv_id":"2511.12662","title":"Hi-Reco: High-Fidelity Real-Time Conversational Digital Humans","abstract":"High-fidelity digital humans are increasingly used in interactive applications, yet achieving both visual realism and real-time responsiveness remains a major challenge. We present a high-fidelity, real-time conversational digital human system that seamlessly combines a visually realistic 3D avatar, persona-driven expressive speech synthesis, and knowledge-grounded dialogue generation. To support natural and timely interaction, we introduce an asynchronous execution pipeline that coordinates multi-modal components with minimal latency. The system supports advanced features such as wake word detection, emotionally expressive prosody, and highly accurate, context-aware response generation. It leverages novel retrieval-augmented methods, including history augmentation to maintain conversational flow and intent-based routing for efficient knowledge access. Together, these components form an integrated system that enables responsive and believable digital humans, suitable for immersive applications in communication, education, and entertainment.","short_abstract":"High-fidelity digital humans are increasingly used in interactive applications, yet achieving both visual realism and real-time responsiveness remains a major challenge. We present a high-fidelity, real-time conversational digital human system that seamlessly combines a visually realistic 3D avatar, persona-driven expr...","url_abs":"https://arxiv.org/abs/2511.12662","url_pdf":"https://arxiv.org/pdf/2511.12662v1","authors":"[\"Hongbin Huang\",\"Junwei Li\",\"Tianxin Xie\",\"Zhuang Li\",\"Cekai Weng\",\"Yaodong Yang\",\"Yue Luo\",\"Li Liu\",\"Jing Tang\",\"Zhijing Shao\",\"Zeyu Wang\"]","published":"2025-11-16T15:52:18Z","proceeding":"cs.CV","tasks":"[\"cs.CV\"]","methods":"[]","has_code":false}
