{"ID":2852813,"CreatedAt":"2026-06-01T04:54:23.091178241Z","UpdatedAt":"2026-06-01T04:54:23.091178241Z","DeletedAt":null,"paper_url":"https://arxiv.org/abs/2510.17599","arxiv_id":"2510.17599","title":"Conveying Meaning through Gestures: An Investigation into Semantic Co-Speech Gesture Generation","abstract":"This study explores two frameworks for co-speech gesture generation, AQ-GT and its semantically-augmented variant AQ-GT-a, to evaluate their ability to convey meaning through gestures and how humans perceive the resulting movements. Using sentences from the SAGA spatial communication corpus, contextually similar sentences, and novel movement-focused sentences, we conducted a user-centered evaluation of concept recognition and human-likeness. Results revealed a nuanced relationship between semantic annotations and performance. The original AQ-GT framework, lacking explicit semantic input, was surprisingly more effective at conveying concepts within its training domain. Conversely, the AQ-GT-a framework demonstrated better generalization, particularly for representing shape and size in novel contexts. While participants rated gestures from AQ-GT-a as more expressive and helpful, they did not perceive them as more human-like. These findings suggest that explicit semantic enrichment does not guarantee improved gesture generation and that its effectiveness is highly dependent on the context, indicating a potential trade-off between specialization and generalization.","short_abstract":"This study explores two frameworks for co-speech gesture generation, AQ-GT and its semantically-augmented variant AQ-GT-a, to evaluate their ability to convey meaning through gestures and how humans perceive the resulting movements. Using sentences from the SAGA spatial communication corpus, contextually similar senten...","url_abs":"https://arxiv.org/abs/2510.17599","url_pdf":"https://arxiv.org/pdf/2510.17599v1","authors":"[\"Hendric Voss\",\"Lisa Michelle Bohnenkamp\",\"Stefan Kopp\"]","published":"2025-10-20T14:47:56Z","proceeding":"cs.HC","tasks":"[\"cs.HC\",\"cs.CV\"]","methods":"[]","has_code":false}