{"ID":2867193,"CreatedAt":"2026-06-01T04:54:23.091178241Z","UpdatedAt":"2026-06-01T04:54:23.091178241Z","DeletedAt":null,"paper_url":"https://arxiv.org/abs/2509.19088","arxiv_id":"2509.19088","title":"Digital Twins as Funhouse Mirrors: Five Key Distortions","abstract":"Scientists and practitioners are increasingly moving to deploy digital twins--LLM-based models of real individuals--across social science and policy research. We conduct 19 pre-registered studies spanning 164 diverse outcomes (e.g., attitudes toward hiring algorithms, intentions to share misinformation), comparing human responses to those of their corresponding digital twins, which are trained on each individual's prior responses to over 500 questions. We establish an empirical benchmark for digital twin performance: their predictions are only modestly more accurate than those of a homogeneous base LLM and exhibit weak correlation with human responses (average $r = 0.20$). To inform future development, we identify five systematic distortions in digital twin behavior: (i) insufficient individuation, (ii) stereotyping, (iii) representation bias, (iv) ideological bias, and (v) hyper-rationality. Finally, we release our full dataset and code as a standardized testbed for evaluating and improving digital twin methodologies. Together, our findings caution against premature deployment while laying the groundwork for a transparent, replicable, and iterative science of responsible digital twin development.","short_abstract":"Scientists and practitioners are increasingly moving to deploy digital twins--LLM-based models of real individuals--across social science and policy research. We conduct 19 pre-registered studies spanning 164 diverse outcomes (e.g., attitudes toward hiring algorithms, intentions to share misinformation), comparing huma...","url_abs":"https://arxiv.org/abs/2509.19088","url_pdf":"https://arxiv.org/pdf/2509.19088v5","authors":"[\"Tianyi Peng\",\"George Gui\",\"Melanie Brucks\",\"Daniel J. Merlau\",\"Grace Jiarui Fan\",\"Malek Ben Sliman\",\"Eric J. Johnson\",\"Abdullah Althenayyan\",\"Silvia Bellezza\",\"Dante Donati\",\"Hortense Fong\",\"Elizabeth Friedman\",\"Ariana Guevara\",\"Mohamed Hussein\",\"Kinshuk Jerath\",\"Bruce Kogut\",\"Akshit Kumar\",\"Kristen Lane\",\"Hannah Li\",\"Vicki Morwitz\",\"Oded Netzer\",\"Patryk Perkowski\",\"Olivier Toubia\"]","published":"2025-09-23T14:42:14Z","proceeding":"cs.CY","tasks":"[\"cs.CY\",\"cs.AI\",\"cs.HC\",\"stat.AP\"]","methods":"[\"Large Language Model\"]","has_code":false}
