{"ID":2879580,"CreatedAt":"2026-06-01T04:54:23.091178241Z","UpdatedAt":"2026-06-01T04:54:23.091178241Z","DeletedAt":null,"paper_url":"https://arxiv.org/abs/2508.16771","arxiv_id":"2508.16771","title":"EyeMulator: Improving Code Language Models by Mimicking Human Visual Attention","abstract":"Code Language Models (CodeLLMs) traditionally learn attention based solely on statistical input-output token correlations (\"machine attention\"). In contrast, human developers rely on intuition, selectively fixating on semantically salient tokens during program comprehension. We present EyeMulator, a model-agnostic technique to align CodeLLM attention with human visual attention without architectural changes. By extracting scan paths from eye-tracking data, we derive token-level attention weights used to augment the loss function during fine-tuning. This induces the model to mimic human focus. Our evaluation across StarCoder, Llama-3.2, and DeepSeek-Coder shows that EyeMulator significantly outperforms baselines, achieving gains of over 30 CodeBLEU points in translation and up to 22 BERTScore points in summarization. Ablation studies confirm that these gains stem directly from replicating human attention dynamics. Artifacts are available at https://zenodo.org/records/17205682.","short_abstract":"Code Language Models (CodeLLMs) traditionally learn attention based solely on statistical input-output token correlations (\"machine attention\"). In contrast, human developers rely on intuition, selectively fixating on semantically salient tokens during program comprehension. We present EyeMulator, a model-agnostic tech...","url_abs":"https://arxiv.org/abs/2508.16771","url_pdf":"https://arxiv.org/pdf/2508.16771v2","authors":"[\"Yifan Zhang\",\"Chen Huang\",\"Yueke Zhang\",\"Jiahao Zhang\",\"Toby Jia-Jun Li\",\"Collin McMillan\",\"Kevin Leach\",\"Yu Huang\"]","published":"2025-08-22T20:08:09Z","proceeding":"cs.SE","tasks":"[\"cs.SE\",\"cs.AI\",\"cs.HC\"]","methods":"[\"Large Language Model\",\"Language Model\"]","project_urls":"[\"https://zenodo.org/records/17205682\"]","has_code":false,"code_links":[{"ID":610597,"CreatedAt":"2026-06-01T04:54:23.091178241Z","UpdatedAt":"2026-06-01T04:54:23.091178241Z","DeletedAt":null,"paper_id":2879580,"paper_url":"https://arxiv.org/abs/2508.16771","paper_title":"EyeMulator: Improving Code Language Models by Mimicking Human Visual Attention","repo_url":"https://github.com/CoderDoge1108/EyeMulator","is_official":false,"mentioned_in_paper":false,"mentioned_in_github":true,"github_stars":0},{"ID":610598,"CreatedAt":"2026-06-01T04:54:23.091178241Z","UpdatedAt":"2026-06-01T04:54:23.091178241Z","DeletedAt":null,"paper_id":2879580,"paper_url":"https://arxiv.org/abs/2508.16771","paper_title":"EyeMulator: Improving Code Language Models by Mimicking Human Visual Attention","repo_url":"https://github.com/zenodo/zenodo-rdm","is_official":false,"mentioned_in_paper":false,"mentioned_in_github":true,"github_stars":0}]}