{"ID":2858067,"CreatedAt":"2026-06-01T04:54:23.091178241Z","UpdatedAt":"2026-06-01T04:54:23.091178241Z","DeletedAt":null,"paper_url":"https://arxiv.org/abs/2510.08042","arxiv_id":"2510.08042","title":"ChatGPT as a Translation Engine: A Case Study on Japanese-English","abstract":"This study investigates ChatGPT for Japanese-English translation, exploring simple and enhanced prompts and comparing against commercially available translation engines. Performing both automatic and MQM-based human evaluations, we found that document-level translation outperforms sentence-level translation for ChatGPT. On the other hand, we were not able to determine if enhanced prompts performed better than simple prompts in our experiments. We also discovered that ChatGPT-3.5 was preferred by automatic evaluation, but a tradeoff exists between accuracy (ChatGPT-3.5) and fluency (ChatGPT-4). Lastly, ChatGPT yields competitive results against two widely-known translation systems.","short_abstract":"This study investigates ChatGPT for Japanese-English translation, exploring simple and enhanced prompts and comparing against commercially available translation engines. Performing both automatic and MQM-based human evaluations, we found that document-level translation outperforms sentence-level translation for ChatGPT...","url_abs":"https://arxiv.org/abs/2510.08042","url_pdf":"https://arxiv.org/pdf/2510.08042v1","authors":"[\"Vincent Michael Sutanto\",\"Giovanni Gatti De Giacomo\",\"Toshiaki Nakazawa\",\"Masaru Yamada\"]","published":"2025-10-09T10:25:10Z","proceeding":"cs.CL","tasks":"[\"cs.CL\"]","methods":"[]","has_code":false}