{"ID":2899768,"CreatedAt":"2026-06-01T04:54:23.091178241Z","UpdatedAt":"2026-06-01T04:54:23.091178241Z","DeletedAt":null,"paper_url":"https://arxiv.org/abs/2507.00999","arxiv_id":"2507.00999","title":"La Leaderboard: A Large Language Model Leaderboard for Spanish Varieties and Languages of Spain and Latin America","abstract":"Leaderboards showcase the current capabilities and limitations of Large Language Models (LLMs). To motivate the development of LLMs that represent the linguistic and cultural diversity of the Spanish-speaking community, we present La Leaderboard, the first open-source leaderboard to evaluate generative LLMs in languages and language varieties of Spain and Latin America. La Leaderboard is a community-driven project that aims to establish an evaluation standard for everyone interested in developing LLMs for the Spanish-speaking community. This initial version combines 66 datasets in Basque, Catalan, Galician, and different Spanish varieties, showcasing the evaluation results of 50 models. To encourage community-driven development of leaderboards in other languages, we explain our methodology, including guidance on selecting the most suitable evaluation setup for each downstream task. In particular, we provide a rationale for using fewer few-shot examples than typically found in the literature, aiming to reduce environmental impact and facilitate access to reproducible results for a broader research community.","short_abstract":"Leaderboards showcase the current capabilities and limitations of Large Language Models (LLMs). To motivate the development of LLMs that represent the linguistic and cultural diversity of the Spanish-speaking community, we present La Leaderboard, the first open-source leaderboard to evaluate generative LLMs in language...","url_abs":"https://arxiv.org/abs/2507.00999","url_pdf":"https://arxiv.org/pdf/2507.00999v1","authors":"[\"María Grandury\",\"Javier Aula-Blasco\",\"Júlia Falcão\",\"Clémentine Fourrier\",\"Miguel González\",\"Gonzalo Martínez\",\"Gonzalo Santamaría\",\"Rodrigo Agerri\",\"Nuria Aldama\",\"Luis Chiruzzo\",\"Javier Conde\",\"Helena Gómez\",\"Marta Guerrero\",\"Guido Ivetta\",\"Natalia López\",\"Flor Miriam Plaza-del-Arco\",\"María Teresa Martín-Valdivia\",\"Helena Montoro\",\"Carmen Muñoz\",\"Pedro Reviriego\",\"Leire Rosado\",\"Alejandro Vaca\",\"María Estrella Vallecillo-Rodríguez\",\"Jorge Vallego\",\"Irune Zubiaga\"]","published":"2025-07-01T17:50:48Z","proceeding":"cs.CL","tasks":"[\"cs.CL\"]","methods":"[\"Large Language Model\",\"Language Model\"]","has_code":false}