Conference: GEM at ACL 2026, special Comic-Con edition! 
Submission deadline: March 19th (via Open Review)
Date: July 3nd or July 4rd, 2026
Location: San Diego, California, USA
Website: https://gem-workshop.com/
Contact: gem-workshop-chairs@googlegroups.com

Evaluation of language models has grown to be a central theme in NLP research, while remaining far from solved. As LMs have become more powerful, errors have become tougher to spot and systems harder to distinguish. Evaluation practices are evolving rapidly—from living benchmarks like Chatbot Arena to LMs being used as evaluators themselves (e.g., LM as judge, autoraters). Further research is needed to understand the interplay between metrics, benchmarks, and human-in-the-loop evaluation, and their impact in real-world settings. We will welcome submissions on a variety of topics and encourage themed presentations and posters! See Website for more information.

Submissions through Open Review can take any of the following forms:

  • Archival Papers: Original and unpublished work, for all the following tracks—Main, ReproNLP, and Opinion/Statement. 
  • Non-Archival Extended Abstracts: Work already presented or under review at a peer-reviewed venue. This is an excellent opportunity to share recent or ongoing work with the GEM community without precluding future publication.
  • Findings Papers: We additionally welcome presentation of relevant papers accepted to Findings, and will share more information at a later date.

Important Dates

  • March 19, 2026: Direct paper submission deadline
  • April 9, 2026: Pre-reviewed ARR commitment deadline
  • April 28, 2026: Notification of acceptance
  • May 14, 2026: Camera-ready paper due
  • June 4, 2026: Pre-recorded video due (hard deadline)
  • July 3–4, 2026: Workshop at ACL in San Diego

We hope to see you there!


Dublin City University

Simon Mille | Postdoctoral Research Fellow
ADAPT Centre
School of Computing
Dublin City University
Dublin 9
Ireland
www.adaptcentre.ie

ADAPT Taighde Éireann – Research Ireland Centre for Digital Content Technology
Privileged/confidential information: This e-mail and any files transmitted with it are confidential and are intended solely for use by the addressee.
Please note that electronic mail to, from or within the College, may be the subject of a request under the Freedom of Information Act.