Shared Task Overview

AutoMin 2025 represents the third iteration of the biennial Automatic Minuting Shared Task, dedicated to advancing the field of automatic meeting summarization and information retrieval from extensive meeting transcripts. This edition has two primary tasks: the generation of structured minutes from multiparty meeting transcripts and the development of systems capable of accurately responding to specific inquiries based on these transcripts. The tasks are designed to assess both monolingual (English) and cross-lingual (Czech-to-English) capabilities, addressing the increasing demand for multilingual support in global collaborative settings. Participants will have access to curated datasets, notably the ELITR Minuting Corpus, EuroParlMin v.1 and ELITR-Bench, which serve as foundational resources for training and evaluation purposes. AutoMin 2025 would be a dedicated workshop scheduled for August 28, 2025, as part of the SIGDial 2025 conference in Avignon, France.

Test Data Instructions (April 17th 2025)

Track A (Minuting) test data is mentioned in the CfP and in the dataset (with freeform .txt files for the test set generations)

Track B (Q&A) The test data is provided in the file elitr-bench-qa_test2.json available in this archive: data.zip. Use the following password to unzip the file: utter.

Your submitted file should follow the format shown in this submission sample. Below is an example of the required structure:

{
  "id": "meeting_en_test2_001",
  "questions": [
    {
      "id": "1",
      "question-type": "what",
      "answer-position": "S",
      "question": "What was the purpose of the meeting?",
      "groundtruth-answer": "Preparation for a workshop or conference event on automatic text summarization.",
      "generated-responses": [
        {
          "model": "<your system name>",
          "generated-response": "<your generated response for this question>"
        }
      ]
    }
  ]
}

Please make sure your submission strictly follows the required format and includes all necessary fields.

Important: While the groundtruth-answer field is included in the provided data, it must not be used by your system to generate answers. However, we ask that you copy this field into your submission as-is, to help us with scoring and evaluation.

Important Dates

All submission deadlines are 11:59 PM AoE (Anywhere on Earth) Time Zone (UTC-12).