The participants are required to submit their system-generated test set minutes (Task A) in .txt format. For Task B and Task C, the participants are required to submit the prediction .tsv file on the test data. The participants would host their system-runs in their own GitHub repository and share the link with us with the exact the system requirements/environment to run their code. The manual evaluation would be carried out by our annotators.
The System Submission form is available to the participants, sent over email. Also, available on the shared Github data repository "automin-2021-confidential-data".
Please organize your upload exactly as per the "sample-submission-folder" in the "automin-2021-confidential-data" repository already shared with you. You can edit your submission and can make up to a maximum of 10 submission runs. Please do not make a new submission for the next attempt; you can edit the earlier submission and upload a new .zip file. By default, we would consider the latest one in our evaluation, unless you explicitly specify a different submission run over email. If you are unable to submit via the form, please email your final submission folder (.zip) at minute@ufal.mff.cuni.cz by July 15, 2021 (11:59 pm AoE).
To be double sure about your final submission, please email us your final submission zipped folder at minute@ufal.mff.cuni.cz by July 15, 2021 (11:59 pm AoE).
Kindly provide your system codebase in the appropriate section on the submission form. Please accompany a README for us to replicate the system runs
You can make up to 10 submissions. Please upload ONLY the output files (.txt) for Task A and the prediction files (.tsv) for Task B and Task C. Kindly adhere to the format (naming conventions, organization) as specified in the "sample-submission-folder" in the "automin-2021-confidential-data" repository already shared with you.
The evaluation phase would consist of both human and automatic metrics.
All teams are required to submit a brief technical report describing their method. All reports must be a minimum of 2 page and a maximum of 5 pages excluding references. For multiple tasks, the report could be of 8 pages excluding references. Reports must be written in English. The proceedings would be added to the ISCA archive. Please follow this template for your system reports. Please send your system description paper to minute@ufal.mff.cuni.cz by August 23, 2021.
We would additionally invite selected authors to submit a full-paper to a special issue of the open access Information journal from MDPI which is indexed within Scopus, ESCI (Web of Science), Ei Compendex, DBLP, and many other databases. The journal submissions would undergo further review. Authors of invited papers should be aware that the final submitted manuscript must provide a minimum of 50% new content and not exceed 30% copy/paste from the proceedings paper. More details on the special issue would be updated here.