Named after Ukrainian fairytale written by Hohol Mykola, a project that collects the parallel corpora from opus, deduplicate them and evaluate using different models
Якщо ви використовуєте vakula: parallel corpus quality-estimation framework, будь ласка, процитуйте статтю, а не посилання на репозиторій — це єдиний спосіб, у який внесок стає видимим у наукометрії.
Chaplynskyi, D. and Zakharov, K. (2025). A Framework for Large-Scale Parallel Corpus Evaluation: Ensemble Quality Estimation Models Versus Human Assessment. In Proceedings of the Fourth Ukrainian Natural Language Processing Workshop (UNLP 2025), pages 73–85. Association for Computational Linguistics. https://doi.org/10.18653/v1/2025.unlp-1.9
@inproceedings{chaplynskyi-zakharov-2025-framework,
title = "A Framework for Large-Scale Parallel Corpus Evaluation: Ensemble Quality Estimation Models Versus Human Assessment",
author = "Chaplynskyi, Dmytro and
Zakharov, Kyrylo",
editor = "Romanyshyn, Mariana",
booktitle = "Proceedings of the Fourth Ukrainian Natural Language Processing Workshop (UNLP 2025)",
month = jul,
year = "2025",
address = "Vienna, Austria (online)",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2025.unlp-1.9/",
doi = "10.18653/v1/2025.unlp-1.9",
pages = "73--85",
ISBN = "979-8-89176-269-5"
}Також релевантно:
- Chaplynskyi, D., Zakharov, K. and Ivashkevych, L. (2026). Professional Translators Versus Quality Estimation Models: Reliability and Agreement in English-Ukrainian Translation Evaluation. In Proceedings of the Fifth Ukrainian Natural Language Processing Conference (UNLP 2026), pages 97–107. Association for Computational Linguistics. https://aclanthology.org/2026.unlp-1.10/
@inproceedings{chaplynskyi-etal-2026-professional,
title = "Professional Translators Versus Quality Estimation Models: Reliability and Agreement in {E}nglish-{U}krainian Translation Evaluation",
author = "Chaplynskyi, Dmytro and
Zakharov, Kyrylo and
Ivashkevych, Lesia",
editor = "Romanyshyn, Mariana",
booktitle = "Proceedings of the Fifth {U}krainian Natural Language Processing Conference ({UNLP} 2026)",
month = may,
year = "2026",
address = "Lviv, Ukraine",
publisher = "Association for Computational Linguistics",
url = "https://aclanthology.org/2026.unlp-1.10/",
pages = "97--107",
ISBN = "979-8-89176-359-3"
}