Dynatask: A Framework for Creating Dynamic AI Benchmark Tasks

Abstract

Tristan Thrush, Kushal Tirumala, Anmol Gupta, Max Bartolo, Pedro Rodriguez, Tariq Kane, William Gaviria Rojas, Peter Mattson, Adina Williams, Douwe Kiela. Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics: System Demonstrations. 2022.