Proceedings of the 4th International Workshop on Semantic Evaluations

Abstract

This volume contains papers describing the tasks and participating systems in SemEval-2007 --- the Fourth International Workshop on Semantic Evaluations. The SemEval-2007 workshop was held in conjunction with the Association for Computational Linguistics meeting on June 23-24, 2007 in Prague, Czech Republic. The ACL Special Interest Group on the Lexicon (SIGLEX) is the umbrella organization for SemEval-2007. SIGLEX previously ran three highly successful evaluation exercises for word sense disambiguation under the name Senseval. As the nature of the tasks in Senseval has evolved to include semantic analysis tasks outside of word sense disambiguation, the Senseval Committee changed the name of the evaluation exercises to SemEval. SemEval-2007 was very successful. Our call for tasks solicited 27 task proposals. After a careful review process and a call for interest in participation, we selected 18 tasks to be part of the evaluation. Over 100 teams participated with over 125 unique systems. As a comparison, Senseval-3 (2004) organized 14 tasks with 55 teams.