Assessing System Agreement and Instance Difficulty in the Lexical Sample Tasks of Senseval-2

Ted Pedersen

Assessing System Agreement and Instance Difficulty in the Lexical Sample Tasks of Senseval-2

Computation and Language 2007-05-23 v1

Authors: Ted Pedersen

Abstract

This paper presents a comparative evaluation among the systems that participated in the Spanish and English lexical sample tasks of Senseval-2. The focus is on pairwise comparisons among systems to assess the degree to which they agree, and on measuring the difficulty of the test instances included in these tasks.

Keywords

shared task evaluation

Cite

@article{arxiv.cs/0205068,
  title  = {Assessing System Agreement and Instance Difficulty in the Lexical Sample Tasks of Senseval-2},
  author = {Ted Pedersen},
  journal= {arXiv preprint arXiv:cs/0205068},
  year   = {2007}
}

Comments

Appears in the Proceedings of the ACL-02 Workshop on Word Sense Disambiguation: Recent Successes and Future Directions, July 11, 2002, Philadelphia, PA

Assessing System Agreement and Instance Difficulty in the Lexical Sample Tasks of Senseval-2

Abstract

Keywords

Cite

Comments

Related papers