Article Structure
Abstract
Wouldn’t it be helpful if your text editor automatically suggested papers that are relevant to your research?
Introduction
Imagine that you were working on a draft paper which contained a sentence like the following:1
Related work
While the existing work in this specific area is far from extensive, previous experiments in evaluating context-based citation recommendation systems have used one of three approaches.
The task: Citation Resolution
In this section we present the evaluation method in more abstract terms; for the implementation used in this paper, please see Sections 4 and 5.
Experiments
Our test corpus consists of approx.
Results and discussion
Table 1 presents a selection of the most relevant results, where the best result and document representation method of each type is highlighted.
Conclusion and future work
In this paper we have presented Citation Resolution: an evaluation method for context-based citation recommendation (CBCR) systems.
Topics
human judgements
- Exploiting the human judgements that are already implicit in available resources, we avoid purpose-specific annotation.Page 1, “Abstract”
- A main problem we face is that evaluating the performance of these systems ultimately requires human judgement .Page 1, “Introduction”
- Fortunately there is already an abundance of data that meets our requirements: every scientific paper contains human “judgements” in the form of citations to other papers which are contextually appropriate: that is, relevant to specific passages of the document and aligned with its argumentative structure.Page 1, “Introduction”
- Citation Resolution is a method for evaluating CBCR systems that is exclusively based on this source of human judgements .Page 1, “Introduction”
- Third, as we outlined above, existing citations between papers can be exploited as a source of human judgements .Page 2, “Related work”
- The core criterion of this task is to use only the human judgements that we have clearest evidence for.Page 3, “The task: Citation Resolution”
See all papers in Proc. ACL 2014 that mention human judgements.
See all papers in Proc. ACL that mention human judgements.
Back to top.
