Index of papers in Proc. ACL 2008 that mention
  • TER
Shen, Libin and Xu, Jinxi and Weischedel, Ralph
Abstract
Our eXperiments show that the string-to-dependency decoder achieves 1.48 point improvement in BLEU and 2.53 point improvement in TER compared to a standard hierarchical string—to—string system on the N IST 04 Chinese—English evaluation set.
Conclusions and Future Work
Our string-to-dependency system generates 80% fewer rules, and achieves 1.48 point improvement in BLEU and 2.53 point improvement in TER on the decoding output on the NIST 04 Chinese-English evaluation set.
Experiments
All models are tuned on BLEU (Papineni et al., 2001), and evaluated on both BLEU and Translation Error Rate ( TER ) (Snover et al., 2006) so that we could detect over-tuning on one metric.
Experiments
BLEU% TER % lower mixed lower mixed Decoding (3—gram LM) baseline 38.18 35.77 58.91 56.60 filtered 37.92 35.48 57.80 55.43 str-dep 39.52 37.25 56.27 54.07 Rescoring (5—gram LM) baseline 40.53 38.26 56.35 54.15 filtered 40.49 38.26 55.57 53.47 str-dep 41.60 39.47 55.06 52.96
Experiments
Table 2: BLEU and TER scores on the test set.
Introduction
Our string-to-dependency decoder shows 1.48 point improvement in BLEU and 2.53 point improvement in TER on the NIST 04 Chinese-English MT evaluation set.
TER is mentioned in 9 sentences in this paper.
Topics mentioned in this paper: