Index of papers in Proc. ACL 2010 that mention
  • error rate
Trogkanis, Nikolaos and Elkan, Charles
Abstract
We create new training sets for English and Dutch from the CELEX European lexical resource, and achieve error rates for English of less than 0.1% for correctly allowed hyphens, and less than 0.01% for Dutch.
Abstract
Experiments show that both the Knuth/Liang method and a leading current commercial altema-tive have error rates several times higher for both languages.
Experimental design
In order to measure accuracy, we compute the confusion matrix for each method, and from this we compute error rates .
Experimental design
We report both word-level and letter-level error rates .
Experimental design
The word-level error rate is the fraction of words on which a method makes at least one mistake.
Experimental results
Figure 1 shows how the error rate is affected by increasing the CRF probability threshold for each language.
Experimental results
Figure 1 shows confidence intervals for the error rates .
Experimental results
All differences between rows in Table 2 are significant, with one exception: the serious error rates for PAT GEN and TALO are not statistically significantly different.
History of automated hyphenation
The lowest per-letter test error rate reported is about 2%.
error rate is mentioned in 28 sentences in this paper.
Topics mentioned in this paper:
Liu, Zhanyi and Wang, Haifeng and Wu, Hua and Li, Sheng
Conclusion
The evaluation results showed that the proposed method significantly improved word alignment, achieving an absolute error rate reduction of 29% on multi-word alignment.
Experiments on Phrase-Based SMT
And Koehn's implementation of minimum error rate training (Och, 2003) is used to tune the feature weights on the development set.
Experiments on Word Alignment
For multi-word alignments, our methods significantly outperform the baseline method in terms of both precision and recall, achieving up to 18% absolute error rate reduction.
Experiments on Word Alignment
CM-3, the error rate of multi-word alignment results is further reduced.
Experiments on Word Alignment
We can see that WA-l achieves lower alignment error rate as compared to the baseline method, since the performance of the improved one-directional alignment method is better than that of GIZA++.
Introduction
The evaluation results show that the proposed method in this paper significantly improves mul-ti-word alignment, achieving an absolute error rate reduction of 29%.
error rate is mentioned in 7 sentences in this paper.
Topics mentioned in this paper:
Lavergne, Thomas and Cappé, Olivier and Yvon, François
Conditional Random Fields
Results are reported in terms of phoneme error rates or tag error rates on the test set.
Conditional Random Fields
Table 1: Features jointly testing label pairs and the observation are useful ( error rates and features counts.)
Conditional Random Fields
Table 3: Error rates of the three regularizers on the Nettalk task.
error rate is mentioned in 4 sentences in this paper.
Topics mentioned in this paper:
Xiong, Deyi and Zhang, Min and Li, Haizhou
Abstract
The experimental results show that l) linguistic features alone outperform word posterior probability based confidence estimation in error detection; and 2) linguistic features can further provide complementary information when combined with word confidence scores, which collectively reduce the classification error rate by 18.52% and improve the F measure by 16.37%.
Experiments
To determine the true class of a word in a generated translation hypothesis, we follow (Blatz et al., 2003) to use the word error rate (WER).
Experiments
To evaluate the overall performance of the error detection, we use the commonly used metric, classification error rate (CER) to evaluate our classifiers.
SMT System
For minimum error rate tuning (Och, 2003), we use NIST MT-02 as the development set for the translation task.
error rate is mentioned in 4 sentences in this paper.
Topics mentioned in this paper:
Beaufort, Richard and Roekhaut, Sophie and Cougnon, Louise-Amélie and Fairon, Cédrick
Abstract
Different well-defined approaches have been proposed, but the problem remains far from being solved: best systems achieve a 11% Word Error Rate .
Abstract
Evaluated in French by 10-fold-cross validation, the system achieves a 9.3% Word Error Rate and a 0.83 BLEU score.
Evaluation
The system was evaluated in terms of BLEU score (Papineni et al., 2001), Word Error Rate (WER) and Sentence Error Rate (SER).
error rate is mentioned in 3 sentences in this paper.
Topics mentioned in this paper:
Corlett, Eric and Penn, Gerald
Experiment
We judged the quality of the decoding by measuring the percentage of characters in the cipher alphabet that were correctly guessed, and also the word error rate of the plaintext generated by our solution.
Experiment
We did not count the accuracy or word error rate for unfinished ciphers.
Results
We can also observe that even when there are errors (e.g., in the size 1000 cipher), the word error rate is very small.
error rate is mentioned in 3 sentences in this paper.
Topics mentioned in this paper:
Liu, Shujie and Li, Chi-Ho and Zhou, Ming
Abstract
We propose a discriminative ITG pruning framework using Minimum Error Rate Training and various features from previous work on ITG alignment.
Evaluation
That is, the first evaluation metric, pruning error rate (henceforth PER), measures how many correct E-spans are discarded.
The DPDI Framework
Parameter training of DPDI is based on Minimum Error Rate Training (MERT) (Och, 2003), a Widely used method in SMT.
error rate is mentioned in 3 sentences in this paper.
Topics mentioned in this paper:
Xiao, Tong and Zhu, Jingbo and Zhu, Muhua and Wang, Huizhen
Background
In this work, Minimum Error Rate Training (MERT) proposed by Och (2003) is used to estimate feature weights ,1 over a series of training samples.
Background
As the weighted BLEU is used to measure the translation accuracy on the training set, the error rate is defined to be:
Background
The diversity is measured in terms of the Translation Error Rate (TER) metric proposed in (Snover et al., 2006).
error rate is mentioned in 3 sentences in this paper.
Topics mentioned in this paper: