Recall that 5K training examples were held out as a development set .

We use a linear kernel, and tune the SVM’s cost parameter on a development set .

While developing our tagging schemes and feature representation, we used a development set of 5K words held out from our CELEX training data.

Our development set experiments suggested that numbering ONC tags increases their performance.

In addition, this grammar has relatively low ambiguity, assigning on average 11.89 parses per item in the development set .

Of the 92 sentences in this text, 20 overlapped with items in the development set , so the

The parsed portion of the development set (732 items) constitutes a sufficiently large corpus to train a parse selection model using the Redwoods disambiguation technology (Toutanova et al., 2005).

We used 10 newswire texts from ACE 2005 training corpora (from March to May of 2003) as our development set , and then conduct blind test on a separate set of 40 ACE 2005 newswire texts.

We select the thresholds (d with k=1~13) for various confidence metrics by optimizing the F-measure score of each rule on the development set , as shown in Figure 2 and 3 as follows.

The labeled point on each curve shows the best F-measure that can be obtained on the development set by adjusting the threshold for that rule.

_ tences ( development set )

A comparison on the impact of accounting for all derivations in training and decoding ( development set ).

The effect of the beam width (log-scale) on max-translation decoding ( development set ).

An informal comparison of the outputs on the development set , presented in Table 4, suggests that the

the kernel whose value is optimized on the development set .

where 0t is a smoothing parameter tuned on the development set , sa is the annotation for the latent variable 5 and sd its corresponding document.

where ,u is a smoothing parameter estimated on the development set , lama is a Boolean variable denoting whether w appears in the annotation sa, and Nw is the number of latent variables that contain w in their annotations.

For each alignment model and decoding type we train Moses and use MERT optimization to tune its parameters on a development set .

For Hansards we randomly chose 1000 and 500 sentences from test 1 and test 2 to be testing and development sets respectively.

In principle, we would like to tune the threshold by optimizing BLEU score on a development set , but that is impractical for experiments with many pairs of languages.

Figure 7 shows an example of the same sentence, using the same model where in one case Viterbi decoding was used and in the other case Posterior decoding tuned to minimize AER on a development set

Training Our model needs to be provided with the number of clusters K. We set K large enough for the model to learn effectively on the development set .

A threshold for this proportion is set for each property via the development set .

Properties with proportions above a set threshold (tuned on a development set ) are predicted as being supported.

We used part of the Russian corpus as a development set for determining the parameters.

On our development set we have tested various parameter settings.

In our experiments we have used the following values (again, determined using a development set ) for these parameters: F0: 1,000 words per million (wpm); FH: 100 wpm; FB: 1.2 wpm; N: 500 words; W: 5 words; L: 30%; S: 2/3; 04: 0.1.

In the final step 4 (line 15), parameters {Am 7'} are discriminatively trained on a development set using the downhill simplex method (Nelder and Mead, 1965).

We use feature functions to decide the order and the threshold 7' to locate the boundary guided with a development set .

A significant deviation from most other approaches is that the framework is parameterized and can be optimized jointly with the decoder to maximize translation performance on a development set .

The the whole feature set was found in feature ablation testing on the development set to outperform all other feature subsets significantly (p < 2.2 - 10—16).

The development set (00) was used to tune the 6 parameter to obtain reasonable hypertag ambiguity levels; the model was not otherwise tuned to it.

limit; on the development set , this improvement eli-mates more than the number of known search errors (cf.

We use the standard split of the Treebank: sections 02-21 as the training data (39832 sentences), section 22 as the development set (1700 sentences), and section 23 as the test set (2416 sentences).

The development set and the test set are parsed with a model trained on all 39832 training sentences.

We use the development set to determine the optimal number of iterations for averaged perceptron, and report the F1 score on the test set.

The English experiments were performed on the Penn Treebank (Marcus et al., 1993), using a standard set of head-selection rules (Yamada and Matsumoto, 2003) to convert the phrase structure syntax of the Treebank to a dependency tree representation.6 We split the Treebank into a training set (Sections 2—21), a development set (Section 22), and several test sets (Sections 0,7 1, 23, and 24).

of iterations of perceptron training, we performed up to 30 iterations and chose the iteration which optimized accuracy on the development set .

Table 6: Parent-prediction accuracies of unlabeled Czech parsers on the PDT 1.0 development set .