Schein and Ungar observe that none of the 8 sampling methods investigated in their experiment achieved a significant improvement over the random sampling baseline on type b) errors.

In fact, entropy sampling and margin sampling even showed a decrease in performance compared to random sampling .

In the first setting, we randomly select new instances from the pool ( random sampling ; rand).

The regularization parameter A is automatically selected on each iteration by searching for a value which maximizes the loglikelihood of a validation set, which is constructed by randomly sampling 25% of L on each iteration.

Resolver precision can be interpreted as the probability that a randomly sampled sense (in a cluster with at least 2 senses) is in a cluster representing its true meaning.

To create this set, we randomly sampled noun phrases from each category and manually matched each noun phrase to one or more real-world entities.

To make this difference concrete, Figure 2 (first page) shows a random sample of 10 concepts from both company and athlete.

Figure 2: A random sample of concepts created by ConceptResolver.

Table 3 lists query-product associations for five randomly sampled products along with their model scores from Pmle Pintp.

We created two samples from the TEST dataset: one randomly sampled by taking click weights into account, and the other sampled uniformly at random.

Table 3: Example query-product association scores for a random sample of five products.

We use the Twigg SDK 7 to crawl all tweets from April 20th 2010 to April 25th 2010, then drop non-English tweets and get about 11,371,389, from which 15,800 tweets are randomly sampled , and are then labeled by two independent annotators, so that the beginning and the end of each named entity are marked with <TYPE> and </TYPE>, respectively.

This is based on an investigation of 12,245 randomly sampled tweets, which are manually labeled.

According to our investigation on 12,245 randomly sampled tweets that are manually labeled, about 46.8% have at least one named entity.