| Conclusions | In this paper we have described a dynamic and inexpensive method of collecting a corpus of questions and answers using the Amazon Mechanical Turk framework. |
| Corpus description | The total cost of producing the corpus was about $350, consisting of $310 paid in workers rewards and $40 in Mechanical Turk fees, including all the trials conducted during the development of the final system. |
| Corpus description | However, the Mechanical Turk framework provided additional information for each assignment, for example the time workers spent on the task. |
| Discussion and future work | We believe that this unexpected result is due to the distributed nature of the worker pool in Mechanical Turk . |
| Introduction | We collected our corpus through Amazon Mechanical Turk service 4 (MTurk). |
| Setup | 2.1 Mechanical Turk |
| Setup | Mechanical Turk is a Web-based service, offered by Amazon.com, Inc. |