| Abstract | We evaluate Brown clusters, Collobert and Weston (2008) embeddings, and HLBL (Mnih & Hinton, 2009) embeddings of words on both NER and chunking. |
| Distributed representations | Distributed word representations are called word embeddings . |
| Distributed representations | Word embeddings are typically induced using neural language models, which use neural networks as the underlying predictive model (Bengio, 2008). |
| Distributed representations | 4.1 Collobert and Weston (2008) embeddings |
| Introduction | word embeddings using unsupervised approaches. |
| Introduction | (2009) about Collobert and Weston (2008) embeddings , given training improvements that we describe in Section 7.1. |