| Introduction | sets of discrete states and recursive deep learning models that jointly learn classifiers and continuous feature representations for variable-sized inputs. |
| Introduction | Deep Learning and Recursive Deep Learning Early attempts at using neural networks to describe phrases include Elman (1991), who used recurrent neural networks to create representations of sentences from a simple toy grammar and to analyze the linguistic expressiveness of the resulting representations. |
| Introduction | The idea of untying has also been successfully used in deep learning applied to vision (Le et al., 2010). |