We propose Bilingually-constrained Recursive Auto-encoders (BRAE) to learn semantic phrase embeddings (compact vector representations for phrases), which can distinguish the phrases with different semantic meanings.

3.1.1 Word Vector Representations

In phrase embedding using composition, the word vector representation is the basis and serves as the input to the neural network.

Given a phrase which is an ordered list of m words, each word has an index i into the columns of the embedding matrix L. The index i is used to retrieve the word’s vector representation using a simple multiplication with a binary vector 6 which is zero in all positions except for the ith index:

embedding, which converts a word into a dense, low dimensional, real-valued vector representation (Bengio et al., 2003; Bengio et al., 2006; Collobert and Weston, 2008; Mikolov et al., 2013).

Therefore, in order to successfully apply DNN to model the whole translation process, such as modelling the decoding process, learning compact vector representations for the basic phrasal translation units is the essential and fundamental work.

In contrast, our method attempts to learn the semantic vector representation for any phrase.

We introduce the problem of generation in distributional semantics: Given a distributional vector representing some meaning, how can we generate the phrase that best expresses that meaning?

Construction of vector spaces We test two types of vector representations .

(2013a) learns vector representations using a neural network architecture by trying to predict a target word given the words surrounding it.

(2014) for an extensive comparison of the two types of vector representations .

To construct the vector representing a two-word phrase, we must compose the vectors associated to the input words.

where {i and 27 are the vector representations associated to words u and v. fcompR : Rd >< Rd —> Rd (for d the dimensionality of vectors) is a composition function specific to the syntactic relation R holding between the two words.1

For example, given the vectors representing red and car, composition derives a vector that approximates the meaning of red car.

We can, for example, synthesize the vector representing the meaning of a phrase or sentence, and then generate alternative phrases or sentences from this vector to accomplish true paraphrase generation (as opposed to paraphrase detection or ranking of candidate paraphrases).

Given a vector representing an image, generation can be used to productively construct phrases or sentences that describe the image (as opposed to simply retrieving an existing description from a set of candidates).

To add auxiliary word vector representations , we use the publicly available word vectors (Cirik

Even in the case of first-order parsers, this results in a high-dimensional vector representation of each arc.

participating in an arc, such as continuous vector representations of words.

Finally, we demonstrate that the model can successfully leverage word vector representations , in contrast to the baselines.

Specifically, U gbh (for a given sentence, suppressed) is an 7“ dimensional vector representation of the word corresponding to h as a head word.

Traditionally, these vector representations have been derived primarily from co-occurrences of words within sentences, ignoring syntactic roles of the co-occurring words.

While this method learns to map word combinations into vectors, it builds on existing word-level vector representations .

The computation process is conducted in a bottom-up manner, and the vector representations are computed recursively.

It performs compositions based on the binary trees, and obtain the vector representations in a bottom-up way.

The vector representation v is obtained via:

The vector representation of root node is then fed into a softmax classifier to predict the label.

Our framework accommodates any paraphrasing method, and in this paper we propose an association model that learns to associate natural language phrases that co-occur frequently in a monolingual parallel corpus, combined with a vector space model, which learns to score the similarity between vector representations of natural language utterances (Section 5).

We now introduce a vector space (VS) model, which assigns a vector representation for each utterance, and learns a scoring function that ranks paraphrase candidates.

We start by constructing vector representations of words.

We can now estimate a paraphrase score for two utterances cc and 0 via a weighted combination of the components of the vector representations:

In this paper, we rely on the same image analysis techniques but instead focus on the reference problem: We do not aim at enriching word representations with visual information, although this might be a side effect of our approach, but we address the issue of automatically mapping objects, as depicted in images, to the context vectors representing the corresponding words.

We show that the induced cross-modal semantic space is powerful enough that sensible guesses about the correct word denoting an object can be made, even when the linguistic context vector representing the word has been created from as little as 1 sentence containing it.

First, we conduct experiments with simple image-and text-based vector representations and compare alternative methods to perform cross-modal mapping.

(2013) use linear regression to transform vector-based image representations onto vectors representing the same concepts in linguistic semantic space.

If distributional vectors encode certain aspects of word meaning, it is natural to expect that similar aspects of sentence meaning can also receive vector representations , obtained compositionally from word vectors.

Deverbal nouns like demolition, often used without mention of who demolished what, would have to get vector representations while the corresponding verbs (demolish) would become tensors, which makes immediately related verbs and nouns incomparable.

The matrices formalize argument slot saturation, operating on an argument vector representation through matrix by vector multiplication, as described in the next section.

This flexibility makes our model suitable to compute vector representations of sentences without stumbling at unseen syntactic usages of words.

The target vector is the sum of X0) and the centroid X0) of the remaining attribute vectors representing object 0.

As shown in Figure 1, our model takes as input two (real-valued) vectors representing the visual and textual modalities.

respond to words and edges to cosine similarity scores between vectors representing their meaning.

Table 6 shows examples of clusters produced by Chinese Whispers when using vector representations provided by the SAE model.

In order to isolate the contribution from word embeddings, it is useful to demonstrate improvement over a parser that already achieves state-of-the-art performance without vector representations .

gb(w) is the vector representation of the word 212, am, are per-basis weights, and 6 is an inverse radius parameter which determines the strength of the smoothing.

vector representation .

Generating Visual Representations Visual vector representations for each image were obtained using the well-known bag of visual words (BoVW) approach (Sivic and Zisserman, 2003).

BoVW obtains a vector representation for an

Generating Linguistic Representations We extract continuous vector representations (also of 50 dimensions) for concepts using the continuous log-linear skipgram model of Mikolov et al.

LinLearn denotes model combination by overloading the vector representation of queries q and documents (1 in the VW linear learner by incorporating arbitrary ranking models as dense features.

This means that the vector representation of queries q and documents (1 in the VW linear learner is overloaded once more: In addition to dense domain-knowledge features, we incorporate arbitrary ranking models as dense features whose value is the score of the ranking model.

Optimization for these additional models including domain knowledge features was done by overloading the vector representation of queries q and documents (1 in the VW linear learner: Instead of sparse word-based features, q and d are represented by real-valued vectors of dense domain-knowledge features.

Finally, we perform SVD on the motif similarity matrix (with size of the order of the total vocabulary in the corpus), and retain the first k principal eigenvectors to obtain low-dimensional vector representations that are more convenient to work with.

For composing the motifs representations to get judgments on semantic similarity of sentences, we use our recent Vector Tree Kernel approach The VTK approach defines a convo-lutional kernel over graphs defined by the dependency parses of sentences, using a vector representation at each graph node that representing a single lexical token.

For this task, we again use the VTK formalism for combining vector representations of the individual motifs.