Word Mover’s Distance in Python

Sat, 07 Nov 2015 ⊕Category: python
#word embeddings #text classification #earth mover's distance

In document classification and other natural language processing applications, having a good measure of the similarity of two texts can be a valuable building block. Ideally, such a measure would capture semantic information. Cosine similarity on bag-of-words vectors is known to do well in practice, but it inherently cannot capture when documents say the same thing in completely different words. …