Wasserstein-Fisher-Rao Document Distance

Zihao Wang, Datong Zhou, Yong Zhang, Hao Wu, Chenglong Bao
Department of Computer Science and Technology, Tsinghua University
arXiv:1904.10294 [cs.LG], (23 Apr 2019)


   title={Wasserstein-Fisher-Rao Document Distance},

   author={Zihao Wang and Datong Zhou and Yong Zhang and Hao Wu and Chenglong Bao},






Download Download (PDF)   View View   Source Source   



As a fundamental problem of natural language processing, it is important to measure the distance between different documents. Among the existing methods, the Word Mover’s Distance (WMD) has shown remarkable success in document semantic matching for its clear physical insight as a parameter-free model. However, WMD is essentially based on the classical Wasserstein metric, thus it often fails to robustly represent the semantic similarity between texts of different lengths. In this paper, we apply the newly developed Wasserstein-Fisher-Rao (WFR) metric from unbalanced optimal transport theory to measure the distance between different documents. The proposed WFR document distance maintains the great interpretability and simplicity as WMD. We demonstrate that the WFR document distance has significant advantages when comparing the texts of different lengths. In addition, an accelerated Sinkhorn based algorithm with GPU implementation has been developed for the fast computation of WFR distances. The KNN classification results on eight datasets have shown its clear improvement over WMD.
No votes yet.
Please wait...

* * *

* * *

HGPU group © 2010-2019 hgpu.org

All rights belong to the respective authors

Contact us: