English
Related papers

Related papers: An Efficient Shared-memory Parallel Sinkhorn-Knopp…

200 papers

Optimal transport (OT) and the related Wasserstein metric (W) are powerful and ubiquitous tools for comparing distributions. However, computing pairwise Wasserstein distances rapidly becomes intractable as cohort size grows. An attractive…

Machine Learning · Computer Science 2024-06-05 Doron Haviv , Russell Zhang Kunes , Thomas Dougherty , Cassandra Burdziak , Tal Nawy , Anna Gilbert , Dana Pe'er

Erasure codes are increasingly being studied in the context of implementing atomic memory objects in large scale asynchronous distributed storage systems. When compared with the traditional replication based schemes, erasure codes have the…

Distributed, Parallel, and Cluster Computing · Computer Science 2016-11-15 Kishori M. Konwar , N. Prakash , Erez Kantor , Nancy Lynch , Muriel Medard , Alexander A. Schwarzmann

The Sinkhorn "distance", a variant of the Wasserstein distance with entropic regularization, is an increasingly popular tool in machine learning and statistical inference. However, the time and memory requirements of standard algorithms for…

Machine Learning · Statistics 2021-11-16 Jason Altschuler , Francis Bach , Alessandro Rudi , Jonathan Niles-Weed

In this paper we derive sufficient conditions for the convergence of two popular alternating minimisation algorithms for dictionary learning - the Method of Optimal Directions (MOD) and Online Dictionary Learning (ODL), which can also be…

Optimization and Control · Mathematics 2023-05-29 Simon Ruetz , Karin Schnass

Artificial Neural networks are mathematical models at their core. This truismpresents some fundamental difficulty when networks are tasked with Natural Language Processing. A key problem lies in measuring the similarity or distance among…

Computation and Language · Computer Science 2021-06-07 Thomas Conley , Jugal Kalita

Distributed distribution comparison aims to measure the distance between the distributions whose data are scattered across different agents in a distributed system and cannot even be shared directly among the agents. In this study, we…

Machine Learning · Computer Science 2024-07-23 Xiangfeng Wang , Hongteng Xu , Moyi Yang

The integration of Mobile Edge Computing (MEC) and Wireless Power Transfer (WPT), which is usually referred to as Wireless Powered Mobile Edge Computing (WP-MEC), has been recognized as a promising technique to enhance the lifetime and…

Networking and Internet Architecture · Computer Science 2021-04-23 Xingqiu He , Yuhang Shen , Xiong Wang , Sheng Wang , Shizhong Xu , Jing Ren

Although deep learning-based methods have dominated stereo matching leaderboards by yielding unprecedented disparity accuracy, their inference time is typically slow, on the order of seconds for a pair of 540p images. The main reason is…

Computer Vision and Pattern Recognition · Computer Science 2020-12-03 Yiran Zhong , Charles Loop , Wonmin Byeon , Stan Birchfield , Yuchao Dai , Kaihao Zhang , Alexey Kamenev , Thomas Breuel , Hongdong Li , Jan Kautz

Existing image-text matching approaches typically infer the similarity of an image-text pair by capturing and aggregating the affinities between the text and each independent object of the image. However, they ignore the connections between…

Computer Vision and Pattern Recognition · Computer Science 2020-02-21 Tianlang Chen , Jiebo Luo

Dictionary plays an important role in multi-instance data representation. It maps bags of instances to histograms. Earth mover's distance (EMD) is the most effective histogram distance metric for the application of multi-instance retrieval.…

Computer Vision and Pattern Recognition · Computer Science 2016-09-06 Jihong Fan , Ru-Ze Liang

This work advances floating-point program verification by introducing Augmented Weak-Distance (AWD), a principled extension of the Weak-Distance (WD) framework. WD is a recent approach that reformulates program analysis as a numerical…

Programming Languages · Computer Science 2025-05-21 Zhoulai Fu , Freek Verbeek , Binoy Ravindran

Linguistic coordination is a well-established phenomenon in spoken conversations and often associated with positive social behaviors and outcomes. While there have been many attempts to measure lexical coordination or entrainment in…

Computation and Language · Computer Science 2019-04-15 Md Nasir , Sandeep Nallan Chakravarthula , Brian Baucom , David C. Atkins , Panayiotis Georgiou , Shrikanth Narayanan

We propose a novel application of coded computing to the problem of the nearest neighbor estimation using MatDot Codes [Fahim. et.al. 2017], that are known to be optimal for matrix multiplication in terms of recovery threshold under storage…

Information Theory · Computer Science 2018-11-30 Utsav Sheth , Sanghamitra Dutta , Malhar Chaudhari , Haewon Jeong , Yaoqing Yang , Jukka Kohonen , Teemu Roos , Pulkit Grover

Prevailing LLM serving engines employ expert parallelism (EP) to implement multi-device inference of massive MoE models. However, the efficiency of expert parallel inference is largely bounded by inter-device communication, as EP embraces…

Machine Learning · Computer Science 2026-03-02 Yan Li , Zhenyu Zhang , Zhengang Wang , Pengfei Chen , Pengfei Zheng

In this work, we develop methods for few-shot image classification from a new perspective of optimal matching between image regions. We employ the Earth Mover's Distance (EMD) as a metric to compute a structural distance between dense image…

Computer Vision and Pattern Recognition · Computer Science 2023-03-31 Chi Zhang , Yujun Cai , Guosheng Lin , Chunhua Shen

Given a metric space $(X,d_X)$, the earth mover distance between two distributions over $X$ is defined as the minimum cost of a bipartite matching between the two distributions. The doubling dimension of a metric $(X, d_X)$ is the smallest…

Data Structures and Algorithms · Computer Science 2010-02-23 Shi Li

The edit distance $ed(X,Y)$ of two strings $X,Y\in \Sigma^*$ is the minimum number of character edits (insertions, deletions, and substitutions) needed to transform $X$ into $Y$. Its weighted counterpart $ed^w(X,Y)$ minimizes the total cost…

Data Structures and Algorithms · Computer Science 2025-07-04 Itai Boneh , Egor Gorbachev , Tomasz Kociumaka

This paper studies the policy mirror descent (PMD) method, which is a general policy optimization framework in reinforcement learning and can cover a wide range of policy gradient methods by specifying difference mirror maps. Existing…

Optimization and Control · Mathematics 2026-01-01 Wenye Li , Hongxu Chen , Jiacai Liu , Ke Wei

Word sense disambiguation (WSD) methods identify the most suitable meaning of a word with respect to the usage of that word in a specific context. Neural network-based WSD approaches rely on a sense-annotated corpus since they do not…

Computation and Language · Computer Science 2021-02-11 Sm Zobaed , Md Enamul Haque , Md Fazle Rabby , Mohsen Amini Salehi

We propose a novel Wasserstein method with a distillation mechanism, yielding joint learning of word embeddings and topics. The proposed method is based on the fact that the Euclidean distance between word embeddings may be employed as the…

Machine Learning · Computer Science 2018-09-14 Hongteng Xu , Wenlin Wang , Wei Liu , Lawrence Carin