English
Related papers

Related papers: Near-Linear Time Generalized Sinkhorn Algorithms f…

200 papers

Let $G$ be an edge-weighted directed graph with $n$ vertices embedded on an orientable surface of genus $g$. We describe a simple deterministic lexicographic perturbation scheme that guarantees uniqueness of minimum-cost flows and shortest…

Data Structures and Algorithms · Computer Science 2018-04-04 Jeff Erickson , Kyle Fox , Luvsandondov Lkhamsuren

This paper introduces new methodology to triangulate dynamic Bayesian networks (DBNs) and dynamic graphical models (DGMs). While most methods to triangulate such networks use some form of constrained elimination scheme based on properties…

Artificial Intelligence · Computer Science 2012-12-12 Jeff A. Bilmes , Chris Bartels

Given a set of points $P = (P^+ \sqcup P^-) \subset \mathbb{R}^d$ for some constant $d$ and a supply function $\mu:P\to \mathbb{R}$ such that $\mu(p) > 0~\forall p \in P^+$, $\mu(p) < 0~\forall p \in P^-$, and $\sum_{p\in P}{\mu(p)} = 0$,…

Computational Geometry · Computer Science 2023-09-29 Emily Fox , Jiashuai Lu

Recent advancement of the WWW, IOT, social network, e-commerce, etc. have generated a large volume of data. These datasets are mostly represented by high dimensional and sparse datasets. Many fundamental subroutines of common data analytic…

Information Retrieval · Computer Science 2019-10-11 Rameshwar Pratap , Debajyoti Bera , Karthik Revanuru

This paper considers the problem of distributed optimization over time-varying graphs. For the case of undirected graphs, we introduce a distributed algorithm, referred to as DIGing, based on a combination of a distributed inexact gradient…

Optimization and Control · Mathematics 2017-03-21 Angelia Nedich , Alex Olshevsky , Wei Shi

Hierarchical graph-based algorithms such as HNSW have achieved state-of-the-art performance for Approximate Nearest Neighbor (ANN) search in practice, yet they often lack theoretical guarantees on query time or recall due to their heavy use…

Data Structures and Algorithms · Computer Science 2025-05-26 Mohsen Dehghankar , Abolfazl Asudeh

First-order methods such as stochastic gradient descent (SGD) are currently the standard algorithm for training deep neural networks. Second-order methods, despite their better convergence rate, are rarely used in practice due to the…

Machine Learning · Computer Science 2019-09-26 Tianle Cai , Ruiqi Gao , Jikai Hou , Siyu Chen , Dong Wang , Di He , Zhihua Zhang , Liwei Wang

Subgraph GNNs enhance message-passing GNNs expressivity by representing graphs as sets of subgraphs, demonstrating impressive performance across various tasks. However, their scalability is hindered by the need to process large numbers of…

Machine Learning · Computer Science 2025-06-02 Guy Bar-Shalom , Yam Eitan , Fabrizio Frasca , Haggai Maron

Arising from structural graph theory, treewidth has become a focus of study in fixed-parameter tractable algorithms in various communities including combinatorics, integer-linear programming, and numerical analysis. Many NP-hard problems…

Data Structures and Algorithms · Computer Science 2023-09-14 Sally Dong , Yin Tat Lee , Guanghao Ye

Numerous approximation algorithms for problems on unit disk graphs have been proposed in the literature, exhibiting a sharp trade-off between running times and approximation ratios. We introduce a variation of the known shifting strategy…

Data Structures and Algorithms · Computer Science 2016-11-08 Guilherme D. da Fonseca , Vinícius G. Pereira de Sá , Celina M. H. de Figueiredo

Recent studies show that, both explicit deep feature matching as well as large-scale and diverse training data can significantly improve the generalization of person re-identification. However, the efficiency of learning deep matchers on…

Computer Vision and Pattern Recognition · Computer Science 2022-04-07 Shengcai Liao , Ling Shao

The complicated syntax structure of natural language is hard to be explicitly modeled by sequence-based models. Graph is a natural structure to describe the complicated relation between tokens. The recent advance in Graph Neural Networks…

Computation and Language · Computer Science 2019-09-19 Wei Li , Shuheng Li , Shuming Ma , Yancheng He , Deli Chen , Xu Sun

Graph Neural Networks (GNNs) are powerful and flexible neural networks that use the naturally sparse connectivity information of the data. GNNs represent this connectivity as sparse matrices, which have lower arithmetic intensity and thus…

Machine Learning · Computer Science 2020-09-04 Alok Tripathy , Katherine Yelick , Aydin Buluc

Training high-quality deep models necessitates vast amounts of data, resulting in overwhelming computational and memory demands. Recently, data pruning, distillation, and coreset selection have been developed to streamline data volume by…

Machine Learning · Computer Science 2024-10-18 Guibin Zhang , Haonan Dong , Yuchen Zhang , Zhixun Li , Dingshuo Chen , Kai Wang , Tianlong Chen , Yuxuan Liang , Dawei Cheng , Kun Wang

We present a nearly-linear time algorithm that produces high-quality sparsifiers of weighted graphs. Given as input a weighted graph $G=(V,E,w)$ and a parameter $\epsilon>0$, we produce a weighted subgraph $H=(V,\tilde{E},\tilde{w})$ of $G$…

Data Structures and Algorithms · Computer Science 2009-11-18 Daniel A. Spielman , Nikhil Srivastava

In this paper we introduce a notion of spectral approximation for directed graphs. While there are many potential ways one might define approximation for directed graphs, most of them are too strong to allow sparse approximations in…

Data Structures and Algorithms · Computer Science 2016-11-03 Michael B. Cohen , Jonathan Kelner , John Peebles , Richard Peng , Anup Rao , Aaron Sidford , Adrian Vladu

The great success of Physics-Informed Neural Networks (PINN) in solving partial differential equations (PDEs) has significantly advanced our simulation and understanding of complex physical systems in science and engineering. However, many…

Numerical Analysis · Mathematics 2024-09-10 Hao Zhang , Longxiang Jiang , Xinkun Chu , Yong Wen , Luxiong Li , Yonghao Xiao , Liyuan Wang

By adding entropic regularization, multi-marginal optimal transport problems can be transformed into tensor scaling problems, which can be solved numerically using the multi-marginal Sinkhorn algorithm. The main computational bottleneck of…

Numerical Analysis · Mathematics 2023-02-07 Christoph Strössner , Daniel Kressner

Given query access to an undirected graph $G$, we consider the problem of computing a $(1\pm\epsilon)$-approximation of the number of $k$-cliques in $G$. The standard query model for general graphs allows for degree queries, neighbor…

Data Structures and Algorithms · Computer Science 2018-11-13 Talya Eden , Dana Ron , C. Seshadhri

As the state-of-the-art methods for high-dimensional data retrieval, Approximate Nearest Neighbor Search (ANNS) approaches with graph-based indexes have attracted increasing attention and play a crucial role in many real-world applications,…