English
Related papers

Related papers: Spectral Approximate Inference

200 papers

We consider the variable selection problem of generalized linear models (GLMs). Stability selection (SS) is a promising method proposed for solving this problem. Although SS provides practical variable selection criteria, it is…

Machine Learning · Statistics 2025-08-06 Takashi Takahashi , Yoshiyuki Kabashima

Probabilistic graphical models are a key tool in machine learning applications. Computing the partition function, i.e., normalizing constant, is a fundamental task of statistical inference but it is generally computationally intractable,…

Machine Learning · Statistics 2020-01-29 Sungsoo Ahn , Michael Chertkov , Adrian Weller , Jinwoo Shin

Existing computationally efficient methods for penalized likelihood GAM fitting employ iterative smoothness selection on working linear models (or working mixed models). Such schemes fail to converge for a non-negligible proportion of…

Methodology · Statistics 2015-11-13 Simon N. Wood

One fruitful formulation of Deep Networks (DNs) enabling their theoretical study and providing practical guidelines to practitioners relies on Piecewise Affine Splines. In that realm, a DN's input-mapping is expressed as per-region affine…

Machine Learning · Computer Science 2024-01-23 Randall Balestriero , Yann LeCun

We give algorithms for approximating the partition function of the ferromagnetic $q$-color Potts model on graphs of maximum degree $d$. Our primary contribution is a fully polynomial-time approximation scheme for $d$-regular graphs with an…

Data Structures and Algorithms · Computer Science 2024-11-20 Charlie Carlson , Ewan Davies , Nicolas Fraiman , Alexandra Kolla , Aditya Potukuchi , Corrine Yap

In this paper, we propose a GPU-efficient subgraph isomorphism algorithm using the Gunrock graph analytic framework, GSM (Gunrock Subgraph Matching), to compute graph matching on GPUs. In contrast to previous approaches on the CPU which are…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-03-12 Leyuan Wang , John D. Owens

Generalized linear models (GLMs) -- such as logistic regression, Poisson regression, and robust regression -- provide interpretable models for diverse data types. Probabilistic approaches, particularly Bayesian ones, allow coherent…

Computation · Statistics 2018-12-19 Jonathan H. Huggins , Ryan P. Adams , Tamara Broderick

Traditional problems in computational geometry involve aspects that are both discrete and continuous. One such example is nearest-neighbor searching, where the input is discrete, but the result depends on distances, which vary continuously.…

Computational Geometry · Computer Science 2023-08-21 Ahmed Abdelkader , David M. Mount

In this paper, we propose a general framework to design {efficient} polynomial time approximation schemes (EPTAS) for fundamental stochastic combinatorial optimization problems. Given an error parameter $\epsilon>0$, such algorithmic…

Data Structures and Algorithms · Computer Science 2025-05-30 Danny Segev , Sahil Singla

Spectral partitioning is a simple, nearly-linear time, algorithm to find sparse cuts, and the Cheeger inequalities provide a worst-case guarantee for the quality of the approximation found by the algorithm. Local graph partitioning…

Data Structures and Algorithms · Computer Science 2012-11-07 Shayan Oveis Gharan , Luca Trevisan

Gaussian process models are commonly used as emulators for computer experiments. However, developing a Gaussian process emulator can be computationally prohibitive when the number of experimental samples is even moderately large. Local…

Methodology · Statistics 2018-09-26 Chih-Li Sung , Robert B. Gramacy , Benjamin Haaland

Many methods for machine learning rely on approximate inference from intractable probability distributions. Variational inference approximates such distributions by tractable models that can be subsequently used for approximate inference.…

Machine Learning · Computer Science 2020-10-08 Oleg Arenz , Mingjun Zhong , Gerhard Neumann

We present a new FPTAS for the Subset Sum Ratio problem, which, given a set of integers, asks for two disjoint subsets such that the ratio of their sums is as close to $1$ as possible. Our scheme makes use of exact and approximate…

Data Structures and Algorithms · Computer Science 2022-12-08 Giannis Alonistiotis , Antonis Antonopoulos , Nikolaos Melissinos , Aris Pagourtzis , Stavros Petsalakis , Manolis Vasilakis

Probabilistic inference is a fundamental task in modern machine learning. Recent advances in tensor network (TN) contraction algorithms have enabled the development of better exact inference methods. However, many common inference tasks in…

Machine Learning · Computer Science 2024-09-10 Martin Roa-Villescas , Xuanzhao Gao , Sander Stuijk , Henk Corporaal , Jin-Guo Liu

We consider the problem of approximating partition functions for Ising models. We make use of recent tools in combinatorial optimization: the Sherali-Adams and Lasserre convex programming hierarchies, in combination with variational methods…

Machine Learning · Computer Science 2016-07-13 Andrej Risteski

Graph similarity computation aims to predict a similarity score between one pair of graphs to facilitate downstream applications, such as finding the most similar chemical compounds similar to a query compound or Fewshot 3D Action…

Machine Learning · Computer Science 2021-01-06 Haoyan Xu , Ziheng Duan , Jie Feng , Runjian Chen , Qianru Zhang , Zhongbin Xu , Yueyang Wang

Partition of unity methods (PUMs) on graphs are simple and highly adaptive auxiliary tools for graph signal processing. Based on a greedy-type metric clustering and augmentation scheme, we show how a partition of unity can be generated in…

Signal Processing · Electrical Eng. & Systems 2020-12-22 Roberto Cavoretto , Alessandra De Rossi , Wolfgang Erb

Low rank matrix approximation is a popular topic in machine learning. In this paper, we propose a new algorithm for this topic by minimizing the least-squares estimation over the Riemannian manifold of fixed-rank matrices. The algorithm is…

Machine Learning · Computer Science 2022-02-15 Qianqian Song

We consider a refinement of the partition function of graph homomorphisms and present a quasi-polynomial algorithm to compute it in a certain domain. As a corollary, we obtain quasi-polynomial algorithms for computing partition functions…

Combinatorics · Mathematics 2015-08-04 Alexander Barvinok , Pablo Soberón

We prove that, unless P=NP, there is no polynomial-time algorithm to approximate within some multiplicative constant the average size of an independent set in graphs of maximum degree 6. This is a special case of a more general result for…

Computational Complexity · Computer Science 2021-07-20 Andreas Galanis , Daniel Stefankovic , Eric Vigoda