English
Related papers

Related papers: A novel greedy Gauss-Seidel method for solving lar…

200 papers

Several sparsity-constrained algorithms such as Orthogonal Matching Pursuit or the Frank-Wolfe algorithm with sparsity constraints work by iteratively selecting a novel atom to add to the current non-zero set of variables. This selection…

Machine Learning · Computer Science 2016-08-23 A Rakotomamonjy , S Koço , Liva Ralaivola

We introduce numerical solvers for the steady-state Boltzmann equation based on the symmetric Gauss-Seidel (SGS) method. Due to the quadratic collision operator in the Boltzmann equation, the SGS method requires solving a nonlinear system…

Computational Physics · Physics 2023-11-27 Tianai Yin , Zhenning Cai , Yanli Wang

There has been significant recent work on the theory and application of randomized coordinate descent algorithms, beginning with the work of Nesterov [SIAM J. Optim., 22(2), 2012], who showed that a random-coordinate selection rule achieves…

Optimization and Control · Mathematics 2018-10-30 Julie Nutini , Mark Schmidt , Issam H. Laradji , Michael Friedlander , Hoyt Koepke

We study the problem of finding the best linear model that can minimize least-squares loss given a data-set. While this problem is trivial in the low dimensional regime, it becomes more interesting in high dimensions where the population…

Machine Learning · Computer Science 2021-02-09 Yahya Sattar , Samet Oymak

We propose a new randomized algorithm for solving L2-regularized least-squares problems based on sketching. We consider two of the most popular random embeddings, namely, Gaussian embeddings and the Subsampled Randomized Hadamard Transform…

Machine Learning · Computer Science 2020-10-26 Jonathan Lacotte , Mert Pilanci

$\newcommand{\eps}{\varepsilon}$ In this paper, we consider two important problems defined on finite metric spaces, and provide efficient new algorithms and approximation schemes for these problems on inputs given as graph shortest path…

Computational Geometry · Computer Science 2021-02-23 David Eppstein , Sariel Har-Peled , Anastasios Sidiropoulos

This paper is concerned with the least squares inverse eigenvalue problem of reconstructing a linear parameterized real symmetric matrix from the prescribed partial eigenvalues in the sense of least squares, which was originally proposed by…

Numerical Analysis · Mathematics 2018-06-19 Teng-Teng Yao , Zheng-Jian Bai , Xiao-Qing Jin , Zhi Zhao

We consider least squares semidefinite programming (LSSDP) where the primal matrix variable must satisfy given linear equality and inequality constraints, and must also lie in the intersection of the cone of symmetric positive semidefinite…

Optimization and Control · Mathematics 2015-05-26 Defeng Sun , Kim-Chuan Toh , Liuqin Yang

Bayesian Reinforcement Learning (RL) is capable of not only incorporating domain knowledge, but also solving the exploration-exploitation dilemma in a natural way. As Bayesian RL is intractable except for special cases, previous work has…

Artificial Intelligence · Computer Science 2013-06-14 Kenji Kawaguchi , Mauricio Araya

Designing a cost-effective sensor placement plan for sewage surveillance is a crucial task because it allows cost-effective early pandemic outbreak detection as supplementation for individual testing. However, this problem is…

Computers and Society · Computer Science 2024-09-26 Sunyu Wang , Yutong Xia , Huanfa Chen , Xinyi Tong , Yulun Zhou

There has been an increasing interest in methods that exploit permutation reasoning to search for directed acyclic causal models, including the "Ordering Search" of Teyssier and Kohler and GSP of Solus, Wang and Uhler. We extend the methods…

Artificial Intelligence · Computer Science 2022-06-14 Wai-Yin Lam , Bryan Andrews , Joseph Ramsey

Gaussian variational approximation is a popular methodology to approximate posterior distributions in Bayesian inference especially in high dimensional and large data settings. To control the computational cost while being able to capture…

Machine Learning · Computer Science 2021-04-07 Bingxin Zhou , Junbin Gao , Minh-Ngoc Tran , Richard Gerlach

Greedy-GQ with linear function approximation, originally proposed in \cite{maei2010toward}, is a value-based off-policy algorithm for optimal control in reinforcement learning, and it has a non-linear two timescale structure with the…

Machine Learning · Computer Science 2024-05-03 Yue Wang , Yi Zhou , Shaofeng Zou

Given a set ${\cal R}=\{R_1,R_2,..., R_n\}$ of $n$ randomly positioned axis parallel rectangles in 2D, the problem of computing the minimum clique cover (MCC) and maximum independent set (MIS) for the intersection graph $G({\cal R})$ of the…

Computational Geometry · Computer Science 2012-12-05 Ritankar Mandal , Anirban Ghosh , Sasanka Roy , Subhas C. Nandy

The randomized sparse Kaczmarz method was recently proposed to recover sparse solutions of linear systems. In this work, we introduce a greedy variant of the randomized sparse Kaczmarz method by employing the sampling Kaczmarz-Motzkin…

Numerical Analysis · Mathematics 2022-04-13 Ziyang Yuan , Hui Zhang , Hongxia Wang

We address the problems of minimizing and of maximizing the spectral radius overa compact family of non-negative matrices. Those problems being hard in generalcan be efficiently solved for some special families. We consider the so-called…

Optimization and Control · Mathematics 2020-05-19 Vladimir Yu. Protasov , Aleksandar Cvetković

We present a novel geographical routing scheme for spontaneous wireless mesh networks. Greedy geographical routing has many advantages, but suffers from packet losses occurring at the border of voids. In this paper, we propose a flexible…

Networking and Internet Architecture · Computer Science 2009-02-25 Fabrice Theoleyre , Eryk Schiller , Andrzej Duda

We study a pair of budget- and performance-constrained weak-submodular maximization problems. For computational efficiency, we explore the use of stochastic greedy algorithms which limit the search space via random sampling instead of the…

Optimization and Control · Mathematics 2026-03-06 Ege C. Kaya , Michael Hibbard , Takashi Tanaka , Ufuk Topcu , Abolfazl Hashemi

In the context of Gaussian conditioning, greedy algorithms iteratively select the most informative measurements, given an observed Gaussian random variable. However, the convergence analysis for conditioning Gaussian random variables…

Statistics Theory · Mathematics 2025-02-18 Daniel Winkle , Ingo Steinwart , Bernard Haasdonk

This paper considers the multi-agent linear least-squares problem in a server-agent network. In this problem, the system comprises multiple agents, each having a set of local data points, that are connected to a server. The goal for the…

Optimization and Control · Mathematics 2024-10-29 Kushal Chakrabarti , Nirupam Gupta , Nikhil Chopra