English
Related papers

Related papers: A greedy randomized average block projection metho…

200 papers

We propose a Greedy strategy to solve the problem of Graph Cut, called GGC. It starts from the state where each data sample is regarded as a cluster and dynamically merges the two clusters which reduces the value of the global objective…

Machine Learning · Computer Science 2024-12-31 Feiping Nie , Shenfei Pei , Zengwei Zheng , Rong Wang , Xuelong Li

Traditionally, there are several polynomial algorithms for linear programming including the ellipsoid method, the interior point method and other variants. Recently, Chubanov [Chubanov, 2015] proposed a projection and rescaling algorithm,…

Optimization and Control · Mathematics 2018-10-11 Zhize Li , Wei Zhang , Kees Roos

To solve nonlinear problems, we construct two kinds of greedy capped nonlinear Kaczmarz methods by setting a capped threshold and introducing an effective probability criterion for selecting a row of the Jacobian matrix. The capped…

Numerical Analysis · Mathematics 2022-10-04 Yanjun Zhang , Hanyu Li

Ranking and selection (R&S) aims to select the best alternative with the largest mean performance from a finite set of alternatives. Recently, considerable attention has turned towards the large-scale R&S problem which involves a large…

Methodology · Statistics 2025-09-09 Zaile Li , Weiwei Fan , L. Jeff Hong

We present a generative reduced basis (RB) approach to construct reduced order models for parametrized partial differential equations. Central to this approach is the construction of generative RB spaces that provide rapidly convergent…

Numerical Analysis · Mathematics 2024-10-08 Ngoc Cuong Nguyen

Informed sampling techniques accelerate the convergence of sampling-based motion planners by biasing sampling toward regions of the state space that are most likely to yield better solutions. However, when the current solution path contains…

Robotics · Computer Science 2025-11-25 Phone Thiha Kyaw , Anh Vu Le , Rajesh Elara Mohan , Jonathan Kelly

In this work, we study a novel class of projection-based algorithms for linearly constrained problems (LCPs) which have a lot of applications in statistics, optimization, and machine learning. Conventional primal gradient-based methods for…

Optimization and Control · Mathematics 2021-01-06 Xiang Li , Zhihua Zhang

Structured statistical estimation problems are often solved by Conditional Gradient (CG) type methods to avoid the computationally expensive projection operation. However, the existing CG type methods are not robust to data corruption. To…

Machine Learning · Computer Science 2020-07-08 Jiacheng Zhuo , Liu Liu , Constantine Caramanis

Projection methods aim to reduce the dimensionality of the optimization instance, thereby improving the scalability of high-dimensional problems. Recently, Sakaue and Oki proposed a data-driven approach for linear programs (LPs), where the…

Optimization and Control · Mathematics 2025-11-18 Anh Tuan Nguyen , Viet Anh Nguyen

Sparsity-constrained optimization has wide applicability in machine learning, statistics, and signal processing problems such as feature selection and compressive Sensing. A vast body of work has studied the sparsity-constrained…

Machine Learning · Statistics 2013-07-17 Sohail Bahmani , Bhiksha Raj , Petros Boufounos

Active learning is increasingly adopted for expensive multi-objective combinatorial optimization problems, but it involves a challenging subset selection problem, optimizing the batch acquisition score that quantifies the goodness of a…

Machine Learning · Computer Science 2024-06-24 Deokjae Lee , Hyun Oh Song , Kyunghyun Cho

Maximum a posteriori (MAP) inference in discrete-valued Markov random fields is a fundamental problem in machine learning that involves identifying the most likely configuration of random variables given a distribution. Due to the…

Machine Learning · Computer Science 2020-07-03 Jonathan N. Lee , Aldo Pacchiano , Peter Bartlett , Michael I. Jordan

In this work we study the method of Bregman projections for deterministic and stochastic convex feasibility problems with three types of control sequences for the selection of sets during the algorithmic procedure: greedy, random, and…

Optimization and Control · Mathematics 2021-01-06 Vladimir Kostic , Saverio Salzo

The Method of Alternating Projections (MAP), a classical algorithm for solving feasibility prob- lems, has recently been intensely studied for nonconvex sets. However, intrinsically available are only local convergence results: convergence…

Optimization and Control · Mathematics 2013-05-21 Heinz H. Bauschke , Hung M. Phan , Xianfu Wang

Data-driven modeling plays an increasingly important role in different areas of engineering. For most of existing methods, such as genetic programming (GP), the convergence speed might be too slow for large scale problems with a large…

Optimization and Control · Mathematics 2017-06-29 Chen Chen , Changtong Luo , Zonglin Jiang

We present a randomized maximum a posteriori (rMAP) method for generating approximate samples of posteriors in high dimensional Bayesian inverse problems governed by large-scale forward problems. We derive the rMAP approach by: 1) casting…

Computation · Statistics 2016-02-12 Kainan Wang , Tan Bui-Thanh , Omar Ghattas

We empirically analyze a simple heuristic for large sparse set cover problems. It uses the weighted greedy algorithm as a basic building block. By multiplicative updates of the weights attached to the elements, the greedy solution is…

Data Structures and Algorithms · Computer Science 2020-10-30 Marc Alexa

This paper is concerned with some new projection methods for solving variational inequality problems with monotone and Lipschitz-continuous mapping in Hilbert space. First, we propose the projected reflected gradient algorithm with a…

Optimization and Control · Mathematics 2018-03-26 Yu. Malitsky

Supervised dimensionality reduction strategies have been of great interest. However, current supervised dimensionality reduction approaches are difficult to scale for situations characterized by large datasets given the high computational…

Machine Learning · Computer Science 2018-11-09 Amir-Hossein Karimi , Alexander Wong , Ali Ghodsi

We describe a novel algorithm for rounding packing integer programs based on multidimensional Brownian motion in $\mathbb{R}^n$. Starting from an optimal fractional feasible solution $\bar{x}$, the procedure converges in polynomial time to…

Data Structures and Algorithms · Computer Science 2014-08-12 Sandeep Sen