English
Related papers

Related papers: An Active Set Algorithm for Nonlinear Optimization…

200 papers

Reward optimization in fully observable Markov decision processes is equivalent to a linear program over the polytope of state-action frequencies. Taking a similar perspective in the case of partially observable Markov decision processes…

Machine Learning · Computer Science 2022-05-30 Johannes Müller , Guido Montúfar

A Halpern-type relaxed inertial inexact progressive hedging algorithm (PHA) is proposed for solving multi-stage stochastic variational inequalities in general probability spaces. The subproblems in this algorithm are allowed to be…

Optimization and Control · Mathematics 2024-12-10 Jiaxin Chen , Zunjie Huang , Haisen Zhang

In this paper, we propose a framework based on the Retrospective Approximation (RA) paradigm to solve optimization problems with a stochastic objective function and general nonlinear deterministic constraints. This framework sequentially…

Optimization and Control · Mathematics 2025-05-27 Albert S. Berahas , Raghu Bollapragada , Shagun Gupta

The state transition algorithm (STA), as an intelligent optimization method grounded in constructivist learning, has been demonstrated to be highly effective in solving complex optimization problems. However, the standard STA suffers from…

Optimization and Control · Mathematics 2026-04-30 Xiaojun Zhou , Chunhua Yang , Weihua Gui , Tingwen Huang

In this work we introduce a new optimisation method called SAGA in the spirit of SAG, SDCA, MISO and SVRG, a set of recently proposed incremental gradient algorithms with fast linear convergence rates. SAGA improves on the theory behind SAG…

Machine Learning · Computer Science 2014-12-17 Aaron Defazio , Francis Bach , Simon Lacoste-Julien

The paper considers the minimization of a separable convex function subject to linear ascending constraints. The problem arises as the core optimization in several resource allocation scenarios, and is a special case of an optimization of a…

Optimization and Control · Mathematics 2016-08-30 Akhil P T , Rajesh Sundaresan

We propose a new ensemble prediction method, Random Subset Averaging (RSA), tailored for settings with many covariates, particularly in the presence of strong correlations. RSA constructs candidate models via binomial random subset strategy…

Methodology · Statistics 2025-12-30 Wenhao Cui , Jie Hu

Principal Component Analysis (PCA) is a powerful and popular dimensionality reduction technique. However, due to its linear nature, it often fails to capture the complex underlying structure of real-world data. While Kernel PCA (kPCA)…

Machine Learning · Computer Science 2026-02-05 Thomas Uriot , Elise Chung

Principal skewness analysis (PSA) has been introduced for feature extraction in hyperspectral imagery. As a third-order generalization of principal component analysis (PCA), its solution of searching for the locally maximum skewness…

Computer Vision and Pattern Recognition · Computer Science 2020-07-15 Xiurui Geng , Lei Wang

Answer Set Programming (ASP) is a well-established formalism for nonmonotonic reasoning. An ASP program can have no answer set due to cyclic default negation. In this case, it is not possible to draw any conclusion, even if this is not…

Logic in Computer Science · Computer Science 2017-07-24 Giovanni Amendola , Carmine Dodaro , Wolfgang Faber , Nicola Leone , Francesco Ricca

We develop a primal dual active set with continuation algorithm for solving the \ell^0-regularized least-squares problem that frequently arises in compressed sensing. The algorithm couples the the primal dual active set method with a…

Optimization and Control · Mathematics 2014-03-04 Yuling Jiao , Bangti Jin , Xiliang Lu

This paper introduces an efficient algorithm for computing the best approximation of a given matrix onto the intersection of linear equalities, inequalities and the doubly nonnegative cone (the cone of all positive semidefinite matrices…

Optimization and Control · Mathematics 2018-03-20 Ying Cui , Defeng Sun , Kim-Chuan Toh

Acceleration of algorithms is becoming a crucial problem, if larger data sets are to be processed. Evaluation of algorithms is mostly done by using computational geometry approach and evaluation of computational complexity. However in…

Computational Geometry · Computer Science 2022-08-29 Vaclav Skala

We consider optimal route planning when the objective function is a general nonlinear and non-monotonic function. Such an objective models user behavior more accurately, for example, when a user is risk-averse, or the utility function needs…

Data Structures and Algorithms · Computer Science 2015-11-24 Ger Yang , Evdokia Nikolova

We present a stationary iteration method, namely Alternating Symmetric positive definite and Scaled symmetric positive semidefinite Splitting (ASSS), for solving the system of linear equations obtained by using finite element discretization…

Numerical Analysis · Mathematics 2021-09-06 Davod Khojasteh Salkuyeh

We design and analyze primal-dual, feasible interior-point algorithms (IPAs) employing full Newton steps to solve convex optimization problems in standard conic form. Unlike most nonsymmetric cone programming methods, the algorithms…

Optimization and Control · Mathematics 2025-02-25 Dávid Papp , Anita Varga

Researchers and practitioners in the field of reliability engineering and optimization frequently use active redundancy techniques to intensify the performance of systems. In this article, we study allocation strategies of non-matching…

Applications · Statistics 2026-05-18 Bidhan Modok , Shovan Chowdhury , Amarjit Kundu

Multiagent planning and coordination problems are common and known to be computationally hard. We show that a wide range of two-agent problems can be formulated as bilinear programs. We present a successive approximation algorithm that…

Artificial Intelligence · Computer Science 2014-01-16 Marek Petrik , Shlomo Zilberstein

The sparse nonlinear programming (SNP) problem has wide applications in signal and image processing, machine learning, pattern recognition, finance and management, etc. However, the computational challenge posed by SNP has not yet been well…

Optimization and Control · Mathematics 2021-05-26 Chen Zhao , Naihua Xiu , Hou-Duo Qi , Ziyan Luo

We consider a class of assortment optimization problems in an offline data-driven setting. A firm does not know the underlying customer choice model but has access to an offline dataset consisting of the historically offered assortment set,…

Machine Learning · Computer Science 2023-02-09 Juncheng Dong , Weibin Mo , Zhengling Qi , Cong Shi , Ethan X. Fang , Vahid Tarokh