English
Related papers

Related papers: Self-adaptive-type CQ algorithms for split equalit…

200 papers

This paper presents a novel stochastic gradient descent algorithm for constrained optimization. The proposed algorithm randomly samples constraints and components of the finite sum objective function and relies on a relaxed logarithmic…

Optimization and Control · Mathematics 2025-05-13 Naum Dimitrieski , Jing Cao , Christian Ebenbauer

The Adaptive Multilevel Splitting algorithm is a very powerful and versatile iterative method to estimate the probability of rare events, based on an interacting particle systems. In an other article, in a so-called idealized setting, the…

Probability · Mathematics 2019-10-21 Charles-Edouard Bréhier , Ludovic Goudenège , Loic Tudela

Adam is a popular variant of stochastic gradient descent for finding a local minimizer of a function. In the constant stepsize regime, assuming that the objective function is differentiable and non-convex, we establish the convergence in…

Machine Learning · Statistics 2020-05-15 Anas Barakat , Pascal Bianchi

Along with developing of Peaceman-Rachford Splittling Method (PRSM), many batch algorithms based on it have been studied very deeply. But almost no algorithm focused on the performance of stochastic version of PRSM. In this paper, we…

Machine Learning · Statistics 2018-02-13 Sen Na , Mingyuan Ma , Mladen Kolar

We present an algorithm based on continuation techniques that can be applied to solve numerically minimization problems with equality constraints. We focus on problems with a great number of local minima which are hard to obtain by local…

Numerical Analysis · Mathematics 2019-09-17 Elisabete Alberdi , Mikel Antoñana , Joseba Makazaga , Ander Murua

Most existing examples of full conformal predictive systems, split-conformal predictive systems, and cross-conformal predictive systems impose severe restrictions on the adaptation of predictive distributions to the test object at hand. In…

Machine Learning · Computer Science 2019-02-19 Vladimir Vovk , Ivan Petej , Paolo Toccaceli , Alex Gammerman

Samplers are the backbone of the implementations of any randomised algorithm. Unfortunately, obtaining an efficient algorithm to test the correctness of samplers is very hard to find. Recently, in a series of works, testers like…

Data Structures and Algorithms · Computer Science 2023-12-19 Rishiraj Bhattacharyya , Sourav Chakraborty , Yash Pote , Uddalok Sarkar , Sayantan Sen

This paper focuses on stochastic proximal gradient methods for optimizing a smooth non-convex loss function with a non-smooth non-convex regularizer and convex constraints. To the best of our knowledge we present the first non-asymptotic…

Optimization and Control · Mathematics 2019-05-27 Michael R. Metel , Akiko Takeda

The article introduces a new algorithm for solving a class ofequilibrium problems involving strongly pseudomonotone bifunctions with Lipschitz-type condition. We describe how to incorporate the proximal-like regularized technique with…

Optimization and Control · Mathematics 2018-04-26 Dang Van Hieu

The paper proposes a novel hybrid method for solving equilibrium problems and fixed point problems. By constructing specially cutting-halfspaces, in this algorithm, only an optimization program is solved at each iteration without the…

Optimization and Control · Mathematics 2015-10-30 Dang Van Hieu

We introduce a framework for quasi-Newton forward--backward splitting algorithms (proximal quasi-Newton methods) with a metric induced by diagonal $\pm$ rank-$r$ symmetric positive definite matrices. This special type of metric allows for a…

Optimization and Control · Mathematics 2018-11-27 Stephen Becker , Jalal Fadili , Peter Ochs

In this paper, we first discuss the optimal convergence of the adaptive finite element methods for non-self-adjoint eigenvalue problems. We present new theoretical error estimators and computable error estimators for multiple and clustered…

Numerical Analysis · Mathematics 2026-03-16 Shixi Wang , Hai Bi , Yidu Yang

We propose an experimental study of adaptive time-stepping methods for efficient modeling of the aggregation-fragmentation kinetics. Precise modeling of this phenomena usually requires utilization of the large systems of nonlinear ordinary…

Numerical Analysis · Mathematics 2025-01-20 Sergey A. Matveev , Viktor Zhilin , Alexander P. Smirnov

We propose an adaptive accelerated gradient method for solving smooth convex optimization problems. The method incorporates a scheme to determine the step size adaptively, by means of a local estimation of the smoothness constant, which is…

Optimization and Control · Mathematics 2025-12-24 Zepeng Wang , Juan Peypouquet

The concept of entanglement and separability of quantum states is relevant for several fields in physics. Still, there is a lack of effective operational methods to characterise these features. We propose a method to certify quantum…

Quantum Physics · Physics 2024-03-06 Ties-A. Ohst , Xiao-Dong Yu , Otfried Gühne , H. Chau Nguyen

In this paper, we provide different splitting methods for solving distributionally robust optimization problems in cases where the uncertainties are described by discrete distributions. The first method involves computing the proximity…

Optimization and Control · Mathematics 2024-10-30 Luis Briceño-Arias , Sergio López-Rivera , Emilio Vilches

In this paper, we introduce two golden ratio algorithms with new stepsize rules for solving pseudomonotone and Lipschitz variational inequalities in finite dimensional Hilbert spaces. The presented stepsize rules allow the resulting…

Optimization and Control · Mathematics 2019-04-17 Dang Van Hieu , Yeol Je Cho , Yi-bin Xiao

We formulate a well-posedness and approximation theory for a class of generalised saddle point problems with a specific form of constraints. In this way we develop an approach to a class of fourth order elliptic partial differential…

Numerical Analysis · Mathematics 2021-03-26 Charles M. Elliott , Philip J. Herbert

A sequential quadratic optimization algorithm is proposed for solving smooth nonlinear equality constrained optimization problems in which the objective function is defined by an expectation of a stochastic function. The algorithmic…

Optimization and Control · Mathematics 2023-03-17 Albert S. Berahas , Frank E. Curtis , Michael J. O'Neill , Daniel P. Robinson

In this paper we analyze the use of time splitting techniques for solving shallow water equation. We discuss some properties that these schemes should satisfy so that interactions between the source term and the shock waves are controlled.…

Numerical Analysis · Mathematics 2016-11-26 Vicente Martínez