English
Related papers

Related papers: Splitting Method for Support Vector Machine with L…

200 papers

The forward-backward splitting algorithm is a popular operator-splitting method for solving monotone inclusion of the sum of a maximal monotone operator and a cocoercive operator. In this paper, we present a new convergence analysis of a…

Functional Analysis · Mathematics 2019-08-30 Fuying Cui , Yuchao Tang , Chuanxi Zhu

In view of the minimization of a function which is the sum of a differentiable function $f$ and a convex function $g$ we introduce descent methods which can be viewed as produced by inexact auxiliary problem principleor inexact variable…

Optimization and Control · Mathematics 2016-09-13 Jean-Philippe Chancelier

In the context of convex optimization problems in Hilbert spaces, we induce inertial effects into the classical ADMM numerical scheme and obtain in this way so-called inertial ADMM algorithms, the convergence properties of which we…

Optimization and Control · Mathematics 2014-04-18 Radu Ioan Bot , Ernö Robert Csetnek

This paper presents a modified iterative approach to solve the variational inequality problem using the double inertial technique in the context of a real Hilbert space. Our iterative technique involves a projection onto a generalized…

Functional Analysis · Mathematics 2026-03-19 Watanjeet Singh , Sumit Chandok

Saddle-point problems appear in various settings including machine learning, zero-sum stochastic games, and regression problems. We consider decomposable saddle-point problems and study an extension of the alternating direction method of…

Optimization and Control · Mathematics 2022-12-29 Mustafa O. Karabag , David Fridovich-Keil , Ufuk Topcu

This paper proposes a novel kernel approach to linear dimension reduction for supervised learning. The purpose of the dimension reduction is to find directions in the input space to explain the output as effectively as possible. The…

Machine Learning · Statistics 2011-09-05 Kenji Fukumizu , Chenlei Leng

In this paper, we develop a splitting algorithm incorporating Bregman distances to solve a broad class of linearly constrained composite optimization problems, whose objective function is the separable sum of possibly nonconvex nonsmooth…

Optimization and Control · Mathematics 2024-10-01 Tan Nhat Pham , Minh N. Dao , Andrew Eberhard , Nargiz Sultanova

This work investigates a Bregman and inertial extension of the forward-reflected-backward algorithm [Y. Malitsky and M. Tam, SIAM J. Optim., 30 (2020), pp. 1451--1472] applied to structured nonconvex minimization problems under relative…

Optimization and Control · Mathematics 2024-04-17 Ziyuan Wang , Andreas Themelis , Hongjia Ou , Xianfu Wang

In this paper, we first propose a general inertial proximal point method for the mixed variational inequality (VI) problem. Based on our knowledge, without stronger assumptions, convergence rate result is not known in the literature for…

Optimization and Control · Mathematics 2014-08-04 Caihua Chen , Shiqian Ma , Junfeng Yang

This paper presents enhancement strategies for the Hermitian and skew-Hermitian splitting method based on gradient iterations. The spectral properties are exploited for the parameter estimation, often resulting in a better convergence. In…

Numerical Analysis · Mathematics 2020-07-08 Qinmeng Zou , Frederic Magoules

Splitting methods have emerged as powerful tools to address complex problems by decomposing them into smaller solvable components. In this work, we develop a general approach to forward-backward splitting methods for solving monotone…

Optimization and Control · Mathematics 2026-04-20 Minh N. Dao , Matthew K. Tam , Thang D. Truong

In general, high order splitting methods suffer from an order reduction phenomena when applied to the time integration of partial differential equations with non-periodic boundary conditions. In the last decade, there were introduced…

Numerical Analysis · Mathematics 2026-04-08 Ramona Häberli

In this paper we present an abstract convergence analysis of inexact descent methods in Riemannian context for functions satisfying Kurdyka-Lojasiewicz inequality. In particular, without any restrictive assumption about the sign of the…

Numerical Analysis · Mathematics 2011-03-25 G. C. Bento , J. X. da Cruz Neto , P. R. Oliveira

This work presents an approach for automating the discretization and approximation procedures in constructing digital representations of composites from Micro-CT images featuring intricate microstructures. The proposed method is guided by…

Machine Learning · Computer Science 2025-09-11 Yanran Wang , Jonghyuk Baek , Yichun Tang , Jing Du , Mike Hillman , J. S. Chen

This paper deals with a splitting method applied to a conservation law model of manufacturing system incorporating yield loss. A splitting scheme has been proposed. The yield loss term is treated by solving implicitly an ordinary…

Numerical Analysis · Mathematics 2014-08-25 Tanmay Sarkar

The split common fixed-point problem is an inverse problem that consists in finding an element in a fixed-point set such that its image under a bounded linear operator belongs to another fixed-point set. Recently Censor and Segal proposed…

Optimization and Control · Mathematics 2014-11-03 Huanhuan Cui , Fenghui Wang

An error analysis of a splitting method applied to the Zakharov system is given. The numerical method is a Lie-Trotter splitting in time that is combined with a Fourier collocation in space to a fully discrete method. First-order…

Numerical Analysis · Mathematics 2017-12-21 Ludwig Gauckler

In this paper, we propose variants of forward-backward splitting method for solving the system of splitting inclusion problem. We propose a conceptual algorithm containing three variants, each having a different projection steps. The…

Optimization and Control · Mathematics 2016-01-05 R. Díaz Millán

We present a new method to study disordered systems in the low temperature limit. The method uses the replicated Hamiltonian. It studies the saddle points of this Hamiltonian and shows how the various saddle point contributions can be…

Disordered Systems and Neural Networks · Physics 2009-10-28 Viktor Dotsenko , Marc Mezard

Several supermodular losses have been shown to improve the perceptual quality of image segmentation in a discriminative framework such as a structured output support vector machine (SVM). These loss functions do not necessarily have the…

Computer Vision and Pattern Recognition · Computer Science 2017-02-14 Jiaqian Yu , Matthew B. Blaschko