English
Related papers

Related papers: Weak Convergence of Approximate reflection couplin…

200 papers

Sparse regularization is fundamental in signal processing and feature extraction but often relies on non-differentiable penalties, conflicting with gradient-based optimizers. We propose WEEP (Weakly-convex Envelope of Piecewise Penalty), a…

Machine Learning · Computer Science 2026-01-21 Takanobu Furuhashi , Hidekata Hontani , Qibin Zhao , Tatsuya Yokota

The stochastic gradient descent has been widely used for solving composite optimization problems in big data analyses. Many algorithms and convergence properties have been developed. The composite functions were convex primarily and…

Machine Learning · Statistics 2020-03-03 Takayuki Kawashima , Hironori Fujisawa

In this paper we first study the penalization approximation of stochastic differential equations reflected in a domain which satisfies conditions (A) and (B) and prove that the sequence of solutions of the penalizing equations converges in…

Probability · Mathematics 2016-04-08 Jiagang Ren , Jing Wu

We study the worst-case convergence rates of the proximal gradient method for minimizing the sum of a smooth strongly convex function and a non-smooth convex function whose proximal operator is available. We establish the exact worst-case…

Optimization and Control · Mathematics 2020-03-03 Adrien B. Taylor , Julien M. Hendrickx , François Glineur

The discrete-time robust repetitive control (RC, or repetitive controller, also designated RC) problem for nonlinear systems is both challenging and practical. This paper proposes a discrete-time output-feedback RC design for a class of…

Systems and Control · Computer Science 2014-01-09 Quan Quan , Lu Jiang , Kai-Yuan Cai

Sample inefficiency is a long-lasting challenge in deep reinforcement learning (DRL). Despite dramatic improvements have been made, the problem is far from being solved and is especially challenging in environments with sparse or delayed…

Machine Learning · Computer Science 2025-06-17 Federico Malato , Ville Hautamaki

We focus on a class of non-smooth optimization problems over the Stiefel manifold in the decentralized setting, where a connected network of $n$ agents cooperatively minimize a finite-sum objective function with each component being weakly…

Optimization and Control · Mathematics 2023-04-03 Jinxin Wang , Jiang Hu , Shixiang Chen , Zengde Deng , Anthony Man-Cho So

This article is about both approximation theory and the numerical solution of partial differential equations (PDEs). First we introduce the notion of {\em reciprocal-log} or {\em log-lightning approximation} of analytic functions with…

Numerical Analysis · Mathematics 2020-10-06 Yuji Nakatsukasa , Lloyd N. Trefethen

In this paper, we investigate the non-asymptotic stationary convergence behavior of Stochastic Mirror Descent (SMD) for nonconvex optimization. We focus on a general class of nonconvex nonsmooth stochastic optimization problems, in which…

Optimization and Control · Mathematics 2018-06-14 Siqi Zhang , Niao He

In reinforcement learning, Reverse Experience Replay (RER) is a recently proposed algorithm that attains better sample complexity than the classic experience replay method. RER requires the learning algorithm to update the parameters…

Machine Learning · Computer Science 2024-09-02 Nan Jiang , Jinzhao Li , Yexiang Xue

Adversarial contrastive learning (ACL) does not require expensive data annotations but outputs a robust representation that withstands adversarial attacks and also generalizes to a wide range of downstream tasks. However, ACL needs…

Machine Learning · Computer Science 2023-10-27 Xilie Xu , Jingfeng Zhang , Feng Liu , Masashi Sugiyama , Mohan Kankanhalli

Stochastic nonconvex optimization problems with nonlinear constraints have a broad range of applications in intelligent transportation, cyber-security, and smart grids. In this paper, first, we propose an inexact-proximal accelerated…

Optimization and Control · Mathematics 2021-07-08 Morteza Boroun , Afrooz Jalilzadeh

We consider a weak adversarial network approach to numerically solve a class of inverse problems, including electrical impedance tomography and dynamic electrical impedance tomography problems. We leverage the weak formulation of PDE in the…

Numerical Analysis · Mathematics 2020-12-02 Gang Bao , Xiaojing Ye , Yaohua Zang , Haomin Zhou

Estimating the directions of arrival (DOAs) of multiple sources from a single snapshot obtained by a coherent antenna array is a well-known problem, which can be addressed by sparse signal reconstruction methods, where the DOAs are…

Signal Processing · Electrical Eng. & Systems 2021-02-02 Tom Tirer , Oded Bialer

We consider a difference-of-convex formulation where one of the terms is allowed to be hypoconvex (or weakly convex). We first examine the precise behavior of a single iteration of the Difference-of-Convex algorithm (DCA), giving a tight…

Optimization and Control · Mathematics 2024-03-26 Teodor Rotaru , Panagiotis Patrinos , François Glineur

Sparse representation-based classification (SRC), proposed by Wright et al., seeks the sparsest decomposition of a test sample over the dictionary of training samples, with classification to the most-contributing class. Because it assumes…

Computer Vision and Pattern Recognition · Computer Science 2018-06-05 Chelsea Weaver , Naoki Saito

There exists a diversity of weak Local Linearization (LL) schemes for the integration of stochastic differential equations with additive noise, which differ with respect to the algorithm that is employed in the numerical implementation of…

Numerical Analysis · Mathematics 2013-12-23 J. C. Jimenez , F. Carbonell

A simple-to-implement weak-sense numerical method to approximate reflected stochastic differential equations (RSDEs) is proposed and analysed. It is proved that the method has the first order of weak convergence. Together with the Monte…

Numerical Analysis · Mathematics 2024-02-06 B. Leimkuhler , A. Sharma , M. V. Tretyakov

In this paper, we demonstrate that the explicit ADER approach as it is used inter alia in [1] can be seen as a special interpretation of the deferred correction (DeC) method as introduced in [2]. By using this fact, we are able to embed…

Numerical Analysis · Mathematics 2022-11-17 Maria Han Veiga , Philipp Öffner , Davide Torlo

We prove nonuniqueness of weak solutions to multi-dimensional generalisation of the Aw-Rascle model of vehicular traffic. Our generalisation includes the velocity offset in a form of gradient of density function, which results in a…

Analysis of PDEs · Mathematics 2022-08-05 Nilasis Chaudhuri , Eduard Feireisl , Ewelina Zatorska