English
Related papers

Related papers: Learning truly monotone operators with application…

200 papers

Training deep neural networks for solving machine learning problems is one great challenge in the field, mainly due to its associated optimisation problem being highly non-convex. Recent developments have suggested that many training…

Machine Learning · Computer Science 2017-11-23 Hao Shen

We propose and show the efficacy of a new method to address generic inverse problems. Inverse modeling is the task whereby one seeks to determine the control parameters of a natural system that produce a given set of observed measurements.…

Machine Learning · Computer Science 2023-08-15 Gregory P. Spell , Simiao Ren , Leslie M. Collins , Jordan M. Malof

Reinforcement learning (RL) offers significant promise for machinery fault detection (MFD). However, most existing RL-based MFD approaches do not fully exploit RL's sequential decision-making strengths, often treating MFD as a simple…

Machine Learning · Computer Science 2026-02-27 Dhiraj Neupane , Richard Dazeley , Mohamed Reda Bouadjenek , Sunil Aryal

We provide two weakly convergent algorithms for finding a zero of the sum of a maximally monotone operator, a cocoercive operator, and the normal cone to a closed vector subspace of a real Hilbert space. The methods exploit the intrinsic…

Optimization and Control · Mathematics 2012-12-27 Luis M. Briceño-Arias

In this paper, we propose an algorithm combining the forward-backward splitting method and the alternative projection method for solving the system of splitting inclusion problem. We want to find a point in the interception of a finite…

Optimization and Control · Mathematics 2016-04-08 R. Díaz Millán

This work presents a hybrid modeling approach to data-driven learning and representation of unknown physical processes and closure parameterizations. These hybrid models are suitable for situations where the mechanistic description of…

Computational Physics · Physics 2021-08-17 Suraj Pawar , Omer San , Adil Rasheed , Ionel M. Navon

The nonlinear, or warped, resolvent recently explored by Giselsson and B\`ui-Combettes has been used to model a large set of existing and new monotone inclusion algorithms. To establish convergent algorithms based on these resolvents,…

Optimization and Control · Mathematics 2023-10-02 Martin Morin , Sebastian Banert , Pontus Giselsson

Federated learning enables training on a massive number of edge devices. To improve flexibility and scalability, we propose a new asynchronous federated optimization algorithm. We prove that the proposed approach has near-linear convergence…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-08 Cong Xie , Sanmi Koyejo , Indranil Gupta

Zero-shot reinforcement learning is necessary for extracting optimal policies in absence of concrete rewards for fast adaptation to future problem settings. Forward-backward representations (FB) have emerged as a promising method for…

Machine Learning · Computer Science 2025-07-09 Núria Armengol Urpí , Marin Vlastelica , Georg Martius , Stelian Coros

Inverse problems are pervasive mathematical methods in inferring knowledge from observational and experimental data by leveraging simulations and models. Unlike direct inference methods, inverse problem approaches typically require many…

Computational Physics · Physics 2019-12-20 Sheroze Sheriffdeen , Jean C. Ragusa , Jim E. Morel , Marvin L. Adams , Tan Bui-Thanh

For nonlinear inverse problems that are prevalent in imaging science, symmetries in the forward model are common. When data-driven deep learning approaches are used to solve such problems, these intrinsic symmetries can cause substantial…

Signal Processing · Electrical Eng. & Systems 2024-03-26 Wenjie Zhang , Yuxiang Wan , Zhong Zhuang , Ju Sun

Tseng's algorithm finds a zero of the sum of a maximally monotone operator and a monotone continuous operator by evaluating the latter twice per iteration. In this paper, we modify Tseng's algorithm for finding a zero of the sum of three…

Optimization and Control · Mathematics 2018-03-26 Luis M. Briceño-Arias , Damek Davis

We introduce a new approach in distributed deep learning, utilizing Geoffrey Hinton's Forward-Forward (FF) algorithm to speed up the training of neural networks in distributed computing environments. Unlike traditional methods that rely on…

Machine Learning · Computer Science 2024-05-10 Ege Aktemur , Ege Zorlutuna , Kaan Bilgili , Tacettin Emre Bok , Berrin Yanikoglu , Suha Orhun Mutluergil

In this work, we extend deep learning-based numerical methods to fully coupled forward-backward stochastic differential equations (FBSDEs) within a non-Markovian framework. Error estimates and convergence are provided. In contrast to the…

Mathematical Finance · Quantitative Finance 2025-11-25 Hasib Uddin Molla , Matthew Backhouse , Ankit Banarjee , Jinniao Qiu

In this work, we propose and analyse two splitting algorithms for finding a zero of the sum of three monotone operators, one of which is assumed to be Lipschitz continuous. Each iteration of these algorithms require one forward evaluation…

Optimization and Control · Mathematics 2020-01-22 Janosch Rieger , Matthew K. Tam

This work proposes an efficient batch algorithm for feature selection in reinforcement learning (RL) with theoretical convergence guarantees. To mitigate the estimation bias inherent in conventional regularization schemes, the first…

Machine Learning · Computer Science 2025-09-22 Kyohei Suzuki , Konstantinos Slavakis

We propose a partially learned approach for the solution of ill posed inverse problems with not necessarily linear forward operators. The method builds on ideas from classical regularization theory and recent advances in deep learning to…

Optimization and Control · Mathematics 2017-11-27 Jonas Adler , Ozan Öktem

It is often useful to perform integration over learned functions represented by neural networks. However, this integration is usually performed numerically, as analytical integration over learned functions (especially neural networks) is…

Machine Learning · Computer Science 2023-12-27 Ryan Kortvelesy

In this paper we consider the solution of monotone inverse problems using the particular example of a parameter identification problem for a semilinear parabolic PDE. For the regularized solution of this problem, we introduce a total…

Numerical Analysis · Mathematics 2025-02-26 Pankaj Gautam , Markus Grasmair

Despite the considerable success of neural networks in security settings such as malware detection, such models have proved vulnerable to evasion attacks, in which attackers make slight changes to inputs (e.g., malware) to bypass detection.…

Machine Learning · Computer Science 2021-06-09 Netanel Raviv , Aidan Kelley , Michael Guo , Yevgeny Vorobeychik