English
Related papers

Related papers: Structured Backward Error Analysis for Double Sadd…

200 papers

Recent focus on robustness to adversarial attacks for deep neural networks produced a large variety of algorithms for training robust models. Most of the effective algorithms involve solving the min-max optimization problem for training…

Machine Learning · Computer Science 2021-03-03 Yasaman Esfandiari , Aditya Balu , Keivan Ebrahimi , Umesh Vaidya , Nicola Elia , Soumik Sarkar

Although sparse neural networks have been studied extensively, the focus has been primarily on accuracy. In this work, we focus instead on network structure, and analyze three popular algorithms. We first measure performance when structure…

Machine Learning · Computer Science 2020-12-02 Maxwell Van Gelder , Mitchell Wortsman , Kiana Ehsani

In this paper, our goal is solving backward doubly stochastic differential equation (BDSDE for short) under weak assumptions on the data. The first part of the paper is devoted to the development of some new technical aspects of stochastic…

Probability · Mathematics 2009-07-14 Auguste Aman

Stochastic optimization methods have been hugely successful in making large-scale optimization problems feasible when computing the full gradient is computationally prohibitive. Using the theory of modified equations for numerical…

Optimization and Control · Mathematics 2023-09-06 Stefano Di Giovacchino , Desmond J. Higham , Konstantinos Zygalakis

Over the past decade, deep learning (DL) has been successfully applied to many industrial domain-specific tasks. However, the current state-of-the-art DL software still suffers from quality issues, which raises great concern especially in…

Software Engineering · Computer Science 2020-04-27 Xiyue Zhang , Xiaofei Xie , Lei Ma , Xiaoning Du , Qiang Hu , Yang Liu , Jianjun Zhao , Meng Sun

In recent years, defect prediction, one of the major software engineering problems, has been in the focus of researchers since it has a pivotal role in estimating software errors and faulty modules. Researchers with the goal of improving…

Software Engineering · Computer Science 2020-04-07 Ahmad Hasanpour , Pourya Farzi , Ali Tehrani , Reza Akbari

We consider convex-concave saddle point problems with a separable structure and non-strongly convex functions. We propose an efficient stochastic block coordinate descent method using adaptive primal-dual updates, which enables flexible…

Machine Learning · Statistics 2015-11-24 Zhanxing Zhu , Amos J. Storkey

In this paper, we propose a deep learning based numerical scheme for strongly coupled FBSDEs, stemming from stochastic control. It is a modification of the deep BSDE method in which the initial value to the backward equation is not a free…

Optimization and Control · Mathematics 2023-02-10 Kristoffer Andersson , Adam Andersson , Cornelis W. Oosterlee

Sequential Bayesian optimal experimental design (SBOED) for PDE-governed inverse problems is computationally challenging, especially for infinite-dimensional random field parameters. High-fidelity approaches require repeated forward and…

Optimization and Control · Mathematics 2026-01-12 Kaichen Shen , Peng Chen

This study focuses on addressing the challenge of solving the reduced biquaternion equality constrained least squares (RBLSE) problem. We develop algebraic techniques to derive real and complex solutions for the RBLSE problem by utilizing…

Numerical Analysis · Mathematics 2025-05-05 Sk. Safique Ahmad , Neha Bhadala

Network complexity and computational efficiency have become increasingly significant aspects of deep learning. Sparse deep learning addresses these challenges by recovering a sparse representation of the underlying target function by…

Machine Learning · Statistics 2024-08-22 Sanket Jantre , Shrijita Bhattacharya , Tapabrata Maiti

This paper aims to build a probabilistic framework for Howard's policy iteration algorithm using the language of forward-backward stochastic differential equations (FBSDEs). As opposed to conventional formulations based on partial…

Optimization and Control · Mathematics 2024-10-28 Yutian Wang , Yuan-Hua Ni , Zengqiang Chen , Ji-Feng Zhang

In the present work, we demonstrate how the pseudoinverse concept from linear algebra can be used to represent and analyze the boundary conditions of linear systems of partial differential equations. This approach has theoretical and…

Numerical Analysis · Mathematics 2024-01-05 Pelle Olsson

We propose a doubly stochastic primal-dual coordinate optimization algorithm for empirical risk minimization, which can be formulated as a bilinear saddle-point problem. In each iteration, our method randomly samples a block of coordinates…

Machine Learning · Computer Science 2017-04-13 Adams Wei Yu , Qihang Lin , Tianbao Yang

Finding sparse solutions of underdetermined systems of linear equations is a fundamental problem in signal processing and statistics which has become a subject of interest in recent years. In general, these systems have infinitely many…

Machine Learning · Statistics 2010-09-21 Arash Ali Amini , Massoud Babaie-Zadeh , Christian Jutten

This paper addresses the problem of robust stabilization for linear hyperbolic Partial Differential Equations (PDEs) with Markov-jumping parameter uncertainty. We consider a 2 x 2 heterogeneous hyperbolic PDE and propose a control law using…

Systems and Control · Electrical Eng. & Systems 2026-03-13 Yihuai Zhang , Jean Auriol , Huan Yu

Over the last few decades, the numerical methods for stochastic differential delay equations (SDDEs) have been investigated and developed by many scholars. Nevertheless, there is still little work to be completed. By virtue of the novel…

Numerical Analysis · Mathematics 2022-09-21 Zhuoqi Liu , Qian Guo , Shuaibin Gao

We propose new machine learning schemes for solving high dimensional nonlinear partial differential equations (PDEs). Relying on the classical backward stochastic differential equation (BSDE) representation of PDEs, our algorithms estimate…

Probability · Mathematics 2020-06-08 Côme Huré , Huyên Pham , Xavier Warin

This paper directly builds upon previous work where we introduced new reduced basis a posteriori error bounds for parametrized saddle point problems based on Brezzi's theory. We here sharpen these estimates for the special case of a…

Numerical Analysis · Mathematics 2012-11-06 Anna-Lena Gerner , Karen Veroy

In this paper, we compute the structured eigenvalue backward error of a Rosenbrock system matrix $S(z)=\left[\begin{array}{cc} A-zI & B \\ C & P(z) \end{array}\right]$ for a given scalar $\lambda\in \mathbb C$. We have developed simplified…

Optimization and Control · Mathematics 2025-11-21 Anshul Prajapati , Punit Sharma