English
Related papers

Related papers: Structured Backward Errors for Special Classes of …

200 papers

Background: Deep learning techniques, particularly neural networks, have revolutionized computational physics, offering powerful tools for solving complex partial differential equations (PDEs). However, ensuring stability and efficiency…

Artificial Intelligence · Computer Science 2024-07-11 A. Noorizadegan , R. Cavoretto , D. L. Young , C. S. Chen

While deep learning has significantly advanced accident anticipation, the robustness of these safety-critical systems against real-world perturbations remains a major challenge. We reveal that state-of-the-art models like CRASH, despite…

Machine Learning · Computer Science 2026-04-03 Wenjing Wang , Wenxuan Wang , Songning Lai

In this paper, we consider robust system identification under sparse outliers and random noises. In our problem, system parameters are observed through a Toeplitz matrix. All observations are subject to random noises and a few are corrupted…

Information Theory · Computer Science 2012-12-06 Weiyu Xu , Er-Wei Bai , Myung Cho

Large sectors of the recent optimization literature focused in the last decade on the development of optimal stochastic first order schemes for constrained convex models under progressively relaxed assumptions. Stochastic proximal point is…

Optimization and Control · Mathematics 2020-05-05 Andrei Patrascu

We consider a generic convex-concave saddle point problem with separable structure, a form that covers a wide-ranged machine learning applications. Under this problem structure, we follow the framework of primal-dual updates for saddle…

Machine Learning · Statistics 2015-06-15 Zhanxing Zhu , Amos J. Storkey

The saddle-point problems (SPPs) with nonlinear coupling operators frequently arise in various control systems, such as dynamic programming optimization, H-infinity control, and Lyapunov stability analysis. However, traditional primal-dual…

Optimization and Control · Mathematics 2025-03-21 Sai Wang , Yi Gong

In this paper we study different algorithms for reflected backward stochastic differential equations (BSDE in short) with two continuous barriers basing on random work framework. We introduce different numerical algorithms by penalization…

Probability · Mathematics 2009-09-23 Mingyu Xu

We introduce a new class of structured matrix polynomials, namely, the class of M_A-structured matrix polynomials, to provide a common framework for many classes of structured matrix polynomials that are important in applications: the…

Numerical Analysis · Mathematics 2016-12-22 Froilán M. Dopico , Javier Pérez , Paul Van Dooren

Adapting large pre-trained models (PTMs) through fine-tuning imposes prohibitive computational and storage burdens. Recent studies of parameter-efficient tuning (PET) find that only optimizing a small portion of parameters conditioned on…

Computation and Language · Computer Science 2022-06-16 Shengding Hu , Zhen Zhang , Ning Ding , Yadao Wang , Yasheng Wang , Zhiyuan Liu , Maosong Sun

We consider machine learning techniques to develop low-latency approximate solutions to a class of inverse problems. More precisely, we use a probabilistic approach for the problem of recovering sparse stochastic signals that are members of…

Information Theory · Computer Science 2016-09-06 Steffen Limmer , Sławomir Stańczak

For a recent new numerical method for computing so-called robust Pad\'e approximants through SVD techniques, the authors gave numerical evidence that such approximants are insensitive to perturbations in the data, and do not have so-called…

Numerical Analysis · Mathematics 2013-12-02 Bernhard Beckermann , Ana Matos

We consider a wide range of regularized stochastic minimization problems with two regularization terms, one of which is composed with a linear function. This optimization model abstracts a number of important applications in artificial…

Machine Learning · Computer Science 2018-02-02 Tianyi Lin , Linbo Qiao , Teng Zhang , Jiashi Feng , Bofeng Zhang

This paper studies two structured approximation problems: (1) Recovering a corrupted low-rank Toeplitz matrix and (2) recovering the range of a Fourier matrix from a single observation. Both problems are computationally challenging because…

Information Theory · Computer Science 2025-11-24 Albert Fannjiang , Weilin Li

We consider the parametric data model employed in applications such as line spectral estimation and direction-of-arrival estimation. We focus on the stochastic maximum likelihood estimation (MLE) framework and offer approaches to estimate…

Signal Processing · Electrical Eng. & Systems 2023-04-12 Rohan R. Pote , Bhaskar D. Rao

For a general class of saddle point problems sharp estimates for Babu\v{s}ka's inf-sup stability constants are derived in terms of the constants in Brezzi's theory. In the finite-dimensional Hermitian case more detailed spectral properties…

Numerical Analysis · Mathematics 2012-02-16 Wolfgang Krendl , Valeria Simoncini , Walter Zulehner

We model and study the patterns created through the interaction of collectively moving self-propelled particles (SPPs) and elastically tethered obstacles. Simulations of an individual-based model reveal at least three distinct large-scale…

We study how inexact nonlinear solvers lead to a loss of exact symplecticity in the Symplectic Euler (SE) and Stormer-Verlet (SV) schemes when applied to general nonseparable Hamiltonian systems. These schemes are implicit and require…

Numerical Analysis · Mathematics 2026-04-22 Matěj Gajdoš , Ondřej Brichta , Václav Kučera

The alternating least squares algorithm for CP and Tucker decomposition is dominated in cost by the tensor contractions necessary to set up the quadratic optimization subproblems. We introduce a novel family of algorithms that uses…

Numerical Analysis · Mathematics 2021-04-15 Linjian Ma , Edgar Solomonik

Randomized subspace embedding methods have had a great impact on the solution of a linear least squares (LS) problem by reducing its row dimension, leading to a randomized or sketched LS (sLS) problem, and use the solution of the sLS…

Numerical Analysis · Mathematics 2026-02-12 Zhongxiao Jia , Xinyuan Wan

We study the optimization landscape and the stability properties of training problems with squared loss for neural networks and general nonlinear conic approximation schemes. It is demonstrated that, if a nonlinear conic approximation…

Optimization and Control · Mathematics 2021-12-03 Constantin Christof