English
Related papers

Related papers: Least Squares Shadowing method for sensitivity ana…

200 papers

We develop a new spatial semidiscrete multiscale method based upon the edge multiscale methods to solve semilinear parabolic problems with heterogeneous coefficients and smooth initial data. This method allows for a cheap spatial…

Numerical Analysis · Mathematics 2025-12-16 Leonardo A. Poveda , Shubin Fu , Guanglian Li , Eric Chung

Stackelberg prediction games (SPGs) model strategic data manipulation in adversarial learning via a leader--follower interaction between a learner and a self-interested data provider, leading to challenging bilevel optimization problems.…

Signal Processing · Electrical Eng. & Systems 2026-04-06 Tong Wei , Yangjie Xu , Xinlin Wang , Pin-Han Ho , Bhavani Shankar M. R. , Radu State , Björn Ottersten

Discriminative least squares regression (DLSR) has been shown to achieve promising performance in multi-class image classification tasks. Its key idea is to force the regression labels of different classes to move in opposite directions by…

Computer Vision and Pattern Recognition · Computer Science 2020-08-05 Zhe Chen , Xiao-Jun Wu , Josef Kittler

In this paper, we consider the minimization of a $C^2-$smooth and strongly convex objective depending on a given parameter, which is usually found in many practical applications. We suppose that we desire to solve the problem with some…

Optimization and Control · Mathematics 2025-03-14 Jean-Jacques Godeme

Minimum achievable complexity (MAC) for a maximum likelihood (ML) performance-achieving detection algorithm is derived. Using the derived MAC, we prove that the conventional sphere decoding (SD) algorithms suffer from an inherent weakness…

Information Theory · Computer Science 2021-09-21 Mohammad Neinavaie , Mostafa Derakhtian , Sergiy A. Vorobyov

The least squares method allows fitting parameters of a mathematical model from experimental data. This article proposes a general approach of this method. After introducing the method and giving a formal definition, the transitivity of the…

Optimization and Control · Mathematics 2015-02-27 Benjamin Lenoir

This work develops a robust diffusion recursive least squares algorithm to mitigate the performance degradation often experienced in networks of agents in the presence of impulsive noise. This algorithm minimizes an exponentially weighted…

Information Theory · Computer Science 2019-02-20 Y. Yu , R. C. de Lamare , Y. Zakharov

Neural networks are predominantly trained using gradient-based methods, yet in many applications their final predictions remain far from the accuracy attainable within the model's expressive capacity. We introduce Linearized Subspace…

Machine Learning · Computer Science 2026-01-21 Wenbo Cao , Weiwei Zhang

In this paper, the paradigm of sphere decoding (SD) for solving the integer least square problem (ILS) is revisited, where extra degrees of freedom are introduced to exploit the decoding potential. Firstly, the equivalent sphere decoding…

Information Theory · Computer Science 2025-12-23 Zheng Wang , Cong Ling , Shi Jin , Yongming Huang , Feifei Gao

Tensor Train~(TT) decomposition is widely used in the machine learning and quantum physics communities as a popular tool to efficiently compress high-dimensional tensor data. In this paper, we propose an efficient algorithm to accelerate…

Data Structures and Algorithms · Computer Science 2024-06-07 Vivek Bharadwaj , Beheshteh T. Rakhshan , Osman Asif Malik , Guillaume Rabusseau

Additive regression models are actively researched in the statistical field because of their usefulness in the analysis of responses determined by non-linear relationships with multivariate predictors. In this kind of statistical models,…

Methodology · Statistics 2018-04-10 German A. Schnaidt Grez , Brani Vidakovic

We obtain an improved finite-sample guarantee on the linear convergence of stochastic gradient descent for smooth and strongly convex objectives, improving from a quadratic dependence on the conditioning $(L/\mu)^2$ (where $L$ is a bound on…

Numerical Analysis · Mathematics 2015-01-19 Deanna Needell , Nathan Srebro , Rachel Ward

In this paper, we investigate the problem of system identification for autonomous Markov jump linear systems (MJS) with complete state observations. We propose switched least squares method for identification of MJS, show that this method…

Machine Learning · Computer Science 2023-02-07 Borna Sayedana , Mohammad Afshari , Peter E. Caines , Aditya Mahajan

Searching for numerical methods that combine facility and efficiency, while remaining accurate and versatile, is critical. Often, irregular geometries challenge traditional methods that rely on structured or body-fitted meshes. Meshless…

Numerical Analysis · Mathematics 2024-06-21 Anna Kucherova , Gbocho M. Terasaki , Selma Strango , Maxime Theillard

In the paper we consider the problem of multivariate function approximation in polynomial basis. In order to solve this problem, we adjust the least squares method (LSM) by adding information about derivatives of the function. This…

Numerical Analysis · Mathematics 2018-02-06 Gleb Ryzhakov , Ivan Oseledets

The time discretization of stochastic spectral fractional wave equation is studied by using the difference methods. Firstly, we exploit rectangle formula to get a low order time discretization, whose the strong convergence order is smaller…

Numerical Analysis · Mathematics 2021-06-08 Xing Liu

We propose a new first-order-system least squares (FOSLS) finite-element discretization for singularly perturbed reaction-diffusion equations. Solutions to such problems feature layer phenomena, and are ubiquitous in many areas of applied…

Numerical Analysis · Mathematics 2019-09-19 James H. Adler , Scott MacLachlan , Niall Madden

In real data analysis with structural equation modeling, data are unlikely to be exactly normally distributed. If we ignore the non-normality reality, the parameter estimates, standard error estimates, and model fit statistics from normal…

Methodology · Statistics 2021-06-21 Han Du , Peter M. Bentler

This paper considers the efficient minimization of the infinite time average of a stationary ergodic process in the space of a handful of design parameters which affect it. Problems of this class, derived from physical or numerical…

Optimization and Control · Mathematics 2019-10-29 Pooriya Beyhaghi , Ryan Alimo , Thomas Bewley

With a high probability the Sarlos randomized algorithm of 2006 outputs a nearly optimal least squares solution of a highly overdeterminedlinear system of equations. We propose its simple deterministic variation which computes such a…

Numerical Analysis · Mathematics 2021-04-02 Qi Luan , Victor Y. Pan