English
Related papers

Related papers: Recursive Geman-McClure method for implementing se…

200 papers

Due to the highly non-convex nature of large-scale robust parameter estimation, avoiding poor local minima is challenging in real-world applications where input data is contaminated by a large or unknown fraction of outliers. In this paper,…

Computer Vision and Pattern Recognition · Computer Science 2020-03-23 Huu Le , Christopher Zach

In this work, we propose a novel selective discontinuity sensor approach for numerical simulations of the compressible Navier-Stokes equations. Since transformation to characteristic space is already a common approach to reduce…

Fluid Dynamics · Physics 2023-05-16 Amareshwara Sainadh Chamarthi , Natan Hoffmann , Steven Frankel

This paper considers the problem of robust adaptive efficient estimating of a periodic function in a continuous time regression model with the dependent noises given by a general square integrable semimartingale with a conditionally…

Statistics Theory · Mathematics 2019-09-24 Evgeny Pchelintsev , Serguei Pergamenshchikov

We consider stochastic convex optimization problems where the objective is an expectation over smooth functions. For this setting we suggest a novel gradient estimate that combines two recent mechanism that are related to notion of…

Machine Learning · Computer Science 2025-03-06 Tehila Dahan , Kfir Y. Levy

High-dimensional linear regression under heavy-tailed noise or outlier corruption is challenging, both computationally and statistically. Convex approaches have been proven statistically optimal but suffer from high computational costs,…

Statistics Theory · Mathematics 2023-05-11 Yinan Shen , Jingyang Li , Jian-Feng Cai , Dong Xia

We introduce a notion of self-concordant smoothing for minimizing the sum of two convex functions, one of which is smooth and the other nonsmooth. The key highlight is a natural property of the resulting problem's structure that yields a…

Optimization and Control · Mathematics 2025-12-01 Adeyemi D. Adeoye , Alberto Bemporad

We provide some basic and sensible definitions of different types of digital twins and recommendations on when and how to use them. Following up on our recent publication of the Learning Causal Digital Twin, this article reports on a…

Machine Learning · Computer Science 2021-05-12 PG Madhavan

This paper introduces two new algorithms to accurately estimate the process noise covariance of a discrete-time Kalman filter online for robust orbit determination in the presence of dynamics model uncertainties. Common orbit determination…

Signal Processing · Electrical Eng. & Systems 2021-05-17 Nathan Stacey , Simone D'Amico

In this paper, we use the optimization formulation of nonlinear Kalman filtering and smoothing problems to develop second-order variants of iterated Kalman smoother (IKS) methods. We show that Newton's method corresponds to a recursion over…

Signal Processing · Electrical Eng. & Systems 2023-06-16 Fatemeh Yaghoobi , Hany Abdulsamad , Simo Särkkä

For recursive circular filtering based on circular statistics, we introduce a general framework for estimation of a circular state based on different circular distributions, specifically the wrapped normal distribution and the von Mises…

Systems and Control · Computer Science 2018-01-01 Gerhard Kurz , Igor Gilitschenski , Uwe D. Hanebeck

Constrained second-order convex optimization algorithms are the method of choice when a high accuracy solution to a problem is needed, due to their local quadratic convergence. These algorithms require the solution of a constrained…

Optimization and Control · Mathematics 2025-06-13 Alejandro Carderera , Sebastian Pokutta

Estimating the state of a dynamical system from a series of noise-corrupted observations is fundamental in many areas of science and engineering. The most well-known method, the Kalman smoother (and the related Kalman filter), relies on…

Machine Learning · Statistics 2017-04-24 Luca Ambrogioni , Umut Güçlü , Eric Maris , Marcel van Gerven

Two-time-scale Stochastic Approximation (SA) is an iterative algorithm with applications in reinforcement learning and optimization. Prior finite time analysis of such algorithms has focused on fixed point iterations with mappings…

Machine Learning · Computer Science 2025-09-30 Siddharth Chandak , Shaan Ul Haque , Nicholas Bambos

Symbolic regression (SR) has emerged as a pivotal technique for uncovering the intrinsic information within data and enhancing the interpretability of AI models. However, current state-of-the-art (sota) SR methods struggle to perform…

Machine Learning · Computer Science 2025-01-03 Chenglu Sun , Shuo Shen , Wenzhi Tao , Deyi Xue , Zixia Zhou

The goal of this paper is to study approaches to bridge the gap between first-order and second-order type methods for composite convex programs. Our key observations are: i) Many well-known operator splitting methods, such as…

Optimization and Control · Mathematics 2016-09-27 Xiantao Xiao , Yongfeng Li , Zaiwen Wen , Liwei Zhang

The Kalman filter (KF) provides optimal recursive state estimates for linear-Gaussian systems and underpins applications in control, signal processing, and others. However, it is vulnerable to outliers in the measurements and process noise.…

Systems and Control · Electrical Eng. & Systems 2025-07-02 Alan Yang , Stephen Boyd

This paper proposes low-complexity algorithms for finding approximate second-order stationary points (SOSPs) of problems with smooth non-convex objective and linear constraints. While finding (approximate) SOSPs is computationally…

Optimization and Control · Mathematics 2019-07-11 Songtao Lu , Meisam Razaviyayn , Bo Yang , Kejun Huang , Mingyi Hong

In this paper, a two-grid temporal second-order scheme for the two-dimensional nonlinear Volterra integro-differential equation with weakly singular kernel is proposed to reduce the computation time and improve the accuracy of the scheme…

Numerical Analysis · Mathematics 2022-09-02 Hao Chen , Mahmoud A. Zaky , Ahmed S. Hendy , Wenlin Qiu

We present a machine learning-based mesh refinement technique for steady and unsteady flows. The clustering technique proposed by Otmani et al. arXiv:2207.02929 [physics.flu-dyn] is used to mark the viscous and turbulent regions for the…

Fluid Dynamics · Physics 2022-09-07 Kenza Tlales , Kheir-Eddine Otmani , Gerasimos Ntoukas , Gonzalo Rubio , Esteban Ferrer

This paper proposes an estimation framework to assess the performance of sorting over perturbed/noisy data. In particular, the recovering accuracy is measured in terms of Minimum Mean Square Error (MMSE) between the values of the sorting…

Information Theory · Computer Science 2019-09-04 Alex Dytso , Martina Cardone , H. Vincent Poor