English
Related papers

Related papers: Cauchy-Gaussian Overbound for Heavy-tailed GNSS Me…

200 papers

For a class of uncertain systems, a non-overshooting sliding mode control is presented to make them globally exponentially stable and without overshoot. Even when the unknown stochastic disturbance exists, and the time-variant reference…

Systems and Control · Electrical Eng. & Systems 2024-05-14 Xinhua Wang , Xuerui Mao

Since the celebrated works of Russo and Zou (2016,2019) and Xu and Raginsky (2017), it has been well known that the generalization error of supervised learning algorithms can be bounded in terms of the mutual information between their input…

Machine Learning · Statistics 2022-07-20 Gábor Lugosi , Gergely Neu

We study high-probability convergence guarantees of learning on streaming data in the presence of heavy-tailed noise. In the proposed scenario, the model is updated in an online fashion, as new information is observed, without storing any…

Machine Learning · Computer Science 2024-05-02 Aleksandar Armacki , Pranay Sharma , Gauri Joshi , Dragana Bajovic , Dusan Jakovetic , Soummya Kar

Gravitational waves provide a powerful enhancement to our understanding of fundamental physics. To make the most of their detection we need to accurately model the entire process of their emission and propagation toward interferometers.…

General Relativity and Quantum Cosmology · Physics 2023-11-22 Thanasis Giannakopoulos , Nigel T. Bishop , David Hilditch , Denis Pollney , Miguel Zilhão

We consider the problem of estimating the state transition matrix of a linear time-invariant (LTI) system, given access to multiple independent trajectories sampled from the system. Several recent papers have conducted a non-asymptotic…

Systems and Control · Electrical Eng. & Systems 2025-05-29 Vinay Kanakeri , Aritra Mitra

3D Gaussian splatting has demonstrated impressive performance in real-time novel view synthesis. However, achieving successful reconstruction from RGB images generally requires multiple input views captured under static conditions. To…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Wei Sun , Qi Zhang , Yanzhao Zhou , Qixiang Ye , Jianbin Jiao , Yuan Li

The empirical evidence indicates that stochastic optimization with heavy-tailed gradient noise is more appropriate to characterize the training of machine learning models than that with standard bounded gradient variance noise. Most…

Machine Learning · Computer Science 2026-01-28 Hongxu Chen , Ke Wei , Xiaoming Yuan , Luo Luo

Gravitational wave detectors will need optimal signal-processing algorithms to extract weak signals from the detector noise. Most algorithms designed to date are based on the unrealistic assumption that the detector noise may be modeled as…

General Relativity and Quantum Cosmology · Physics 2009-11-07 Bruce Allen , Jolien D. E. Creighton , Eanna E. Flanagan , Joseph D. Romano

Global Navigation Satellite System (GNSS) is essential for autonomous driving systems, unmanned vehicles, and various location-based technologies, as it provides the precise geospatial information necessary for navigation and situational…

Robotics · Computer Science 2025-05-27 Jianan Lou , Rong Zhang

Global Navigation Satellite Systems (GNSS)-based positioning plays a crucial role in various applications, including navigation, transportation, logistics, mapping, and emergency services. Traditional GNSS positioning methods are…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Adyasha Mohanty , Grace Gao

Gradient compression has surfaced as a key technique to address the challenge of communication efficiency in distributed learning. In distributed deep learning, however, it is observed that gradient distributions are heavy-tailed, with…

Machine Learning · Computer Science 2024-02-07 Guangfeng Yan , Tan Li , Yuanzhang Xiao , Hanxu Hou , Linqi Song

We study large deviation upper bounds and mean-squared error (MSE) guarantees of a general framework of nonlinear stochastic gradient methods in the online setting, in the presence of heavy-tailed noise. Unlike existing works that rely on…

Machine Learning · Computer Science 2025-03-25 Aleksandar Armacki , Shuhua Yu , Dragana Bajovic , Dusan Jakovetic , Soummya Kar

Safety-critical navigation applications require that estimation errors be reliably quantified and bounded. This can be challenging for linear dynamic systems if the process noise or measurement errors have uncertain time correlation. In…

Signal Processing · Electrical Eng. & Systems 2020-09-22 Omar Garcia Crespillo , Mathieu Joerger , Steve Langel

Stochastic gradient descent (SGD) and its variants enable modern artificial intelligence. However, theoretical understanding lags far behind their empirical success. It is widely believed that SGD has a curious ability to avoid sharp local…

Machine Learning · Computer Science 2025-10-27 Xingyu Wang , Chang-Han Rhee

Randomized smoothing is a popular way of providing robustness guarantees against adversarial attacks: randomly-smoothed functions have a universal Lipschitz-like bound, allowing for robustness certificates to be easily computed. In this…

Machine Learning · Computer Science 2020-12-16 Alexander Levine , Aounon Kumar , Thomas Goldstein , Soheil Feizi

We present a novel approach to anomaly detection by integrating Generalized Hyperbolic (GH) processes into kernel-based methods. The GH distribution, known for its flexibility in modeling skewness, heavy tails, and kurtosis, helps to…

Machine Learning · Computer Science 2025-01-28 Pauline Bourigault , Danilo P. Mandic

In this paper, we propose robust stochastic algorithms for solving convex compositional problems of the form $f(\E_\xi g(\cdot; \xi)) + r(\cdot)$ by establishing {\bf sub-Gaussian confidence bounds} under weak assumptions about the tails of…

Machine Learning · Computer Science 2020-06-19 Yan Yan , Xin Man , Tianbao Yang

Global Navigation Satellite Systems enable precise localization and timing even for highly mobile devices, but legacy implementations provide only limited support for the new generation of security-enhanced signals. Inertial Measurement…

Cryptography and Security · Computer Science 2025-02-07 Tore Johansson , Marco Spanghero , Panos Papadimitratos

Understanding the generalization abilities of modern machine learning algorithms has been a major research topic over the past decades. In recent years, the learning dynamics of Stochastic Gradient Descent (SGD) have been related to…

Machine Learning · Statistics 2023-12-04 Benjamin Dupuis , Paul Viallard

Standard chance constrained control algorithms typically rely on the assumption that uncertainties in vehicle states obey Gaussian statistics. Highly nonlinear systems tend to disrupt Gaussianity, challenging standard chance-constrained…

Optimization and Control · Mathematics 2026-04-07 Ethan Burnett , Spencer Boone