English
Related papers

Related papers: A Robust Probabilistic Approach to Stochastic Subs…

200 papers

The recent advancement of foundation models (FMs) has brought about a paradigm shift, revolutionizing various sectors worldwide. The popular optimizers used to train these models are stochastic gradient descent-based algorithms, which face…

Machine Learning · Computer Science 2026-01-06 Shenglong Zhou , Ouya Wang , Ziyan Luo , Yongxu Zhu , Geoffrey Ye Li

Recent years have witnessed a booming interest in data-driven control of dynamical systems. However, the implicit data-driven output predictors are vulnerable to uncertainty such as process disturbance and measurement noise, causing…

Optimization and Control · Mathematics 2024-07-08 Yibo Wang , Keyou You , Dexian Huang , Chao Shang

The focus in this paper is Bayesian system identification based on noisy incomplete modal data where we can impose spatially-sparse stiffness changes when updating a structural model. To this end, based on a similar hierarchical sparse…

Applications · Statistics 2017-02-07 Yong Huang , James L. Beck , Hui Li

This paper is on Bayesian inference for parametric statistical models that are defined by a stochastic simulator which specifies how data is generated. Exact sampling is then possible but evaluating the likelihood function is typically…

Machine Learning · Statistics 2020-03-02 Borislav Ikonomov , Michael U. Gutmann

Recent advances in robust semi-supervised learning (SSL) typically filter out-of-distribution (OOD) information at the sample level. We argue that an overlooked problem of robust SSL is its corrupted information on semantic level,…

Computer Vision and Pattern Recognition · Computer Science 2023-05-31 Yu Wang , Pengchong Qiao , Chang Liu , Guoli Song , Xiawu Zheng , Jie Chen

A number of problems in relational Artificial Intelligence can be viewed as Stochastic Constraint Optimization Problems (SCOPs). These are constraint optimization problems that involve objectives or constraints with a stochastic component.…

Artificial Intelligence · Computer Science 2018-07-04 Anna L. D. Latour , Behrouz Babaki , Siegfried Nijssen

Building on the recent trend of new deep generative models known as Normalizing Flows (NF), simulation-based inference (SBI) algorithms can now efficiently accommodate arbitrary complex and high-dimensional data distributions. The…

Machine Learning · Statistics 2022-11-28 Julia Linhart , Alexandre Gramfort , Pedro L. C. Rodrigues

To achieve the greatest possible speed, practitioners regularly implement randomized algorithms for low-rank approximation and least-squares regression with structured dimension reduction maps. Despite significant research effort, basic…

Data Structures and Algorithms · Computer Science 2025-09-01 Chris Camaño , Ethan N. Epperly , Raphael A. Meyer , Joel A. Tropp

Simulation-based inference (SBI) is emerging as a new statistical paradigm for addressing complex scientific inference problems. By leveraging the representational power of deep neural networks, SBI can extract the most informative…

Instrumentation and Methods for Astrophysics · Physics 2025-10-17 Huifang Lyu , James Alvey , Noemi Anau Montel , Mauro Pieroni , Christoph Weniger

Flagship near-future surveys targeting $10^8-10^9$ galaxies across cosmic time will soon reveal the processes of galaxy assembly in unprecedented resolution. This creates an immediate computational challenge on effective analyses of the…

Instrumentation and Methods for Astrophysics · Physics 2023-10-03 Bingjie Wang , Joel Leja , V. Ashley Villar , Joshua S. Speagle

Supervised operator learning centers on the use of training data, in the form of input-output pairs, to estimate maps between infinite-dimensional spaces. It is emerging as a powerful tool to complement traditional scientific computing,…

Machine Learning · Computer Science 2024-08-14 Nicholas H. Nelsen , Andrew M. Stuart

Self-organizing systems demonstrate how simple local rules can generate complex stochastic patterns. Many natural systems rely on such dynamics, making self-organization central to understanding natural complexity. A fundamental challenge…

Adaptation and Self-Organizing Systems · Physics 2026-01-12 Elias Najarro , Nicolas Bessone , Sebastian Risi

A new algorithm named EXPected Similarity Estimation (EXPoSE) was recently proposed to solve the problem of large-scale anomaly detection. It is a non-parametric and distribution free kernel method based on the Hilbert space embedding of…

Machine Learning · Computer Science 2015-11-18 Markus Schneider , Wolfgang Ertel , Günther Palm

In this paper, we analyze the finite sample complexity of stochastic system identification using modern tools from machine learning and statistics. An unknown discrete-time linear system evolves over time under Gaussian noise without…

Machine Learning · Computer Science 2019-03-22 Anastasios Tsiamis , George J. Pappas

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

The reliability of artificial intelligence (AI) systems in open-world settings depends heavily on their ability to flag out-of-distribution (OOD) inputs unseen during training. Recent advances in large-scale vision-language models (VLMs)…

Machine Learning · Computer Science 2025-10-14 Faizul Rakib Sayem , Shahana Ibrahim

Submodular optimization has become a fundamental paradigm for data selection, retrieval, summarization, and representation learning due to its ability to model coverage, diversity, and representativeness. However, classical submodular…

Machine Learning · Computer Science 2026-05-26 Rishabh Iyer

3D anomaly detection has recently become a significant focus in computer vision. Several advanced methods have achieved satisfying anomaly detection performance. However, they typically concentrate on the external structure of 3D samples…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Hanzhe Liang , Guoyang Xie , Chengbin Hou , Bingshu Wang , Can Gao , Jinbao Wang

We evaluate the robustness of a probabilistic formulation of system identification (ID) to sparse, noisy, and indirect data. Specifically, we compare estimators of future system behavior derived from the Bayesian posterior of a learning…

Machine Learning · Statistics 2023-01-02 Nicholas Galioto , Alex Gorodetsky

This note presents a unified analysis of the identification of dynamical systems with low-rank constraints under high-dimensional scaling. This identification problem for dynamic systems are challenging due to the intrinsic dependency of…

Statistics Theory · Mathematics 2019-12-23 Junlin Li