English
Related papers

Related papers: Bayesian BiLO: Bilevel Local Operator Learning for…

200 papers

Data point selection (DPS) is becoming a critical topic in deep learning due to the ease of acquiring uncurated training data compared to the difficulty of obtaining curated or processed data. Existing approaches to DPS are predominantly…

Machine Learning · Computer Science 2024-11-07 Xinnuo Xu , Minyoung Kim , Royson Lee , Brais Martinez , Timothy Hospedales

Bilevel optimization is a hierarchical framework where an upper-level optimization problem is constrained by a lower-level problem, commonly used in machine learning applications such as hyperparameter optimization. Existing bilevel…

Optimization and Control · Mathematics 2026-03-03 Yuman Wu , Xiaochuan Gong , Jie Hao , Mingrui Liu

We explore using neural operators, or neural network representations of nonlinear maps between function spaces, to accelerate infinite-dimensional Bayesian inverse problems (BIPs) with models governed by nonlinear parametric partial…

Numerical Analysis · Mathematics 2023-05-03 Lianghao Cao , Thomas O'Leary-Roseberry , Prashant K. Jha , J. Tinsley Oden , Omar Ghattas

Bilevel learning has gained prominence in machine learning, inverse problems, and imaging applications, including hyperparameter optimization, learning data-adaptive regularizers, and optimizing forward operators. The large-scale nature of…

Optimization and Control · Mathematics 2025-05-20 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

Specifying a governing physical model in the presence of missing physics and recovering its parameters are two intertwined and fundamental problems in science. Modern machine learning allows one to circumvent these, via emulators and…

Machine Learning · Computer Science 2020-06-30 Daniel J. Tait , Theodoros Damoulas

Bayesian optimization (BO) is a popular method to optimize costly black-box functions. While traditional BO optimizes each new target task from scratch, meta-learning has emerged as a way to leverage knowledge from related tasks to optimize…

Machine Learning · Computer Science 2024-07-01 Jiarong Pan , Stefan Falkner , Felix Berkenkamp , Joaquin Vanschoren

Inverse optimization (IO) is used to estimate unknown parameters of an optimization model from observed decisions. In the data-driven context, the estimated parameters are inherently uncertain, yet quantifying this uncertainty has received…

Optimization and Control · Mathematics 2026-05-26 Timothy C. Y. Chan , Nathan Sandholtz , Nasrin Yousefi

Bayesian Optimization (BO) is a powerful tool for optimizing complex non-linear systems. However, its performance degrades in high-dimensional problems with tightly coupled parameters and highly asymmetric objective landscapes, where…

Machine Learning · Computer Science 2026-02-12 Aashwin Mishra , Matt Seaberg , Ryan Roussel , Daniel Ratner , Apurva Mehta

Bayesian modelling allows for the quantification of predictive uncertainty which is crucial in safety-critical applications. Yet for many machine learning (ML) algorithms, it is difficult to construct or implement their Bayesian…

Machine Learning · Statistics 2024-10-22 Ziyu Wang , Chris Holmes

Bilevel optimization (BO) is useful for solving a variety of important machine learning problems including but not limited to hyperparameter optimization, meta-learning, continual learning, and reinforcement learning. Conventional BO…

Machine Learning · Computer Science 2022-09-20 Mao Ye , Bo Liu , Stephen Wright , Peter Stone , Qiang Liu

Neural operators are a type of deep architecture that learns to solve (i.e. learns the nonlinear solution operator of) partial differential equations (PDEs). The current state of the art for these models does not provide explicit…

Machine Learning · Computer Science 2022-08-03 Emilia Magnani , Nicholas Krämer , Runa Eschenhagen , Lorenzo Rosasco , Philipp Hennig

We propose a Bayesian uncertainty quantification method for large-scale imaging inverse problems. Our method applies to all Bayesian models that are log-concave, where maximum-a-posteriori (MAP) estimation is a convex optimization problem.…

Methodology · Statistics 2018-11-07 Audrey Repetti , Marcelo Pereyra , Yves Wiaux

Machine learning methods for computational imaging require uncertainty estimation to be reliable in real settings. While Bayesian models offer a computationally tractable way of recovering uncertainty, they need large data volumes to be…

Machine Learning · Computer Science 2020-08-24 Francesco Tonolini , Jack Radford , Alex Turpin , Daniele Faccio , Roderick Murray-Smith

Despite their widespread use, large language models (LLMs) are known to hallucinate incorrect information and be poorly calibrated. This makes the uncertainty quantification of these models of critical importance, especially in high-stakes…

Machine Learning · Computer Science 2025-06-27 Colin Samplawski , Adam D. Cobb , Manoj Acharya , Ramneet Kaur , Susmit Jha

Bilevel optimization has emerged as a technique for addressing a wide range of machine learning problems that involve an outer objective implicitly determined by the minimizer of an inner problem. While prior works have primarily focused on…

Machine Learning · Computer Science 2025-11-18 Fares El Khoury , Edouard Pauwels , Samuel Vaiter , Michael Arbel

As the size of quantum devices continues to grow, the development of scalable methods to characterise and diagnose noise is becoming an increasingly important problem. Recent methods have shown how to efficiently estimate Hamiltonians in…

Quantum Physics · Physics 2019-12-18 Tim J. Evans , Robin Harper , Steven T. Flammia

Variational regularization techniques are dominant in the field of mathematical imaging. A drawback of these techniques is that they are dependent on a number of parameters which have to be set by the user. A by now common strategy to…

Optimization and Control · Mathematics 2020-12-10 Matthias J. Ehrhardt , Lindon Roberts

Bayesian estimation approaches, which are capable of combining the information of experimental data from different likelihood functions to achieve high precisions, have been widely used in phase estimation via introducing a controllable…

Quantum Physics · Physics 2021-07-02 Yuxiang Qiu , Min Zhuang , Jiahao Huang , Chaohong Lee

Bilevel optimization is a central tool in machine learning for high-dimensional hyperparameter tuning. Its applications are vast; for instance, in imaging it can be used for learning data-adaptive regularizers and optimizing forward…

Optimization and Control · Mathematics 2025-11-11 Mohammad Sadegh Salehi , Subhadip Mukherjee , Lindon Roberts , Matthias J. Ehrhardt

Regularization techniques are crucial to improving the generalization performance and training efficiency of deep neural networks. Many deep learning algorithms rely on weight decay, dropout, batch/layer normalization to converge faster and…

Machine Learning · Computer Science 2025-05-23 Peng Lu , Ahmad Rashid , Ivan Kobyzev , Mehdi Rezagholizadeh , Philippe Langlais