English
Related papers

Related papers: Safe Active Learning for Gaussian Differential Equ…

200 papers

Sequential learning methods, such as active learning and Bayesian optimization, aim to select the most informative data for task learning. In many applications, however, data selection is constrained by unknown safety conditions, motivating…

Machine Learning · Computer Science 2025-01-22 Cen-You Li , Olaf Duennbier , Marc Toussaint , Barbara Rakitsch , Christoph Zimmer

Due to its state-of-the-art estimation performance complemented by rigorous and non-conservative uncertainty bounds, Gaussian process regression is a popular tool for enhancing dynamical system models and coping with their inaccuracies.…

Systems and Control · Electrical Eng. & Systems 2025-02-05 Anna Scampicchio , Elena Arcari , Amon Lahr , Melanie N. Zeilinger

Change-point detection (CPD) is crucial for identifying abrupt shifts in data, which influence decision-making and efficient resource allocation across various domains. To address the challenges posed by the costly and time-intensive data…

Machine Learning · Computer Science 2023-12-07 Hao Zhao , Rong Pan

Solving partial differential equations (PDEs) is a fundamental problem in science and engineering. While neural PDE solvers can be more efficient than established numerical solvers, they often require large amounts of training data that is…

Machine Learning · Computer Science 2025-03-25 Daniel Musekamp , Marimuthu Kalimuthu , David Holzmüller , Makoto Takamoto , Mathias Niepert

A major problem with Active Learning (AL) is high training costs since models are typically retrained from scratch after every query round. We start by demonstrating that standard AL on neural networks with warm starting fails, both to…

Machine Learning · Computer Science 2023-12-14 Arnav Das , Gantavya Bhatt , Megh Bhalerao , Vianne Gao , Rui Yang , Jeff Bilmes

Labeled data can be expensive to acquire in several application domains, including medical imaging, robotics, and computer vision. To efficiently train machine learning models under such high labeling costs, active learning (AL) judiciously…

Machine Learning · Computer Science 2022-06-13 Konstantinos D. Polyzos , Qin Lu , Georgios B. Giannakis

The deep-learning-based least squares method has shown successful results in solving high-dimensional non-linear partial differential equations (PDEs). However, this method usually converges slowly. To speed up the convergence of this…

Numerical Analysis · Mathematics 2025-07-10 Wenhan Gao , Chunmei Wang

We consider the active learning problem where the goal is to learn an unknown function with low prediction error under an unknown Boltzmann distribution induced by the function itself. This self-induced weighting arises naturally in…

Machine Learning · Computer Science 2026-05-12 Jixiang Qing , Henry Moss , Matthias Sachs

Safe learning and optimization deals with learning and optimization problems that avoid, as much as possible, the evaluation of non-safe input points, which are solutions, policies, or strategies that cause an irrecoverable loss (e.g.,…

Machine Learning · Computer Science 2021-06-25 Youngmin Kim , Richard Allmendinger , Manuel López-Ibáñez

Active learning strives to reduce the need for costly data annotation, by repeatedly querying an annotator to label the most informative samples from a pool of unlabeled data, and then training a model from these samples. We identify two…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Jiarong Wei , Yancong Lin , Holger Caesar

Recently, Gaussian processes have been used to model the vector field of continuous dynamical systems, referred to as GPODEs, which are characterized by a probabilistic ODE equation. Bayesian inference for these models has been extensively…

Machine Learning · Computer Science 2025-08-11 Jian Xu , Shian Du , Junmei Yang , Xinghao Ding , John Paisley , Delu Zeng

In this paper, we propose a novel sequential data-driven method for dealing with equilibrium based chemical simulations, which can be seen as a specific machine learning approach called active learning. The underlying idea of our approach…

Machine Learning · Statistics 2024-01-26 Mary Savino , Céline Lévy-Leduc , Marc Leconte , Benoit Cochepin

Accurately solving partial differential equations (PDEs) is critical to understanding complex scientific and engineering phenomena, yet traditional numerical solvers are computationally expensive. Surrogate models offer a more efficient…

Machine Learning · Computer Science 2026-04-17 Yegon Kim , Hyunsu Kim , Gyeonghoon Ko , Juho Lee

Efficiently solving the Fokker-Planck equation (FPE) is crucial for understanding the probabilistic evolution of stochastic particles in dynamical systems, however, analytical solutions or density functions are only attainable in specific…

Computational Physics · Physics 2025-03-13 Xiaolong Wang , Jing Feng , Gege Wang , Tong Li , Yong Xu

Learning time-series models is useful for many applications, such as simulation and forecasting. In this study, we consider the problem of actively learning time-series models while taking given safety constraints into account. For…

Machine Learning · Computer Science 2024-02-12 Christoph Zimmer , Mona Meister , Duy Nguyen-Tuong

Reinforcement learning provides a framework for learning to control which actions to take towards completing a task through trial-and-error. In many applications observing interactions is costly, necessitating sample-efficient learning. In…

Machine Learning · Statistics 2020-11-04 Charles Gadd , Markus Heinonen , Harri Lähdesmäki , Samuel Kaski

Active learning (AL) has shown promise for being a particularly data-efficient machine learning approach. Yet, its performance depends on the application and it is not clear when AL practitioners can expect computational savings. Here, we…

Machine Learning · Computer Science 2024-08-22 Kunal Ghosh , Milica Todorović , Aki Vehtari , Patrick Rinke

Conventional active learning (AL) frameworks aim to reduce the cost of data annotation by actively requesting the labeling for the most informative data points. However, introducing AL to data hungry deep learning algorithms has been a…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Salman Mohamadi , Gianfranco Doretto , Donald A. Adjeroh

We propose an active learning method for discovering low-dimensional structure in high-dimensional Gaussian process (GP) tasks. Such problems are increasingly frequent and important, but have hitherto presented severe practical…

Machine Learning · Statistics 2013-10-28 Roman Garnett , Michael A. Osborne , Philipp Hennig

Active learning in computer experiments aims at allocating resources in an intelligent manner based on the already observed data to satisfy certain objectives such as emulating or optimizing a computationally expensive function. There are…

Methodology · Statistics 2025-01-24 Difan Song , V. Roshan Joseph