English
Related papers

Related papers: Adaptive Sampling for Discovery

200 papers

Efficient exploration remains a major challenge for reinforcement learning. One reason is that the variability of the returns often depends on the current state and action, and is therefore heteroscedastic. Classical exploration strategies…

Machine Learning · Computer Science 2019-03-26 Nikolay Nikolov , Johannes Kirschner , Felix Berkenkamp , Andreas Krause

Deep learning-based sequence models are extensively employed in Time Series Anomaly Detection (TSAD) tasks due to their effective sequential modeling capabilities. However, the ability of TSAD is limited by two key challenges: (i) the…

Machine Learning · Computer Science 2024-08-21 Junqi Chen , Xu Tan , Sylwan Rahardja , Jiawei Yang , Susanto Rahardja

The demands on visual recognition systems do not end with the complexity offered by current large-scale image datasets, such as ImageNet. In consequence, we need curious and continuously learning algorithms that actively acquire knowledge…

Computer Vision and Pattern Recognition · Computer Science 2016-12-20 Christoph Käding , Erik Rodner , Alexander Freytag , Joachim Denzler

Classification is an important task in many fields including biomedical research and machine learning. Traditionally, a classification rule is constructed based a bunch of labeled data. Recently, due to technological innovation and…

Methodology · Statistics 2014-06-19 Jing Wang , Eunsik Park , Yuan-chin Ivan Chang

This paper addresses performance degradation in anomalous sound detection (ASD) when neither sufficiently similar machine data nor operational state labels are available. We present an integrated pipeline that combines three complementary…

Sound · Computer Science 2025-05-27 Ibuki Kuroyanagi , Takuya Fujimura , Kazuya Takeda , Tomoki Toda

We introduce Deep Adaptive Design (DAD), a method for amortizing the cost of adaptive Bayesian experimental design that allows experiments to be run in real-time. Traditional sequential Bayesian optimal experimental design approaches…

Machine Learning · Statistics 2021-06-14 Adam Foster , Desi R. Ivanova , Ilyas Malik , Tom Rainforth

In many scientific settings there is a need for adaptive experimental design to guide the process of identifying regions of the search space that contain as many true positives as possible subject to a low rate of false discoveries (i.e.…

Machine Learning · Statistics 2020-08-18 Lalit Jain , Kevin Jamieson

Recent research in robot exploration and mapping has focused on sampling environmental hotspot fields. This exploration task is formalized by Low, Dolan, and Khosla (2008) in a sequential decision-theoretic planning under uncertainty…

Machine Learning · Computer Science 2013-05-28 Kian Hsiang Low , John M. Dolan , Pradeep Khosla

Learning causal structure from observational data is a fundamental challenge in machine learning. However, the majority of commonly used differentiable causal discovery methods are non-identifiable, turning this problem into a continuous…

Machine Learning · Computer Science 2022-09-30 Yu Wang , An Zhang , Xiang Wang , Yancheng Yuan , Xiangnan He , Tat-Seng Chua

We study an adaptive source seeking problem, in which a mobile robot must identify the strongest emitter(s) of a signal in an environment with background emissions. Background signals may be highly heterogeneous and can mislead algorithms…

Machine Learning · Computer Science 2020-06-25 Esther Rolf , David Fridovich-Keil , Max Simchowitz , Benjamin Recht , Claire Tomlin

Stochastic Gradient Descent (SGD) is one of the most widely used techniques for online optimization in machine learning. In this work, we accelerate SGD by adaptively learning how to sample the most useful training examples at each time…

Machine Learning · Computer Science 2016-03-16 Guillaume Bouchard , Théo Trouillon , Julien Perez , Adrien Gaidon

Out-of-distribution (OOD) detection, which aims to distinguish unknown classes from known classes, has received increasing attention recently. A main challenge within is the unavailable of samples from the unknown classes in the training…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Mingle Xu , Jaehwan Lee , Sook Yoon , Dong Sun Park

Discrete diffusion models (DDMs) have shown powerful generation ability for discrete data modalities like text and molecules. However, their practical application is hindered by inefficient sampling, requiring a large number of sampling…

Machine Learning · Computer Science 2025-09-25 Feiyang Fu , Tongxian Guo , Zhaoqiang Liu

Importance sampling has become an indispensable strategy to speed up optimization algorithms for large-scale applications. Improved adaptive variants - using importance values defined by the complete gradient information which changes…

Machine Learning · Computer Science 2017-11-08 Sebastian U. Stich , Anant Raj , Martin Jaggi

Anomaly detection (AD) plays a crucial role in time series applications, primarily because time series data is employed across real-world scenarios. Detecting anomalies poses significant challenges since anomalies take diverse forms making…

Machine Learning · Computer Science 2025-01-03 Jihan Ghanim , Mariette Awad

A stochastic search method, the so-called Adaptive Subspace (AdaSub) method, is proposed for variable selection in high-dimensional linear regression models. The method aims at finding the best model with respect to a certain model…

Computation · Statistics 2021-04-20 Christian Staerk , Maria Kateri , Ioannis Ntzoufras

Out-of-Distribution (OOD) detection is essential in real-world applications, which has attracted increasing attention in recent years. However, most existing OOD detection methods require many labeled In-Distribution (ID) data, causing a…

Machine Learning · Computer Science 2022-10-14 Yi-Xuan Sun , Wei Wang

Minimizing prediction uncertainty on unlabeled data is a key factor to achieve good performance in semi-supervised learning (SSL). The prediction uncertainty is typically expressed as the \emph{entropy} computed by the transformed…

Machine Learning · Computer Science 2021-12-16 Jing Li , Yuangang Pan , Ivor W. Tsang

Tuning of model-based boosting algorithms relies mainly on the number of iterations, while the step-length is fixed at a predefined value. For complex models with several predictors such as Generalized Additive Models for Location, Scale…

Methodology · Statistics 2021-02-19 Boyao Zhang , Tobias Hepp , Sonja Greven , Elisabeth Bergherr

Deep learning has emerged as an effective solution for solving the task of object detection in images but at the cost of requiring large labeled datasets. To mitigate this cost, semi-supervised object detection methods, which consist in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Renaud Vandeghen , Gilles Louppe , Marc Van Droogenbroeck