English
Related papers

Related papers: Few-Shot Design Optimization by Exploiting Auxilia…

200 papers

Global optimization of expensive, derivative-free black-box functions requires extreme sample efficiency. While Bayesian optimization (BO) is the current state-of-the-art, its performance hinges on surrogate and acquisition function…

Extending Bayesian optimization to batch evaluation can enable the designer to make the most use of parallel computing technology. However, most of current batch approaches do not scale well with the batch size. That is, their performances…

Machine Learning · Computer Science 2025-04-25 Dawei Zhan , Zhaoxi Zeng , Shuoxiao Wei , Ping Wu

Contrastive self-supervised learning methods learn to map data points such as images into non-parametric representation space without requiring labels. While highly successful, current methods require a large amount of data in the training…

Computer Vision and Pattern Recognition · Computer Science 2022-06-23 Ali Lotfi Rezaabad , Sidharth Kumar , Sriram Vishwanath , Jonathan I. Tamir

Recent work has shown that label-efficient few-shot learning through self-supervision can achieve promising medical image segmentation results. However, few-shot segmentation models typically rely on prototype representations of the…

Image and Video Processing · Electrical Eng. & Systems 2022-03-07 Stine Hansen , Srishti Gautam , Robert Jenssen , Michael Kampffmeyer

Bayesian optimization is an approach to optimizing objective functions that take a long time (minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of less than 20 dimensions, and tolerates stochastic…

Machine Learning · Statistics 2018-07-10 Peter I. Frazier

Decision-making problems are commonly formulated as optimization problems, which are then solved to make optimal decisions. In this work, we consider the inverse problem where we use prior decision data to uncover the underlying…

Optimization and Control · Mathematics 2022-12-27 Rishabh Gupta , Qi Zhang

In real-world applications, users often favor structurally diverse design choices over one high-quality solution. It is hence important to consider more solutions that decision makers can compare and further explore based on additional…

Machine Learning · Computer Science 2025-04-02 Maria Laura Santoni , Elena Raponi , Aneta Neumann , Frank Neumann , Mike Preuss , Carola Doerr

Bayesian optimization (BO) has become an effective approach for black-box function optimization problems when function evaluations are expensive and the optimum can be achieved within a relatively small number of queries. However, many…

Machine Learning · Statistics 2018-08-06 Zi Wang , Clement Gehring , Pushmeet Kohli , Stefanie Jegelka

We study the few-shot learning (FSL) problem, where a model learns to recognize new objects with extremely few labeled training data per category. Most of previous FSL approaches resort to the meta-learning paradigm, where the model…

Computer Vision and Pattern Recognition · Computer Science 2021-09-08 Zejiang Hou , Sun-Yuan Kung

Black-box zero-th order optimization is a central primitive for applications in fields as diverse as finance, physics, and engineering. In a common formulation of this problem, a designer sequentially attempts candidate solutions, receiving…

Machine Learning · Computer Science 2024-07-08 Yunchuan Zhang , Sangwoo Park , Osvaldo Simeone

Black-box problems are common in real life like structural design, drug experiments, and machine learning. When optimizing black-box systems, decision-makers always consider multiple performances and give the final decision by comprehensive…

Machine Learning · Computer Science 2021-01-22 Wenjie Chen , Shengcai Liu , Ke Tang

We consider Bayesian optimization of the output of a network of functions, where each function takes as input the output of its parent nodes, and where the network takes significant time to evaluate. Such problems arise, for example, in…

Machine Learning · Computer Science 2022-01-03 Raul Astudillo , Peter I. Frazier

Domain experts often possess valuable physical insights that are overlooked in fully automated decision-making processes such as Bayesian optimisation. In this article we apply high-throughput (batch) Bayesian optimisation alongside…

Machine Learning · Computer Science 2023-12-06 Tom Savage , Ehecatl Antonio del Rio Chanona

In the ever-evolving era of Artificial Intelligence (AI), model performance has constituted a key metric driving innovation, leading to an exponential growth in model size and complexity. However, sustainability and energy efficiency have…

Autonomous agents interacting with the real world need to learn new concepts efficiently and reliably. This requires learning in a low-data regime, which is a highly challenging problem. We address this task by introducing a fast…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Ardhendu Shekhar Tripathi , Martin Danelljan , Luc Van Gool , Radu Timofte

Bayesian optimization is a sequential decision making framework for optimizing expensive-to-evaluate black-box functions. Computing a full lookahead policy amounts to solving a highly intractable stochastic dynamic program. Myopic…

Machine Learning · Computer Science 2020-06-30 Shali Jiang , Daniel R. Jiang , Maximilian Balandat , Brian Karrer , Jacob R. Gardner , Roman Garnett

Data collected from arrays of sensors are essential for informed decision-making in various systems. However, the presence of anomalies can compromise the accuracy and reliability of insights drawn from the collected data or information…

Applications · Statistics 2024-03-19 Katie Buchhorn , Kerrie Mengersen , Edgar Santos-Fernandez , James McGree

We introduce a class of acquisition functions for sample selection that leads to faster convergence in applications related to Bayesian experimental design and uncertainty quantification. The approach follows the paradigm of active…

Machine Learning · Statistics 2021-04-12 Antoine Blanchard , Themistoklis Sapsis

The field of visual few-shot classification aims at transferring the state-of-the-art performance of deep learning visual systems onto tasks where only a very limited number of training samples are available. The main solution consists in…

Computer Vision and Pattern Recognition · Computer Science 2023-01-18 Yassir Bendou , Lucas Drumetz , Vincent Gripon , Giulia Lioi , Bastien Pasdeloup

Among adversarial attacks against sequential recommender systems, model extraction attacks represent a method to attack sequential recommendation models without prior knowledge. Existing research has primarily concentrated on the…

Machine Learning · Computer Science 2026-03-04 Hui Zhang , Fu Liu