中文
相关论文

相关论文: Learning Representation for Bayesian Optimization …

200 篇论文

Bayesian optimization (BO) is a popular approach for sample-efficient optimization of black-box objective functions. While BO has been successfully applied to a wide range of scientific applications, traditional approaches to…

机器学习 · 计算机科学 2023-05-04 Natalie Maus , Kaiwen Wu , David Eriksson , Jacob Gardner

Simulators often require calibration inputs estimated from real world data and the quality of the estimate can significantly affect simulation output. Particularly when performing simulation optimisation to find an optimal solution, the…

机器学习 · 计算机科学 2020-06-02 Juan Ungredda , Michael Pearce , Juergen Branke

In the automation of many kinds of processes, the observable outcome can often be described as the combined effect of an entire sequence of actions, or controls, applied throughout its execution. In these cases, strategies to optimise…

机器人学 · 计算机科学 2019-04-05 Rafael Oliveira , Fernando H. M. Rocha , Lionel Ott , Vitor Guizilini , Fabio Ramos , Valdir Grassi

In representation learning (RL), how to make the learned representations easy to interpret and less overfitted to training data are two important but challenging issues. To address these problems, we study a new type of regulariza- tion…

机器学习 · 计算机科学 2017-11-28 Pengtao Xie , Hongbao Zhang , Eric P. Xing

Bayesian optimisation is a popular method for efficient optimisation of expensive black-box functions. Traditionally, BO assumes that the search space is known. However, in many problems, this assumption does not hold. To this end, we…

机器学习 · 统计学 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Huong Ha , Svetha Venkatesh

The large capacity of neural networks enables them to learn complex functions. To avoid overfitting, networks however require a lot of training data that can be expensive and time-consuming to collect. A common practical approach to…

机器学习 · 计算机科学 2020-03-10 Majed El Helou , Frederike Dümbgen , Sabine Süsstrunk

Online tuning of real-world plants is a complex optimisation problem that continues to require manual intervention by experienced human operators. Autonomous tuning is a rapidly expanding field of research, where learning-based methods,…

In high-dimensional settings, Bayesian optimization (BO) can be expensive and infeasible. The random embedding Bayesian optimization algorithm is commonly used to address high-dimensional BO challenges. However, this method relies on the…

机器学习 · 计算机科学 2024-08-12 Jiaming Lu , Rong J. B. Zhu

Local optimization presents a promising approach to expensive, high-dimensional black-box optimization by sidestepping the need to globally explore the search space. For objective functions whose gradient cannot be evaluated directly,…

机器学习 · 计算机科学 2023-01-18 Quan Nguyen , Kaiwen Wu , Jacob R. Gardner , Roman Garnett

Investigating the cognitive and neural mechanisms involved with face processing is a fundamental task in modern neuroscience and psychology. To date, the majority of such studies have focused on the use of pre-selected stimuli. The absence…

机器学习 · 计算机科学 2020-07-21 Pedro F. da Costa , Romy Lorenz , Ricardo Pio Monti , Emily Jones , Robert Leech

Extending the capabilities of robotics to real-world complex, unstructured environments requires the need of developing better perception systems while maintaining low sample complexity. When dealing with high-dimensional state spaces,…

计算机视觉与模式识别 · 计算机科学 2020-05-19 Yiming Ding , Ignasi Clavera , Pieter Abbeel

We investigate geometric regularization strategies for learned latent representations in encoder--decoder reduced-order models. In a fixed experimental setting for the advection--diffusion--reaction (ADR) equation, we model latent dynamics…

机器学习 · 计算机科学 2026-03-04 Mikhail Osipov

Randomized experiments are the gold standard for evaluating the effects of changes to real-world systems. Data in these tests may be difficult to collect and outcomes may have high variance, resulting in potentially large measurement error.…

机器学习 · 统计学 2018-06-27 Benjamin Letham , Brian Karrer , Guilherme Ottoni , Eytan Bakshy

Reinforcement learning (RL) aims to find an optimal policy by interaction with an environment. Consequently, learning complex behavior requires a vast number of samples, which can be prohibitive in practice. Nevertheless, instead of…

机器学习 · 计算机科学 2021-11-23 Sarah Müller , Alexander von Rohr , Sebastian Trimpe

Deeply-learned planning methods are often based on learning representations that are optimized for unrelated tasks. For example, they might be trained on reconstructing the environment. These representations are then combined with predictor…

机器学习 · 计算机科学 2021-03-18 Hlynur Davíð Hlynsson , Merlin Schüler , Robin Schiewer , Tobias Glasmachers , Laurenz Wiskott

Gradient-based meta-learning techniques are both widely applicable and proficient at solving challenging few-shot learning and fast adaptation problems. However, they have practical difficulties when operating on high-dimensional parameter…

机器学习 · 计算机科学 2019-03-27 Andrei A. Rusu , Dushyant Rao , Jakub Sygnowski , Oriol Vinyals , Razvan Pascanu , Simon Osindero , Raia Hadsell

We show that several machine learning estimators, including square-root LASSO (Least Absolute Shrinkage and Selection) and regularized logistic regression can be represented as solutions to distributionally robust optimization (DRO)…

统计理论 · 数学 2020-10-22 Jose Blanchet , Yang Kang , Karthyek Murthy

Many state estimation algorithms must be tuned given the state space process and observation models, the process and observation noise parameters must be chosen. Conventional tuning approaches rely on heuristic hand-tuning or gradient-based…

系统与控制 · 电气工程与系统科学 2019-12-19 Zhaozhong Chen , Nisar Ahmed , Simon Julier , Christoffer Heckman

Bayesian Optimization (BO) is a well-established method for addressing black-box optimization problems. In many real-world scenarios, optimization often involves multiple functions, emphasizing the importance of leveraging data and learned…

机器学习 · 计算机科学 2025-03-11 Khoa Nguyen , Viet Huynh , Binh Tran , Tri Pham , Tin Huynh , Thin Nguyen

Learning for control can acquire controllers for novel robotic tasks, paving the path for autonomous agents. Such controllers can be expert-designed policies, which typically require tuning of parameters for each task scenario. In this…

机器人学 · 计算机科学 2020-08-20 Akshara Rai , Rika Antonova , Franziska Meier , Christopher G. Atkeson