中文
相关论文

相关论文: BREATHE: Second-Order Gradients and Heteroscedasti…

200 篇论文

Bayesian Optimization (BO) has shown significant success in tackling expensive low-dimensional black-box optimization problems. Many optimization problems of interest are high-dimensional, and scaling BO to such settings remains an…

机器学习 · 统计学 2022-06-02 Eric Han , Ishank Arora , Jonathan Scarlett

Decision Tree (DT) Learning is a fundamental problem in Interpretable Machine Learning, yet it poses a formidable optimisation challenge. Practical algorithms have recently emerged, primarily leveraging Dynamic Programming and Branch &…

机器学习 · 计算机科学 2025-05-13 Ayman Chaouki , Jesse Read , Albert Bifet

Optimization of materials performance for specific applications often requires balancing multiple aspects of materials functionality. Even for the cases where generative physical model of material behavior is known and reliable, this often…

Bayesian Optimization (BO) for the minimization of expensive functions of continuous variables uses all the knowledge acquired from previous samples (${\boldsymbol x}_i$ and $f({\boldsymbol x}_i)$ values) to build a surrogate model based on…

数值分析 · 数学 2025-05-15 Roberto Battiti , Mauro Brunato

Bayesian optimization (BO) is a popular paradigm for global optimization of expensive black-box functions, but there are many domains where the function is not completely a black-box. The data may have some known structure (e.g. symmetries)…

机器学习 · 计算机科学 2022-12-08 Samuel Kim , Peter Y. Lu , Charlotte Loh , Jamie Smith , Jasper Snoek , Marin Soljačić

This paper presents novel mixed-type Bayesian optimization (BO) algorithms to accelerate the optimization of a target objective function by exploiting correlated auxiliary information of binary type that can be more cheaply obtained, such…

机器学习 · 统计学 2019-06-19 Yehong Zhang , Zhongxiang Dai , Kian Hsiang Low

Bayesian optimisation (BO) algorithms have shown remarkable success in applications involving expensive black-box functions. Traditionally BO has been set as a sequential decision-making process which estimates the utility of query points…

机器学习 · 计算机科学 2022-10-25 Rafael Oliveira , Louis Tiao , Fabio Ramos

Robots often need to solve path planning problems where essential and discrete aspects of the environment are partially observable. This introduces a multi-modality, where the robot must be able to observe and infer the state of its…

机器人学 · 计算机科学 2022-08-02 Camille Phiquepal , Andreas Orthey , Nicolas Viennot , Marc Toussaint

Computational models in fields such as computational neuroscience are often evaluated via stochastic simulation or numerical approximation. Fitting these models implies a difficult optimization problem over complex, possibly noisy parameter…

机器学习 · 统计学 2017-11-03 Luigi Acerbi , Wei Ji Ma

The early pioneering Neural Architecture Search (NAS) works were multi-trial methods applicable to any general search space. The subsequent works took advantage of the early findings and developed weight-sharing methods that assume a…

神经与进化计算 · 计算机科学 2022-02-18 Hyunghun Cho , Jungwook Shin , Wonjong Rhee

Heuristic search is often used for motion planning and pathfinding problems, for finding the shortest path in a graph while also promising completeness and optimal efficiency. The drawback is it's space complexity, specifically storing all…

人工智能 · 计算机科学 2024-06-10 Davor Bokan , Zlatan Ajanovic , Bakir Lacevic

Embedding a web-scale information network into a low-dimensional vector space facilitates tasks such as link prediction, classification, and visualization. Past research has addressed the problem of extracting such embeddings by adopting…

社会与信息网络 · 计算机科学 2018-03-14 Anton Tsitsulin , Davide Mottin , Panagiotis Karras , Emmanuel Müller

Bayesian Optimisation (BO) methods seek to find global optima of objective functions which are only available as a black-box or are expensive to evaluate. Such methods construct a surrogate model for the objective function, quantifying the…

机器学习 · 统计学 2023-01-10 Enrico Crovini , Simon L. Cotter , Konstantinos Zygalakis , Andrew B. Duncan

Bayesian optimization (BO) is an effective technique for black-box optimization. However, its applicability is typically limited to moderate-budget problems due to the cubic complexity of fitting the Gaussian process (GP) surrogate model.…

机器学习 · 统计学 2025-10-13 Qiyu Wei , Haowei Wang , Zirui Cao , Songhao Wang , Richard Allmendinger , Mauricio A Álvarez

Bayesian optimization (BO) is a model-based approach to sequentially optimize expensive black-box functions, such as the validation error of a deep neural network with respect to its hyperparameters. In many real-world scenarios, the…

We propose a method to incrementally learn an embedding space over the domain of network architectures, to enable the careful selection of architectures for evaluation during compressed architecture search. Given a teacher network, we…

计算机视觉与模式识别 · 计算机科学 2019-04-26 Shengcao Cao , Xiaofang Wang , Kris M. Kitani

For the last few decades, optimization has been developing at a fast rate. Bio-inspired optimization algorithms are metaheuristics inspired by nature. These algorithms have been applied to solve different problems in engineering, economics,…

人工智能 · 计算机科学 2014-07-17 Muhammad Marwan Muhammad Fuad

Bayesian optimization (BO) methods often rely on the assumption that the objective function is well-behaved, but in practice, this is seldom true for real-world objectives even if noise-free observations can be collected. Common approaches,…

Multi-Objective Evolutionary Algorithms (MOEAs) have proven effective at solving Multi-Objective Optimisation Problems (MOOPs). However, their performance can be significantly hindered when applied to computationally intensive industrial…

神经与进化计算 · 计算机科学 2026-01-30 Tiwonge Msulira Banda , Alexandru-Ciprian Zăvoianu

This work addresses a Multi-Objective Shortest Path Problem (MO-SPP) on a graph where the goal is to find a set of Pareto-optimal solutions from a start node to a destination in the graph. A family of approaches based on MOA* have been…

人工智能 · 计算机科学 2022-05-31 Zhongqiang Ren , Richard Zhan , Sivakumar Rathinam , Maxim Likhachev , Howie Choset