English
Related papers

Related papers: An adaptive approach to Bayesian Optimization with…

200 papers

Many approaches for optimizing decision making models rely on gradient based methods requiring informative feedback from the environment. However, in the case where such feedback is sparse or uninformative, such approaches may result in…

Machine Learning · Computer Science 2024-11-12 Mohit Rajpal , Lac Gia Tran , Yehong Zhang , Bryan Kian Hsiang Low

In this work, we study a single-machine scheduling problem that aims at minimizing the total cost of a schedule subject to start-time dependent costs. This framework naturally captures scenarios where costs fluctuate throughout the day,…

Optimization and Control · Mathematics 2026-04-17 Sofía Rodríguez-Ballesteros , Javier Alcaraz , Laura Anton-Sanchez , Marc Goerigk , Dorothee Henke

Bipartite ranking is an important supervised learning problem; however, unlike regression or classification, it has a quadratic dependence on the number of samples. To circumvent the prohibitive sample cost, many recent work focus on…

Machine Learning · Computer Science 2019-12-03 San Gultekin , John Paisley

Bayesian optimization (BO) is increasingly employed in critical applications such as materials design and drug discovery. An increasingly popular strategy in BO is to forgo the sole reliance on high-fidelity data and instead use an ensemble…

Machine Learning · Statistics 2023-03-22 Zahra Zanjani Foumani , Mehdi Shishehbor , Amin Yousefpour , Ramin Bostanabad

Bilevel optimization poses a significant computational challenge due to its nested structure, where each upper-level candidate solution requires solving a corresponding lower-level problem. While evolutionary algorithms (EAs) are effective…

Neural and Evolutionary Computing · Computer Science 2025-06-10 Dejun Xu , Jijia Chen , Gary G. Yen , Min Jiang

Bayesian optimization (BO) is a sample-efficient approach to optimizing costly-to-evaluate black-box functions. Most BO methods ignore how evaluation costs may vary over the optimization domain. However, these costs can be highly…

Machine Learning · Computer Science 2021-11-15 Raul Astudillo , Daniel R. Jiang , Maximilian Balandat , Eytan Bakshy , Peter I. Frazier

In this paper, we propose sparsity-aware data-selective adaptive filtering algorithms with adjustable penalties. Prior work incorporates a penalty function into the cost function used in the optimization that originates the algorithms to…

Data Structures and Algorithms · Computer Science 2017-08-08 André Flores , Rodrigo C. de Lamare

The design of multiple experiments is commonly undertaken via suboptimal strategies, such as batch (open-loop) design that omits feedback or greedy (myopic) design that does not account for future effects. This paper introduces new…

Methodology · Statistics 2016-04-29 Xun Huan , Youssef M. Marzouk

Automatic numerical algorithms attempt to provide approximate solutions that differ from exact solutions by no more than a user-specified error tolerance. The computational cost is often determined \emph{adaptively} by the algorithm based…

Numerical Analysis · Mathematics 2015-01-16 Nicholas Clancy , Yuhan Ding , Caleb Hamilton , Fred J. Hickernell , Yizhi Zhang

Optimal design is a critical yet challenging task within many applications. This challenge arises from the need for extensive trial and error, often done through simulations or running field experiments. Fortunately, sequential optimal…

Machine Learning · Computer Science 2025-03-25 Xubo Yue , Raed Al Kontar , Albert S. Berahas , Yang Liu , Blake N. Johnson

Many real-world classification problems are cost-sensitive in nature, such that the misclassification costs vary between data instances. Cost-sensitive learning adapts classification algorithms to account for differences in…

Machine Learning · Computer Science 2023-01-05 Natalie Lawrance , Marie-Anne Guerry , George Petrides

Software model optimization is the task of automatically generate design alternatives, usually to improve quality aspects of software that are quantifiable, like performance and reliability. In this context, multi-objective optimization…

Software Engineering · Computer Science 2024-01-31 Daniele Di Pompeo , Michele Tucci

There has been a surge in interest in data-driven experimental design with applications to chemical engineering and drug manufacturing. Bayesian optimization (BO) has proven to be adaptable to such cases, since we can model the reactions of…

Bayesian optimization (BO) algorithms try to optimize an unknown function that is expensive to evaluate using minimum number of evaluations/experiments. Most of the proposed algorithms in BO are sequential, where only one experiment is…

Machine Learning · Computer Science 2011-10-18 Javad Azimi , Ali Jalali , Xiaoli Fern

Bayesian Optimization (BO) is a widely-used method for optimizing expensive-to-evaluate black-box functions. Traditional BO assumes that the learner has full control over all query variables without additional constraints. However, in many…

Machine Learning · Computer Science 2024-12-23 Vu Viet Hoang , Quoc Anh Hoang Nguyen , Hung Tran The

We show that the optimal decision policy for several types of Bayesian sequential detection problems has a threshold switching curve structure on the space of posterior distributions. This is established by using lattice programming and…

Information Theory · Computer Science 2015-03-17 Vikram Krishnamurthy

Software model optimization is a process that automatically generates design alternatives aimed at improving quantifiable non-functional properties of software systems, such as performance and reliability. Multi-objective evolutionary…

Software Engineering · Computer Science 2025-11-04 J. Andres Diaz-Pace , Daniele Di Pompeo , Michele Tucci

Taking inspiration from how the brain coordinates multiple learning systems is an appealing strategy to endow robots with more flexibility. One of the expected advantages would be for robots to autonomously switch to the least costly system…

Robotics · Computer Science 2020-07-17 Rémi Dromnelle , Erwan Renaudo , Guillaume Pourcel , Raja Chatila , Benoît Girard , Mehdi Khamassi

The high simulation cost has been a bottleneck of practical analog/mixed-signal design automation. Many learning-based algorithms require thousands of simulated data points, which is impractical for expensive to simulate circuits. We…

Machine Learning · Computer Science 2023-11-30 Ahmet F. Budak , Keren Zhu , David Z. Pan

The performance of algorithmic decision rules is largely dependent on the quality of training datasets available to them. Biases in these datasets can raise economic and ethical concerns due to the resulting algorithms' disparate treatment…

Machine Learning · Computer Science 2025-04-14 Yifan Yang , Yang Liu , Parinaz Naghizadeh