English
Related papers

Related papers: Limbo: A Fast and Flexible Library for Bayesian Op…

200 papers

Interactive Machine Learning (IML) seeks to integrate human expertise into machine learning processes. However, most existing algorithms cannot be applied to Realworld Scenarios because their state spaces and/or action spaces are limited to…

Robotics · Computer Science 2024-01-24 Nikolaus Feith , Elmar Rueckert

Bayesian Optimization (BO) has been recognized for its effectiveness in optimizing expensive and complex objective functions. Recent advancements in Latent Bayesian Optimization (LBO) have shown promise by integrating generative models such…

Machine Learning · Computer Science 2025-04-22 Seunghun Lee , Jinyoung Park , Jaewon Chu , Minseo Yoon , Hyunwoo J. Kim

Local optimization presents a promising approach to expensive, high-dimensional black-box optimization by sidestepping the need to globally explore the search space. For objective functions whose gradient cannot be evaluated directly,…

Machine Learning · Computer Science 2023-01-18 Quan Nguyen , Kaiwen Wu , Jacob R. Gardner , Roman Garnett

A software library for constructing and learning probabilistic models is presented. The library offers a set of building blocks from which a large variety of static and dynamic models can be built. These include hierarchical models for…

Mathematical Software · Computer Science 2012-07-09 Markus Harva , Tapani Raiko , Antti Honkela , Harri Valpola , Juha Karhunen

We develop the first Bayesian Optimization algorithm, BLOSSOM, which selects between multiple alternative acquisition functions and traditional local optimization at each step. This is combined with a novel stopping condition based on…

Machine Learning · Statistics 2018-05-23 Mark McLeod , Michael A. Osborne , Stephen J. Roberts

Theano is a Python library that allows to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. Since its introduction, it has been one of the most used CPU and GPU mathematical compilers -…

Symbolic Computation · Computer Science 2016-05-10 The Theano Development Team , Rami Al-Rfou , Guillaume Alain , Amjad Almahairi , Christof Angermueller , Dzmitry Bahdanau , Nicolas Ballas , Frédéric Bastien , Justin Bayer , Anatoly Belikov , Alexander Belopolsky , Yoshua Bengio , Arnaud Bergeron , James Bergstra , Valentin Bisson , Josh Bleecher Snyder , Nicolas Bouchard , Nicolas Boulanger-Lewandowski , Xavier Bouthillier , Alexandre de Brébisson , Olivier Breuleux , Pierre-Luc Carrier , Kyunghyun Cho , Jan Chorowski , Paul Christiano , Tim Cooijmans , Marc-Alexandre Côté , Myriam Côté , Aaron Courville , Yann N. Dauphin , Olivier Delalleau , Julien Demouth , Guillaume Desjardins , Sander Dieleman , Laurent Dinh , Mélanie Ducoffe , Vincent Dumoulin , Samira Ebrahimi Kahou , Dumitru Erhan , Ziye Fan , Orhan Firat , Mathieu Germain , Xavier Glorot , Ian Goodfellow , Matt Graham , Caglar Gulcehre , Philippe Hamel , Iban Harlouchet , Jean-Philippe Heng , Balázs Hidasi , Sina Honari , Arjun Jain , Sébastien Jean , Kai Jia , Mikhail Korobov , Vivek Kulkarni , Alex Lamb , Pascal Lamblin , Eric Larsen , César Laurent , Sean Lee , Simon Lefrancois , Simon Lemieux , Nicholas Léonard , Zhouhan Lin , Jesse A. Livezey , Cory Lorenz , Jeremiah Lowin , Qianli Ma , Pierre-Antoine Manzagol , Olivier Mastropietro , Robert T. McGibbon , Roland Memisevic , Bart van Merriënboer , Vincent Michalski , Mehdi Mirza , Alberto Orlandi , Christopher Pal , Razvan Pascanu , Mohammad Pezeshki , Colin Raffel , Daniel Renshaw , Matthew Rocklin , Adriana Romero , Markus Roth , Peter Sadowski , John Salvatier , François Savard , Jan Schlüter , John Schulman , Gabriel Schwartz , Iulian Vlad Serban , Dmitriy Serdyuk , Samira Shabanian , Étienne Simon , Sigurd Spieckermann , S. Ramana Subramanyam , Jakub Sygnowski , Jérémie Tanguay , Gijs van Tulder , Joseph Turian , Sebastian Urban , Pascal Vincent , Francesco Visin , Harm de Vries , David Warde-Farley , Dustin J. Webb , Matthew Willson , Kelvin Xu , Lijun Xue , Li Yao , Saizheng Zhang , Ying Zhang

Bayesian optimization has emerged as a strong candidate tool for global optimization of functions with expensive evaluation costs. However, due to the dynamic nature of research in Bayesian approaches, and the evolution of computing…

Applications · Statistics 2018-08-24 Ran Rubin

Massive multiple-input multiple-output (MIMO) has gained widespread popularity in recent years due to its ability to increase data rates, improve signal quality, and provide better coverage in challenging environments. In this paper, we…

Networking and Internet Architecture · Computer Science 2023-10-31 Yuhong Huang , Wenxin Li , Chengkang Pan , Shuai Hou , Xian Lu , Chunfeng Cui , Jingwei Wen , Jiaqi Xu , Chongyu Cao , Yin Ma , Hai Wei , Kai Wen

Bayesian optimization has recently emerged as a popular method for the sample-efficient optimization of expensive black-box functions. However, the application to high-dimensional problems with several thousand observations remains…

Machine Learning · Computer Science 2020-02-26 David Eriksson , Michael Pearce , Jacob R Gardner , Ryan Turner , Matthias Poloczek

Fine-tuning large language models (LLMs) with zeroth-order (ZO) optimization reduces memory by approximating gradients through function evaluations. However, existing methods essentially perform updates in a one-dimensional space, and…

Machine Learning · Computer Science 2026-01-19 Jian Feng , Zhihong Huang

Bayesian optimization (BO) is a powerful tool for scientific discovery in chemistry, yet its efficiency is often hampered by the sparse experimental data and vast search space. Here, we introduce ChemBOMAS: a large language model…

QUESO stands for Quantification of Uncertainty for Estimation, Simulation and Optimization and consists of algorithms and C++ classes intended for research in uncertainty quantification, including the solution of statistical inverse problem…

Machine learning has shown tremendous potential for improving the capabilities of network traffic analysis applications, often outperforming simpler rule-based heuristics. However, ML-based solutions remain difficult to deploy in practice.…

Networking and Internet Architecture · Computer Science 2025-05-02 Gerry Wan , Shinan Liu , Francesco Bronzino , Nick Feamster , Zakir Durumeric

Both computational and experimental material discovery bring forth the challenge of exploring multidimensional and often non-differentiable parameter spaces, such as phase diagrams of Hamiltonians with multiple interactions, composition…

Machine Learning · Computer Science 2024-02-22 Arpan Biswas , Sai Mani Prudhvi Valleti , Rama Vasudevan , Maxim Ziatdinov , Sergei V. Kalinin

Bayesian optimization (BO) is a powerful approach to sample-efficient optimization of black-box objective functions. However, the application of BO to areas such as recommendation systems often requires taking the interpretability and…

Machine Learning · Computer Science 2023-03-06 Sulin Liu , Qing Feng , David Eriksson , Benjamin Letham , Eytan Bakshy

We introduce COMBO - a fully neural NLP system for accurate part-of-speech tagging, morphological analysis, lemmatisation, and (enhanced) dependency parsing. It predicts categorical morphosyntactic features whilst also exposes their vector…

Computation and Language · Computer Science 2021-09-14 Mateusz Klimaszewski , Alina Wróblewska

Over the last three decades, a large number of evolutionary algorithms have been developed for solving multiobjective optimization problems. However, there lacks an up-to-date and comprehensive software platform for researchers to properly…

Neural and Evolutionary Computing · Computer Science 2017-10-19 Ye Tian , Ran Cheng , Xingyi Zhang , Yaochu Jin

Recent advances in large language models (LLMs) have enabled automated dataset labeling with minimal human supervision. While majority voting across multiple LLMs can improve label reliability by mitigating individual model biases, it…

Machine Learning · Computer Science 2025-12-16 Eray Can Elumar , Cem Tekin , Osman Yagan

Python has become the programming language of choice for research and industry projects related to data science, machine learning, and deep learning. Since optimization is an inherent part of these research fields, more optimization related…

Neural and Evolutionary Computing · Computer Science 2020-05-25 Julian Blank , Kalyanmoy Deb

This paper revisits the fundamental problem of monitoring the linearizability of concurrent stacks, queues, sets, and multisets. Given a history of a library implementing one of these abstract data types, the monitoring problem is to answer…

Programming Languages · Computer Science 2025-09-23 Parosh Aziz Abdulla , Samuel Grahn , Bengt Jonsson , Shankaranarayanan Krishna , Om Swostik Mishra