English
Related papers

Related papers: ODBO: Bayesian Optimization with Search Space Pres…

200 papers

Bayesian optimization is a broadly applied methodology to optimize the expensive black-box function. Despite its success, it still faces the challenge from the high-dimensional search space. To alleviate this problem, we propose a novel…

Machine Learning · Computer Science 2020-10-20 Jingfan Chen , Guanghui Zhu , Chunfeng Yuan , Yihua Huang

Selecting the optimal combination of a machine learning (ML) algorithm and its hyper-parameters is crucial for the development of high-performance ML systems. However, since the combination of ML algorithms and hyper-parameters is enormous,…

Machine Learning · Computer Science 2025-02-14 Kazuki Ishikawa , Ryota Ozaki , Yohei Kanzaki , Ichiro Takeuchi , Masayuki Karasuyama

Automatic Chemical Design is a framework for generating novel molecules with optimized properties. The original scheme, featuring Bayesian optimization over the latent space of a variational autoencoder, suffers from the pathology that it…

Machine Learning · Statistics 2019-08-13 Ryan-Rhys Griffiths , José Miguel Hernández-Lobato

Prompt engineering has proven to be a crucial step in leveraging pretrained large language models (LLMs) in solving various real-world tasks. Numerous solutions have been proposed that seek to automate prompt engineering by using the model…

Protein is linked to almost every life process. Therefore, analyzing the biological structure and property of protein sequences is critical to the exploration of life, as well as disease detection and drug discovery. Traditional protein…

Machine Learning · Computer Science 2021-12-08 Yijia Xiao , Jiezhong Qiu , Ziang Li , Chang-Yu Hsieh , Jie Tang

Navigating vast, rugged biological fitness landscapes to discover high-value functional patterns-such as optimal protein sequences-is a central challenge in health informatics. However, conventional algorithms often struggle with the…

Neural and Evolutionary Computing · Computer Science 2025-11-25 Xu Wang , Yiquan Wang , Tin-Yeh Huang , Yuhua Dong , Jia Deng , Longji Xu , Xiang Li , Rui He

We present a multi-objective binder design paradigm based on instruction fine-tuning and direct preference optimization (DPO) of autoregressive protein language models (pLMs). Multiple design objectives are encoded in the language model…

Biological Physics · Physics 2024-03-08 Pouria Mistani , Venkatesh Mysore

Many real world scientific and industrial applications require optimizing multiple competing black-box objectives. When the objectives are expensive-to-evaluate, multi-objective Bayesian optimization (BO) is a popular approach because of…

Machine Learning · Computer Science 2022-06-17 Samuel Daulton , David Eriksson , Maximilian Balandat , Eytan Bakshy

Designing proteins with desired functions or properties represents a core goal in synthetic biology and drug discovery. Recent advances in protein language models (PLMs) have enabled the generation of highly designable protein sequences,…

Machine Learning · Computer Science 2026-05-12 Yulin Zhang , He Cao , Zihao Jiang , Chenyi Zi , Zhipeng Zhou , Zijing Liu , Yu Li , Jia Li , Ziqi Gao

Bayesian Optimization (BO) is a powerful tool for optimizing complex non-linear systems. However, its performance degrades in high-dimensional problems with tightly coupled parameters and highly asymmetric objective landscapes, where…

Machine Learning · Computer Science 2026-02-12 Aashwin Mishra , Matt Seaberg , Ryan Roussel , Daniel Ratner , Apurva Mehta

Directed evolution as a widely-used engineering strategy faces obstacles in finding desired mutants from the massive size of candidate modifications. While deep learning methods learn protein contexts to establish feasible searching space,…

Quantitative Methods · Quantitative Biology 2023-04-18 Bingxin Zhou , Outongyi Lv , Kai Yi , Xinye Xiong , Pan Tan , Liang Hong , Yu Guang Wang

Diffusion models have achieved promising results for Structure-Based Drug Design (SBDD). Nevertheless, high-quality protein subpocket and ligand data are relatively scarce, which hinders the models' generation capabilities. Recently, Direct…

Biomolecules · Quantitative Biology 2026-02-11 Xiwei Cheng , Xiangxin Zhou , Yuwei Yang , Yu Bao , Quanquan Gu

Protein sequence design methods have demonstrated strong performance in sequence generation for de novo protein design. However, as the training objective was sequence recovery, it does not guarantee designability--the likelihood that a…

Machine Learning · Computer Science 2025-06-03 Fanglei Xue , Andrew Kubaney , Zhichun Guo , Joseph K. Min , Ge Liu , Yi Yang , David Baker

Computational design problems arise in a number of settings, from synthetic biology to computer architectures. In this paper, we aim to solve data-driven model-based optimization (MBO) problems, where the goal is to find a design input that…

Machine Learning · Computer Science 2021-07-15 Brandon Trabucco , Aviral Kumar , Xinyang Geng , Sergey Levine

Bayesian Optimization (BO) in high-dimensional spaces remains fundamentally limited by the curse of dimensionality and the rigidity of global low-dimensional assumptions. While Random EMbedding Bayesian Optimization (REMBO) mitigates this…

Machine Learning · Statistics 2025-05-19 Yuejiang Wen , Paul D. Franzon

In applications such as molecule design or drug discovery, it is desirable to have an algorithm which recommends new candidate molecules based on the results of past tests. These molecules first need to be synthesized and then tested for…

Machine learning methods have been used to accelerate the molecule optimization process. However, efficient search for optimized molecules satisfying several properties with scarce labeled data remains a challenge for machine learning…

Biomolecules · Quantitative Biology 2022-12-20 Xin Xia , Yansen Su , Chunhou Zheng , Xiangxiang Zeng

As a variant of standard convolution, a dilated convolution can control effective receptive fields and handle large scale variance of objects without introducing additional computational costs. To fully explore the potential of dilated…

Computer Vision and Pattern Recognition · Computer Science 2021-05-11 Jie Liu , Chuming Li , Feng Liang , Chen Lin , Ming Sun , Junjie Yan , Wanli Ouyang , Dong Xu

The inverse folding problem, aiming to design amino acid sequences that fold into desired three-dimensional structures, is pivotal for various biotechnological applications. Here, we introduce a novel approach leveraging Direct Preference…

Machine Learning · Computer Science 2025-06-04 Junde Xu , Zijun Gao , Xinyi Zhou , Jie Hu , Xingyi Cheng , Le Song , Guangyong Chen , Pheng-Ann Heng , Jiezhong Qiu

To fully leverage the capabilities of diffusion models, we are often interested in optimizing downstream reward functions during inference. While numerous algorithms for reward-guided generation have been recently proposed due to their…

Machine Learning · Computer Science 2025-04-18 Masatoshi Uehara , Xingyu Su , Yulai Zhao , Xiner Li , Aviv Regev , Shuiwang Ji , Sergey Levine , Tommaso Biancalani