中文
相关论文

相关论文: Conflict-Averse Gradient Optimization of Ensembles…

200 篇论文

Consensus-based optimization (CBO) is a powerful and versatile zero-order multi-particle method designed to provably solve high-dimensional global optimization problems, including those that are genuinely nonconvex or nonsmooth. The method…

最优化与控制 · 数学 2026-02-13 Massimo Fornasier , Hui Huang , Jona Klemenc , Greta Malaspina

Online black-box optimization (BBO) aims to optimize an objective function by iteratively querying a black-box oracle in a sample-efficient way. While prior studies focus on forward approaches such as Gaussian Processes (GPs) to learn a…

机器学习 · 计算机科学 2025-02-04 Dongxia Wu , Nikki Lijing Kuang , Ruijia Niu , Yi-An Ma , Rose Yu

Multi-Modal Learning (MML) integrates information from diverse modalities to improve predictive accuracy. While existing optimization strategies have made significant strides by mitigating gradient direction conflicts, we revisit MML from a…

机器学习 · 计算机科学 2026-02-09 Peizheng Guo , Jingyao Wang , Wenwen Qiang , Jiahuan Zhou , Changwen Zheng , Gang Hua

Many challenges in science and engineering, such as drug discovery and communication network design, involve optimizing complex and expensive black-box functions across vast search spaces. Thus, it is essential to leverage existing data to…

机器学习 · 计算机科学 2024-12-04 Juncheng Dong , Zihao Wu , Hamid Jafarkhani , Ali Pezeshki , Vahid Tarokh

We study offline model-based optimization to maximize a black-box objective function with a static dataset of designs and scores. These designs encompass a variety of domains, including materials, robots and DNA sequences. A common approach…

计算工程、金融与科学 · 计算机科学 2023-10-11 Can Chen , Christopher Beckham , Zixuan Liu , Xue Liu , Christopher Pal

In offline model-based optimization, we strive to maximize a black-box objective function by only leveraging a static dataset of designs and their scores. This problem setting arises in numerous fields including the design of materials,…

计算工程、金融与科学 · 计算机科学 2023-03-07 Can Chen , Yingxue Zhang , Jie Fu , Xue Liu , Mark Coates

High-fidelity simulations, such as computational fluid dynamics and finite element analysis, are essential for modeling complex engineering systems but are often prohibitively expensive for tasks including parametric studies, optimization,…

机器学习 · 计算机科学 2026-05-07 Melika Baghi , Xiao Liu , Kamran Paynabar

Offline black-box optimization aims to maximize a black-box function using an offline dataset of designs and their measured properties. Two main approaches have emerged: the forward approach, which learns a mapping from input to its value,…

机器学习 · 计算机科学 2025-01-03 Can Sam Chen , Christopher Beckham , Zixuan Liu , Xue Liu , Christopher Pal

When gradient-based methods are impractical, black-box optimization (BBO) provides a valuable alternative. However, BBO often struggles with high-dimensional problems and limited trial budgets. In this work, we propose a novel approach…

系统与控制 · 电气工程与系统科学 2025-10-03 Riccardo Busetto , Manas Mejari , Marco Forgione , Alberto Bemporad , Dario Piga

Motivated by energy management for micro-grids, we study convex optimization problems with uncertainty in the objective function and sequential decision making. To solve these problems, we propose a new framework called ``Online…

最优化与控制 · 数学 2020-08-25 Martijn H. H. Schoot Uiterkamp , Marco E. T. Gerards , Johann L. Hurink

The goal of offline black-box optimization (BBO) is to optimize an expensive black-box function using a fixed dataset of function evaluations. Prior works consider forward approaches that learn surrogates to the black-box function and…

机器学习 · 计算机科学 2023-08-22 Siddarth Krishnamoorthy , Satvik Mehul Mashkaria , Aditya Grover

Offline optimization aims to maximize a black-box objective function with a static dataset and has wide applications. In addition to the objective function being black-box and expensive to evaluate, numerous complex real-world problems…

机器学习 · 计算机科学 2024-06-07 Ke Xue , Rong-Xi Tan , Xiaobin Huang , Chao Qian

Bayesian optimization (BO) is a powerful black-box optimization framework that looks to efficiently learn the global optimum of an unknown system by systematically trading-off between exploration and exploitation. However, the use of BO as…

最优化与控制 · 数学 2023-03-28 Dinesh Krishnamoorthy , Joel A. Paulson

In recent years, a variety of gradient-based methods have been developed to solve Bi-Level Optimization (BLO) problems in machine learning and computer vision areas. However, the theoretical correctness and practical effectiveness of these…

机器学习 · 计算机科学 2022-01-04 Risheng Liu , Pan Mu , Xiaoming Yuan , Shangzhi Zeng , Jin Zhang

Traditional approaches to portfolio optimization, often rooted in Modern Portfolio Theory and solved via quadratic programming or evolutionary algorithms, struggle with scalability or flexibility, especially in scenarios involving complex…

计算工程、金融与科学 · 计算机科学 2025-07-23 Christian Oliva , Pedro R. Ventura , Luis F. Lago-Fernández

We consider the online convex optimization (OCO) problem with quadratic and linear switching cost in the limited information setting, where an online algorithm can choose its action using only gradient information about the previous…

机器学习 · 计算机科学 2023-10-19 Spandan Senapati , Rahul Vaze

We consider the problem of offline reinforcement learning with model-based control, whose goal is to learn a dynamics model from the experience replay and obtain a pessimism-oriented agent under the learned model. Current model-based…

机器学习 · 计算机科学 2021-09-16 Ruizhen Liu , Dazhi Zhong , Zhicong Chen

Offline multi-objective optimization (MOO) aims to recover Pareto-optimal designs given a finite, static dataset. Recent generative approaches, including diffusion models, show strong performance under hypervolume, yet their behavior under…

Bayesian experimental design (BED) aims at designing an experiment to maximize the information gathering from the collected data. The optimal design is usually achieved by maximizing the mutual information (MI) between the data and the…

机器学习 · 计算机科学 2021-03-17 Jiaxin Zhang , Sirui Bi , Guannan Zhang

Offline model-based optimization aims to find a design that maximizes a property of interest using only an offline dataset, with applications in robot, protein, and molecule design, among others. A prevalent approach is gradient ascent,…

计算工程、金融与科学 · 计算机科学 2023-10-11 Ye Yuan , Can Chen , Zixuan Liu , Willie Neiswanger , Xue Liu