English
Related papers

Related papers: Parallel black-box optimization of expensive high-…

200 papers

We consider black-box optimization in which only an extremely limited number of function evaluations, on the order of around 100, are affordable and the function evaluations must be performed in even fewer batches of a limited number of…

Machine Learning · Computer Science 2021-03-19 Carlos Ansotegui , Meinolf Sellmann , Tapan Shah , Kevin Tierney

Meta-black-box optimization has been significantly advanced through the use of large language models (LLMs), yet in fancy on constrained evolutionary optimization. In this work, AwesomeDE is proposed that leverages LLMs as the strategy of…

Neural and Evolutionary Computing · Computer Science 2026-03-11 Xu Yang , Rui Wang , Kaiwen Li , Wenhua Li , Weixiong Huang

Molecular optimization is a key challenge in drug discovery and material science domain, involving the design of molecules with desired properties. Existing methods focus predominantly on single-property optimization, necessitating…

Machine Learning · Computer Science 2024-09-13 Aye Phyu Phyu Aung , Jay Chaudhary , Ji Wei Yoon , Senthilnath Jayavelu

High-dimensional partial differential equations (PDE) appear in a number of models from the financial industry, such as in derivative pricing models, credit valuation adjustment (CVA) models, or portfolio optimization models. The PDEs in…

Numerical Analysis · Mathematics 2020-07-15 Christian Beck , Weinan E , Arnulf Jentzen

Divide and Conquer (DC) is conceptually well suited to high-dimensional optimization by decomposing a problem into multiple small-scale sub-problems. However, appealing performance can be seldom observed when the sub-problems are…

Artificial Intelligence · Computer Science 2018-07-12 Peng Yang , Ke Tang , Xin Yao

In this paper we consider parallelization for applications whose objective can be expressed as maximizing a non-monotone submodular function under a cardinality constraint. Our main result is an algorithm whose approximation is arbitrarily…

Data Structures and Algorithms · Computer Science 2018-07-31 Eric Balkanski , Adam Breuer , Yaron Singer

We consider the classical problems of interpolating a polynomial given a black box for evaluation, and of multiplying two polynomials, in the setting where the bit-lengths of the coefficients may vary widely, so-called unbalanced…

Symbolic Computation · Computer Science 2024-10-22 Pascal Giorgi , Bruno Grenet , Armelle Perret du Cray , Daniel S. Roche

Learning to Optimize (L2O) approaches, including algorithm unrolling, plug-and-play methods, and hyperparameter learning, have garnered significant attention and have been successfully applied to the Alternating Direction Method of…

Optimization and Control · Mathematics 2024-09-27 Ling Liang , Cameron Austin , Haizhao Yang

Multi-objective optimization is a crucial matter in computer systems design space exploration because real-world applications often rely on a trade-off between several objectives. Derivatives are usually not available or impractical to…

Machine Learning · Computer Science 2019-07-26 Luigi Nardi , David Koeplinger , Kunle Olukotun

We consider non-monotone DR-submodular function maximization, where DR-submodularity (diminishing return submodularity) is an extension of submodularity for functions over the integer lattice based on the concept of the diminishing return…

Data Structures and Algorithms · Computer Science 2016-12-06 Tasuku Soma , Yuichi Yoshida

An optimization algorithm for nonsmooth nonconvex constrained optimization problems with upper-C2 objective functions is proposed and analyzed. Upper-C2 is a weakly concave property that exists in difference of convex (DC) functions and…

Optimization and Control · Mathematics 2022-04-21 Jingyi Wang , Cosmin G. Petra

Promoting and maintaining diversity of candidate solutions is a key requirement of evolutionary algorithms in general and multi-objective evolutionary algorithms in particular. In this paper, we use the recently developed theory of…

Neural and Evolutionary Computing · Computer Science 2023-03-15 Steve Huntsman

We consider the problem of maximizing a monotone nondecreasing set function under multiple constraints, where the constraints are also characterized by monotone nondecreasing set functions. We propose two greedy algorithms to solve the…

Optimization and Control · Mathematics 2023-05-09 Lintao Ye , Zhi-Wei Liu , Ming Chi , Vijay Gupta

The theory of magnitude provides a mathematical framework for quantifying and maximizing diversity. We apply this framework to formulate quality-diversity algorithms in generic dissimilarity spaces. In particular, we instantiate and…

Artificial Intelligence · Computer Science 2023-11-30 Steve Huntsman

A multi-modal multi-objective optimization problem is a special kind of multi-objective optimization problem with multiple Pareto subsets. In this paper, we propose an efficient multi-modal multi-objective optimization algorithm based on…

Neural and Evolutionary Computing · Computer Science 2020-04-22 Yiming Peng , Hisao Ishibuchi

Large language models (LLMs) have demonstrated exceptional performance not only in natural language processing tasks but also in a great variety of non-linguistic domains. In diverse optimization scenarios, there is also a rising trend of…

Neural and Evolutionary Computing · Computer Science 2024-07-09 Beichen Huang , Xingyu Wu , Yu Zhou , Jibin Wu , Liang Feng , Ran Cheng , Kay Chen Tan

We consider the problem of distributionally robust multimodal machine learning. Existing approaches often rely on merging modalities on the feature level (early fusion) or heuristic uncertainty modeling, which downplays modality-aware…

Machine Learning · Computer Science 2025-11-11 Peilin Yang , Yu Ma

This note provides upper bounds on the number of operations required to compute by value iterations a nearly optimal policy for an infinite-horizon discounted Markov decision process with a finite number of states and actions. For a given…

Optimization and Control · Mathematics 2020-01-29 Eugene A. Feinberg , Gaojin He

Solving large-scale robust portfolio optimization problems is challenging due to the high computational demands associated with an increasing number of assets, the amount of data considered, and market uncertainty. To address this issue, we…

Computational Finance · Quantitative Finance 2024-08-16 Chung-Han Hsieh , Jie-Ling Lu

In machine learning and big data, the optimization objectives based on set-cover, entropy, diversity, influence, feature selection, etc. are commonly modeled as submodular functions. Submodular (function) maximization is generally NP-hard,…

Data Structures and Algorithms · Computer Science 2022-12-13 Haotian Zhang , Rao Li , Zewei Wu , Guodong Sun