English
Related papers

Related papers: Differentiable Extensions with Rounding Guarantees…

200 papers

In this paper, we propose the first continuous optimization algorithms that achieve a constant factor approximation guarantee for the problem of monotone continuous submodular maximization subject to a linear constraint. We first prove that…

Data Structures and Algorithms · Computer Science 2020-06-23 Moran Feldman , Amin Karbasi

The performance of multi-objective evolutionary algorithms deteriorates appreciably in solving many-objective optimization problems which encompass more than three objectives. One of the known rationales is the loss of selection pressure…

Neural and Evolutionary Computing · Computer Science 2018-02-27 Yanan Sun , Gary G. Yen , Zhang Yi

Bayesian optimization is a coherent, ubiquitous approach to decision-making under uncertainty, with applications including multi-arm bandits, active learning, and black-box optimization. Bayesian optimization selects decisions (i.e.…

Machine Learning · Computer Science 2023-12-13 Samuel Stanton , Wesley Maddox , Andrew Gordon Wilson

Although real-coded differential evolution (DE) algorithms can perform well on continuous optimization problems (CoOPs), it is still a challenging task to design an efficient binary-coded DE algorithm. Inspired by the learning mechanism of…

Neural and Evolutionary Computing · Computer Science 2014-05-13 Yu Chen , Weicheng Xie , Xiufen Zou

Solving inverse and optimization problems over solutions of nonlinear partial differential equations (PDEs) on complex spatial domains is a long-standing challenge. Here we introduce a method that parameterizes the solution using spectral…

Numerical Analysis · Mathematics 2025-10-30 James V. Roggeveen , Michael P. Brenner

Recent advances in learnable evolutionary algorithms have demonstrated the importance of leveraging population distribution information and historical evolutionary trajectories. While significant progress has been made in continuous…

Neural and Evolutionary Computing · Computer Science 2024-12-10 Jiaxiang Huang , Licheng Jiao

A tremendous range of design tasks in materials, physics, and biology can be formulated as finding the optimum of an objective function depending on many parameters without knowing its closed-form expression or the derivative. Traditional…

Machine Learning · Computer Science 2024-04-08 Ye Wei , Bo Peng , Ruiwen Xie , Yangtao Chen , Yu Qin , Peng Wen , Stefan Bauer , Po-Yen Tung

To solve large-scale or high-resolution topology optimization problem, a novel algorithm is developed based on modified bi-directional evolutionary structure optimization (BESO) and extended finite element method (XFEM). Within XFEM, a set…

Applied Physics · Physics 2026-04-07 Hongxin Wang , Jie Liu , Guilin Wen

We propose a distributionally robust approach to learning hyperparameters for first-order methods in convex optimization. Given a dataset of problem instances, we minimize a Wasserstein distributionally robust version of the performance…

Machine Learning · Computer Science 2026-05-08 Vinit Ranjan , Jisun Park , Bartolomeo Stellato

Submodular optimization generalizes many classic problems in combinatorial optimization and has recently found a wide range of applications in machine learning (e.g., feature engineering and active learning). For many large-scale…

Data Structures and Algorithms · Computer Science 2023-04-11 Matthew Fahrbach , Vahab Mirrokni , Morteza Zadimoghaddam

Evolutionary optimization is a generic population-based metaheuristic that can be adapted to solve a wide variety of optimization problems and has proven very effective for combinatorial optimization problems. However, the potential of this…

Multiagent Systems · Computer Science 2020-09-03 Saaduddin Mahmud , Moumita Choudhury , Md. Mosaddek Khan , Long Tran-Thanh , Nicholas R. Jennings

Several fundamental problems in science and engineering consist of global optimization tasks involving unknown high-dimensional (black-box) functions that map a set of controllable variables to the outcomes of an expensive experiment.…

Machine Learning · Computer Science 2023-09-15 Mohamed Aziz Bhouri , Michael Joly , Robert Yu , Soumalya Sarkar , Paris Perdikaris

This paper studies distributed algorithms for the extended monotropic optimization problem, which is a general convex optimization problem with a certain separable structure. The considered objective function is the sum of local convex…

Optimization and Control · Mathematics 2016-08-04 Xianlin Zeng , Peng Yi , Yiguang Hong , Lihua Xie

In this work, we introduce a learning model designed to meet the needs of applications in which computational resources are limited, and robustness and interpretability are prioritized. Learning problems can be formulated as constrained…

Systems and Control · Electrical Eng. & Systems 2025-09-26 Christos Mavridis , John Baras

Submodular set-functions have many applications in combinatorial optimization, as they can be minimized and approximately maximized in polynomial time. A key element in many of the algorithms and analyses is the possibility of extending the…

Machine Learning · Computer Science 2016-02-24 Francis Bach

It was shown recently by Su et al. (2016) that Nesterov's accelerated gradient method for minimizing a smooth convex function $f$ can be thought of as the time discretization of a second-order ODE, and that $f(x(t))$ converges to its…

Optimization and Control · Mathematics 2022-01-19 Valentin Duruisseaux , Melvin Leok

The present paper studies a kind of robust optimization problems with constraint. The problem is formulated through Backward Stochastic Differential Equations (BSDEs) with quadratic generators. A necessary condition is established for the…

Optimization and Control · Mathematics 2024-02-14 Peng Luo , Alexander Schied , Xiaole Xue

Bayesian optimization (BO) is a sample-efficient global optimization algorithm for black-box functions which are expensive to evaluate. Existing literature on model based optimization in conditional parameter spaces are usually built on…

Machine Learning · Statistics 2020-10-08 Xingchen Ma , Matthew B. Blaschko

Bayesian optimisation is a popular method for efficient optimisation of expensive black-box functions. Traditionally, BO assumes that the search space is known. However, in many problems, this assumption does not hold. To this end, we…

Machine Learning · Statistics 2026-04-28 Hung Tran-The , Sunil Gupta , Santu Rana , Huong Ha , Svetha Venkatesh

Convergence guarantees for optimization over bounded-rank matrices are delicate to obtain because the feasible set is a non-smooth and non-convex algebraic variety. Existing techniques include projected gradient descent, fixed-rank…

Optimization and Control · Mathematics 2024-06-21 Quentin Rebjock , Nicolas Boumal