English
Related papers

Related papers: On Revealing the Hidden Problem Structure in Real-…

200 papers

Feedback optimization enables autonomous optimality seeking of a dynamical system through its closed-loop interconnection with iterative optimization algorithms. Among various iteration structures, model-based approaches require the…

Optimization and Control · Mathematics 2026-05-26 Zhiyu He , Saverio Bolognani , Michael Muehlebach , Florian Dörfler

Optimization in the latent space of variational autoencoders is a promising approach to generate high-dimensional discrete objects that maximize an expensive black-box property (e.g., drug-likeness in molecular generation, function…

Machine Learning · Computer Science 2021-07-02 Pascal Notin , José Miguel Hernández-Lobato , Yarin Gal

Optimization problems with uncertain black-box constraints, modeled by warped Gaussian processes, have recently been considered in the Bayesian optimization setting. This work introduces a new class of constraints in which the same…

Optimization and Control · Mathematics 2020-06-16 Johannes Wiebe , Inês Cecílio , Jonathan Dunlop , Ruth Misener

For many real-world optimization problems it is possible to perform partial evaluations, meaning that the impact of changing a few variables on a solution's fitness can be computed very efficiently. It has been shown that such partial…

Neural and Evolutionary Computing · Computer Science 2024-02-19 Georgios Andreadis , Tanja Alderliesten , Peter A. N. Bosman

The optimization of high dimensional functions is a key issue in engineering problems but it frequently comes at a cost that is not acceptable since it usually involves a complex and expensive computer code. Engineers often overcome this…

Machine Learning · Statistics 2019-06-18 Adrien Spagnol , Rodolphe Le Riche , Sebastien Da Veiga

Methods of quantum nuclear wave-function dynamics have become very efficient in simulating large isolated systems using the time-dependent variational principle (TDVP). However, a straightforward extension of the TDVP to the density matrix…

Chemical Physics · Physics 2015-06-23 Loic Joubert-Doriol , Artur F. Izmaylov

Motivated by variational inference methods, we propose a zeroth-order algorithm for solving optimization problems in the space of Gaussian probability measures. The algorithm is based on an interacting system of Gaussian particles that…

Optimization and Control · Mathematics 2026-05-15 Giacomo Borghi , José A. Carrillo

Bayesian optimization is a methodology to optimize black-box functions. Traditionally, it focuses on the setting where you can arbitrarily query the search space. However, many real-life problems do not offer this flexibility; in…

We present Mask-GVAE, a variational generative model for blind denoising large discrete graphs, in which "blind denoising" means we don't require any supervision from clean graphs. We focus on recovering graph structures via deleting…

Machine Learning · Computer Science 2021-02-09 Jia Li , Mengzhou Liu , Honglei Zhang , Pengyun Wang , Yong Wen , Lujia Pan , Hong Cheng

Black-box variational inference (BBVI) now sees widespread use in machine learning and statistics as a fast yet flexible alternative to Markov chain Monte Carlo methods for approximate Bayesian inference. However, stochastic optimization…

Machine Learning · Statistics 2025-09-22 Manushi Welandawe , Michael Riis Andersen , Aki Vehtari , Jonathan H. Huggins

Efficient Global Optimization (EGO) is widely used for the optimization of computationally expensive black-box functions. It uses a surrogate modeling technique based on Gaussian Processes (Kriging). However, due to the use of a stationary…

Optimization and Control · Mathematics 2018-09-14 Ali Hebbal , Loic Brevault , Mathieu Balesdent , El-Ghazali Talbi , Nouredine Melab

The work explores a specific scenario for structural computational optimization based on the following elements: (a) a relaxed optimization setting considering the ersatz (bi-material) approximation, (b) a treatment based on a nonsmoothed…

Computational Engineering, Finance, and Science · Computer Science 2021-08-06 J. Oliver , D. Yago , J. Cante , O. Lloberas-Valls

Robust optimization is a popular paradigm for modeling and solving two- and multi-stage decision-making problems affected by uncertainty. In many real-world applications, the time of information discovery is decision-dependent and the…

Optimization and Control · Mathematics 2022-08-24 Phebe Vayanos , Angelos Georghiou , Han Yu

In many applications, it is of interest to assess the dependence structure in multivariate longitudinal data. Discovering such dependence is challenging due to the dimensionality involved. By concatenating the random effects from component…

Applications · Statistics 2012-08-16 Hongxia Yang , Fan Li , Enrique F. Schisterman , Sunni L. Mumford , David Dunson

This paper explores the non-convex composition optimization in the form including inner and outer finite-sum functions with a large number of component functions. This problem arises in some important applications such as nonlinear…

Machine Learning · Statistics 2017-11-15 Liu Liu , Ji Liu , Dacheng Tao

Many optimization problems in robotics involve the optimization of time-expensive black-box functions, such as those involving complex simulations or evaluation of real-world experiments. Furthermore, these functions are often stochastic as…

We propose an algorithmic framework, that employs active subspace techniques, for scalable global optimization of functions with low effective dimension (also referred to as low-rank functions). This proposal replaces the original…

Optimization and Control · Mathematics 2024-02-01 Coralia Cartis , Xinzhu Liang , Estelle Massart , Adilet Otemissov

We propose an algorithm to solve quasi-variational inequality problems, based on the Dantzig-Wolfe decomposition paradigm. Our approach solves in the subproblems variational inequalities, which is a simpler problem, while restricting…

Optimization and Control · Mathematics 2026-02-02 Manoel Jardim , Claudia Sagastizábal , Mikhail Solodov

The truncated singular value decomposition (SVD) of the measurement matrix is the optimal solution to the_representation_ problem of how to best approximate a noisy measurement matrix using a low-rank matrix. Here, we consider the…

Statistics Theory · Mathematics 2014-04-21 Raj Rao Nadakuditi

We propose a data-driven way to reduce the noise of covariance matrices of nonstationary systems. In the case of stationary systems, asymptotic approaches were proved to converge to the optimal solutions. Such methods produce eigenvalues…

Applications · Statistics 2023-03-10 Christian Bongiorno , Damien Challet , Grégoire Loeper