English
Related papers

Related papers: On Revealing the Hidden Problem Structure in Real-…

200 papers

Sparse Gaussian graphical models characterize sparse dependence relationships between random variables in a network. To estimate multiple related Gaussian graphical models on the same set of variables, we formulate a hierarchical model,…

Methodology · Statistics 2014-06-10 Yuancheng Zhu , Rina Foygel Barber

Estimation of distribution algorithms are evolutionary algorithms that use extracted information from the population instead of traditional genetic operators to generate new solutions. This information is represented as a probabilistic…

Neural and Evolutionary Computing · Computer Science 2022-03-25 Saeed Ghadiri , Amin Nikanjam

Recently, audio-visual speech enhancement has been tackled in the unsupervised settings based on variational auto-encoders (VAEs), where during training only clean data is used to train a generative model for speech, which at test time is…

Audio and Speech Processing · Electrical Eng. & Systems 2021-02-09 Mostafa Sadeghi , Xavier Alameda-Pineda

Variable aggregation has been largely studied as an important pre-solve algorithm for optimization of linear and mixed-integer programs. Although some nonlinear solvers and algebraic modeling languages implement variable aggregation as a…

Optimization and Control · Mathematics 2026-02-17 Sakshi Naik , Lorenz Biegler , Russell Bent , Robert Parker

Generalized nonlinear programming is considered without any convexity assumption, capturing a variety of problems that include nonsmooth objectives, combinatorial structures, and set-membership nonlinear constraints. We extend the augmented…

Optimization and Control · Mathematics 2024-04-02 Alberto De Marchi

Real-world structural optimisation problems involve multiple loading conditions and design constraints, with responses typically depending on states of discretised governing equations. Generally, one uses gradient-based nested analysis and…

Computational Engineering, Finance, and Science · Computer Science 2022-02-23 Stijn Koppen , Max van der Kolk , Sanne van den Boom , Matthijs Langelaar

We consider the problem of estimating a low-rank matrix from a noisy observed matrix. Previous work has shown that the optimal method depends crucially on the choice of loss function. In this paper, we use a family of weighted loss…

Statistics Theory · Mathematics 2021-04-08 William Leeb

Recent work used importance sampling ideas for better variational bounds on likelihoods. We clarify the applicability of these ideas to pure probabilistic inference, by showing the resulting Importance Weighted Variational Inference (IWVI)…

Machine Learning · Computer Science 2018-10-30 Justin Domke , Daniel Sheldon

Systems involving Partial Differential Equations (PDEs) have recently become more popular among the machine learning community. However prior methods usually treat infinite dimensional problems in finite dimensions with Reduced Order…

Optimization and Control · Mathematics 2020-06-08 Ethan N. Evans , Marcus A. Pereira , George I. Boutselis , Evangelos A. Theodorou

Correlations between factors of variation are prevalent in real-world data. Exploiting such correlations may increase predictive performance on noisy data; however, often correlations are not robust (e.g., they may change between domains,…

Machine Learning · Computer Science 2022-12-26 Christina M. Funke , Paul Vicol , Kuan-Chieh Wang , Matthias Kümmerer , Richard Zemel , Matthias Bethge

One of the fundamental challenges found throughout the data sciences is to explain why things happen in specific ways, or through which mechanisms a certain variable $X$ exerts influences over another variable $Y$. In statistics and machine…

Methodology · Statistics 2023-06-09 Drago Plecko , Elias Bareinboim

We propose a scalable encoding of combinatorial optimization problems with arbitrary connectivity, including higher-order terms, on arrays of trapped neutral atoms requiring only a global laser drive. Our approach relies on modular…

Quantum Physics · Physics 2024-10-08 Martin Lanthaler , Kilian Ender , Clemens Dlaska , Wolfgang Lechner

Robust correlation estimation is essential in high-dimensional settings, particularly when data are contaminated by outliers or exhibit heavy-tailed behavior. Many robust loss functions of practical interest-such as those involving…

Applications · Statistics 2025-06-19 Priyam Das

We consider the nonparametric estimation problem of time-dependent multivariate functions observed in a presence of additive cylindrical Gaussian white noise of a small intensity. We derive minimax lower bounds for the $L^2$-risk in the…

Statistics Theory · Mathematics 2012-11-02 Jérémie Bigot , Theofanis Sapatinas

The Gene-pool Optimal Mixing EA (GOMEA) family of EAs offers a specific means to exploit problem-specific knowledge through linkage learning, i.e., inter-variable dependency detection, expressed using subsets of variables, that should…

Neural and Evolutionary Computing · Computer Science 2025-07-01 Renzo J. Scholman , Tanja Alderliesten , Peter A. N. Bosman

Many resource allocation tasks are challenging global (i.e., non-convex) optimization problems. The main issue is that the computational complexity of these problems grows exponentially in the number of variables instead of polynomially as…

Information Theory · Computer Science 2019-10-17 Bho Matthiesen , Eduard A. Jorswieck

Constrained blackbox optimization is a difficult problem, with most approaches coming from the mathematical programming literature. The statistical literature is sparse, especially in addressing problems with nontrivial constraints. This…

This paper addresses risk averse constrained optimization problems where the objective and constraint functions can only be computed by a blackbox subject to unknown uncertainties. To handle mixed aleatory/epistemic uncertainties, the…

Optimization and Control · Mathematics 2023-10-18 Charles Audet , Jean Bigeon , Romain Couderc , Michael Kokkolaras

We propose a novel Bayesian Optimization approach for black-box functions with an environmental variable whose value determines the tradeoff between evaluation cost and the fidelity of the evaluations. Further, we use a novel approach to…

Machine Learning · Statistics 2018-05-16 Mark McLeod , Michael A. Osborne , Stephen J. Roberts

Data-driven control of nonlinear systems with rigorous guarantees is a challenging problem as it usually calls for nonconvex optimization and requires often knowledge of the true basis functions of the system dynamics. To tackle these…

Optimization and Control · Mathematics 2023-03-27 Tim Martin , Thomas B. Schön , Frank Allgöwer