English
Related papers

Related papers: Preisach Based Storage Devices and Global Optimize…

200 papers

The demand for explainable and energy-efficient artificial intelligence (AI) systems for edge computing has led to significant interest in electronic systems dedicated to Bayesian inference. Traditional designs of such systems often rely on…

Penalized regression methods, such as $L_1$ regularization, are routinely used in high-dimensional applications, and there is a rich literature on optimality properties under sparsity assumptions. In the Bayesian paradigm, sparsity is…

Statistics Theory · Mathematics 2014-01-22 Anirban Bhattacharya , Debdeep Pati , Natesh S. Pillai , David B. Dunson

Some methods based on simple regularizing geometric element transformations have heuristically been shown to give runtime efficient and quality effective smoothing algorithms for meshes. We describe the mathematical framework and a…

Computational Geometry · Computer Science 2013-07-09 Dimitris Vartziotis , Benjamin Himpel

We consider convex underestimators that are used in the global optimization {\alpha}BB method and its variants. The method is based by augmenting the original nonconvex function by a relaxation term that is derived from an interval…

Optimization and Control · Mathematics 2019-05-27 Milan Hladík

Bayesian optimization methods have been successfully applied to black box optimization problems that are expensive to evaluate. In this paper, we adapt the so-called super effcient global optimization algorithm to solve more accurately…

Machine Learning · Statistics 2020-06-30 Rémy Priem , Nathalie Bartoli , Youssef Diouane , Alessandro Sgueglia

Optimization of problems with high computational power demands is a challenging task. A probabilistic approach to such optimization called Bayesian optimization lowers performance demands by solving mathematically simpler model of the…

Machine Learning · Computer Science 2021-01-27 Jakub Klus , Pavel Grunt , Martin Dobrovolný

Purpose: To describe and mathematically validate the superiorization methodology, which is a recently-developed heuristic approach to optimization, and to discuss its applicability to medical physics problem formulations that specify the…

Optimization and Control · Mathematics 2015-06-11 G. T. Herman , E. Garduño , R. Davidi , Y. Censor

Distributed optimization plays an important role in modern large-scale machine learning and data processing systems by optimizing the utilization of computational resources. One of the classical and popular approaches is Local Stochastic…

Optimization and Control · Mathematics 2024-12-19 Andrey Sadchikov , Savelii Chezhegov , Aleksandr Beznosikov , Alexander Gasnikov

The tunable mechanical response of knitted fabrics underpins applications ranging from soft robotics and artificial muscles to morphing electromagnetic field sensors. Elasticity in fabrics emerges from the bending of yarn in the knitted…

We consider solving distributed consensus optimization problems over multi-agent networks. Current distributed methods fail to capture the heterogeneity among agents' local computation capacities. We propose DISH as a distributed hybrid…

Optimization and Control · Mathematics 2023-08-03 Xiaochun Niu , Ermin Wei

In this paper, we extend and analyze a Bayesian hierarchical spatio-temporal model for physical systems. A novelty is to model the discrepancy between the output of a computer simulator for a physical process and the actual process values…

This paper presents a novel numerical optimisation method for infinite dimensional optimisation. The functional optimisation makes minimal assumptions about the functional and without any specific knowledge on the derivative of the…

Optimization and Control · Mathematics 2016-11-18 Muhammad F. Kasim , Peter A. Norreys

This paper proposes a universal algorithm for convex minimization problems of the composite form $g_0(x)+h(g_1(x),\dots, g_m(x)) + u(x)$. We allow each $g_j$ to independently range from being nonsmooth Lipschitz to smooth, from convex to…

Optimization and Control · Mathematics 2026-01-15 Aaron Zoll , Benjamin Grimmer

We investigate the fundamental optimization question of minimizing a target function $f$, whose gradients are expensive to compute or have limited availability, given access to some auxiliary side function $h$ whose gradients are cheap or…

Machine Learning · Computer Science 2025-12-19 El Mahdi Chayti , Sai Praneeth Karimireddy

A new model of causal failure is presented and used to solve a novel replica placement problem in data centers. The model describes dependencies among system components as a directed graph. A replica placement is defined as a subset of…

Data Structures and Algorithms · Computer Science 2017-01-09 K. Alex Mills , R. Chandrasekaran , Neeraj Mittal

In this paper, the problem of safe global maximization (it should not be confused with robust optimization) of expensive noisy black-box functions satisfying the Lipschitz condition is considered. The notion "safe" means that the objective…

Optimization and Control · Mathematics 2020-08-18 Yaroslav D. Sergeyev , Antonio Candelieri , Dmitri E. Kvasov , Riccardo Perego

A subgradient method is presented for solving general convex optimization problems, the main requirement being that a strictly-feasible point is known. A feasible sequence of iterates is generated, which converges to within user-specified…

Optimization and Control · Mathematics 2016-05-30 James Renegar

Parallelization is a popular strategy for improving the performance of iterative algorithms. Optimization methods are no exception: design of efficient parallel optimization methods and tight analysis of their theoretical properties are…

Optimization and Control · Mathematics 2023-11-28 Alexander Tyurin , Peter Richtárik

Bayesian optimization is a powerful paradigm to optimize black-box functions based on scarce and noisy data. Its data efficiency can be further improved by transfer learning from related tasks. While recent transfer models meta-learn a…

Bayesian optimisation has proven to be a powerful tool for expensive global black-box optimisation problems. In this paper, we propose new Bayesian optimisation variants of the popular Knowledge Gradient acquisition functions for problems…

Machine Learning · Computer Science 2025-12-22 Xietao Wang Lin , Juan Ungredda , Max Butler , James Town , Alma Rahat , Hemant Singh , Juergen Branke