English
Related papers

Related papers: Arbitrarily Small Execution-Time Certificate: What…

200 papers

Viewing optimization methods as numerical integrators for ordinary differential equations (ODEs) provides a thought-provoking modern framework for studying accelerated first-order optimizers. In this literature, acceleration is often…

Optimization and Control · Mathematics 2021-02-24 Peiyuan Zhang , Antonio Orvieto , Hadi Daneshmand , Thomas Hofmann , Roy Smith

Compared with the fixed-run designs, the sequential adaptive designs (SAD) are thought to be more efficient and effective. Efficient global optimization (EGO) is one of the most popular SAD methods for expensive black-box optimization…

Machine Learning · Computer Science 2020-10-22 Jianhui Ning , Yao Xiao , Zikang Xiong

Ordinary differential equations (ODEs) are widely used to model biological, (bio-)chemical and technical processes. The parameters of these ODEs are often estimated from experimental data using ODE-constrained optimisation. This article…

Optimization and Control · Mathematics 2015-11-06 Anna Fiedler , Fabian J. Theis , Jan Hasenauer

This paper is an attempt to remedy the problem of slow convergence for first-order numerical algorithms by proposing an adaptive conditioning heuristic. First, we propose a parallelizable numerical algorithm that is capable of solving…

Optimization and Control · Mathematics 2021-03-02 Muhammad Adil , Sasan Tavakkol , Ramtin Madani

Quantum optimization has gained increasing attention as advances in quantum hardware enable the exploration of problem instances approaching real-world scale. Among existing approaches, variational quantum algorithms and quantum annealing…

Adiabatic quantum optimization has attracted a lot of attention because small scale simulations gave hope that it would allow to solve NP-complete problems efficiently. Later, negative results proved the existence of specifically designed…

Quantum Physics · Physics 2009-12-02 Boris Altshuler , Hari Krovi , Jeremie Roland

We present a novel methodology for convex optimization algorithm design using ideas from electric RLC circuits. Given an optimization problem, the first stage of the methodology is to design an appropriate electric circuit whose…

Optimization and Control · Mathematics 2025-01-22 Stephen P. Boyd , Tetiana Parshakova , Ernest K. Ryu , Jaewook J. Suh

We present a novel approach to non-convex optimization with certificates, which handles smooth functions on the hypercube or on the torus. Unlike traditional methods that rely on algebraic properties, our algorithm exploits the regularity…

Optimization and Control · Mathematics 2023-12-21 Gaspard Beugnot , Julien Mairal , Alessandro Rudi

Symmetry and dominance breaking can be crucial for solving hard combinatorial search and optimisation problems, but the correctness of these techniques sometimes relies on subtle arguments. For this reason, it is desirable to produce…

Artificial Intelligence · Computer Science 2023-08-17 Bart Bogaerts , Stephan Gocht , Ciaran McCreesh , Jakob Nordström

In real-time systems optimization, designers often face a challenging problem posed by the non-convex and non-continuous schedulability conditions, which may even lack an analytical form to understand their properties. To tackle this…

Systems and Control · Electrical Eng. & Systems 2025-03-20 Sen Wang , Dong Li , Shao-Yu Huang , Xuanliang Deng , Ashrarul H. Sifat , Changhee Jung , Ryan Williams , Haibo Zeng

Optimal Control Problems consist on the optimisation of an objective functional subjected to a set of Ordinary Differential Equations. In this work, we consider the effects on the stability of the numerical solution when this optimisation…

Optimization and Control · Mathematics 2024-01-09 Ashutosh Bijalwan , Jose J Muñoz

Optimal control problems naturally arise in many scientific applications where one wishes to steer a dynamical system from a certain initial state $\mathbf{x}_0$ to a desired target state $\mathbf{x}^*$ in finite time $T$. Recent advances…

Machine Learning · Computer Science 2022-09-20 Lucas Böttcher , Thomas Asikis

This paper considers global optimization with a black-box unknown objective function that can be non-convex and non-differentiable. Such a difficult optimization problem arises in many real-world applications, such as parameter tuning in…

Optimization and Control · Mathematics 2016-07-19 Kenji Kawaguchi , Yu Maruyama , Xiaoyu Zheng

We address the problem of minimizing a class of energy functions consisting of data and smoothness terms that commonly occur in machine learning, computer vision, and pattern recognition. While discrete optimization methods are able to give…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Zhakshylyk Nurlanov , Daniel Cremers , Florian Bernard

This work presents a convex-optimization-based framework for analysis and control of nonlinear partial differential equations. The approach uses a particular weak embedding of the nonlinear PDE, resulting in a linear equation in the space…

Optimization and Control · Mathematics 2018-04-23 Milan Korda , Didier Henrion , Jean-Bernard Lasserre

Energy minimization has been an intensely studied core problem in computer vision. With growing image sizes (2D and 3D), it is now highly desirable to run energy minimization algorithms in parallel. But many existing algorithms, in…

Computer Vision and Pattern Recognition · Computer Science 2015-03-06 K. S. Sesh Kumar , Alvaro Barbero , Stefanie Jegelka , Suvrit Sra , Francis Bach

A new topology optimization method called the Proportional Topology Optimization (PTO) is presented. As a non-gradient method, PTO is simple to understand, easy to implement, and is also efficient and accurate at the same time. It is…

Computational Engineering, Finance, and Science · Computer Science 2016-05-30 Emre Biyikli , Albert C. To

On computers, discrete problems are solved instead of continuous ones. One must be sure that the solutions of the former problems, obtained in real time (i.e., when the stepsize h is not infinitesimal) are good approximations of the…

Numerical Analysis · Mathematics 2010-12-07 Luigi Brugnano , Felice Iavernaro , Donato Trigiante

We consider potentially non-convex optimization problems, for which optimal rates of approximation depend on the dimension of the parameter space and the smoothness of the function to be optimized. In this paper, we propose an algorithm…

Machine Learning · Computer Science 2022-04-12 Blake Woodworth , Francis Bach , Alessandro Rudi

The optimisation of software energy consumption is of growing importance across all scales of modern computing, i.e., from embedded systems to data-centres. Practitioners in the field of Search-Based Software Engineering and Genetic…

Software Engineering · Computer Science 2020-04-10 Mahmoud A. Bokhari , Brad Alexander , Markus Wagner