English
Related papers

Related papers: A Canonical Structure for Constructing Projected F…

200 papers

We derive several numerical methods for designing optimized first-order algorithms in unconstrained convex optimization settings. Our methods are based on the Performance Estimation Problem (PEP) framework, which casts the worst-case…

Optimization and Control · Mathematics 2025-07-29 Yassine Kamri , Julien M. Hendrickx , François Glineur

Predictive coding has emerged as an influential normative model of neural computation, with numerous extensions and applications. As such, much effort has been put into mapping PC faithfully onto the cortex, but there are issues that remain…

Neurons and Cognition · Quantitative Biology 2023-03-07 Siavash Golkar , Tiberiu Tesileanu , Yanis Bahroun , Anirvan M. Sengupta , Dmitri B. Chklovskii

A new finite atlas of overlapping balanced canonical forms for multivariate discrete-time lossless systems is presented. The canonical forms have the property that the controllability matrix is positive upper triangular up to a suitable…

Optimization and Control · Mathematics 2010-12-16 Ralf L. M. Peeters , Bernard Hanzon , Martine Olivi

Model order reduction involves constructing a reduced-order approximation of a high-order model while retaining its essential characteristics. This reduced-order model serves as a substitute for the original one in various applications such…

Systems and Control · Electrical Eng. & Systems 2024-03-06 Qiu-Yan Song , Umair Zulfiqar , Zhi-Hua Xiao , Mohammad Monir Uddin , Victor Sreeram

This paper studies first-order algorithms for solving fully composite optimization problems over convex and compact sets. We leverage the structure of the objective by handling its differentiable and non-differentiable components…

Optimization and Control · Mathematics 2023-07-13 Maria-Luiza Vladarean , Nikita Doikov , Martin Jaggi , Nicolas Flammarion

We present a methodology for establishing the existence of quadratic Lyapunov inequalities for a wide range of first-order methods used to solve convex optimization problems. In particular, we consider i) classes of optimization problems of…

Optimization and Control · Mathematics 2025-10-24 Manu Upadhyaya , Sebastian Banert , Adrien B. Taylor , Pontus Giselsson

Exactly solving first-order constraints (i.e., first-order formulas over a certain predefined structure) can be a very hard, or even undecidable problem. In continuous structures like the real numbers it is promising to compute approximate…

Logic in Computer Science · Computer Science 2007-05-23 Stefan Ratschan

Modern computationally-intensive applications often operate under time constraints, necessitating acceleration methods and distribution of computational workloads across multiple entities. However, the outcome is either achieved within the…

Information Theory · Computer Science 2024-02-13 Homa Esfahanizadeh , Alejandro Cohen , Shlomo Shamai , Muriel Medard

In this work, we study a novel class of projection-based algorithms for linearly constrained problems (LCPs) which have a lot of applications in statistics, optimization, and machine learning. Conventional primal gradient-based methods for…

Optimization and Control · Mathematics 2021-01-06 Xiang Li , Zhihua Zhang

We develop a finite-data framework for certifying \emph{zero-defect} (neutral) configurations of positive vectors under the canonical separable reciprocal cost. We show that this scalar cost is characterized among non-constant continuous…

Optimization and Control · Mathematics 2026-03-24 Jonathan Washburn , Amir Rahnamai Barghi

This paper establishes the equivalence between systems described by a single first-order hyperbolic partial differential equation and systems described by integral delay equations. System-theoretic results are provided for both classes of…

Optimization and Control · Mathematics 2019-02-20 Iasson Karafyllis , Miroslav Krstic

Due to the rapid growth of data and computational resources, distributed optimization has become an active research area in recent years. While first-order methods seem to dominate the field, second-order methods are nevertheless attractive…

Machine Learning · Computer Science 2018-06-21 Celestine Dünner , Aurelien Lucchi , Matilde Gargiani , An Bian , Thomas Hofmann , Martin Jaggi

The primary focus of this paper is on designing an inexact first-order algorithm for solving constrained nonlinear optimization problems. By controlling the inexactness of the subproblem solution, we can significantly reduce the…

Optimization and Control · Mathematics 2019-11-19 Hao Wang , Fan Zhang , Jiashan Wang , Yuyang Rong

Motivated by applications in automated verification of higher-order functional programs, we develop a notion of constrained Horn clauses in higher-order logic and a decision problem concerning their satisfiability. We show that, although…

Programming Languages · Computer Science 2017-08-02 Toby Cathcart Burn , C. -H. Luke Ong , Steven J. Ramsay

In the field of online sequential decision-making, we address the problem with delays utilizing the framework of online convex optimization (OCO), where the feedback of a decision can arrive with an unknown delay. Unlike previous research…

Machine Learning · Computer Science 2024-02-26 Ping Wu , Heyan Huang , Zhengyang Liu

A very simple first-order algorithm is proposed for solving nonlinear optimization problems with deterministic nonlinear equality constraints. This algorithm adaptively selects steps in the plane tangent to the constraints or steps that…

Optimization and Control · Mathematics 2026-03-11 Serge Gratton , Philippe L. Toint

We show that several classes of ordered structures (namely, convex linear orders, layered permutations, and compositions) admit first-order logical limit laws.

Logic · Mathematics 2021-11-15 Samuel Braunfeld , Matthew Kukla

This paper presents and implements an iterative feedback design algorithm for stabilisation of discrete-time switched systems under arbitrary switching regimes. The algorithm seeks state feedback gains so that the closed-loop switching…

Systems and Control · Computer Science 2010-09-13 Hernan Haimovich , Julio H. Braslavsky

Several applications in time series forecasting require predicting multiple steps ahead. Despite the vast amount of literature in the topic, both classical and recent deep learning based approaches have mostly focused on minimising…

Machine Learning · Computer Science 2024-07-15 Ignacio Hounie , Javier Porras-Valenzuela , Alejandro Ribeiro

Starting with the first-order singular Lagrangian, the canonical structure in the noncommutative quantum mechanics with the noncommutativities both of coordinates and momenta is investgated. Using the projection operator method (POM) for…

High Energy Physics - Theory · Physics 2014-12-24 M. Nakamura