English
Related papers

Related papers: Efficient Lexicographic Optimization for Prioritiz…

200 papers

We propose a methodology at the nexus of operations research and machine learning (ML) leveraging generic approximators available from ML to accelerate the solution of mixed-integer linear two-stage stochastic programs. We aim at solving…

Optimization and Control · Mathematics 2022-06-14 Eric Larsen , Emma Frejinger , Bernard Gendron , Andrea Lodi

In this work, we present a hardware compatible neural network training algorithm in which we used alternating direction method of multipliers (ADMM) and iterative least-square methods. The motive behind this approach was to conduct a method…

Machine Learning · Computer Science 2020-09-08 Seyedeh Niusha Alavi Foumani , Ce Guo , Wayne Luk

This paper introduces the stochastic Fej\'{e}r-monotone hybrid steepest descent method (S-FM-HSDM) to solve affinely constrained and composite convex minimization tasks. The minimization task is not known exactly; noise contaminates the…

Optimization and Control · Mathematics 2019-05-22 Konstantinos Slavakis

Typically, nonlinear Support Vector Machines (SVMs) produce significantly higher classification quality when compared to linear ones but, at the same time, their computational complexity is prohibitive for large-scale datasets: this…

Machine Learning · Computer Science 2021-11-11 S. Cipolla , J. Gondzio

The present work introduces the hybrid consensus alternating direction method of multipliers (H-CADMM), a novel framework for optimization over networks which unifies existing distributed optimization approaches, including the centralized…

Optimization and Control · Mathematics 2018-05-10 Meng Ma , Athanasios N. Nikolakopoulos , Georgios B. Giannakis

This work considers infinite-horizon optimal control of positive linear systems applied to the case of network routing problems. We demonstrate the equivalence between Stochastic Shortest Path (SSP) problems and optimal control of a certain…

Optimization and Control · Mathematics 2026-02-17 David Ohlin , Anders Rantzer , Emma Tegling

The Sequential Linear Quadratic (SLQ) algorithm is a continuous-time variant of the well-known Differential Dynamic Programming (DDP) technique with a Gauss-Newton Hessian approximation. This family of methods has gained popularity in the…

Robotics · Computer Science 2021-03-29 Jean-Pierre Sleiman , Farbod Farshidian , Marco Hutter

This paper addresses the scalar regression problem through a novel solution to exactly optimize the Huber loss in a general semi-supervised setting, which combines multi-view learning and manifold regularization. We propose a principled…

Machine Learning · Computer Science 2016-06-28 Jacopo Cavazza , Vittorio Murino

In this paper, we consider a planning problem for a large-scale system modelled as a hierarchical finite state machine (HFSM) and develop a control algorithm for computing optimal plans between any two states. The control algorithm consists…

Systems and Control · Electrical Eng. & Systems 2023-12-21 Elis Stefansson , Karl H. Johansson

Modern large language models (LLMs) place extraordinary pressure on memory and compute budgets, making principled compression indispensable for both deployment and continued training. We present Hierarchical Sparse Plus Low-Rank (HSS)…

Machine Learning · Computer Science 2026-01-14 Pawan Kumar , Aditi Gupta

Nonlinear least-squares problems are a special class of unconstrained optimization problems in which their gradient and Hessian have special structures. In this paper, we exploit these structures and proposed a matrix-free algorithm with a…

Optimization and Control · Mathematics 2020-02-06 Aliyu Muhammed Awwal , Poom Kumam , Hassan Mohammad

We present ADMM-Softmax, an alternating direction method of multipliers (ADMM) for solving multinomial logistic regression (MLR) problems. Our method is geared toward supervised classification tasks with many examples and features. It…

Machine Learning · Computer Science 2019-07-12 Samy Wu Fung , Sanna Tyrväinen , Lars Ruthotto , Eldad Haber

We introduce a family of numerical algorithms for the solution of linear system in higher dimensions with the matrix and right hand side given and the solution sought in the tensor train format. The proposed methods are rank--adaptive and…

Numerical Analysis · Mathematics 2014-10-07 Sergey V. Dolgov , Dmitry V. Savostyanov

In the Minimum Common String Partition Problem (MCSP), we are given two strings on input, and we want to partition both into the same collection of substrings, minimizing the number of the substrings in the partition. This combinatorial…

Data Structures and Algorithms · Computer Science 2021-10-12 Miloš Chromý , Markus Sinnl

As humanoid robots enter real-world environments, ensuring robust locomotion across diverse environments is crucial. This paper presents a computationally efficient hierarchical control framework for humanoid robot locomotion based on…

Robotics · Computer Science 2025-09-08 Adrian B. Ghansah , Sergio A. Esteban , Aaron D. Ames

In a multi-agent network, we consider the problem of minimizing an objective function that is expressed as the sum of private convex and smooth functions, and a (possibly) non-differentiable convex regularizer. We propose a novel…

Optimization and Control · Mathematics 2021-09-30 Yichuan Li , Nikolaos M. Freris , Petros Voulgaris , Dusan Stipanovic

While Large Language Models (LLM) enable non-experts to specify open-world multi-robot tasks, the generated plans often lack kinematic feasibility and are not efficient, especially in long-horizon scenarios. Formal methods like Linear…

Robotics · Computer Science 2026-02-11 Shuyuan Hu , Tao Lin , Kai Ye , Yang Yang , Tianwei Zhang

To ensure the system stability of the $\bf{\mathcal{H}_{2}}$-guaranteed cost optimal decentralized control problem (ODC), an approximate semidefinite programming (SDP) problem is formulated based on the sparsity of the gain matrix of the…

Optimization and Control · Mathematics 2024-02-05 Bo Yang , Xinyuan Zhao , Xudong Li , Defeng Sun

This paper introduces OptimizedDP, a high-performance software library for several common grid-based dynamic programming (DP) algorithms used in control theory and robotics. Specifically, OptimizedDP provides functions to numerically solve…

Systems and Control · Electrical Eng. & Systems 2025-11-21 Minh Bui , Hanyang Hu , Chong He , Michael Lu , George Giovanis , Arrvindh Shriraman , Mo Chen

In this paper we present an active-set method for the solution of $\ell_1$-regularized convex quadratic optimization problems. It is derived by combining a proximal method of multipliers (PMM) strategy with a standard semismooth Newton…

Optimization and Control · Mathematics 2023-03-01 Spyridon Pougkakiotis , Jacek Gondzio , Dionysios S. Kalogerias