English
Related papers

Related papers: Learning Convex Optimization Models

200 papers

Recent numerical experiments have demonstrated that the choice of optimization geometry used during training can impact generalization performance when learning expressive nonlinear model classes such as deep neural networks. These…

Machine Learning · Computer Science 2022-04-25 Nicholas M. Boffi , Stephen Tu , Jean-Jacques E. Slotine

Given a set of observations generated by an optimization process, the goal of inverse optimization is to determine likely parameters of that process. We cast inverse optimization as a form of deep learning. Our method, called deep inverse…

Machine Learning · Computer Science 2018-12-04 Yingcong Tan , Andrew Delong , Daria Terekhov

Increasing effort is put into the development of methods for learning mechanistic models from data. This task entails not only the accurate estimation of parameters but also a suitable model structure. Recent work on the discovery of…

Machine Learning · Computer Science 2024-07-01 Justin N. Kreikemeyer , Philipp Andelfinger , Adelinde M. Uhrmacher

We investigate constrained optimal control problems for linear stochastic dynamical systems evolving in discrete time. We consider minimization of an expected value cost over a finite horizon. Hard constraints are introduced first, and then…

Optimization and Control · Mathematics 2011-07-07 Eugenio Cinquemani , Mayank Agarwal , Debasish Chatterjee , John Lygeros

Data-driven Model Predictive Control (MPC), where the system model is learned from data with machine learning, has recently gained increasing interests in the control community. Gaussian Processes (GP), as a type of statistical models, are…

Systems and Control · Computer Science 2019-10-03 Truong X. Nghiem

We propose a new framework that unifies different fairness measures into a general, parameterized class of convex fairness measures suitable for optimization contexts. First, we propose a new class of order-based fairness measures, discuss…

Optimization and Control · Mathematics 2025-01-30 Man Yiu Tsang , Karmel S. Shehadeh

This study develops a framework for a class of constant modulus (CM) optimization problems, which covers binary constraints, discrete phase constraints, semi-orthogonal matrix constraints, non-negative semi-orthogonal matrix constraints,…

Signal Processing · Electrical Eng. & Systems 2024-11-12 Junbin Liu , Ya Liu , Wing-Kin Ma , Mingjie Shao , Anthony Man-Cho So

Inverse optimization refers to the inference of unknown parameters of an optimization problem based on knowledge of its optimal solutions. This paper considers inverse optimization in the setting where measurements of the optimal solutions…

Optimization and Control · Mathematics 2017-12-27 Anil Aswani , Zuo-Jun Max Shen , Auyon Siddiq

We present a novel methodology for convex optimization algorithm design using ideas from electric RLC circuits. Given an optimization problem, the first stage of the methodology is to design an appropriate electric circuit whose…

Optimization and Control · Mathematics 2025-01-22 Stephen P. Boyd , Tetiana Parshakova , Ernest K. Ryu , Jaewook J. Suh

In this paper, we study adaptive online convex optimization, and aim to design a universal algorithm that achieves optimal regret bounds for multiple common types of loss functions. Existing universal methods are limited in the sense that…

Machine Learning · Computer Science 2019-05-16 Guanghui Wang , Shiyin Lu , Lijun Zhang

The large majority of inferences drawn in empirical political research follow from model-based associations (e.g. regression). Here, we articulate the benefits of predictive modeling as a complement to this approach. Predictive models aim…

Methodology · Statistics 2016-12-20 Skyler J. Cranmer , Bruce A. Desmarais

We present an end-to-end framework for generating solutions to combinatorial optimization problems with unknown components using transformer-based sequence-to-sequence neural networks. Our framework learns directly from past solutions and…

Optimization and Control · Mathematics 2026-02-06 Macarena Navarro , Willem-Jan van Hoeve , Karan Singh

In this paper, a novel distributed optimization framework has been proposed. The key idea is to convert optimization problems into optimal control problems where the objective of each agent is to design the current control input minimizing…

Optimization and Control · Mathematics 2025-04-01 Ziyuan Guo , Yue Sun , Yeming Xu , Liping Zhang , Huanshui Zhang

This paper proposes an algorithmic framework for solving parametric optimization problems which we call adjoint-based predictor-corrector sequential convex programming. After presenting the algorithm, we prove a contraction estimate that…

Optimization and Control · Mathematics 2011-09-14 Q. Tran Dinh , C. Savorgnan , M. Diehl

In this paper, we focus on the solution of online optimization problems that arise often in signal processing and machine learning, in which we have access to streaming sources of data. We discuss algorithms for online optimization based on…

Optimization and Control · Mathematics 2023-05-05 Nicola Bastianello , Ruggero Carli , Andrea Simonetto

Most of the optimal guidance problems can be formulated as nonconvex optimization problems, which can be solved indirectly by relaxation, convexification, or linearization. Although these methods are guaranteed to converge to the global…

Optimization and Control · Mathematics 2024-03-19 Gyubin Park , Jiwoo Choi , Da Hoon Jeong , Jong-Han Kim

Multiview representation learning is very popular for latent factor analysis. It naturally arises in many data analysis, machine learning, and information retrieval applications to model dependent structures among multiple data sources. For…

Machine Learning · Computer Science 2019-09-17 Zhehui Chen , Lin F. Yang , Chris J. Li , Tuo Zhao

This study presents a constructive methodology for designing accelerated convex optimisation algorithms in continuous-time domain. The two key enablers are the classical concept of passivity in control theory and the time-dependent change…

Optimization and Control · Mathematics 2024-09-16 Namhoon Cho , Hyo-Sang Shin

Region-specific linear models are widely used in practical applications because of their non-linear but highly interpretable model representations. One of the key challenges in their use is non-convexity in simultaneous optimization of…

Machine Learning · Statistics 2014-11-03 Hidekazu Oiwa , Ryohei Fujimaki

Gradient boosting is a state-of-the-art prediction technique that sequentially produces a model in the form of linear combinations of simple predictors---typically decision trees---by solving an infinite-dimensional convex optimization…

Statistics Theory · Mathematics 2017-07-18 Gérard Biau , Benoît Cadre
‹ Prev 1 8 9 10 Next ›