English
Related papers

Related papers: Primal-dual Estimator Learning: an Offline Constra…

200 papers

Conventional image reconstruction models for lensless cameras often assume that each measurement results from convolving a given scene with a single experimentally measured point-spread function. These image reconstruction models fall short…

Computer Vision and Pattern Recognition · Computer Science 2022-12-21 Oliver Kingshott , Nick Antipa , Emrah Bostan , Kaan Akşit

We propose to use deep learning to estimate parameters in statistical models when standard likelihood estimation methods are computationally infeasible. We show how to estimate parameters from max-stable processes, where inference is…

Methodology · Statistics 2021-08-02 Amanda Lenzi , Julie Bessac , Johann Rudi , Michael L. Stein

This work derives a residual-based a posteriori error estimator for reduced models learned with non-intrusive model reduction from data of high-dimensional systems governed by linear parabolic partial differential equations with control…

Numerical Analysis · Mathematics 2020-05-13 Wayne Isaac Tan Uy , Benjamin Peherstorfer

Conformal prediction is a framework for uncertainty quantification that constructs prediction sets for previously unseen data, guaranteeing coverage of the true label with a specified probability. However, the efficiency of these prediction…

Machine Learning · Computer Science 2026-01-06 Erfan Hajihashemi , Yanning Shen

We propose a moving horizon estimation scheme for estimating the states and time-varying parameters of nonlinear systems. We consider the case where observability of the parameters depends on the excitation of the system and may be absent…

Systems and Control · Electrical Eng. & Systems 2025-08-21 Julian D. Schiller , Matthias A. Müller

Continual learning is inherently a constrained learning problem. The goal is to learn a predictor under a no-forgetting requirement. Although several prior studies formulate it as such, they do not solve the constrained problem explicitly.…

Machine Learning · Computer Science 2024-06-03 Juan Elenter , Navid NaderiAlizadeh , Tara Javidi , Alejandro Ribeiro

Non-convex functional constrained optimization problems have gained substantial attention in machine learning and data science, addressing broad requirements that typically go beyond the often performance-centric objectives. An influential…

Optimization and Control · Mathematics 2025-10-29 Sang Bin Moon , Jong Gwang Kim , Ashish Chandra , Christopher Brinton , Abolfazl Hashemi

This paper addresses the design and analysis of feedback-based online algorithms to control systems or networked systems based on performance objectives and engineering constraints that may evolve over time. The emerging time-varying convex…

Optimization and Control · Mathematics 2019-03-27 Andrey Bernstein , Emiliano Dall'Anese , Andrea Simonetto

We consider Lagrangian duality based approaches to design and analyze algorithms for online energy-efficient scheduling. First, we present a primal-dual framework. Our approach makes use of the Lagrangian weak duality and convexity to…

Data Structures and Algorithms · Computer Science 2014-08-06 Nguyen Kim Thang

In this work, we introduce a learning model designed to meet the needs of applications in which computational resources are limited, and robustness and interpretability are prioritized. Learning problems can be formulated as constrained…

Systems and Control · Electrical Eng. & Systems 2025-09-26 Christos Mavridis , John Baras

In this paper, we propose a suboptimal moving horizon estimator for nonlinear systems. For the stability analysis we transfer the "feasibility-implies-stability/robustness" paradigm from model predictive control to the context of moving…

Systems and Control · Electrical Eng. & Systems 2021-09-13 Julian D. Schiller , Sven Knüfer , Matthias A. Müller

We study a continuous-time primal-dual algorithm for distributed optimization with nonconvex local cost functions over weight-unbalanced digraphs, and analyze its performance from a dissipativity-based perspective. We first reformulate the…

Optimization and Control · Mathematics 2026-02-10 Weijian Li , Panos J. Antsaklis , Hai Lin

In this paper, we propose two novel non-stationary first-order primal-dual algorithms to solve nonsmooth composite convex optimization problems. Unlike existing primal-dual schemes where the parameters are often fixed, our methods use…

Optimization and Control · Mathematics 2020-07-13 Quoc Tran-Dinh , Yuzixuan Zhu

This paper develops projection-free algorithms for online convex optimization with stochastic constraints. We design an online primal-dual projection-free framework that can take any projection-free algorithms developed for online convex…

Optimization and Control · Mathematics 2023-05-17 Duksang Lee , Nam Ho-Nguyen , Dabeen Lee

Best subset selection is considered the `gold standard' for many sparse learning problems. A variety of optimization techniques have been proposed to attack this non-convex and NP-hard problem. In this paper, we investigate the dual forms…

Methodology · Statistics 2022-07-06 Shaogang Ren , Guanhua Fang , Ping Li

Stochastic approximation techniques have been used in various contexts in data science. We propose a stochastic version of the forward-backward algorithm for minimizing the sum of two convex functions, one of which is not necessarily…

Optimization and Control · Mathematics 2016-02-26 Patrick L. Combettes , Jean-Christophe Pesquet

Sequential decision-making agents struggle with long horizon tasks, since solving them requires multi-step reasoning. Most reinforcement learning (RL) algorithms address this challenge by improved credit assignment, introducing memory…

Machine Learning · Computer Science 2023-04-04 Bogdan Mazoure , Jake Bruce , Doina Precup , Rob Fergus , Ankit Anand

The paper addresses state estimation for linear discrete-time systems with binary (threshold) measurements. A Moving Horizon Estimation (MHE) approach is followed and different estimators, characterized by two different choices of the cost…

Systems and Control · Computer Science 2018-04-05 Giorgio Battistelli , Luigi Chisci , Stefano Gherardini

We consider a general class of nonsmooth optimal control problems with partial differential equation (PDE) constraints, which are very challenging due to its nonsmooth objective functionals and the resulting high-dimensional and…

Optimization and Control · Mathematics 2023-07-26 Yongcun Song , Xiaoming Yuan , Hangrui Yue

Sample-efficiency guarantees for offline reinforcement learning (RL) often rely on strong assumptions on both the function classes (e.g., Bellman-completeness) and the data coverage (e.g., all-policy concentrability). Despite the recent…

Machine Learning · Computer Science 2022-06-29 Wenhao Zhan , Baihe Huang , Audrey Huang , Nan Jiang , Jason D. Lee