English
Related papers

Related papers: Learning in Inverse Optimization: Incenter Cost, A…

200 papers

Machine Learning (ML) methods and tools have gained great success in many data, signal, image and video processing tasks, such as classification, clustering, object detection, semantic segmentation, language processing, Human-Machine…

Machine Learning · Computer Science 2023-09-06 Ali Mohammad-Djafari , Ning Chu , Li Wang , Liang Yu

This paper proposes and analyzes a communication-efficient distributed optimization framework for general nonconvex nonsmooth signal processing and machine learning problems under an asynchronous protocol. At each iteration, worker machines…

Optimization and Control · Mathematics 2020-07-15 Jineng Ren , Jarvis Haupt

We derive an efficient stochastic algorithm for inverse problems that present an unknown linear forcing term and a set of nonlinear parameters to be recovered. It is assumed that the data is noisy and that the linear part of the problem is…

Numerical Analysis · Mathematics 2019-09-17 Darko Volkov

We study inverse reinforcement learning (IRL) and imitation learning (IM), the problems of recovering a reward or policy function from expert's demonstrated trajectories. We propose a new way to improve the learning process by adding a…

Machine Learning · Computer Science 2022-08-23 The Viet Bui , Tien Mai , Patrick Jaillet

Inverse Reinforcement Learning (IRL) aims to recover a reward function from expert demonstrations. Recently, Optimal Transport (OT) methods have been successfully deployed to align trajectories and infer rewards. While OT-based methods have…

Machine Learning · Computer Science 2025-06-10 Zixuan Dong , Yumi Omori , Keith Ross

This paper proposes an inverse optimal control method which enables a robot to incrementally learn a control objective function from a collection of trajectory segments. By saying incrementally, it means that the collection of trajectory…

Robotics · Computer Science 2022-02-03 Zihao Liang , Wanxin Jin , Shaoshuai Mou

Nonlinear parametric inverse problems appear in many applications and are typically very expensive to solve, especially if they involve many measurements. These problems pose huge computational challenges as evaluating the objective…

Numerical Analysis · Mathematics 2020-03-25 Drayton Munster , Eric de Sturler

This paper studies the problem of controlling linear dynamical systems subject to point-wise-in-time constraints. We present an algorithm similar to online gradient descent, that can handle time-varying and a priori unknown convex cost…

Optimization and Control · Mathematics 2021-11-03 Marko Nonhoff , Matthias A. Müller

We consider the minimization of submodular functions subject to ordering constraints. We show that this optimization problem can be cast as a convex optimization problem on a space of uni-dimensional measures, with ordering constraints…

Machine Learning · Computer Science 2017-07-31 Francis Bach

Inverse problems describe the task of recovering an underlying signal of interest given observables. Typically, the observables are related via some non-linear forward model applied to the underlying unknown signal. Inverting the non-linear…

Signal Processing · Electrical Eng. & Systems 2023-05-19 Jihui Jin , Etienne Ollivier , Richard Touret , Matthew McKinley , Karim G. Sabra , Justin K. Romberg

Consistent improvement of image priors over the years has led to the development of better inverse problem solvers. Diffusion models are the newcomers to this arena, posing the strongest known prior to date. Recently, such models operating…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Ron Raphaeli , Sean Man , Michael Elad

Learning to Optimize (LtO) is a problem setting in which a machine learning (ML) model is trained to emulate a constrained optimization solver. Learning to produce optimal and feasible solutions subject to complex constraints is a difficult…

Machine Learning · Computer Science 2024-03-18 James Kotary , Ferdinando Fioretto

Aligning partially overlapping point sets where there is no prior information about the value of the transformation is a challenging problem in computer vision. To achieve this goal, we first reduce the objective of the robust point…

Computer Vision and Pattern Recognition · Computer Science 2020-07-07 Wei Lian , WangMeng Zuo , Lei Zhang

We consider Constrained Online Convex Optimization (COCO) with adversarially chosen constraints. At each round, the learner chooses an action before observing the loss and constraint function for that round. The goal is to achieve small…

Machine Learning · Computer Science 2026-05-21 Dhruv Sarkar , Abhishek Sinha

In many applied optimization settings, parameters that define the constraints may not guarantee the best possible solution, and superior solutions might exist that are infeasible for the given parameter values. Removing such constraints,…

Optimization and Control · Mathematics 2024-07-22 Farzin Ahmadi , Todd R. McNutt , Kimia Ghobadi

We consider the problem of optimizing a high-dimensional convex function using stochastic zeroth-order queries. Under sparsity assumptions on the gradients or function values, we present two algorithms: a successive component/feature…

Machine Learning · Statistics 2018-02-27 Yining Wang , Simon Du , Sivaraman Balakrishnan , Aarti Singh

The inverse source problem arising in photoacoustic tomography and in several other coupled-physics modalities is frequently solved by iterative algorithms. Such algorithms are based on the minimization of a certain cost functional. In…

Image and Video Processing · Electrical Eng. & Systems 2025-10-29 Andreas Hauptmann , Leonid Kunyansky , Jenni Poimala

Inverse problems use physical measurements along with a computational model to estimate the parameters or state of a system of interest. Errors in measurements and uncertainties in the computational model lead to inaccurate estimates. This…

Numerical Analysis · Mathematics 2015-02-02 Vishwas Rao , Adrian Sandu

A new algorithm for regret minimization in online convex optimization is described. The regret of the algorithm after $T$ time periods is $O(\sqrt{T \log T})$ - which is the minimum possible up to a logarithmic term. In addition, the new…

Machine Learning · Computer Science 2023-07-24 Elad Hazan , Nimrod Megiddo

The promise of compressive sensing (CS) has been offset by two significant challenges. First, real-world data is not exactly sparse in a fixed basis. Second, current high-performance recovery algorithms are slow to converge, which limits CS…

Machine Learning · Statistics 2017-01-17 Ali Mousavi , Richard G. Baraniuk