English
Related papers

Related papers: Data-driven Inverse Optimization with Imperfect In…

200 papers

We study the problem of inverse reinforcement learning (IRL), where the learning agent recovers a reward function using expert demonstrations. Most of the existing IRL techniques make the often unrealistic assumption that the agent has…

Machine Learning · Computer Science 2021-12-20 Franck Djeumou , Murat Cubuktepe , Craig Lennon , Ufuk Topcu

Modeling the purposeful behavior of imperfect agents from a small number of observations is a challenging task. When restricted to the single-agent decision-theoretic setting, inverse optimal control techniques assume that observed behavior…

Computer Science and Game Theory · Computer Science 2015-03-19 Kevin Waugh , Brian D. Ziebart , J. Andrew Bagnell

Inverse optimal control can be used to characterize behavior in sequential decision-making tasks. Most existing work, however, is limited to fully observable or linear systems, or requires the action signals to be known. Here, we introduce…

Machine Learning · Computer Science 2023-10-31 Dominik Straub , Matthias Schultheis , Heinz Koeppl , Constantin A. Rothkopf

We consider the problem of designing agents able to compute optimal decisions by composing data from multiple sources to tackle tasks involving: (i) tracking a desired behavior while minimizing an agent-specific cost; (ii) satisfying safety…

Optimization and Control · Mathematics 2023-05-23 Emiland Garrabe , Martina Lamberti , Giovanni Russo

Data used to train machine learning models can be adversarial--maliciously constructed by adversaries to fool the model. Challenge also arises by privacy, confidentiality, or due to legal constraints when data are geographically gathered…

Machine Learning · Computer Science 2020-07-09 Alireza Sadeghi , Gang Wang , Meng Ma , Georgios B. Giannakis

Non-discrimination is a recognized objective in algorithmic decision making. In this paper, we introduce a novel probabilistic formulation of data pre-processing for reducing discrimination. We propose a convex optimization for learning a…

Machine Learning · Statistics 2017-04-12 Flavio P. Calmon , Dennis Wei , Karthikeyan Natesan Ramamurthy , Kush R. Varshney

In this paper, multi-agent systems minimizing a sum of objective functions, where each component is only known to a particular node, is considered for continuous-time dynamics with time-varying interconnection topologies. Assuming that each…

Multiagent Systems · Computer Science 2015-03-19 Guodong Shi , Karl Henrik Johansson , Yiguang Hong

Inverse linear programming (LP) has received increasing attention due to its potential to generate efficient optimization formulations that can closely replicate the behavior of a complex system. However, inversely inferred parameters and…

Optimization and Control · Mathematics 2022-02-22 Zahed Shahmoradi , Taewoo Lee

This work is focussed on the inversion task of inferring the distribution over parameters of interest leading to multiple sets of observations. The potential to solve such distributional inversion problems is driven by increasing…

Machine Learning · Statistics 2026-05-06 Arnaud Vadeboncoeur , Mark Girolami , Andrew M. Stuart

Inverse optimization (Inverse optimal control) is the task of imputing a cost function such that given test points (trajectories) are (nearly) optimal with respect to the discovered cost. Prior methods in inverse optimization assume that…

Optimization and Control · Mathematics 2025-10-21 Filip Bečanović , Jared Miller , Vincent Bonnet , Kosta Jovanović , Samer Mohammed

While data-driven decision-making is transforming modern operations, most large-scale data is of an observational nature, such as transactional records. These data pose unique challenges in a variety of operational problems posed as…

Optimization and Control · Mathematics 2017-05-23 Dimitris Bertsimas , Nathan Kallus

Distributed learning and adaptation have received significant interest and found wide-ranging applications in machine learning and signal processing. While various approaches, such as shared-memory optimization, multi-task learning, and…

Signal Processing · Electrical Eng. & Systems 2024-12-03 Pourya Behmandpoor , Marc Moonen , Panagiotis Patrinos

The goal of this paper is to solve a class of stochastic optimal control problems numerically, in which the state process is governed by an It\^o type stochastic differential equation with control process entering both in the drift and the…

Optimization and Control · Mathematics 2020-06-05 Richard Archibald , Feng Bao , Jiongmin Yong , Tao Zhou

A typical assumption in supervised machine learning is that the train (source) and test (target) datasets follow completely the same distribution. This assumption is, however, often violated in uncertain real-world applications, which…

Machine Learning · Computer Science 2021-08-17 Masahiro Nomura , Yuta Saito

The goal of inverse reinforcement learning (IRL) is to infer a reward function that explains the behavior of an agent performing a task. The assumption that most approaches make is that the demonstrated behavior is near-optimal. In many…

Machine Learning · Computer Science 2020-11-20 Luis Haug , Ivan Ovinnikov , Eugene Bykovets

The design of data-driven formulations for machine learning and decision-making with good out-of-sample performance is a key challenge. The observation that good in-sample performance does not guarantee good out-of-sample performance is…

Machine Learning · Statistics 2025-02-04 Amine Bennouna , Bart Van Parys , Ryan Lucas

Machine learning algorithms typically rely on optimization subroutines and are well-known to provide very effective outcomes for many types of problems. Here, we flip the reliance and ask the reverse question: can machine learning…

Machine Learning · Computer Science 2019-07-30 Jesus A. De Loera , Jamie Haddock , Anna Ma , Deanna Needell

Heterogeneous networks comprise agents with varying capabilities in terms of computation, storage, and communication. In such settings, it is crucial to factor in the operating characteristics in allowing agents to choose appropriate…

Optimization and Control · Mathematics 2022-09-07 Yichuan Li , Petros Voulgaris , Nikolaos M. Freris

Existing approaches to diffusion-based inverse problem solvers frame the signal recovery task as a probabilistic sampling episode, where the solution is drawn from the desired posterior distribution. This framework suffers from several…

Machine Learning · Computer Science 2024-12-24 Henry Li , Marcus Pereira

A fundamental question in neuroscience is how the brain creates an internal model of the world to guide actions using sequences of ambiguous sensory information. This is naturally formulated as a reinforcement learning problem under partial…

Machine Learning · Computer Science 2020-11-02 Minhae Kwon , Saurabh Daptardar , Paul Schrater , Xaq Pitkow