English
Related papers

Related papers: The Perils of Learning Before Optimizing

200 papers

This paper aims to explore the problem of trajectory prediction in heterogeneous pedestrian zones, where social dynamics representation is a big challenge. Proposed is an end-to-end learning framework for prediction accuracy improvement…

Artificial Intelligence · Computer Science 2021-01-06 Ha Q. Ngo , Christoph Henke , Frank Hees

Optimization problems involving sequential decisions in a stochastic environment were studied in Stochastic Programming (SP), Stochastic Optimal Control (SOC) and Markov Decision Processes (MDP). In this paper we mainly concentrate on SP…

Optimization and Control · Mathematics 2023-03-29 Guanghui Lan , Alexander Shapiro

In the predict-then-optimize framework, the objective is to train a predictive model, mapping from environment features to parameters of an optimization problem, which maximizes decision quality when the optimization is subsequently solved.…

Machine Learning · Computer Science 2022-07-19 Kai Wang , Sanket Shah , Haipeng Chen , Andrew Perrault , Finale Doshi-Velez , Milind Tambe

We study a new two-time-scale stochastic gradient method for solving optimization problems, where the gradients are computed with the aid of an auxiliary variable under samples generated by time-varying MDPs controlled by the underlying…

Optimization and Control · Mathematics 2024-08-27 Sihan Zeng , Thinh T. Doan , Justin Romberg

In traditional machine learning techniques, the degree of closeness between true and predicted values generally measures the quality of predictions. However, these learning algorithms do not consider prescription problems where the…

Machine Learning · Computer Science 2021-01-05 Mehmet Kolcu , Alper E. Murat

Conventional wisdom to improve the effectiveness of economic dispatch is to design the load forecasting method as accurately as possible. However, this approach can be problematic due to the temporal and spatial correlations between system…

Optimization and Control · Mathematics 2020-03-02 Chenbei Lu , Kui Wang , Chenye Wu

Autonomous driving has a natural bi-level structure. The goal of the upper behavioural layer is to provide appropriate lane change, speeding up, and braking decisions to optimize a given driving task. However, this layer can only indirectly…

Robotics · Computer Science 2022-12-06 Arun Kumar Singh , Jatan Shrestha , Nicola Albarella

Strategic classification studies the problem where self-interested individuals or agents manipulate their response to obtain favorable decision outcomes made by classifiers, typically turning to dishonest actions when they are less costly…

Machine Learning · Computer Science 2026-05-07 Ziyuan Huang , Lina Alkarmi , Mingyan Liu

World models paired with model predictive control (MPC) can be trained offline on large-scale datasets of expert trajectories and enable generalization to a wide range of planning tasks at inference time. Compared to traditional MPC…

Machine Learning · Computer Science 2025-12-11 Arjun Parthasarathy , Nimit Kalra , Rohun Agrawal , Yann LeCun , Oumayma Bounou , Pavel Izmailov , Micah Goldblum

Recent years have seen considerable progress in the continual training of deep neural networks, predominantly thanks to approaches that add replay or regularization terms to the loss function to approximate the joint loss over all tasks so…

Machine Learning · Computer Science 2024-11-01 Timm Hess , Tinne Tuytelaars , Gido M. van de Ven

Machine learning algorithms typically rely on optimization subroutines and are well-known to provide very effective outcomes for many types of problems. Here, we flip the reliance and ask the reverse question: can machine learning…

Machine Learning · Computer Science 2019-07-30 Jesus A. De Loera , Jamie Haddock , Anna Ma , Deanna Needell

We consider a class of a nested optimization problems involving inner and outer objectives. We observe that by taking into explicit account the optimization dynamics for the inner objective it is possible to derive a general framework that…

Machine Learning · Statistics 2019-08-22 Luca Franceschi , Michele Donini , Paolo Frasconi , Massimiliano Pontil

Predictive Coding (PC) is an influential account of cortical learning. Much of recent work has focused on comparing PC to Backpropagation (BP) to find whether PC offers any advantages. Small scale experiments show that PC enables learning…

Machine Learning · Computer Science 2026-05-13 Gaspard Oliviers , Elene Lominadze , Rafal Bogacz

Learning under one-sided feedback (i.e., where we only observe the labels for examples we predicted positively on) is a fundamental problem in machine learning -- applications include lending and recommendation systems. Despite this, there…

Machine Learning · Computer Science 2020-10-14 Heinrich Jiang , Qijia Jiang , Aldo Pacchiano

Increasing effort is put into the development of methods for learning mechanistic models from data. This task entails not only the accurate estimation of parameters but also a suitable model structure. Recent work on the discovery of…

Machine Learning · Computer Science 2024-07-01 Justin N. Kreikemeyer , Philipp Andelfinger , Adelinde M. Uhrmacher

A common strategy in modern learning systems is to learn a representation that is useful for many tasks, a.k.a. representation learning. We study this strategy in the imitation learning setting for Markov decision processes (MDPs) where…

Machine Learning · Computer Science 2020-02-26 Sanjeev Arora , Simon S. Du , Sham Kakade , Yuping Luo , Nikunj Saunshi

In its simplest form, the traffic flow prediction problem is restricted to predicting a single time-step into the future. Multi-step traffic flow prediction extends this set-up to the case where predicting multiple time-steps into the…

Artificial Intelligence · Computer Science 2018-05-18 Arief Koesdwiady , Fakhri Karray

In optimization problems, the quality of a candidate solution can be characterized by the optimality gap. For most stochastic optimization problems, this gap must be statistically estimated. We show that for risk-averse problems, standard…

Optimization and Control · Mathematics 2025-05-05 E. Ruben van Beesten , Nick W. Koning , David P. Morton

Most work on sequential learning assumes a fixed set of actions that are available all the time. However, in practice, actions can consist of picking subsets of readings from sensors that may break from time to time, road segments that can…

Machine Learning · Computer Science 2026-04-29 Gergely Neu , Michal Valko

Traditional maximum entropy and sparsity-based algorithms for analytic continuation often suffer from the ill-posed kernel matrix or demand tremendous computation time for parameter tuning. Here we propose a neural network method by convex…

Machine Learning · Computer Science 2022-02-07 Dongchen Huang , Yi-feng Yang