English
Related papers

Related papers: Score Function Gradient Estimation to Widen the Ap…

200 papers

Decision-focused learning (DFL) was recently proposed for stochastic optimization problems that involve unknown parameters. By integrating predictive modeling with an implicitly differentiable optimization layer, DFL has shown superior…

Machine Learning · Computer Science 2022-11-28 Lingkai Kong , Jiaming Cui , Yuchen Zhuang , Rui Feng , B. Aditya Prakash , Chao Zhang

Gradient-based methods enable efficient search capabilities in high dimensions. However, in order to apply them effectively in offline optimization paradigms such as offline Reinforcement Learning (RL) or Imitation Learning (IL), we require…

Machine Learning · Computer Science 2023-10-18 H. J. Terry Suh , Glen Chou , Hongkai Dai , Lujie Yang , Abhishek Gupta , Russ Tedrake

Decision-focused learning (DFL) offers an end-to-end approach to the predict-then-optimize (PO) framework by training predictive models directly on decision loss (DL), enhancing decision-making performance within PO contexts. However, the…

Machine Learning · Computer Science 2025-04-15 Jiaqi Yang , Enming Liang , Zicheng Su , Zhichao Zou , Peng Zhen , Jiecheng Guo , Wanjing Ma , Kun An

When some parameters of a constrained optimization problem (COP) are uncertain, this gives rise to a predict-then-optimize (PtO) problem, comprising two stages: the prediction of the unknown parameters from contextual information and the…

Machine Learning · Computer Science 2025-10-28 Jayanta Mandi , Marianne Defresne , Senne Berden , Tias Guns

Federated learning has gained popularity as a means of training models distributed across the wireless edge. The paper introduces delay-aware hierarchical federated learning (DFL) to improve the efficiency of distributed machine learning…

Machine Learning · Computer Science 2023-09-29 Frank Po-Chen Lin , Seyyedali Hosseinalipour , Nicolò Michelusi , Christopher Brinton

In this paper, we consider gradient methods for minimizing smooth convex functions, which employ the information obtained at the previous iterations in order to accelerate the convergence towards the optimal solution. This information is…

Optimization and Control · Mathematics 2021-06-02 Yurii Nesterov , Mihai I. Florea

In decision-making problems under uncertainty, predicting unknown parameters is often considered independent of the optimization part. Decision-focused learning (DFL) is a task-oriented framework that integrates prediction and optimization…

Machine Learning · Computer Science 2025-02-11 Haeun Jeon , Hyunglip Bae , Minsu Park , Chanyeong Kim , Woo Chang Kim

Decision-focused learning (DFL) has emerged as a powerful end-to-end alternative to conventional predict-then-optimize (PTO) pipelines by directly optimizing predictive models through downstream decision losses. Existing DFL frameworks are…

Machine Learning · Computer Science 2025-12-01 Xinyu Wang , Jinxiao Du , Yiyang Peng , Wei Ma

Differential equations in general and neural ODEs in particular are an essential technique in continuous-time system identification. While many deterministic learning algorithms have been designed based on numerical integration via the…

Machine Learning · Computer Science 2021-10-18 Lenart Treven , Philippe Wenk , Florian Dörfler , Andreas Krause

The use of machine learning methods helps to improve decision making in different fields. In particular, the idea of bridging predictions (machine learning models) and prescriptions (optimization problems) is gaining attention within the…

Optimization and Control · Mathematics 2022-11-22 Antonio Alcántara , Carlos Ruiz

We present an algorithm for learning decision trees using stochastic gradient information as the source of supervision. In contrast to previous approaches to gradient-based tree learning, our method operates in the incremental learning…

Machine Learning · Statistics 2019-09-25 Henry Gouk , Bernhard Pfahringer , Eibe Frank

In this paper, we introduce a powerful and efficient framework for direct optimization of ranking metrics. The problem is ill-posed due to the discrete structure of the loss, and to deal with that, we introduce two important techniques:…

Machine Learning · Computer Science 2020-08-21 Aleksei Ustimenko , Liudmila Prokhorenkova

Uncertainty in optimization is often represented as stochastic parameters in the optimization model. In Predict-Then-Optimize approaches, predictions of a machine learning model are used as values for such parameters, effectively…

Machine Learning · Computer Science 2025-12-03 Pieter Smet

An algorithm is proposed, analyzed, and tested experimentally for solving stochastic optimization problems in which the decision variables are constrained to satisfy equations defined by deterministic, smooth, and nonlinear functions. It is…

Optimization and Control · Mathematics 2021-07-09 Frank E. Curtis , Daniel P. Robinson , Baoyu Zhou

In this work, we develop analysis and algorithms for a class of (stochastic) bilevel optimization problems whose lower-level (LL) problem is strongly convex and linearly constrained. Most existing approaches for solving such problems rely…

Optimization and Control · Mathematics 2025-04-08 Prashant Khanduri , Ioannis Tsaknakis , Yihua Zhang , Sijia Liu , Mingyi Hong

Federated learning (FL) is a distributed machine learning paradigm in which a large number of clients coordinate with a central server to learn a model without sharing their own training data. One central server is not enough, due to…

The recently introduced Gradient Methods with Memory use a subset of the past oracle information to create an accurate model of the objective function that enables them to surpass the Gradient Method in practical performance. The model…

Optimization and Control · Mathematics 2024-01-30 Mihai I. Florea

Discrete optimization problems often arise in deep learning tasks, despite the fact that neural networks typically operate on continuous data. One class of these problems involve objective functions which depend on neural networks, but…

Machine Learning · Computer Science 2023-10-17 Eric Lei , Arman Adibi , Hamed Hassani

Optimization models used to make discrete decisions often contain uncertain parameters that are context-dependent and estimated through prediction. To account for the quality of the decision made based on the prediction, decision-focused…

Machine Learning · Computer Science 2024-07-30 Noah Schutte , Krzysztof Postek , Neil Yorke-Smith

Significant advances have been made recently on training neural networks, where the main challenge is in solving an optimization problem with abundant critical points. However, existing approaches to address this issue crucially rely on a…

Machine Learning · Computer Science 2019-02-28 Weihao Gao , Ashok Vardhan Makkuva , Sewoong Oh , Pramod Viswanath