English
Related papers

Related papers: Learning to branch with Tree MDPs

200 papers

Scheduling flexible sources to promote the integration of renewable generation is one fundamental problem for operating active distribution networks (ADNs). However, existing works are usually based on power flow models, which require…

Optimization and Control · Mathematics 2022-08-09 Ge Chen , Hongcai Zhang , Yonghua Song

Deploying reinforcement learning policies in the real world requires adapting to time-varying environments. We study this problem in the contextual Markov Decision Process (cMDP) framework, where a family of environments is indexed by a…

Machine Learning · Computer Science 2026-05-04 Param Budhraja , Aditya Gangrade , Alex Olshevsky , Venkatesh Saligrama

Tree ensembles are very popular machine learning models, known for their effectiveness in supervised classification and regression tasks. Their performance derives from aggregating predictions of multiple decision trees, which are renowned…

Optimization and Control · Mathematics 2025-01-14 Lorenzo Bonasera , Emilio Carrizosa

Reinforcement learning (RL) algorithms can be used to provide personalized services, which rely on users' private and sensitive data. To protect the users' privacy, privacy-preserving RL algorithms are in demand. In this paper, we study RL…

Machine Learning · Computer Science 2021-10-20 Chonghua Liao , Jiafan He , Quanquan Gu

Recommender systems play a crucial role in mitigating the problem of information overload by suggesting users' personalized items or services. The vast majority of traditional recommender systems consider the recommendation procedure as a…

Machine Learning · Computer Science 2019-06-28 Xiangyu Zhao , Liang Zhang , Long Xia , Zhuoye Ding , Dawei Yin , Jiliang Tang

This paper presents an approach for learning Model Predictive Control (MPC) schemes directly from data using Reinforcement Learning (RL) methods. The state-of-the-art learning methods use RL to improve the performance of parameterized MPC…

Systems and Control · Electrical Eng. & Systems 2023-01-05 Shambhuraj Sawant , Akhil S Anand , Dirk Reinhardt , Sebastien Gros

k-plex is a representative definition of communities in networks. While the cliques is too stiff to applicate to real cases, the k-plex relaxes the notion of the clique, allowing each node to miss up to k connections. Although k-plexes are…

Data Structures and Algorithms · Computer Science 2022-08-12 Yun-Ya Huang , Chih-Ya Shen

In this paper we consider the problem of how a reinforcement learning agent that is tasked with solving a sequence of reinforcement learning problems (a sequence of Markov decision processes) can use knowledge acquired early in its lifetime…

Machine Learning · Computer Science 2019-02-05 Francisco M. Garcia , Philip S. Thomas

The POMDP is a powerful framework for reasoning under outcome and information uncertainty, but constructing an accurate POMDP model is difficult. Bayes-Adaptive Partially Observable Markov Decision Processes (BA-POMDPs) extend POMDPs to…

Artificial Intelligence · Computer Science 2018-06-15 Sammie Katt , Frans A. Oliehoek , Christopher Amato

We present two elegant solutions for modeling continuous-time dynamics, in a novel model-based reinforcement learning (RL) framework for semi-Markov decision processes (SMDPs), using neural ordinary differential equations (ODEs). Our models…

Machine Learning · Computer Science 2020-10-27 Jianzhun Du , Joseph Futoma , Finale Doshi-Velez

Designing sample-efficient and computationally feasible reinforcement learning (RL) algorithms is particularly challenging in environments with large or infinite state and action spaces. In this paper, we advance this effort by presenting…

Machine Learning · Computer Science 2024-10-04 Zakaria Mhammedi

Machine learning is increasingly used to guide branch-and-cut (B&C) for mixed-integer linear programming by learning score-based policies for selecting branching variables and cutting planes. Many approaches train on local signals from…

Optimization and Control · Mathematics 2026-02-02 Hongyu Cheng , Amitabh Basu

Math word problems (MWPs) require analyzing text descriptions and generating mathematical equations to derive solutions. Existing works focus on solving MWPs with two types of solvers: tree-based solver and large language model (LLM)…

Computation and Language · Computer Science 2023-08-29 Jie Yao , Zihao Zhou , Qiufeng Wang

We consider online reinforcement learning in episodic Markov decision process (MDP) with unknown transition function and stochastic rewards drawn from some fixed but unknown distribution. The learner aims to learn the optimal policy and…

Machine Learning · Computer Science 2024-03-12 Vincent Leon , S. Rasoul Etesami

In Reinforcement Learning (RL), it is commonly assumed that an immediate reward signal is generated for each action taken by the agent, helping the agent maximize cumulative rewards to obtain the optimal policy. However, in many real-world…

Machine Learning · Computer Science 2024-10-29 Yuting Tang , Xin-Qiang Cai , Yao-Xiang Ding , Qiyu Wu , Guoqing Liu , Masashi Sugiyama

Robust Markov decision processes (r-MDPs) extend MDPs by explicitly modelling epistemic uncertainty about transition dynamics. Learning r-MDPs from interactions with an unknown environment enables the synthesis of robust policies with…

Machine Learning · Computer Science 2025-11-21 Yannik Schnitzer , Alessandro Abate , David Parker

Contextual Reinforcement Learning (CRL) tackles the problem of solving a set of related Contextual Markov Decision Processes (CMDPs) that vary across different context variables. Traditional approaches--independent training and multi-task…

Machine Learning · Computer Science 2026-03-31 Tianyue Zhou , Jung-Hoon Cho , Cathy Wu

Recommender systems (RSs) have become an inseparable part of our everyday lives. They help us find our favorite items to purchase, our friends on social networks, and our favorite movies to watch. Traditionally, the recommendation problem…

Information Retrieval · Computer Science 2022-06-09 M. Mehdi Afsar , Trafford Crump , Behrouz Far

Reinforcementlearning(RL)folkloresuggeststhathistory-basedfunctionapproximationmethods,suchas recurrent neural nets or history-based state abstraction, perform better than their memory-less counterparts, due to the fact that function…

Machine Learning · Computer Science 2022-11-08 Gandharv Patil , Aditya Mahajan , Doina Precup

Mixed-integer linear programs (MILPs) are widely used in artificial intelligence and operations research to model complex decision problems like scheduling and routing. Designing such programs however requires both domain and modelling…

Artificial Intelligence · Computer Science 2021-07-16 Mohit Kumar , Samuel Kolb , Luc De Raedt , Stefano Teso