English
Related papers

Related papers: Transform then Explore: a Simple and Effective Tec…

200 papers

Combinatorial Optimization underpins many real-world applications and yet, designing performant algorithms to solve these complex, typically NP-hard, problems remains a significant research challenge. Reinforcement Learning (RL) provides a…

Conventional reinforcement learning (RL) algorithms exhibit broad generality in their theoretical formulation and high performance on several challenging domains when combined with powerful function approximation. However, developing RL…

Machine Learning · Computer Science 2023-11-07 Joseph Modayil , Zaheer Abbas

Combining Chain-of-Thought (CoT) with Reinforcement Learning (RL) improves text-to-image (T2I) generation, yet the underlying interaction between CoT's exploration and RL's optimization remains unclear. We present a systematic entropy-based…

Machine Learning · Computer Science 2026-04-06 Han Song , Yucheng Zhou , Jianbing Shen , Yu Cheng

The exploration-exploitation dilemma in reinforcement learning (RL) is a fundamental challenge to efficient RL algorithms. Existing algorithms for finite state and action discounted RL problems address this by assuming sufficient…

Machine Learning · Computer Science 2025-12-09 Caleb Ju , Guanghui Lan

Reinforcement learning (RL) for mathematical reasoning can suffer from reward sparsity: for challenging problems, LLM fails to sample any correct trajectories, preventing RL from receiving meaningful positive feedback. At the same time,…

Machine Learning · Computer Science 2026-03-06 Yangzhen Wu , Shanda Li , Zixin Wen , Xin Zhou , Ameet Talwalkar , Yiming Yang , Wenhao Huang , Tianle Cai

Feature transformation methods aim to find an optimal mathematical feature-feature crossing process that generates high-value features and improves the performance of downstream machine learning tasks. Existing frameworks, though designed…

Machine Learning · Computer Science 2025-04-25 Xiaohan Huang , Dongjie Wang , Zhiyuan Ning , Ziyue Qiao , Qingqing Long , Haowei Zhu , Yi Du , Min Wu , Yuanchun Zhou , Meng Xiao

One of the challenges in online reinforcement learning (RL) is that the agent needs to trade off the exploration of the environment and the exploitation of the samples to optimize its behavior. Whether we optimize for regret, sample…

Machine Learning · Computer Science 2021-11-19 Jean Tarbouriech , Matteo Pirotta , Michal Valko , Alessandro Lazaric

Benders decomposition (BD), along with its generalized version (GBD), is a widely used algorithm for solving large-scale mixed-integer optimization problems that arise in the operation of process systems. However, the off-the-shelf…

Optimization and Control · Mathematics 2025-08-12 Zhe Li , Bernard T. Agyeman , Ilias Mitrai , Prodromos Daoutidis

In reinforcement learning (RL), it is easier to solve a task if given a good representation. While deep RL should automatically acquire such good representations, prior work often finds that learning representations in an end-to-end fashion…

Machine Learning · Computer Science 2023-02-21 Benjamin Eysenbach , Tianjun Zhang , Ruslan Salakhutdinov , Sergey Levine

We present an implementation of model-based online reinforcement learning (RL) for continuous domains with deterministic transitions that is specifically designed to achieve low sample complexity. To achieve low sample complexity, since the…

Artificial Intelligence · Computer Science 2012-02-01 Tobias Jung , Peter Stone

Reinforcement learning (RL) is used to directly design a control policy using data collected from the system. This paper considers the robustness of controllers trained via model-free RL. The discussion focuses on the standard model-based…

Systems and Control · Computer Science 2019-04-09 Harish K. Venkataraman , Peter J. Seiler

Recently reinforcement learning (RL) has emerged as a promising approach for quadrupedal locomotion, which can save the manual effort in conventional approaches such as designing skill-specific controllers. However, due to the complex…

Robotics · Computer Science 2021-09-17 Haojie Shi , Bo Zhou , Hongsheng Zeng , Fan Wang , Yueqiang Dong , Jiangyong Li , Kang Wang , Hao Tian , Max Q. -H. Meng

In natural language processing tasks, pure reinforcement learning (RL) fine-tuning methods often suffer from inefficient exploration and slow convergence; while supervised fine-tuning (SFT) methods, although efficient in training, have…

Computation and Language · Computer Science 2025-09-17 Min Zeng , Jingfei Sun , Xueyou Luo , Caiquan Liu , Shiqi Zhang , Li Xie , Xiaoxin Chen

Reinforcement learning (RL) often struggles to accomplish a sparse-reward long-horizon task in a complex environment. Goal-conditioned reinforcement learning (GCRL) has been employed to tackle this difficult problem via a curriculum of…

Machine Learning · Computer Science 2023-12-20 Lisheng Wu , Ke Chen

Combinatorial optimization problems (COPs) are an important research topic in various fields. In recent times, there have been many attempts to solve COPs using deep learning-based approaches. We propose a novel neural network model that…

Computational Geometry · Computer Science 2023-04-17 Jaeseung Lee , Woojin Choi , Jibum Kim

Reinforcement Learning (RL) methods used for solving real-world optimization problems often involve dynamic state-action spaces, larger scale, and sparse rewards, leading to significant challenges in convergence, scalability, and efficient…

Machine Learning · Computer Science 2025-09-29 Stavros Orfanoudakis , Nanda Kishor Panda , Peter Palensky , Pedro P. Vergara

Reinforcement learning with general utilities (RLGU) offers a unifying framework to capture several problems beyond standard expected returns, including imitation learning, pure exploration, and safe RL. Despite recent fundamental advances…

Machine Learning · Computer Science 2025-10-27 Anas Barakat , Souradip Chakraborty , Peihong Yu , Pratap Tokekar , Amrit Singh Bedi

Graph of Thoughts (GoT), a generalized form of recent prompting paradigms for large language models (LLMs), has been shown to be useful for elaborate problem solving. By executing a graph of operations, thoughts of the LLM are structured as…

Machine Learning · Computer Science 2026-05-22 Manuel Noah Riesen , Peter Alfred von Niederhäusern

We consider reinforcement learning (RL) in continuous time and study the problem of achieving the best trade-off between exploration of a black box environment and exploitation of current knowledge. We propose an entropy-regularized reward…

Optimization and Control · Mathematics 2019-02-14 Haoran Wang , Thaleia Zariphopoulou , Xunyu Zhou

Tabular data serves as the backbone of modern data analysis and scientific research. While Large Language Models (LLMs) fine-tuned via Supervised Fine-Tuning (SFT) have significantly improved natural language interaction with such…