English
Related papers

Related papers: AutoBool: An Reinforcement-Learning trained LLM fo…

200 papers

This position paper outlines the potential of AutoML for incremental (continual) learning to encourage more research in this direction. Incremental learning involves incorporating new data from a stream of tasks and distributions to learn…

Machine Learning · Computer Science 2023-11-21 Mert Kilickaya , Joaquin Vanschoren

Large vision-language models (VLMs) fine-tuned on specialized visual instruction-following data have exhibited impressive language reasoning capabilities across various scenarios. However, this fine-tuning paradigm may not be able to…

Artificial Intelligence · Computer Science 2024-10-10 Yuexiang Zhai , Hao Bai , Zipeng Lin , Jiayi Pan , Shengbang Tong , Yifei Zhou , Alane Suhr , Saining Xie , Yann LeCun , Yi Ma , Sergey Levine

Recent years, the database committee has attempted to develop automatic database management systems. Although some researches show that the applying AI to data management is a significant and promising direction, there still exists many…

Databases · Computer Science 2021-11-23 Yu Yan , Hongzhi Wang , Jian Ma , Jian Geng , Yuzhuo Wang

With the rapid advancement of large language models (LLMs), reinforcement learning (RL) has emerged as a pivotal methodology for enhancing the reasoning capabilities of LLMs. Unlike traditional pre-training approaches, RL encompasses…

Machine Learning · Computer Science 2025-08-27 Jingkai He , Tianjian Li , Erhu Feng , Dong Du , Qian Liu , Tao Liu , Yubin Xia , Haibo Chen

Effective tool use is essential for large language models (LLMs) to interact with their environment. However, progress is limited by the lack of efficient reinforcement learning (RL) frameworks specifically designed for tool use, due to…

Computation and Language · Computer Science 2026-04-16 Junjie Ye , Changhao Jiang , Zhengyin Du , Yufei Xu , Xuesong Yao , Zhiheng Xi , Xiaoran Fan , Qi Zhang , Tao Gui , Xuanjing Huang , Jiecao Chen

Reinforcement learning from expert demonstrations has long remained a challenging research problem, and existing state-of-the-art methods using behavioral cloning plus further RL training often suffer from poor generalization, low sample…

Machine Learning · Computer Science 2025-05-07 Borui Wang , Kathleen McKeown , Rex Ying

Reinforcement learning (RL) enhanced large language models (LLMs), particularly exemplified by DeepSeek-R1, have exhibited outstanding performance. Despite the effectiveness in improving LLM capabilities, its implementation remains highly…

Computation and Language · Computer Science 2025-02-25 Shuhe Wang , Shengyu Zhang , Jie Zhang , Runyi Hu , Xiaoya Li , Tianwei Zhang , Jiwei Li , Fei Wu , Guoyin Wang , Eduard Hovy

Preference-based reinforcement learning (RL) has emerged as a new field in robot learning, where humans play a pivotal role in shaping robot behavior by expressing preferences on different sequences of state-action pairs. However,…

Robotics · Computer Science 2024-02-26 Simon Holk , Daniel Marta , Iolanda Leite

Reinforcement learning (RL) over text representations can be effective for finding high-value policies that can search over graphs. However, RL requires careful structuring of the search space and algorithm design to be effective in this…

Machine Learning · Computer Science 2023-10-05 Raj Ghugare , Santiago Miret , Adriana Hugessen , Mariano Phielipp , Glen Berseth

In a recent study, Reinforcement Learning (RL) used in combination with many-objective search, has been shown to outperform alternative techniques (random search and many-objective search) for online testing of Deep Neural Network-enabled…

Software Engineering · Computer Science 2024-03-21 Luca Giamattei , Matteo Biagiola , Roberto Pietrantuono , Stefano Russo , Paolo Tonella

Recent advances in reinforcement learning (RL) for large language model (LLM) fine-tuning show promise in addressing multi-objective tasks but still face significant challenges, including competing objective balancing, low training…

Computation and Language · Computer Science 2025-07-10 Lingxiao Kong , Cong Yang , Susanne Neufang , Oya Deniz Beyan , Zeyd Boukhers

Compared with model-based control and optimization methods, reinforcement learning (RL) provides a data-driven, learning-based framework to formulate and solve sequential decision-making problems. The RL framework has become promising due…

Systems and Control · Electrical Eng. & Systems 2024-07-29 Pouria Razzaghi , Amin Tabrizian , Wei Guo , Shulu Chen , Abenezer Taye , Ellis Thompson , Alexis Bregeon , Ali Baheri , Peng Wei

Recent advancements in Large Language Models (LLMs) have shown significant progress in understanding complex natural language. One important application of LLM is LLM-based AI Agent, which leverages the ability of LLM as well as external…

Computation and Language · Computer Science 2024-07-19 Zelong Li , Shuyuan Xu , Kai Mei , Wenyue Hua , Balaji Rama , Om Raheja , Hao Wang , He Zhu , Yongfeng Zhang

Large language models are increasingly used for complex reasoning tasks where high-quality offline data such as expert-annotated solutions and distilled reasoning traces are often available. However, in environments with sparse rewards,…

Artificial Intelligence · Computer Science 2025-08-11 Yihao Liu , Shuocheng Li , Lang Cao , Yuhang Xie , Mengyu Zhou , Haoyu Dong , Xiaojun Ma , Shi Han , Dongmei Zhang

Reinforcement Learning (RL) plays a crucial role in advancing autonomous driving technologies by maximizing reward functions to achieve the optimal policy. However, crafting these reward functions has been a complex, manual process in many…

Artificial Intelligence · Computer Science 2024-06-18 Xu Han , Qiannan Yang , Xianda Chen , Xiaowen Chu , Meixin Zhu

Sensational headlines are headlines that capture people's attention and generate reader interest. Conventional abstractive headline generation methods, unlike human writers, do not optimize for maximal reader attention. In this paper, we…

Computation and Language · Computer Science 2019-09-10 Peng Xu , Chien-Sheng Wu , Andrea Madotto , Pascale Fung

Reinforcement Learning (RL) has shown great potential for autonomous decision-making in the cybersecurity domain, enabling agents to learn through direct environment interaction. However, RL agents in Autonomous Cyber Operations (ACO)…

Cryptography and Security · Computer Science 2026-02-17 Konur Tholl , François Rivest , Mariam El Mezouar , Adrian Taylor , Ranwa Al Mallah

Large Language Model (LLM) agents have shown stunning results in complex tasks, yet they often operate in isolation, failing to learn from past experiences. Existing memory-based methods primarily store raw trajectories, which are often…

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

Machine Learning · Statistics 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

Conducting literature reviews for scientific papers is essential for understanding research, its limitations, and building on existing work. It is a tedious task which makes an automatic literature review generator appealing. Unfortunately,…

‹ Prev 1 3 4 5 6 7 10 Next ›