English
Related papers

Related papers: ReaCritic: Reasoning Transformer-based DRL Critic-…

200 papers

Deep Reinforcement Learning (DRL) has emerged as an efficient approach to resource allocation due to its strong capability in handling complex decision-making tasks. However, only limited research has explored the training of DRL models…

Machine Learning · Computer Science 2025-09-23 Aohan Li , Miyu Tsuzuki

6G networks are composed of subnetworks expected to meet ultra-reliable low-latency communication (URLLC) requirements for mission-critical applications such as industrial control and automation. An often-ignored aspect in URLLC is…

Systems and Control · Electrical Eng. & Systems 2025-07-17 Fateme Salehi , Aamir Mahmood , Sarder Fakhrul Abedin , Kyi Thar , Mikael Gidlund

Buildings with Heating, Ventilation, and Air Conditioning (HVAC) systems play a crucial role in ensuring indoor comfort and efficiency. While traditionally governed by physics-based models, the emergence of big data has enabled data-driven…

Machine Learning · Computer Science 2025-03-26 Gautham Udayakumar Bekal , Ahmed Ghareeb , Ashish Pujari

As wireless networks grow to support more complex applications, the Open Radio Access Network (O-RAN) architecture, with its smart RAN Intelligent Controller (RIC) modules, becomes a crucial solution for real-time network data collection,…

Networking and Internet Architecture · Computer Science 2024-10-08 Fatemeh Lotfi , Fatemeh Afghah

Technology advancements in wireless communications and high-performance Extended Reality (XR) have empowered the developments of the Metaverse. The demand for the Metaverse applications and hence, real-time digital twinning of real-world…

Machine Learning · Computer Science 2023-03-10 Wenhan Yu , Terence Jie Chua , Jun Zhao

Large language models excel at complex tasks by breaking down problems into structured reasoning steps. However, reasoning traces often extend beyond reaching a correct answer, causing wasted computation, reduced readability, and…

Computation and Language · Computer Science 2025-05-26 Razvan-Gabriel Dumitru , Darius Peteleaza , Vikas Yadav , Liangming Pan

Utilizing Deep Reinforcement Learning (DRL) for Reconfigurable Intelligent Surface (RIS) assisted wireless communication has been extensively researched. However, existing DRL methods either act as a simple optimizer or only solve problems…

Systems and Control · Electrical Eng. & Systems 2026-01-19 Meng-Qian Alexander Wu , Tzu-Hsien Sang , Luisa Schuhmacher , Ming-Jie Guo , Khodr Hammoud , Sofie Pollin

While Large Language Models (LLMs) excel at algorithmic code generation, they struggle with front-end development, where correctness is judged on rendered pixels and interaction. We present ReLook, an agentic, vision-grounded reinforcement…

Machine Learning · Computer Science 2025-10-14 Yuhang Li , Chenchen Zhang , Ruilin Lv , Ao Liu , Ken Deng , Yuanxing Zhang , Jiaheng Liu , Wiggin Zhou , Bo Zhou

Large Language Models (LLMs) demonstrate transformative potential, yet their reasoning remains inconsistent and unreliable. Reinforcement learning (RL)-based fine-tuning is a key mechanism for improvement, but its effectiveness is…

Machine Learning · Computer Science 2026-02-11 Pei-Chi Pan , Yingbin Liang , Sen Lin

Constructing states from sequences of observations is an important component of reinforcement learning agents. One solution for state construction is to use recurrent neural networks. Back-propagation through time (BPTT), and real-time…

Machine Learning · Computer Science 2023-11-23 Khurram Javed , Haseeb Shah , Rich Sutton , Martha White

Recent studies show that Large Language Models (LLMs) achieve strong reasoning capabilities through supervised fine-tuning or reinforcement learning. However, a key approach, the Process Reward Model (PRM), suffers from reward hacking,…

Computation and Language · Computer Science 2026-04-10 Teng Wang , Zhangyi Jiang , Zhenqi He , Shenyang Tong , Wenhan Yang , Yanan Zheng , Zeyu Li , Zifan He , Hailei Gong , Zewen Ye , Shengjie Ma , Jianping Zhang

Deep reinforcement learning (DRL) has become a powerful tool for complex decision-making in machine learning and AI. However, traditional methods often assume perfect action execution, overlooking the uncertainties and deviations between an…

Robotics · Computer Science 2025-07-02 Oren Fivel , Matan Rudman , Kobi Cohen

This paper introduces a model-based approach for training feedback controllers for an autonomous agent operating in a highly nonlinear (albeit deterministic) environment. We desire the trained policy to ensure that the agent satisfies…

Systems and Control · Electrical Eng. & Systems 2024-08-29 Navid Hashemi , Bardh Hoxha , Danil Prokhorov , Georgios Fainekos , Jyotirmoy Deshmukh

This critical review provides an in-depth analysis of Large Language Models (LLMs), encompassing their foundational principles, diverse applications, and advanced training methodologies. We critically examine the evolution from Recurrent…

Artificial Intelligence · Computer Science 2025-09-29 Milad Moradi , Ke Yan , David Colwell , Matthias Samwald , Rhona Asgari

Deep Reinforcement Learning (DRL) has become a powerful methodology to solve complex decision-making problems. However, DRL has several limitations when used in real-world problems (e.g., robotics applications). For instance, long training…

Robotics · Computer Science 2019-08-15 Rodrigo Pérez-Dattari , Carlos Celemin , Javier Ruiz-del-Solar , Jens Kober

Recent advances in learning decision-making policies can largely be attributed to training expressive policy models, largely via imitation learning. While imitation learning discards non-expert data, reinforcement learning (RL) can still…

Machine Learning · Computer Science 2024-12-10 Max Sobol Mark , Tian Gao , Georgia Gabriela Sampaio , Mohan Kumar Srirama , Archit Sharma , Chelsea Finn , Aviral Kumar

Actor-critic (AC) methods are widely used in reinforcement learning (RL) and benefit from the flexibility of using any policy gradient method as the actor and value-based method as the critic. The critic is usually trained by minimizing the…

Machine Learning · Computer Science 2023-11-01 Sharan Vaswani , Amirreza Kazemi , Reza Babanezhad , Nicolas Le Roux

Large language model-based agents make mistakes, yet critique can often guide the same model toward correct behavior. However, when critique is removed, the model may fail again on the same query, indicating that it has not internalized the…

Artificial Intelligence · Computer Science 2026-05-18 Jianbo Lin , Xiaomin Yu , Yi Xin , Yifu Guo , Zhuosong Jiang , Zhongqi Yue , Weishi Wang , Heqing Zou , Chengwei Qin , Hui Xiong

Resource allocation in integrated sensing and communication (ISAC) systems needs to be optimized to balance the requirements of the communication and sensing modules considering complicated cross-layer data traffic and queue status in…

Signal Processing · Electrical Eng. & Systems 2026-04-28 Xiyu Wang , Gilberto Berardinelli , Hei Victor Cheng , Petar Popovski , Ramoni Adeogun

Large language models (LLMs) tackle complex tasks by generating long chains of thought or "reasoning traces" that act as latent variables in the generation of an output given a query. A model's ability to generate such traces can be…

Computation and Language · Computer Science 2025-12-03 Alexander Gurung , Nikolay Malkin , Mirella Lapata