English
Related papers

Related papers: PDiT: Interleaving Perception and Decision-making …

200 papers

Learning the optimal policy from a random network initialization is the theme of deep Reinforcement Learning (RL). As the scale of DRL training increases, treating DRL policy network weights as a new data modality and exploring the…

Machine Learning · Computer Science 2025-03-07 Hongyao Tang

Recent studies have shown that Transformers can perform in-context reinforcement learning (RL) by imitating existing RL algorithms, enabling sample-efficient adaptation to unseen tasks without parameter updates. However, these models also…

Machine Learning · Computer Science 2025-02-27 Jaehyeon Son , Soochan Lee , Gunhee Kim

Our research investigates the challenges Deep Reinforcement Learning (DRL) faces in complex, Partially Observable Markov Decision Processes (POMDP) such as autonomous driving (AD), and proposes a solution for vision-based navigation in…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Shawan Mohammed , Alp Argun , Nicolas Bonnotte , Gerd Ascheid

In the landscape of Recommender System (RS) applications, reinforcement learning (RL) has recently emerged as a powerful tool, primarily due to its proficiency in optimizing long-term rewards. Nevertheless, it suffers from instability in…

Information Retrieval · Computer Science 2024-06-11 Ziru Liu , Shuchang Liu , Zijian Zhang , Qingpeng Cai , Xiangyu Zhao , Kesen Zhao , Lantao Hu , Peng Jiang , Kun Gai

Creating a vision pipeline for different datasets to solve a computer vision task is a complex and time consuming process. Currently, these pipelines are developed with the help of domain experts. Moreover, there is no systematic structure…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Aditya Kapoor , Nijil George , Vartika Sengar , Vighnesh Vatsal , Jayavardhana Gubbi

Over parameterization is a common technique in deep learning to help models learn and generalize sufficiently to the given task; nonetheless, this often leads to enormous network structures and consumes considerable computing resources…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Yuanchu Liang , Saeed Anwar , Yang Liu

Recent progress in in-context reinforcement learning (ICRL) has demonstrated its potential for training generalist agents that can acquire new tasks directly at inference. Algorithm Distillation (AD) pioneered this paradigm and was…

One approach to explaining the hierarchical levels of understanding within a machine learning model is the symbolic method of inductive logic programming (ILP), which is data efficient and capable of learning first-order logic rules that…

Machine Learning · Computer Science 2023-09-01 Andreas Bueff , Vaishak Belle

Traditional approaches in offline reinforcement learning aim to learn the optimal policy that maximizes the cumulative reward, also known as return. It is increasingly important to adjust the performance of AI agents to meet human…

Machine Learning · Computer Science 2025-06-23 Tsunehiko Tanaka , Kenshi Abe , Kaito Ariu , Tetsuro Morimura , Edgar Simo-Serra

The success of deep learning in the computer vision and natural language processing communities can be attributed to training of very deep neural networks with millions or billions of parameters which can then be trained with massive…

Machine Learning · Computer Science 2021-02-17 Kei Ota , Devesh K. Jha , Asako Kanezaki

Packet routing is one of the fundamental problems in computer networks in which a router determines the next-hop of each packet in the queue to get it as quickly as possible to its destination. Reinforcement learning (RL) has been…

Networking and Internet Architecture · Computer Science 2019-11-15 Xinyu You , Xuanjie Li , Yuedong Xu , Hui Feng , Jin Zhao , Huaicheng Yan

Humans often juggle multiple, sometimes conflicting objectives and shift their priorities as circumstances change, rather than following a fixed objective function. In contrast, most computational decision-making and multi-objective RL…

Artificial Intelligence · Computer Science 2026-03-25 Xianwei Cao , Dou Quan , Zhenliang Zhang , Shuang Wang

Collision avoidance algorithms are essential for safe and efficient robot operation among pedestrians. This work proposes using deep reinforcement (RL) learning as a framework to model the complex interactions and cooperation with nearby,…

Robotics · Computer Science 2021-01-26 Michael Everett , Yu Fan Chen , Jonathan P. How

Decision Transformers have recently emerged as a new and compelling paradigm for offline Reinforcement Learning (RL), completing a trajectory in an autoregressive way. While improvements have been made to overcome initial shortcomings,…

Machine Learning · Computer Science 2024-11-01 Kai Yan , Alexander G. Schwing , Yu-Xiong Wang

Deep neural networks (DNNs) provide useful models of visual representational transformations. We present a method that enables a DNN (student) to learn from the internal representational spaces of a reference model (teacher), which could be…

Neural and Evolutionary Computing · Computer Science 2019-09-19 Patrick McClure , Nikolaus Kriegeskorte

The performance of a reinforcement learning (RL) system depends on the computational architecture used to approximate a value function. Deep learning methods provide both optimization techniques and architectures for approximating nonlinear…

Machine Learning · Computer Science 2021-06-21 John D. Martin , Joseph Modayil

The digital transformation is pushing the existing network technologies towards new horizons, enabling new applications (e.g., vehicular networks). As a result, the networking community has seen a noticeable increase in the requirements of…

Networking and Internet Architecture · Computer Science 2021-09-01 Paul Almasan , José Suárez-Varela , Bo Wu , Shihan Xiao , Pere Barlet-Ros , Albert Cabellos-Aparicio

Inspired by the impressive reasoning capabilities demonstrated by reinforcement learning approaches like DeepSeek-R1, recent emerging research has begun exploring the use of reinforcement learning (RL) to enhance vision-language models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-19 Yizhen Zhang , Yang Ding , Shuoshuo Zhang , Xinchen Zhang , Haoling Li , Zhong-zhi Li , Peijie Wang , Jie Wu , Lei Ji , Yelong Shen , Yujiu Yang , Yeyun Gong

Deep reinforcement learning (RL) algorithms are powerful tools for solving visuomotor decision tasks. However, the trained models are often difficult to interpret, because they are represented as end-to-end deep neural networks. In this…

Machine Learning · Computer Science 2021-11-04 Sihang Guo , Ruohan Zhang , Bo Liu , Yifeng Zhu , Mary Hayhoe , Dana Ballard , Peter Stone

Transformer architectures, particularly Diffusion Transformers (DiTs), have become widely used in diffusion and flow-matching models due to their strong performance compared to convolutional UNets. However, the isotropic design of DiTs…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Quan Dao , Dimitris Metaxas