English
Related papers

Related papers: Improving Computational Efficiency in Visual Reinf…

200 papers

In the training process of Deep Reinforcement Learning (DRL), agents require repetitive interactions with the environment. With an increase in training volume and model complexity, it is still a challenging problem to enhance data…

Machine Learning · Computer Science 2024-05-15 Jingwen Wang , Dehui Du , Yida Li , Yiyang Li , Yikang Chen

Evolutionary Reinforcement Learning (ERL) that applying Evolutionary Algorithms (EAs) to optimize the weight parameters of Deep Neural Network (DNN) based policies has been widely regarded as an alternative to traditional reinforcement…

Neural and Evolutionary Computing · Computer Science 2023-02-01 Lan Tang , Xiaxi Li , Jinyuan Zhang , Guiying Li , Peng Yang , Ke Tang

Incremental learning aims to enable machine learning models to continuously acquire new knowledge given new classes, while maintaining the knowledge already learned for old classes. Saving a subset of training samples of previously seen…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Jian Jiang , Edoardo Cetin , Oya Celiktutan

Deep reinforcement learning (RL) methods have significant potential for dialogue policy optimisation. However, they suffer from a poor performance in the early stages of learning. This is especially problematic for on-line learning with…

Computation and Language · Computer Science 2017-07-06 Pei-Hao Su , Pawel Budzianowski , Stefan Ultes , Milica Gasic , Steve Young

Continual learning of deep neural networks is a key requirement for scaling them up to more complex applicative scenarios and for achieving real lifelong learning of these architectures. Previous approaches to the problem have considered…

Machine Learning · Computer Science 2020-06-25 Jary Pomponi , Simone Scardapane , Vincenzo Lomonaco , Aurelio Uncini

Deep reinforcement learning achieves superhuman performance in a range of video game environments, but requires that a designer manually specify a reward function. It is often easier to provide demonstrations of a target behavior than to…

Machine Learning · Computer Science 2018-10-26 Aaron Tucker , Adam Gleave , Stuart Russell

Recurrent neural network (RNN) based reinforcement learning (RL) is used for learning context-dependent tasks and has also attracted attention as a method with remarkable learning performance in recent research. However, RNN-based RL has…

Machine Learning · Computer Science 2022-03-04 Toshitaka Matsuki

While Reinforcement Learning (RL) agents can successfully learn to handle complex tasks, effectively generalizing acquired skills to unfamiliar settings remains a challenge. One of the reasons behind this is the visual encoders used are…

Computer Vision and Pattern Recognition · Computer Science 2025-02-11 Yuhan Zhang , Guoqing Ma , Guangfu Hao , Liangxuan Guo , Yang Chen , Shan Yu

Implicit Neural Representations (INRs) have garnered significant attention for their ability to model complex signals in various domains. Recently, INR-based frameworks have shown promise in neural video compression by embedding video…

Image and Video Processing · Electrical Eng. & Systems 2025-07-25 Taiga Hayami , Kakeru Koizumi , Hiroshi Watanabe

Learning neural program embeddings is key to utilizing deep neural networks in program languages research --- precise and efficient program representations enable the application of deep models to a wide range of program analysis tasks.…

Software Engineering · Computer Science 2019-07-12 Ke Wang , Zhendong Su

Elucidating the reasoning process with structured explanations from question to answer is crucial, as it significantly enhances the interpretability, traceability, and trustworthiness of question-answering (QA) systems. However, structured…

Computation and Language · Computer Science 2024-09-30 Guoxin Chen , Kexin Tang , Chao Yang , Fuying Ye , Yu Qiao , Yiming Qian

Recent studies have explored the use of pre-trained embeddings for speech emotion recognition (SER), achieving comparable performance to conventional methods that rely on low-level knowledge-inspired acoustic features. These embeddings are…

Sound · Computer Science 2023-05-22 Tiantian Feng , Rajat Hebbar , Shrikanth Narayanan

Reinforcement Learning (RL) algorithms can learn robotic control tasks from visual observations, but they often require a large amount of data, especially when the visual scene is complex and unstructured. In this paper, we explore how the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Ameya Pore , Riccardo Muradore , Diego Dall'Alba

Reinforcement Learning (RL) has achieved significant success in application domains such as robotics, games and health care. However, training RL agents is very time consuming. Current implementations exhibit poor performance due to…

Machine Learning · Computer Science 2021-12-24 Chi Zhang , Sanmukh Rao Kuppannagari , Viktor K Prasanna

This paper describes an improvement in Deep Q-learning called Reverse Experience Replay (also RER) that solves the problem of sparse rewards and helps to deal with reward maximizing tasks by sampling transitions successively in reverse…

Machine Learning · Computer Science 2019-10-24 Egor Rotinov

Despite the potential of neural scene representations to effectively compress 3D scalar fields at high reconstruction quality, the computational complexity of the training and data reconstruction step using scene representation networks…

Graphics · Computer Science 2022-07-26 Sebastian Weiss , Philipp Hermüller , Rüdiger Westermann

Recent advances in large language models have demonstrated remarkable effectiveness in information retrieval (IR) tasks. While many neural IR systems encode queries and documents into single-vector representations, multi-vector models…

Information Retrieval · Computer Science 2023-12-12 Susav Shrestha , Narasimha Reddy , Zongwang Li

Deferred neural rendering (DNR) is an emerging computer graphics pipeline designed for high-fidelity rendering and robotic perception. However, DNR heavily relies on datasets composed of numerous ray-traced images and demands substantial…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Dongli Wu , Haochen Li , Xiaobao Wei

This paper introduces a distributed, GPU-centric experience replay system, GEAR, designed to perform scalable reinforcement learning (RL) with large sequence models (such as transformers). With such models, existing systems such as Reverb…

Machine Learning · Computer Science 2023-10-10 Hanjing Wang , Man-Kit Sit , Congjie He , Ying Wen , Weinan Zhang , Jun Wang , Yaodong Yang , Luo Mai

Experience replay (ER) is a crucial component of many deep reinforcement learning (RL) systems. However, uniform sampling from an ER buffer can lead to slow convergence and unstable asymptotic behaviors. This paper introduces Stratified…

Machine Learning · Computer Science 2023-06-21 Varun Kompella , Thomas J. Walsh , Samuel Barrett , Peter Wurman , Peter Stone