English
Related papers

Related papers: Action-Sufficient State Representation Learning fo…

200 papers

Speech is understood better by using visual context; for this reason, there have been many attempts to use images to adapt automatic speech recognition (ASR) systems. Current work, however, has shown that visually adapted ASR models only…

Computation and Language · Computer Science 2020-02-19 Tejas Srinivasan , Ramon Sanabria , Florian Metze

Neuro-symbolic reinforcement learning (NS-RL) has emerged as a promising paradigm for explainable decision-making, characterized by the interpretability of symbolic policies. NS-RL entails structured state representations for tasks with…

Artificial Intelligence · Computer Science 2024-06-14 Lirui Luo , Guoxi Zhang , Hongming Xu , Yaodong Yang , Cong Fang , Qing Li

Adversarial scenario generation is crucial for autonomous driving testing because it can efficiently simulate various challenge and complex traffic conditions. However, it is difficult to control current existing methods to generate desired…

Robotics · Computer Science 2024-08-27 Shuo Yang , Caojun Wang , Yuanjian Zhang , Yuming Yin , Yanjun Huang , Shengbo Eben Li , Hong Chen

Decision making via sequence modeling aims to mimic the success of language models, where actions taken by an embodied agent are modeled as tokens to predict. Despite their promising performance, it remains unclear if embodied sequence…

Machine Learning · Computer Science 2023-11-08 Tian Yun , Zilai Zeng , Kunal Handa , Ashish V. Thapliyal , Bo Pang , Ellie Pavlick , Chen Sun

Both animals and artificial agents benefit from state representations that support rapid transfer of learning across tasks and which enable them to efficiently traverse their environments to reach rewarding states. The successor…

Machine Learning · Computer Science 2021-11-09 Ted Moskovitz , Spencer R. Wilson , Maneesh Sahani

Modern automatic speech recognition (ASR) systems need to be robust under acoustic variability arising from environmental, speaker, channel, and recording conditions. Ensuring such robustness to variability is a challenge in modern day…

Computation and Language · Computer Science 2016-12-07 Dmitriy Serdyuk , Kartik Audhkhasi , Philémon Brakel , Bhuvana Ramabhadran , Samuel Thomas , Yoshua Bengio

From the existing research it has been observed that many techniques and methodologies are available for performing every step of Automatic Speech Recognition (ASR) system, but the performance (Minimization of Word Error Recognition-WER and…

Computation and Language · Computer Science 2013-03-25 Urmila Shrawankar , Vilas Thakare

Building Automatic Speech Recognition (ASR) systems from scratch is significantly challenging, mostly due to the time-consuming and financially-expensive process of annotating a large amount of audio data with transcripts. Although several…

Audio and Speech Processing · Electrical Eng. & Systems 2020-09-22 Mengli Cheng , Chengyu Wang , Xu Hu , Jun Huang , Xiaobo Wang

Reinforcement Learning (RL) can be considered as a sequence modeling task: given a sequence of past state-action-reward experiences, an agent predicts a sequence of next actions. In this work, we propose State-Action-Reward Transformer…

Machine Learning · Computer Science 2023-01-05 Jinghuan Shang , Kumara Kahatapitiya , Xiang Li , Michael S. Ryoo

The subject of this paper is reinforcement learning. Policies are considered here that produce actions based on states and random elements autocorrelated in subsequent time instants. Consequently, an agent learns from experiments that are…

Machine Learning · Computer Science 2020-09-11 Marcin Szulc , Jakub Łyskawa , Paweł Wawrzyński

Autonomous vehicles inevitably encounter a vast array of scenarios in real-world environments. Addressing long-tail scenarios, particularly those involving intensive interactions with numerous traffic participants, remains one of the most…

Robotics · Computer Science 2024-12-16 Guanzhou Li , Jianping Wu , Yujing He

This work explores how to learn robust and generalizable state representation from image-based observations with deep reinforcement learning methods. Addressing the computational complexity, stringent assumptions and representation collapse…

Machine Learning · Computer Science 2022-03-01 Hongyu Zang , Xin Li , Mingzhong Wang

Learning latent representations from complex data is central to modern machine learning, spanning temporal, multimodal, and partially observed systems. In such settings, representations are better understood as latent states capturing…

Machine Learning · Computer Science 2026-05-18 Gwenolé Quellec

In reinforcement learning, agents collect state information and rewards through environmental interactions, essential for policy refinement. This process is notably time-consuming, especially in complex robotic simulations and real-world…

Robotics · Computer Science 2024-10-18 Ke Duan , Kai Yang , Houde Liu , Xueqian Wang

Detecting a diverse range of objects under various driving scenarios is essential for the effectiveness of autonomous driving systems. However, the real-world data collected often lacks the necessary diversity presenting a long-tail…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Aqeel Anwar , Tae Eun Choe , Zian Wang , Sanja Fidler , Minwoo Park

In reinforcement learning, we encode the potential behaviors of an agent interacting with an environment into an infinite set of policies, the policy space, typically represented by a family of parametric functions. Dealing with such a…

Machine Learning · Computer Science 2022-02-23 Mirco Mutti , Stefano Del Col , Marcello Restelli

Identifying an appropriate task space that simplifies control solutions is important for solving robotic manipulation problems. One approach to this problem is learning an appropriate low-dimensional action space. Linear and nonlinear…

Reinforcement Learning (RL) has made significant strides in enabling artificial agents to learn diverse behaviors. However, learning an effective policy often requires a large number of environment interactions. To mitigate sample…

Artificial Intelligence · Computer Science 2024-04-04 Yash Shukla , Tanushree Burman , Abhishek Kulkarni , Robert Wright , Alvaro Velasquez , Jivko Sinapov

Despite the recent success of deep reinforcement learning (RL), domain adaptation remains an open problem. Although the generalization ability of RL agents is critical for the real-world applicability of Deep RL, zero-shot policy transfer…

Machine Learning · Computer Science 2021-09-06 Jinwei Xing , Takashi Nagata , Kexin Chen , Xinyun Zou , Emre Neftci , Jeffrey L. Krichmar

Scaling end-to-end reinforcement learning to control real robots from vision presents a series of challenges, in particular in terms of sample efficiency. Against end-to-end learning, state representation learning can help learn a compact,…

Machine Learning · Computer Science 2019-06-25 Antonin Raffin , Ashley Hill , René Traoré , Timothée Lesort , Natalia Díaz-Rodríguez , David Filliat