English
Related papers

Related papers: Learning by Watching

200 papers

Existing vision based supervised approaches to lateral vehicle control are capable of directly mapping RGB images to the appropriate steering commands. However, they are prone to suffering from inadequate robustness in real world scenarios…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Florian Müller , Qadeer Khan , Daniel Cremers

To construct effective teaming strategies between humans and AI systems in complex, risky situations requires an understanding of individual preferences and behaviors of humans. Previously this problem has been treated in case-specific or…

Human-Computer Interaction · Computer Science 2022-11-24 Jonathan A. DeCastro , Deepak Gopinath , Guy Rosman , Emily Sumner , Shabnam Hakimi , Simon Stent

Robots operating in complex and uncertain environments face considerable challenges. Advanced robotic systems often rely on extensive datasets to learn manipulation tasks. In contrast, when humans are faced with unfamiliar tasks, such as…

Robotics · Computer Science 2025-11-10 Yichen Zhu , Feifei Feng

Learning analytics (LA) draws from the learning sciences to interpret learner behavior and inform system design. Yet, past personalization remains largely at the content or performance level (during learner-system interactions), overlooking…

Human-Computer Interaction · Computer Science 2026-02-03 Conrad Borchers , Hannah Deininger , Zachary A. Pardos

Recent advances in high-fidelity simulators have enabled closed-loop training of autonomous driving agents, potentially solving the distribution shift in training v.s. deployment and allowing training to be scaled both safely and cheaply.…

Robotics · Computer Science 2023-06-29 Chris Zhang , Runsheng Guo , Wenyuan Zeng , Yuwen Xiong , Binbin Dai , Rui Hu , Mengye Ren , Raquel Urtasun

Data-driven simulators promise high data-efficiency for driving policy learning. When used for modelling interactions, this data-efficiency becomes a bottleneck: Small underlying datasets often lack interesting and challenging edge cases…

We propose the use of latent space generative world models to address the covariate shift problem in autonomous driving. A world model is a neural network capable of predicting an agent's next state given past states and actions. By…

Autonomous driving is an emerging technology that has advanced rapidly over the last decade. Modern transportation is expected to benefit greatly from a wise decision-making framework of autonomous vehicles, including the improvement of…

Artificial Intelligence · Computer Science 2023-12-20 Yuyang Xia , Shuncheng Liu , Quanlin Yu , Liwei Deng , You Zhang , Han Su , Kai Zheng

Traditional reinforcement learning (RL)-based learning approaches for wireless networks rely on expensive trial-and-error mechanisms and real-time feedback based on extensive environment interactions, which leads to low data efficiency and…

Artificial Intelligence · Computer Science 2025-08-04 Lingyi Wang , Rashed Shelim , Walid Saad , Naren Ramakrishnan

Autonomous driving is a complex task, which has been tackled since the first self-driving car ALVINN in 1989, with a supervised learning approach, or behavioral cloning (BC). In BC, a neural network is trained with state-action pairs that…

Robotics · Computer Science 2023-02-08 Gustavo Claudio Karl Couto , Eric Aislan Antonelo

Self-driving vehicles have their own intelligence to drive on open roads. However, vehicle managers, e.g., government or industrial companies, still need a way to tell these self-driving vehicles what behaviors are encouraged or forbidden.…

Robotics · Computer Science 2023-04-20 Jiaxin Liu , Wenhui Zhou , Hong Wang , Zhong Cao , Wenhao Yu , Chengxiang Zhao , Ding Zhao , Diange Yang , Jun Li

Connected and automated vehicles (CAVs) have attracted more and more attention recently. The fast actuation time allows them having the potential to promote the efficiency and safety of the whole transportation system. Due to technical…

Machine Learning · Statistics 2021-10-26 Tianyu Shi , Jiawei Wang , Yuankai Wu , Luis Miranda-Moreno , Lijun Sun

Offline reinforcement learning methods hold the promise of learning policies from pre-collected datasets without the need to query the environment for new transitions. This setting is particularly well-suited for continuous control robotic…

Machine Learning · Computer Science 2022-03-18 Xi Chen , Ali Ghadirzadeh , Tianhe Yu , Yuan Gao , Jianhao Wang , Wenzhe Li , Bin Liang , Chelsea Finn , Chongjie Zhang

We present a novel approach to automatically identify driver behaviors from vehicle trajectories and use them for safe navigation of autonomous vehicles. We propose a novel set of features that can be easily extracted from car trajectories.…

Robotics · Computer Science 2018-03-19 Ernest Cheung , Aniket Bera , Emily Kubin , Kurt Gray , Dinesh Manocha

Accurate identification of important objects in the scene is a prerequisite for safe and high-quality decision making and motion planning of intelligent agents (e.g., autonomous vehicles) that navigate in complex and dynamic environments.…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Jiachen Li , Haiming Gang , Hengbo Ma , Masayoshi Tomizuka , Chiho Choi

The operational space of an autonomous vehicle (AV) can be diverse and vary significantly. This may lead to a scenario that was not postulated in the design phase. Due to this, formulating a rule based decision maker for selecting maneuvers…

Robotics · Computer Science 2019-04-02 Subramanya Nageshrao , Eric Tseng , Dimitar Filev

In conditionally automated driving, drivers decoupled from driving while immersed in non-driving-related tasks (NDRTs) could potentially either miss the system-initiated takeover request (TOR) or a sudden TOR may startle them. To better…

Human-Computer Interaction · Computer Science 2022-08-31 Erfan Pakdamanian , Erzhen Hu , Shili Sheng , Sarit Kraus , Seongkook Heo , Lu Feng

In the area of autonomous driving, navigating off-road terrains presents a unique set of challenges, from unpredictable surfaces like grass and dirt to unexpected obstacles such as bushes and puddles. In this work, we present a novel…

Robotics · Computer Science 2025-05-15 Akhil Nagariya , Dimitar Filev , Srikanth Saripalli , Gaurav Pandey

Reinforcement Learning (RL) has demonstrated remarkable success in solving sequential decision-making problems. However, in real-world scenarios, RL agents often struggle to generalize when faced with unseen actions that were not…

Machine Learning · Computer Science 2025-03-13 Abdullah Alchihabi , Hanping Zhang , Yuhong Guo

Modern end-to-end learning systems can learn to explicitly infer control from perception. However, it is difficult to guarantee stability and robustness for these systems since they are often exposed to unstructured, high-dimensional, and…

Robotics · Computer Science 2023-04-07 Tsun-Hsuan Wang , Wei Xiao , Makram Chahine , Alexander Amini , Ramin Hasani , Daniela Rus