English
Related papers

Related papers: Analyzing Knowledge Transfer in Deep Q-Networks fo…

200 papers

Autonomous driving requires operation in different behavioral modes ranging from lane following and intersection crossing to turning and stopping. However, most existing deep learning approaches to autonomous driving do not consider the…

Machine Learning · Computer Science 2019-01-15 Sauhaarda Chowdhuri , Tushar Pankaj , Karl Zipser

Real-world reinforcement learning tasks often involve some form of partial observability where the observations only give a partial or noisy view of the true state of the world. Such tasks typically require some form of memory, where the…

Machine Learning · Computer Science 2022-11-11 Kevin Esslinger , Robert Platt , Christopher Amato

The task of link prediction aims to solve the problem of incomplete knowledge caused by the difficulty of collecting facts from the real world. GCNs-based models are widely applied to solve link prediction problems due to their…

Artificial Intelligence · Computer Science 2022-09-07 Shuanglong Yao , Dechang Pi , Junfu Chen , Yufei Liu , Zhiyuan Wu

Knowledge tracing---where a machine models the knowledge of a student as they interact with coursework---is a well established problem in computer supported education. Though effectively modeling student knowledge would have high…

Artificial Intelligence · Computer Science 2015-06-22 Chris Piech , Jonathan Spencer , Jonathan Huang , Surya Ganguli , Mehran Sahami , Leonidas Guibas , Jascha Sohl-Dickstein

In this work, we study adaptive data-guided traffic planning and control using Reinforcement Learning (RL). We shift from the plain use of classic methods towards state-of-the-art in deep RL community. We embed several recent techniques in…

Machine Learning · Computer Science 2020-07-23 Siavash Alemzadeh , Ramin Moslemi , Ratnesh Sharma , Mehran Mesbahi

Transfer Learning enables Convolutional Neural Networks (CNN) to acquire knowledge from a source domain and transfer it to a target domain, where collecting large-scale annotated examples is time-consuming and expensive. Conventionally,…

Computer Vision and Pattern Recognition · Computer Science 2024-01-25 S. H. Shabbeer Basha , Debapriya Tula , Sravan Kumar Vinakota , Shiv Ram Dubey

We introduce techniques for rapidly transferring the information stored in one neural net into another neural net. The main purpose is to accelerate the training of a significantly larger neural net. During real-world workflows, one often…

Machine Learning · Computer Science 2016-04-26 Tianqi Chen , Ian Goodfellow , Jonathon Shlens

The behavior decision-making subsystem is a key component of the autonomous driving system, which reflects the decision-making ability of the vehicle and the driver, and is an important symbol of the high-level intelligence of the vehicle.…

Machine Learning · Computer Science 2024-12-31 Zixiang Wang , Hao Yan , Changsong Wei , Junyu Wang , Minheng Xiao

In open-ended continuous environments, robots need to learn multiple parameterised control tasks in hierarchical reinforcement learning. We hypothesise that the most complex tasks can be learned more easily by transferring knowledge from…

Artificial Intelligence · Computer Science 2021-02-22 Nicolas Duminy , Sao Mai Nguyen , Junshuai Zhu , Dominique Duhaut , Jerome Kerdreux

Despite huge success, deep networks are unable to learn effectively in sequential multitask learning settings as they forget the past learned tasks after learning new tasks. Inspired from complementary learning systems theory, we address…

Machine Learning · Computer Science 2019-06-04 Mohammad Rostami , Soheil Kolouri , Praveen K. Pilly

Intelligent Transportation Systems (ITSs) are envisioned to play a critical role in improving traffic flow and reducing congestion, which is a pervasive issue impacting urban areas around the globe. Rapidly advancing vehicular communication…

Machine Learning · Computer Science 2018-12-04 Xiao-Yang Liu , Zihan Ding , Sem Borst , Anwar Walid

Deep network compression has been achieved notable progress via knowledge distillation, where a teacher-student learning manner is adopted by using predetermined loss. Recently, more focuses have been transferred to employ the adversarial…

Machine Learning · Computer Science 2019-04-26 Shu Changyong , Li Peng , Xie Yuan , Qu Yanyun , Dai Longquan , Ma Lizhuang

Training Deep Neural Networks (DNNs) is still highly time-consuming and compute-intensive. It has been shown that adapting a pretrained model may significantly accelerate this process. With a focus on classification, we show that current…

Neural and Evolutionary Computing · Computer Science 2020-12-01 Farshid Varno , Lucas May Petry , Lisa Di Jorio , Stan Matwin

Monitoring bridge health using the vibrations of drive-by vehicles has various benefits, such as low cost and no need for direct installation or on-site maintenance of equipment on the bridge. However, many such approaches require labeled…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Jingxiao Liu , Mario Bergés , Jacobo Bielak , Hae Young Noh

Opponent modeling is necessary in multi-agent settings where secondary agents with competing goals also adapt their strategies, yet it remains challenging because strategies interact with each other and change. Most previous work focuses on…

Machine Learning · Computer Science 2016-09-20 He He , Jordan Boyd-Graber , Kevin Kwok , Hal Daumé

The widespread use of knowledge graphs in various fields has brought about a challenge in effectively integrating and updating information within them. When it comes to incorporating contexts, conventional methods often rely on rules or…

Artificial Intelligence · Computer Science 2024-04-22 Ngoc Quach , Qi Wang , Zijun Gao , Qifeng Sun , Bo Guan , Lillian Floyd

In this work, we propose a novel cross Q-learning algorithm, aim at alleviating the well-known overestimation problem in value-based reinforcement learning methods, particularly in the deep Q-networks where the overestimation is exaggerated…

Artificial Intelligence · Computer Science 2020-09-30 Xing Wang , Alexander Vinel

In order to solve the problem of frequent deceleration of unmanned vehicles when approaching obstacles, this article uses a Deep Q-Network (DQN) and its extension, the Double Deep Q-Network (DDQN), to develop a local navigation system that…

Robotics · Computer Science 2024-04-29 Hao Liu , Yi Shen , Wenjing Zhou , Yuelin Zou , Chang Zhou , Shuyao He

This paper investigates how a Bayesian reinforcement learning method can be used to create a tactical decision-making agent for autonomous driving in an intersection scenario, where the agent can estimate the confidence of its recommended…

Robotics · Computer Science 2020-11-04 Carl-Johan Hoel , Tommy Tram , Jonas Sjöberg

Despite the remarkable success achieved by graph convolutional networks for functional brain activity analysis, the heterogeneity of functional patterns and the scarcity of imaging data still pose challenges in many tasks. Transferring…

Machine Learning · Computer Science 2022-12-19 Wenhui Cui , Haleh Akrami , Anand A. Joshi , Richard M. Leahy