English
Related papers

Related papers: End-to-end Active Object Tracking and Its Real-wor…

200 papers

Deep learning has recently started being applied to visual tracking of generic objects in video streams. For the purposes of robotics applications, it is very important for a target tracker to recover its track if it is lost due to heavy or…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Pranoy Panda , Martin Barczyk

In this paper, the main task we aim to tackle is the multi-instance semi-supervised video object segmentation across a sequence of frames where only the first-frame box-level ground-truth is provided. Detection-based algorithms are widely…

Computer Vision and Pattern Recognition · Computer Science 2020-04-17 Mingjie Sun , Jimin Xiao , Eng Gee Lim , Bingfeng Zhang , Yao Zhao

In this work, we study vision-based end-to-end reinforcement learning on vehicle control problems, such as lane following and collision avoidance. Our controller policy is able to control a small-scale robot to follow the right-hand lane of…

Machine Learning · Computer Science 2020-12-15 András Kalapos , Csaba Gór , Róbert Moni , István Harmati

Two less addressed issues of deep reinforcement learning are (1) lack of generalization capability to new target goals, and (2) data inefficiency i.e., the model requires several (and often costly) episodes of trial and error to converge,…

Computer Vision and Pattern Recognition · Computer Science 2016-09-19 Yuke Zhu , Roozbeh Mottaghi , Eric Kolve , Joseph J. Lim , Abhinav Gupta , Li Fei-Fei , Ali Farhadi

The accurate tracking of live cells using video microscopy recordings remains a challenging task for popular state-of-the-art image processing based object tracking methods. In recent years, several existing and new applications have…

Image and Video Processing · Electrical Eng. & Systems 2025-02-03 Gergely Szabó , Paolo Bonaiuti , Andrea Ciliberto , András Horváth

Applying end-to-end learning to solve complex, interactive, pixel-driven control tasks on a robot is an unsolved problem. Deep Reinforcement Learning algorithms are too slow to achieve performance on a real robot, but their potential has…

Robotics · Computer Science 2018-05-23 Andrei A. Rusu , Mel Vecerik , Thomas Rothörl , Nicolas Heess , Razvan Pascanu , Raia Hadsell

In this paper, we develop a new approach of spatially supervised recurrent convolutional neural networks for visual object tracking. Our recurrent convolutional network exploits the history of locations as well as the distinctive visual…

Computer Vision and Pattern Recognition · Computer Science 2016-07-21 Guanghan Ning , Zhi Zhang , Chen Huang , Zhihai He , Xiaobo Ren , Haohong Wang

This paper presents an end-to-end approach for tracking static and dynamic objects for an autonomous vehicle driving through crowded urban environments. Unlike traditional approaches to tracking, this method is learned end-to-end, and is…

Computer Vision and Pattern Recognition · Computer Science 2017-04-20 Julie Dequaire , Dushyant Rao , Peter Ondruska , Dominic Wang , Ingmar Posner

Autonomous tracking of flying aerial objects has important civilian and defense applications, ranging from search and rescue to counter-unmanned aerial systems (counter-UAS). Ground based tracking requires setting up infrastructure, could…

In recent years, deep learning based visual tracking methods have obtained great success owing to the powerful feature representation ability of Convolutional Neural Networks (CNNs). Among these methods, classification-based tracking…

Computer Vision and Pattern Recognition · Computer Science 2020-02-10 Yihan Du , Yan Yan , Si Chen , Yang Hua

Object pushing presents a key non-prehensile manipulation problem that is illustrative of more complex robotic manipulation tasks. While deep reinforcement learning (RL) methods have demonstrated impressive learning capabilities using…

Robotics · Computer Science 2023-07-27 Max Yang , Yijiong Lin , Alex Church , John Lloyd , Dandan Zhang , David A. W. Barton , Nathan F. Lepora

Recent work has described neural-network-based agents that are trained with reinforcement learning (RL) to execute language-like commands in simulated worlds, as a step towards an intelligent agent or robot that can be instructed by human…

Computation and Language · Computer Science 2020-05-20 Felix Hill , Sona Mokra , Nathaniel Wong , Tim Harley

Advances in perception modeling have significantly improved the performance of object tracking. However, the current methods for specifying the target object in the initial frame are either by 1) using a box or mask template, or by 2)…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Jiawen Zhu , Zhi-Qi Cheng , Jun-Yan He , Chenyang Li , Bin Luo , Huchuan Lu , Yifeng Geng , Xuansong Xie

The advancement of visual tracking has continuously been brought by deep learning models. Typically, supervised learning is employed to train these models with expensive labeled data. In order to reduce the workload of manual annotations…

Computer Vision and Pattern Recognition · Computer Science 2020-07-24 Ning Wang , Wengang Zhou , Yibing Song , Chao Ma , Wei Liu , Houqiang Li

While deep reinforcement learning (RL) methods have achieved unprecedented successes in a range of challenging problems, their applicability has been mainly limited to simulation or game domains due to the high sample complexity of the…

Artificial Intelligence · Computer Science 2017-09-26 Siyi Li , Tianbo Liu , Chi Zhang , Dit-Yan Yeung , Shaojie Shen

Visual object tracking task is constantly gaining importance in several fields of application as traffic monitoring, robotics, and surveillance, to name a few. Dealing with changes in the appearance of the tracked object is paramount to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Fabio Garcea , Alessandro Cucco , Lia Morra , Fabrizio Lamberti

In this work we present a novel end-to-end framework for tracking and classifying a robot's surroundings in complex, dynamic and only partially observable real-world environments. The approach deploys a recurrent neural network to filter an…

Machine Learning · Computer Science 2016-04-20 Peter Ondruska , Julie Dequaire , Dominic Zeng Wang , Ingmar Posner

Deep reinforcement learning (RL) has been successfully applied to a variety of game-like environments. However, the application of deep RL to visual navigation with realistic environments is a challenging task. We propose a novel learning…

Robotics · Computer Science 2019-11-12 Jonáš Kulhánek , Erik Derner , Tim de Bruin , Robert Babuška

This paper proposes an end-to-end deep reinforcement learning approach for mobile robot navigation with dynamic obstacles avoidance. Using experience collected in a simulation environment, a convolutional neural network (CNN) is trained to…

Robotics · Computer Science 2020-02-12 Guangda Chen , Lifan Pan , Yu'an Chen , Pei Xu , Zhiqiang Wang , Peichen Wu , Jianmin Ji , Xiaoping Chen

Efficient and accurate object detection is an important topic in the development of computer vision systems. With the advent of deep learning techniques, the accuracy of object detection has increased significantly. The project aims to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Md Pranto , Omar Faruk