English
Related papers

Related papers: Learning Deep Sensorimotor Policies for Vision-bas…

200 papers

In this paper, we present a decentralized sensor-level collision avoidance policy for multi-robot systems, which shows promising results in practical applications. In particular, our policy directly maps raw sensor measurements to an…

Robotics · Computer Science 2018-08-14 Tingxiang Fan , Pinxin Long , Wenxi Liu , Jia Pan

Although quadcopters boast impressive traversal capabilities enabled by their omnidirectional maneuverability, the need for continuous pilot control in complex environments impedes their application in GNSS and telemetry-denied scenarios.…

Robotics · Computer Science 2026-05-26 Shiladitya Dutta , Aayush Gupta , Varun Saran , Avideh Zakhor

Autonomous drone racing requires powerful perception, planning, and control and has become a benchmark and test field for autonomous, agile flight. Existing work usually assumes static race tracks with known maps, which enables offline…

Robotics · Computer Science 2025-03-19 Ralf Römer , Tim Emmert , Angela P. Schoellig

Aerial filming is constantly gaining importance due to the recent advances in drone technology. It invites many intriguing, unsolved problems at the intersection of aesthetical and scientific challenges. In this work, we propose a deep…

Robotics · Computer Science 2019-10-16 Mirko Gschwindt , Efe Camci , Rogerio Bonatti , Wenshan Wang , Erdal Kayacan , Sebastian Scherer

This research aims to explore the application of deep learning in autonomous driving computer vision technology and its impact on improving system performance. By using advanced technologies such as convolutional neural networks (CNN),…

Computer Vision and Pattern Recognition · Computer Science 2024-06-05 Jingyu Zhang , Jin Cao , Jinghao Chang , Xinjin Li , Houze Liu , Zhenglin Li

While deep reinforcement learning (RL) methods have achieved unprecedented successes in a range of challenging problems, their applicability has been mainly limited to simulation or game domains due to the high sample complexity of the…

Artificial Intelligence · Computer Science 2017-09-26 Siyi Li , Tianbo Liu , Chi Zhang , Dit-Yan Yeung , Shaojie Shen

Policy search methods can allow robots to learn control policies for a wide range of tasks, but practical applications of policy search often require hand-engineered components for perception, state estimation, and low-level control. In…

Machine Learning · Computer Science 2016-04-20 Sergey Levine , Chelsea Finn , Trevor Darrell , Pieter Abbeel

This paper presents a novel system for autonomous, vision-based drone racing combining learned data abstraction, nonlinear filtering, and time-optimal trajectory planning. The system has successfully been deployed at the first autonomous…

Developing a safe and efficient collision avoidance policy for multiple robots is challenging in the decentralized scenarios where each robot generate its paths without observing other robots' states and intents. While other distributed…

Robotics · Computer Science 2018-05-22 Pinxin Long , Tingxiang Fan , Xinyi Liao , Wenxi Liu , Hao Zhang , Jia Pan

Learning to control robots directly based on images is a primary challenge in robotics. However, many existing reinforcement learning approaches require iteratively obtaining millions of robot samples to learn a policy, which can take…

Robotics · Computer Science 2019-08-02 AJ Piergiovanni , Alan Wu , Michael S. Ryoo

Model predictive control (MPC) is an effective method for controlling robotic systems, particularly autonomous aerial vehicles such as quadcopters. However, application of MPC can be computationally demanding, and typically requires…

Machine Learning · Computer Science 2016-02-17 Tianhao Zhang , Gregory Kahn , Sergey Levine , Pieter Abbeel

Mobile service robots are increasingly prevalent in human-centric, real-world domains, operating autonomously in unconstrained indoor environments. In such a context, robotic vision plays a central role in enabling service robots to…

Robotics · Computer Science 2025-10-20 Michele Antonazzi , Matteo Luperto , N. Alberto Borghese , Nicola Basilico

Humans race drones faster than neural networks trained for end-to-end autonomous flight. This may be related to the ability of human pilots to select task-relevant visual information effectively. This work investigates whether neural…

Robotics · Computer Science 2022-03-03 Christian Pfeiffer , Simon Wengeler , Antonio Loquercio , Davide Scaramuzza

With the increase in use of Unmanned Aerial Vehicles (UAVs)/drones, it is important to detect and identify causes of failure in real time for proper recovery from a potential crash-like scenario or post incident forensics analysis. The…

Signal Processing · Electrical Eng. & Systems 2020-05-08 Vidyasagar Sadhu , Saman Zonouz , Dario Pompili

Realtime model learning proves challenging for complex dynamical systems, such as drones flying in variable wind conditions. Machine learning technique such as deep neural networks have high representation power but is often too slow to…

Robotics · Computer Science 2022-05-26 Michael O'Connell , Guanya Shi , Xichen Shi , Soon-Jo Chung

In autonomous and mobile robotics, a principal challenge is resilient real-time environmental perception, particularly in situations characterized by unknown and dynamic elements, as exemplified in the context of autonomous drone racing.…

Robotics · Computer Science 2024-05-03 Zhongzheng Qiao , Xuan Huy Pham , Savitha Ramasamy , Xudong Jiang , Erdal Kayacan , Andriy Sarabakha

This paper presents a novel approach for aerial drone autonomous navigation along predetermined paths using only visual input form an onboard camera and without reliance on a Global Positioning System (GPS). It is based on using a deep…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 K. Amer , M. Samy , M. Shaker , M. ElHelw

The decision and planning system for autonomous driving in urban environments is hard to design. Most current methods manually design the driving policy, which can be expensive to develop and maintain at scale. Instead, with imitation…

Robotics · Computer Science 2019-10-15 Jianyu Chen , Bodi Yuan , Masayoshi Tomizuka

Learning strategic robot behavior -- like that required in pursuit-evasion interactions -- under real-world constraints is extremely challenging. It requires exploiting the dynamics of the interaction, and planning through both physical…

Robotics · Computer Science 2023-08-31 Andrea Bajcsy , Antonio Loquercio , Ashish Kumar , Jitendra Malik

This paper investigates the application of Deep Reinforcement (DRL) Learning to address motion control challenges in drones for additive manufacturing (AM). Drone-based additive manufacturing promises flexible and autonomous material…

Robotics · Computer Science 2025-04-15 Gaurav Shetty , Mahya Ramezani , Hamed Habibi , Holger Voos , Jose Luis Sanchez-Lopez