English
Related papers

Related papers: A Multi-Task Recurrent Neural Network for End-to-E…

200 papers

Convolutional Neural Networks (CNNs) are successfully used for the important automotive visual perception tasks including object recognition, motion and depth estimation, visual SLAM, etc. However, these tasks are typically independently…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Ganesh Sistu , Isabelle Leang , Sumanth Chennupati , Senthil Yogamani , Ciaran Hughes , Stefan Milz , Samir Rawashdeh

Grid-centric perception is a crucial field for mobile robot perception and navigation. Nonetheless, grid-centric perception is less prevalent than object-centric perception as autonomous vehicles need to accurately perceive highly dynamic,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Yining Shi , Kun Jiang , Jiusi Li , Zelin Qian , Junze Wen , Mengmeng Yang , Ke Wang , Diange Yang

Models that can simulate how environments change in response to actions can be used by agents to plan and act efficiently. We improve on previous environment simulators from high-dimensional pixel observations by introducing recurrent…

Artificial Intelligence · Computer Science 2017-04-20 Silvia Chiappa , Sébastien Racaniere , Daan Wierstra , Shakir Mohamed

End-to-end autonomous driving has emerged as a dominant paradigm, yet its highly entangled black-box models pose significant challenges in terms of interpretability and safety assurance. To improve model transparency and training…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Ni Ding , Lei He , Shengbo Eben Li , Keqiang Li

Task-based modeling with recurrent neural networks (RNNs) has emerged as a popular way to infer the computational function of different brain regions. These models are quantitatively assessed by comparing the low-dimensional neural…

Neurons and Cognition · Quantitative Biology 2019-12-06 Niru Maheswaranathan , Alex H. Williams , Matthew D. Golub , Surya Ganguli , David Sussillo

With the great achievement of artificial intelligence, vehicle technologies have advanced significantly from human centric driving towards fully automated driving. An intelligent vehicle should be able to understand the driver's perception…

Human-Computer Interaction · Computer Science 2019-03-12 Yang Zheng , Izzat H. Izzat , John H. L. Hansen

We introduce MultiDepth, a novel training strategy and convolutional neural network (CNN) architecture that allows approaching single-image depth estimation (SIDE) as a multi-task problem. SIDE is an important part of road scene…

Computer Vision and Pattern Recognition · Computer Science 2019-07-26 Lukas Liebel , Marco Körner

We introduce a novel approach to endowing neural networks with emergent, long-term, large-scale memory. Distinct from strategies that connect neural networks to external memory banks via intricately crafted controllers and hand-designed…

Machine Learning · Computer Science 2020-08-18 Tri Huynh , Michael Maire , Matthew R. Walter

Accurate and high precision of the indoor positioning is as important as ensuring reliable navigation in outdoor environments. Using the state-of-the-art deep learning models provides better reliability and accuracy to navigate and monitor…

Signal Processing · Electrical Eng. & Systems 2025-08-19 Muhammad Ammad , Paul Schwarzbach , Michael Schultz , Oliver Michler

Despite tremendous progress in developing deep-learning-based weather forecasting systems, their design space, including the impact of different design choices, is yet to be well understood. This paper aims to fill this knowledge gap by…

Multitask learning is a common approach in machine learning, which allows to train multiple objectives with a shared architecture. It has been shown that by training multiple tasks together inference time and compute resources can be saved,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Falk Heuer , Sven Mantowsky , Syed Saqib Bukhari , Georg Schneider

Data on vehicular mobility patterns have proved useful in many contexts. Yet generative models which accurately reproduce these mobility patterns are scarce. Here, we explore if recurrent neural networks can cure this scarcity. By training…

Physics and Society · Physics 2019-10-28 Kevin O'Keeffe , Paolo Santi , Carlo Ratti

Nowadays, there is a general agreement on the need to better characterize agricultural monitoring systems in response to the global changes. Timely and accurate land use/land cover mapping can support this vision by providing useful…

Computer Vision and Pattern Recognition · Computer Science 2020-04-07 Yawogan Jean Eudes Gbodjo , Dino Ienco , Louise Leroux , Roberto Interdonato , Raffaelle Gaetano

This paper presents two variations of a novel stochastic prediction algorithm that enables mobile robots to accurately and robustly predict the future state of complex dynamic scenes. The proposed algorithm uses a variational autoencoder to…

Robotics · Computer Science 2023-10-17 Zhanteng Xie , Philip Dames

This paper addresses the problem of learning instantaneous occupancy levels of dynamic environments and predicting future occupancy levels. Due to the complexity of most real-world environments, such as urban streets or crowded areas, the…

Robotics · Computer Science 2019-12-05 Vitor Guizilini , Ransalu Senanayake , Fabio Ramos

End-to-end autonomous driving systems increasingly rely on vision-centric world models to understand and predict their environment. However, a common ineffectiveness in these models is the full reconstruction of future scenes, which expends…

Computer Vision and Pattern Recognition · Computer Science 2026-02-10 Jianbiao Mei , Yu Yang , Xuemeng Yang , Licheng Wen , Jiajun Lv , Botian Shi , Yong Liu

General-purpose planning algorithms for automated driving combine mission, behavior, and local motion planning. Such planning algorithms map features of the environment and driving kinematics into complex reward functions. To achieve this,…

Robotics · Computer Science 2020-09-17 Sascha Rosbach , Vinit James , Simon Großjohann , Silviu Homoceanu , Xing Li , Stefan Roth

Multi-task learning aims to improve generalization performance of multiple prediction tasks by appropriately sharing relevant information across them. In the context of deep neural networks, this idea is often realized by hand-designed…

Computer Vision and Pattern Recognition · Computer Science 2016-11-17 Yongxi Lu , Abhishek Kumar , Shuangfei Zhai , Yu Cheng , Tara Javidi , Rogerio Feris

Learning-based 3D reconstruction using implicit neural representations has shown promising progress not only at the object level but also in more complicated scenes. In this paper, we propose Dynamic Plane Convolutional Occupancy Networks,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-12 Stefan Lionar , Daniil Emtsev , Dusan Svilarkovic , Songyou Peng

Traditionally, autonomous reconnaissance applications have acted on explicit sets of historical observations. Aided by recent breakthroughs in generative technologies, this work enables robot teams to act beyond what is currently known…