English
Related papers

Related papers: Point Cloud Models Improve Visual Robustness in Ro…

200 papers

Generalization in Deep Reinforcement Learning (DRL) across unseen environment variations often requires training over a diverse set of scenarios. Many existing DRL algorithms struggle with efficiency when handling numerous variations. The…

Machine Learning · Computer Science 2024-11-12 Xiu Yuan

Three-dimensional (3D) object recognition is crucial for intelligent autonomous agents such as autonomous vehicles and robots alike to operate effectively in unstructured environments. Most state-of-art approaches rely on relatively dense…

Robotics · Computer Science 2022-05-10 Prajval Kumar Murali , Cong Wang , Ravinder Dahiya , Mohsen Kaboli

Self-supervised methods have been proven effective for learning deep representations of 3D point cloud data. Although recent methods in this domain often rely on random masking of inputs, the results of this approach can be improved. We…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Michał Szachniewicz , Wojciech Kozłowski , Michał Stypułkowski , Maciej Zięba

Adversarial attacks exploit vulnerabilities in a model's decision boundaries through small, carefully crafted perturbations that lead to significant mispredictions. In 3D vision, the high dimensionality and sparsity of data greatly expand…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Nastaran Darabi , Dinithi Jayasuriya , Devashri Naik , Theja Tulabandhula , Amit Ranjan Trivedi

Point cloud learning is receiving increasing attention. However, most existing point cloud models lack the practical ability to deal with the unavoidable presence of unknown objects. This paper primarily discusses point cloud learning in…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Jie Hong , Shi Qiu , Weihao Li , Saeed Anwar , Mehrtash Harandi , Nick Barnes , Lars Petersson

Learning to control robots directly based on images is a primary challenge in robotics. However, many existing reinforcement learning approaches require iteratively obtaining millions of robot samples to learn a policy, which can take…

Robotics · Computer Science 2019-08-02 AJ Piergiovanni , Alan Wu , Michael S. Ryoo

A promising direction for pre-training 3D point clouds is to leverage the massive amount of data in 2D, whereas the domain gap between 2D and 3D creates a fundamental challenge. This paper proposes a novel approach to point-cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Siming Yan , Chen Song , Youkang Kong , Qixing Huang

Reinforcement learning (RL) and model predictive control (MPC) offer a wealth of distinct approaches for automatic decision-making under uncertainty. Given the impact both fields have had independently across numerous domains, there is…

Systems and Control · Electrical Eng. & Systems 2025-10-13 Nathan P. Lawrence , Philip D. Loewen , Michael G. Forbes , R. Bhushan Gopaluni , Ali Mesbah

3D reconstruction from images is a core problem in computer vision. With recent advances in deep learning, it has become possible to recover plausible 3D shapes even from single RGB images for the first time. However, obtaining detailed…

Computer Vision and Pattern Recognition · Computer Science 2019-12-24 Tao Hu , Geng Lin , Zhizhong Han , Matthias Zwicker

Point cloud is point sets defined in 3D metric space. Point cloud has become one of the most significant data format for 3D representation. Its gaining increased popularity as a result of increased availability of acquisition devices, such…

Computer Vision and Pattern Recognition · Computer Science 2020-01-20 Saifullahi Aminu Bello , Shangshu Yu , Cheng Wang

Despite significant progress in image-based 3D scene flow estimation, the performance of such approaches has not yet reached the fidelity required by many applications. Simultaneously, these applications are often not restricted to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Aseem Behl , Despoina Paschalidou , Simon Donné , Andreas Geiger

Vision-based robotics often separates the control loop into one module for perception and a separate module for control. It is possible to train the whole system end-to-end (e.g. with deep RL), but doing it "from scratch" comes with a high…

Robotics · Computer Science 2020-11-16 Bryan Chen , Alexander Sax , Gene Lewis , Iro Armeni , Silvio Savarese , Amir Zamir , Jitendra Malik , Lerrel Pinto

Recent advances in deep reinforcement learning have showcased its potential in tackling complex tasks. However, experiments on visual control tasks have revealed that state-of-the-art reinforcement learning models struggle with…

Machine Learning · Computer Science 2023-11-30 Rudra P. K. Poudel , Harit Pandya , Chao Zhang , Roberto Cipolla

Point cloud is often regarded as a discrete sampling of Riemannian manifold and plays a pivotal role in the 3D image interpretation. Particularly, rotation perturbation, an unexpected small change in rotation caused by various factors (like…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Xinyu Xu , Huazhen Liu , Feiming Wei , Huilin Xiong , Wenxian Yu , Tao Zhang

In recent years, the challenge of 3D shape analysis within point cloud data has gathered significant attention in computer vision. Addressing the complexities of effective 3D information representation and meaningful feature extraction for…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Md Meraz , Md Afzal Ansari , Mohammed Javed , Pavan Chakraborty

Visual model-based reinforcement learning (RL) has the potential to enable sample-efficient robot learning from visual observations. Yet the current approaches typically train a single model end-to-end for learning both visual…

Robotics · Computer Science 2023-05-30 Younggyo Seo , Danijar Hafner , Hao Liu , Fangchen Liu , Stephen James , Kimin Lee , Pieter Abbeel

Learning robust and generalizable world models is crucial for enabling efficient and scalable robotic control in real-world environments. In this work, we introduce a novel framework for learning world models that accurately capture…

Robotics · Computer Science 2025-12-16 Chenhao Li , Andreas Krause , Marco Hutter

Point cloud is one of the most widely used digital representation formats for three-dimensional (3D) contents, the visual quality of which may suffer from noise and geometric shift distortions during the production procedure as well as…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Zicheng Zhang , Wei Sun , Yucheng Zhu , Xiongkuo Min , Wei Wu , Ying Chen , Guangtao Zhai

Following the advent of immersive technologies and the increasing interest in representing interactive geometrical format, 3D Point Clouds (PC) have emerged as a promising solution and effective means to display 3D visual information. In…

Computer Vision and Pattern Recognition · Computer Science 2022-11-07 Marouane Tliba , Aladine Chetouani , Giuseppe Valenzise , Frederic Dufaux

Semantic understanding of 3D point clouds is important for various robotics applications. Given that point-wise semantic annotation is expensive, in this paper, we address the challenge of learning models with extremely sparse labels. The…

Computer Vision and Pattern Recognition · Computer Science 2021-09-20 Liyi Luo , Beiwen Tian , Hao Zhao , Guyue Zhou