English
Related papers

Related papers: SE(3)-bi-equivariant Transformers for Point Cloud …

200 papers

Modern pre-trained transformers have rapidly advanced the state-of-the-art in machine learning, but have also grown in parameters and computational complexity, making them increasingly difficult to deploy in resource-constrained…

Machine Learning · Computer Science 2022-10-04 Zechun Liu , Barlas Oguz , Aasish Pappu , Lin Xiao , Scott Yih , Meng Li , Raghuraman Krishnamoorthi , Yashar Mehdad

Point cloud registration is a foundational task for 3D alignment and reconstruction applications. While both traditional and learning-based registration approaches have succeeded, leveraging the intrinsic symmetry of point cloud data,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Xueyang Kang , Zhaoliang Luan , Kourosh Khoshelham , Bing Wang

Existing networks directly learn feature representations on 3D point clouds for shape analysis. We argue that 3D point clouds are highly redundant and hold irregular (permutation-invariant) structure, which makes it difficult to achieve…

Machine Learning · Computer Science 2020-07-21 Sameera Ramasinghe , Salman Khan , Nick Barnes , Stephen Gould

Recently, detection transformers (DETRs) have gradually taken a dominant position in 2D detection thanks to their elegant framework. However, DETR-based detectors for 3D point clouds are still difficult to achieve satisfactory performance.…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Zhe Liu , Jinghua Hou , Xiaoqing Ye , Tong Wang , Jingdong Wang , Xiang Bai

To alleviate the resource constraint for real-time point cloud applications that run on edge devices, in this paper we present BiPointNet, the first model binarization approach for efficient deep learning on point clouds. We discover that…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Haotong Qin , Zhongang Cai , Mingyuan Zhang , Yifu Ding , Haiyu Zhao , Shuai Yi , Xianglong Liu , Hao Su

Recently, Transformer-based methods have achieved impressive results in single image super-resolution (SISR). However, the lack of locality mechanism and high complexity limit their application in the field of super-resolution (SR). To…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ling Zheng , Jinchen Zhu , Jinpeng Shi , Shizhuang Weng

The irregular domain and lack of ordering make it challenging to design deep neural networks for point cloud processing. This paper presents a novel framework named Point Cloud Transformer(PCT) for point cloud learning. PCT is based on…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Meng-Hao Guo , Jun-Xiong Cai , Zheng-Ning Liu , Tai-Jiang Mu , Ralph R. Martin , Shi-Min Hu

3D point cloud is an efficient and flexible representation of 3D structures. Recently, neural networks operating on point clouds have shown superior performance on 3D understanding tasks such as shape classification and part segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2019-10-21 Wentao Yuan , David Held , Christoph Mertz , Martial Hebert

Point clouds are unstructured and unordered in the embedded 3D space. In order to produce consistent responses under different permutation layouts, most existing methods aggregate local spatial points through maximum or summation operation.…

Computer Vision and Pattern Recognition · Computer Science 2020-09-04 Yuan Fang , Chunyan Xu , Zhen Cui , Yuan Zong , Jian Yang

The recent surge in 3D data acquisition has spurred the development of geometric deep learning models for point cloud processing, boosted by the remarkable success of transformers in natural language processing. While point cloud…

Computer Vision and Pattern Recognition · Computer Science 2024-01-29 Alessandro Baiocchi , Indro Spinelli , Alessandro Nicolosi , Simone Scardapane

For computer vision, Vision Transformers (ViTs) have become one of the go-to deep net architectures. Despite being inspired by Convolutional Neural Networks (CNNs), ViTs' output remains sensitive to small spatial shifts in the input, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Renan A. Rojas-Gomez , Teck-Yian Lim , Minh N. Do , Raymond A. Yeh

Representations are a foundational component of any modelling protocol, including on molecules and molecular solids. For tasks that depend on knowledge of both molecular conformation and 3D orientation, such as the modelling of molecular…

Machine Learning · Computer Science 2026-03-17 Michael Kilgour , Mark Tuckerman , Jutta Rogal

Bundle Adjustment (BA) refers to the problem of simultaneous determination of sensor poses and scene geometry, which is a fundamental problem in robot vision. This paper presents an efficient and consistent bundle adjustment method for…

Robotics · Computer Science 2024-06-18 Zheng Liu , Xiyuan Liu , Fu Zhang

Category-level object pose estimation aims to find 6D object poses of previously unseen object instances from known categories without access to object CAD models. To reduce the huge amount of pose annotations needed for category-level…

Computer Vision and Pattern Recognition · Computer Science 2021-11-02 Xiaolong Li , Yijia Weng , Li Yi , Leonidas Guibas , A. Lynn Abbott , Shuran Song , He Wang

Transformer, as an alternative to CNN, has been proven effective in many modalities (e.g., texts and images). For 3D point cloud transformers, existing efforts focus primarily on pushing their accuracy to the state-of-the-art level.…

Computer Vision and Pattern Recognition · Computer Science 2023-07-18 Zhijian Liu , Xinyu Yang , Haotian Tang , Shang Yang , Song Han

DEtection TRansformer (DETR) started a trend that uses a group of learnable queries for unified visual perception. This work begins by applying this appealing paradigm to LiDAR-based point cloud segmentation and obtains a simple yet…

Computer Vision and Pattern Recognition · Computer Science 2023-03-24 Zeqi Xiao , Wenwei Zhang , Tai Wang , Chen Change Loy , Dahua Lin , Jiangmiao Pang

Group equivariance (e.g. SE(3) equivariance) is a critical physical symmetry in science, from classical and quantum physics to computational biology. It enables robust and accurate prediction under arbitrary reference transformations. In…

Computational Engineering, Finance, and Science · Computer Science 2023-02-08 Weitao Du , He Zhang , Yuanqi Du , Qi Meng , Wei Chen , Bin Shao , Tie-Yan Liu

Many point cloud classification methods are developed under the assumption that all point clouds in the dataset are well aligned with the canonical axes so that the 3D Cartesian point coordinates can be employed to learn features. When…

Computer Vision and Pattern Recognition · Computer Science 2023-02-23 Pranav Kadam , Hardik Prajapati , Min Zhang , Jintang Xue , Shan Liu , C. -C. Jay Kuo

We tackle the problem of object-centric learning on point clouds, which is crucial for high-level relational reasoning and scalable machine intelligence. In particular, we introduce a framework, SPAIR3D, to factorize a 3D point cloud into a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-19 Tianyu Wang , Miaomiao Liu , Kee Siong Ng

Deep learning for predicting the electronic-structure Hamiltonian of quantum systems necessitates satisfying the covariance laws, among which achieving SO(3)-equivariance without sacrificing the non-linear expressive capability of networks…

Computational Physics · Physics 2024-06-25 Shi Yin , Xinyang Pan , Xudong Zhu , Tianyu Gao , Haochong Zhang , Feng Wu , Lixin He