English
Related papers

Related papers: TetraSphere: A Neural Descriptor for O(3)-Invarian…

200 papers

In this paper we propose a rotation-invariant deep network for point clouds analysis. Point-based deep networks are commonly designed to recognize roughly aligned 3D shapes based on point coordinates, but suffer from performance drops with…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Ruixuan Yu , Xin Wei , Federico Tombari , Jian Sun

Analyzing a visual scene by inferring the configuration of a generative model is widely considered the most flexible and generalizable approach to scene understanding. Yet, one major problem is the computational challenge of the inference…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Alpha Renner , Lazar Supic , Andreea Danielescu , Giacomo Indiveri , Bruno A. Olshausen , Yulia Sandamirskaya , Friedrich T. Sommer , E. Paxon Frady

Dynamical system models such as Recurrent Neural Networks (RNNs) have become increasingly popular as hypothesis-generating tools in scientific research. Evaluating the dynamics in such networks is key to understanding their learned…

Machine Learning · Computer Science 2024-02-16 Ruiqi Chen , Giacomo Vedovati , Todd Braver , ShiNung Ching

3D point clouds deep learning is a promising field of research that allows a neural network to learn features of point clouds directly, making it a robust tool for solving 3D scene understanding tasks. While recent works show that point…

Computer Vision and Pattern Recognition · Computer Science 2022-03-22 Zhiyuan Zhang , Binh-Son Hua , Sai-Kit Yeung

Recent years have witnessed the emergence and increasing popularity of 3D medical imaging techniques with the development of 3D sensors and technology. However, achieving geometric invariance in the processing of 3D medical images is…

Image and Video Processing · Electrical Eng. & Systems 2019-11-11 Liu Yang , Rudrasis Chakraborty

Semantic segmentation of raw 3D point clouds is an essential component in 3D scene analysis, but it poses several challenges, primarily due to the non-Euclidean nature of 3D point clouds. Although, several deep learning based approaches…

Computer Vision and Pattern Recognition · Computer Science 2020-12-01 Saqib Ali Khan , Yilei Shi , Muhammad Shahzad , Xiao Xiang Zhu

This paper explores the problem of reconstructing temporally consistent surfaces from a 3D point cloud sequence without correspondence. To address this challenging task, we propose DynoSurf, an unsupervised learning framework integrating a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Yuxin Yao , Siyu Ren , Junhui Hou , Zhi Deng , Juyong Zhang , Wenping Wang

We present a novel adaptive machine-learning based approach for reconstructing three-dimensional (3D) crystals from coherent diffraction imaging (CDI). We represent the crystals using spherical harmonics (SH) and generate corresponding…

Computational Physics · Physics 2020-12-02 Alexander Scheinker , Reeju Pokharel

Deep learning systems extensively use convolution operations to process input data. Though convolution is clearly defined for structured data such as 2D images or 3D volumes, this is not true for other data types such as sparse point…

Computer Vision and Pattern Recognition · Computer Science 2018-09-26 Pedro Hermosilla , Tobias Ritschel , Pere-Pau Vázquez , Àlvar Vinacua , Timo Ropinski

3D point cloud semantic and instance segmentation is crucial and fundamental for 3D scene understanding. Due to the complex structure, point sets are distributed off balance and diversely, which appears as both category imbalance and…

Computer Vision and Pattern Recognition · Computer Science 2020-01-07 Tong He , Dong Gong , Zhi Tian , Chunhua Shen

Graph neural networks that model 3D data, such as point clouds or atoms, are typically desired to be $SO(3)$ equivariant, i.e., equivariant to 3D rotations. Unfortunately equivariant convolutions, which are a fundamental operation for…

Machine Learning · Computer Science 2023-06-16 Saro Passaro , C. Lawrence Zitnick

Transformers have been at the heart of the Natural Language Processing (NLP) and Computer Vision (CV) revolutions. The significant success in NLP and CV inspired exploring the use of Transformers in point cloud processing. However, how do…

Computer Vision and Pattern Recognition · Computer Science 2022-09-22 Dening Lu , Qian Xie , Mingqiang Wei , Kyle Gao , Linlin Xu , Jonathan Li

Learning local descriptors is an important problem in computer vision. While there are many techniques for learning local patch descriptors for 2D images, recently efforts have been made for learning local descriptors for 3D points. The…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Siddharth Srivastava , Brejesh Lall

Rotation estimation of high precision from an RGB-D object observation is a huge challenge in 6D object pose estimation, due to the difficulty of learning in the non-linear space of SO(3). In this paper, we propose a novel rotation…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jiehong Lin , Zewei Wei , Yabin Zhang , Kui Jia

Recently, implicit neural representations have gained popularity for learning-based 3D reconstruction. While demonstrating promising results, most implicit approaches are limited to comparably simple geometry of single objects and do not…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Songyou Peng , Michael Niemeyer , Lars Mescheder , Marc Pollefeys , Andreas Geiger

Deep convolutional neural networks (CNNs) have shown outstanding performance in the task of semantically segmenting images. Applying the same methods on 3D data still poses challenges due to the heavy memory requirements and the lack of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-21 Radu Alexandru Rosu , Peer Schütt , Jan Quenzel , Sven Behnke

Neural Radiance Fields (NeRFs) are a very recent and very popular approach for the problems of novel view synthesis and 3D reconstruction. A popular scene representation used by NeRFs is to combine a uniform, voxel-based subdivision of the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-22 Jonas Kulhanek , Torsten Sattler

Convolutional neural networks (CNNs) have been widely used in various vision tasks, e.g. image classification, semantic segmentation, etc. Unfortunately, standard 2D CNNs are not well suited for spherical signals such as panorama images or…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Yuqi Liu , Yin Wang , Haikuan Du , Shen Cai

Despite significant progress in image-based 3D scene flow estimation, the performance of such approaches has not yet reached the fidelity required by many applications. Simultaneously, these applications are often not restricted to…

Computer Vision and Pattern Recognition · Computer Science 2019-01-08 Aseem Behl , Despoina Paschalidou , Simon Donné , Andreas Geiger

In this paper, we propose a novel deep architecture tailored for 3D point cloud applications, named as SPE-Net. The embedded ``Selective Position Encoding (SPE)'' procedure relies on an attention mechanism that can effectively attend to the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Zhaofan Qiu , Yehao Li , Yu Wang , Yingwei Pan , Ting Yao , Tao Mei