English
Related papers

Related papers: Deep Hyperspherical Learning

200 papers

Deep neural networks have enjoyed remarkable success for various vision tasks, however it remains challenging to apply CNNs to domains lacking a regular underlying structures such as 3D point clouds. Towards this we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2018-09-13 Yifan Xu , Tianqi Fan , Mingye Xu , Long Zeng , Yu Qiao

Convolutional Neural Networks (CNNs) have been providing the state-of-the-art performance for learning-related problems involving 2D/3D images in Euclidean space. However, unlike in the Euclidean space, the shapes of many structures in…

Computer Vision and Pattern Recognition · Computer Science 2019-04-02 Fenqiang Zhao , Shunren Xia , Zhengwang Wu , Dingna Duan , Li Wang , Weili Lin , John H Gilmore , Dinggang Shen , Gang Li

Subspace clustering methods based on data self-expression have become very popular for learning from data that lie in a union of low-dimensional linear subspaces. However, the applicability of subspace clustering has been limited because…

Computer Vision and Pattern Recognition · Computer Science 2019-05-02 Junjian Zhang , Chun-Guang Li , Chong You , Xianbiao Qi , Honggang Zhang , Jun Guo , Zhouchen Lin

Inner product-based convolution has been the founding stone of convolutional neural networks (CNNs), enabling end-to-end learning of visual representation. By generalizing inner product with a bilinear matrix, we propose the neural…

Machine Learning · Computer Science 2019-12-09 Weiyang Liu , Zhen Liu , James M. Rehg , Le Song

Convolution is a central operation in Convolutional Neural Networks (CNNs), which applies a kernel to overlapping regions shifted across the image. However, because of the strong correlations in real-world image data, convolutional kernels…

Convolutional Neural Networks (CNNs) have become indispensable for solving machine learning tasks in speech recognition, computer vision, and other areas that involve high-dimensional data. A CNN filters the input feature using a network…

Machine Learning · Computer Science 2020-02-13 Jonathan Ephrath , Moshe Eliasof , Lars Ruthotto , Eldad Haber , Eran Treister

It is well known that Convolutional Neural Networks (CNNs) have significant redundancy in their filter weights. Various methods have been proposed in the literature to compress trained CNNs. These include techniques like pruning weights,…

Machine Learning · Computer Science 2019-06-12 Muhammad Tayyab , Abhijit Mahalanobis

This work introduces pyramidal convolution (PyConv), which is capable of processing the input at multiple filter scales. PyConv contains a pyramid of kernels, where each level involves different types of filters with varying size and depth,…

Computer Vision and Pattern Recognition · Computer Science 2020-06-23 Ionut Cosmin Duta , Li Liu , Fan Zhu , Ling Shao

An important goal in visual recognition is to devise image representations that are invariant to particular transformations. In this paper, we address this goal with a new type of convolutional neural network (CNN) whose invariance is…

Computer Vision and Pattern Recognition · Computer Science 2015-01-08 Julien Mairal , Piotr Koniusz , Zaid Harchaoui , Cordelia Schmid

Deep neural networks face numerous challenges in hyperspectral image classification, including high-dimensional data, sparse ground object distributions, and spectral redundancy, which often lead to classification overfitting and limited…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Guandong Li , Mengxia Ye

Convolution has been the core ingredient of modern neural networks, triggering the surge of deep learning in vision. In this work, we rethink the inherent principles of standard convolution for vision tasks, specifically spatial-agnostic…

Computer Vision and Pattern Recognition · Computer Science 2021-04-13 Duo Li , Jie Hu , Changhu Wang , Xiangtai Li , Qi She , Lei Zhu , Tong Zhang , Qifeng Chen

Diffusion magnetic resonance imaging is sensitive to the microstructural properties of brain tissue. However, estimating clinically and scientifically relevant microstructural properties from the measured signals remains a highly…

Image and Video Processing · Electrical Eng. & Systems 2024-02-27 Leevi Kerkelä , Kiran Seunarine , Filip Szczepankiewicz , Chris A. Clark

Deep-predictive-coding networks (DPCNs) are hierarchical, generative models. They rely on feed-forward and feed-back connections to modulate latent feature representations of stimuli in a dynamic and context-sensitive manner. A crucial…

Artificial Intelligence · Computer Science 2021-09-27 Isaac J. Sledge , Jose C. Principe

Omnidirectional images and spherical representations of $3D$ shapes cannot be processed with conventional 2D convolutional neural networks (CNNs) as the unwrapping leads to large distortion. Using fast implementations of spherical and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Suhas Lohit , Shubhendu Trivedi

Convolutional neural networks typically encode an input image into a series of intermediate features with decreasing resolutions. While this structure is suited to classification tasks, it does not perform well for tasks requiring…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Xianzhi Du , Tsung-Yi Lin , Pengchong Jin , Golnaz Ghiasi , Mingxing Tan , Yin Cui , Quoc V. Le , Xiaodan Song

Inner product-based convolution has been a central component of convolutional neural networks (CNNs) and the key to learning visual representations. Inspired by the observation that CNN-learned features are naturally decoupled with the norm…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Weiyang Liu , Zhen Liu , Zhiding Yu , Bo Dai , Rongmei Lin , Yisen Wang , James M. Rehg , Le Song

Deep learning is currently playing a crucial role toward higher levels of artificial intelligence. This paradigm allows neural networks to learn complex and abstract representations, that are progressively obtained by combining simpler…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-12 Mirco Ravanelli , Yoshua Bengio

Deep neural networks (DNN) have shown great capacity of modeling a dynamical system; nevertheless, they usually do not obey physics constraints such as conservation laws. This paper proposes a new learning framework named ConCerNet to…

Machine Learning · Computer Science 2023-07-20 Wang Zhang , Tsui-Wei Weng , Subhro Das , Alexandre Megretski , Luca Daniel , Lam M. Nguyen

Analyzing scalar and vector fields on the sphere, such as temperature or wind speed and direction on Earth, is a difficult task. Models should respect both the rotational symmetries of the sphere and the inherent symmetries of the vector…

Machine Learning · Computer Science 2026-04-01 Francesco Ballerin , Nello Blaser , Erlend Grong

Normalization Layers (NLs) are widely used in modern deep-learning architectures. Despite their apparent simplicity, their effect on optimization is not yet fully understood. This paper introduces a spherical framework to study the…

Machine Learning · Computer Science 2022-05-20 Simon Roburin , Yann de Mont-Marin , Andrei Bursuc , Renaud Marlet , Patrick Pérez , Mathieu Aubry