English
Related papers

Related papers: Attention on the Sphere

200 papers

We address semantic segmentation on omnidirectional images, to leverage a holistic understanding of the surrounding scene for applications like autonomous driving systems. For the spherical domain, several methods recently adopt an…

Computer Vision and Pattern Recognition · Computer Science 2019-07-31 Chao Zhang , Stephan Liwicki , William Smith , Roberto Cipolla

This study proposes a 3D semantic segmentation method for the spine based on the improved SwinUNETR to improve segmentation accuracy and robustness. Aiming at the complex anatomical structure of spinal images, this paper introduces a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Yanlin Xiang , Qingyuan He , Ting Xu , Ran Hao , Jiacheng Hu , Hanchao Zhang

Kilometer-scale Earth system models are essential for capturing local climate change. However, these models are computationally expensive and produce petabyte-scale outputs, which limits their utility for applications such as probabilistic…

Machine Learning · Computer Science 2026-01-22 Johannes Meuer , Maximilian Witte , Étiénne Plésiat , Thomas Ludwig , Christopher Kadow

In the current landscape of large models, the Transformer stands as a cornerstone, playing a pivotal role in shaping the trajectory of modern models. However, its application encounters challenges attributed to the substantial computational…

Machine Learning · Computer Science 2024-09-03 Gaoxiang Duan , Junkai Zhang , Xiaoying Zheng , Yongxin Zhu , Victor Chang

This work addresses the task of overhead image segmentation when auxiliary ground-level images are available. Recent work has shown that performing joint inference over these two modalities, often called near/remote sensing, can yield…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Scott Workman , M. Usman Rafique , Hunter Blanton , Nathan Jacobs

Sphere fitting is a common problem in almost all science and engineering disciplines. Most of methods available are iterative in behavior. This involves fitting of the parameters in a least square sense or in a geometric sense. Here we…

Computer Vision and Pattern Recognition · Computer Science 2015-06-10 Sumith YD

We propose a new class of linear-time attention mechanisms based on a relaxed and computationally efficient formulation of the recently introduced E-Product, often referred to as the Yat-kernel (Bouhsine, 2025). The resulting interactions…

Machine Learning · Computer Science 2026-02-10 Jose Miguel Luna , Taha Bouhsine , Krzysztof Choromanski

Integrating quantum computing into deep learning architectures is a promising but poorly understood endeavor: when does a quantum layer actually help, and how much quantum is enough? We address both questions through Quantum Adaptive…

Quantum Physics · Physics 2026-04-23 Chi-Sheng Chen , En-Jui Kuo

While convolutional neural networks have shown a tremendous impact on various computer vision tasks, they generally demonstrate limitations in explicitly modeling long-range dependencies due to the intrinsic locality of the convolution…

Computer Vision and Pattern Recognition · Computer Science 2021-08-06 Guanglei Yang , Hao Tang , Mingli Ding , Nicu Sebe , Elisa Ricci

The state-of-the-art speech enhancement has limited performance in speech estimation accuracy. Recently, in deep learning, the Transformer shows the potential to exploit the long-range dependency in speech by self-attention. Therefore, it…

Sound · Computer Science 2023-05-10 Yi Li , Yang Sun , Syed Mohsen Naqvi

Convolutional neural networks (CNNs) have been widely used in various vision tasks, e.g. image classification, semantic segmentation, etc. Unfortunately, standard 2D CNNs are not well suited for spherical signals such as panorama images or…

Computer Vision and Pattern Recognition · Computer Science 2022-09-05 Yuqi Liu , Yin Wang , Haikuan Du , Shen Cai

Panoramic distortion poses a significant challenge in 360 depth estimation, particularly pronounced at the north and south poles. Existing methods either adopt a bi-projection fusion strategy to remove distortions or model long-range…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Junsong Zhang , Zisong Chen , Chunyu Lin , Lang Nie , Zhijie Shen , Kang Liao , Junda Huang , Yao Zhao

Rotational symmetry plays a central role in physics, providing an elegant framework to describe how the properties of 3D objects -- from atoms to the macroscopic scale -- transform under the action of rigid rotations. Equivariant models of…

Chemical Physics · Physics 2025-10-28 Michelangelo Domina , Filippo Bigi , Paolo Pegolo , Michele Ceriotti

We describe an efficient and scalable spherical graph embedding method. The method uses a generalization of the Euclidean stress function for Multi-Dimensional Scaling adapted to spherical space, where geodesic pairwise distances are…

Computational Geometry · Computer Science 2022-09-02 Jacob Miller , Vahan Huroyan , Stephen Kobourov

Based on a recent purely geometric construction of observables for the spatial diffeomorphism constraint, we propose two distinct quantum reductions to spherical symmetry within full 3+1-dimensional loop quantum gravity. The construction of…

General Relativity and Quantum Cosmology · Physics 2015-05-28 Norbert Bodendorfer , Jerzy Lewandowski , Jedrzej Świeżewski

The global attention mechanism is one of the keys to the success of transformer architecture, but it incurs quadratic computational costs in relation to the number of tokens. On the other hand, equivariant models, which leverage the…

Machine Learning · Computer Science 2025-09-30 Owen Lewis Howell , Linfeng Zhao , Xupeng Zhu , Yaoyao Qian , Haojie Huang , Lingfeng Sun , Wil Thomason , Robert Platt , Robin Walters

In recent years, attention mechanisms have significantly enhanced the performance of object detection by focusing on key feature information. However, prevalent methods still encounter difficulties in effectively balancing local and global…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Yifan Shao

The Transformer architecture has significantly advanced deep learning, particularly in natural language processing, by effectively managing long-range dependencies. However, as the demand for understanding complex relationships grows,…

Computation and Language · Computer Science 2024-06-18 Qian Chen , Wen Wang , Qinglin Zhang , Siqi Zheng , Shiliang Zhang , Chong Deng , Hai Yu , Jiaqing Liu , Yukun Ma , Chong Zhang

Reliable depth estimation from spherical images is crucial for 360{\deg} vision in robotic navigation and immersive scene understanding. However, the onboard spherical camera can experience unintentional pose variations in real-world…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Soulayma Gazzeh , Giuseppe Mazzola , Liliana Lo Presti , Marco La Cascia

360$^{\circ}$ panoramas are a rich medium, yet notoriously difficult to visualize in the 2D image plane. We explore how intelligent rotations of a spherical image may enable content-aware projection with fewer perceptible distortions.…

Computer Vision and Pattern Recognition · Computer Science 2018-08-14 Bo Xiong , Kristen Grauman