English
Related papers

Related papers: Universal Spectral Tokenization via Self-Supervise…

200 papers

The development of single-cell and spatial transcriptomics has revolutionized our capacity to investigate cellular properties, functions, and interactions in both cellular and spatial contexts. However, the analysis of single-cell and…

Genomics · Quantitative Biology 2024-12-09 Shuang Ge , Shuqing Sun , Huan Xu , Qiang Cheng , Zhixiang Ren

Airborne hyperspectral images can be used to map the land cover in large urban areas, thanks to their very high spatial and spectral resolutions on a wide spectral domain. While the spectral dimension of hyperspectral images is highly…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Romain Thoreau , Laurent Risser , Véronique Achard , Béatrice Berthelot , Xavier Briottet

Deep learning has generated diverse perspectives in astronomy, with ongoing discussions between proponents and skeptics motivating this review. We examine how neural networks complement classical statistics, extending our data analytical…

Instrumentation and Methods for Astrophysics · Physics 2026-05-07 Yuan-Sen Ting

Spectroscopy represents the ideal observational method to maximally extract information from galaxies regarding their star formation and chemical enrichment histories. However, absorption spectra of galaxies prove rather challenging at high…

Instrumentation and Methods for Astrophysics · Physics 2025-10-10 Oliver Camilleri , Zahra Sharbaf , Ignacio Ferreras

Spectral imaging data acquired via multispectral and hyperspectral cameras can have hundreds of channels, where each channel records the reflectance at a specific wavelength and bandwidth. Time and resource constraints limit our ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 William Michael Laprade , Jesper Cairo Westergaard , Svend Christensen , Mads Nielsen , Anders Bjorholm Dahl

Astronomical observations typically provide three-dimensional maps, encoding the distribution of the observed flux in (1) the two angles of the celestial sphere and (2) energy/frequency. An important task regarding such maps is to…

Instrumentation and Methods for Astrophysics · Physics 2024-01-09 Florian Wolf , Florian List , Nicholas L. Rodd , Oliver Hahn

We demonstrate spectroscopy of incoherent light with sub-diffraction resolution. In a proof-of-principle experiment we analyze the spectrum of a pair of incoherent point-like sources whose separation is below the diffraction limit. The two…

Hyperspectral imaging has become a significant source of valuable data for astronomers over the past decades. Current instrumental and observing time constraints allow direct acquisition of multispectral images, with high spatial but low…

Computer Vision and Pattern Recognition · Computer Science 2019-12-30 Claire Guilloteau , Thomas Oberlin , Olivier Berné , Nicolas Dobigeon

The information recoverable from galaxy spectra depends fundamentally on spectral resolution, yet assembling large samples at high resolution remains observationally expensive. We present a deep-learning framework for spectral…

Human adaptability relies crucially on learning and merging knowledge from both supervised and unsupervised tasks: the parents point out few important concepts, but then the children fill in the gaps on their own. This is particularly…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Silvia Bucci , Antonio D'Innocente , Yujun Liao , Fabio Maria Carlucci , Barbara Caputo , Tatiana Tommasi

In clinical practice, medical segmentation datasets are often limited and heterogeneous, with variations in modalities, protocols, and anatomical targets across institutions. Existing deep learning models struggle to jointly learn from such…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Weiwei Ma , Xiaobing Yu , Peijie Qiu , Jin Yang , Pan Xiao , Xiaoqi Zhao , Xiaofeng Liu , Tomo Miyazaki , Shinichiro Omachi , Yongsong Huang

Hyperspectral imaging provides precise classification for land use and cover due to its exceptional spectral resolution. However, the challenges of high dimensionality and limited spatial resolution hinder its effectiveness. This study…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Shivam Pande

The European Space Agency's Sentinel-2 satellite provides global multispectral coverage for remote sensing (RS) applications. However, limited spectral resolution (12 bands) and non-unified spatial resolution (60/20/10 m) restrict their…

Image and Video Processing · Electrical Eng. & Systems 2026-03-03 Si-Sheng Young , Chia-Hsiang Lin

Hyperspectral images show similar statistical properties to natural grayscale or color photographic images. However, the classification of hyperspectral images is more challenging because of the very high dimensionality of the pixels and…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Gustavo Camps-Valls , Devis Tuia , Lorenzo Bruzzone , Jón Atli Benediktsson

Progress in self-supervised learning has brought strong general image representation learning methods. Yet so far, it has mostly focused on image-level learning. In turn, tasks such as unsupervised image segmentation have not benefited from…

Computer Vision and Pattern Recognition · Computer Science 2022-06-22 Adrian Ziegler , Yuki M. Asano

Self-supervised learning (SSL) has driven impressive advances in speech processing by adopting time-domain prediction objectives, while audio representation learning frameworks operate on time-frequency spectrograms. Models optimized for…

Audio and Speech Processing · Electrical Eng. & Systems 2026-04-09 Ameenudeen P E , Charumathi Narayanan , Sriram Ganapathy

Machine learning for differential equations paves the way for computationally efficient alternatives to numerical solvers, with potentially broad impacts in science and engineering. Though current algorithms typically require simulated…

Machine Learning · Computer Science 2024-02-15 Grégoire Mialon , Quentin Garrido , Hannah Lawrence , Danyal Rehman , Yann LeCun , Bobak T. Kiani

When adopting a model-based formulation, solving inverse problems encountered in multiband imaging requires to define spatial and spectral regularizations. In most of the works of the literature, spectral information is extracted from the…

Image and Video Processing · Electrical Eng. & Systems 2023-07-03 Min Zhao , Nicolas Dobigeon , Jie Chen

Deep neural networks have proven to be very effective for computer vision tasks, such as image classification, object detection, and semantic segmentation -- these are primarily applied to color imagery and video. In recent years, there has…

Computer Vision and Pattern Recognition · Computer Science 2020-07-20 Xiong Zhou , Saurabh Prasad

Hyperspectral imaging provides detailed spectral information and holds significant potential for monitoring of greenhouse gases (GHGs). However, its application is constrained by limited spatial coverage and infrequent revisit times. In…