English
Related papers

Related papers: A General Purpose Spectral Foundational Model for …

200 papers

The foundation model has recently garnered significant attention due to its potential to revolutionize the field of visual representation learning in a self-supervised manner. While most foundation models are tailored to effectively process…

Computer Vision and Pattern Recognition · Computer Science 2024-02-13 Danfeng Hong , Bing Zhang , Xuyang Li , Yuxuan Li , Chenyu Li , Jing Yao , Naoto Yokoya , Hao Li , Pedram Ghamisi , Xiuping Jia , Antonio Plaza , Paolo Gamba , Jon Atli Benediktsson , Jocelyn Chanussot

Hyperspectral imaging provides detailed spectral information, offering significant potential for monitoring greenhouse gases like CH4 and NO2. However, its application is constrained by limited spatial coverage and infrequent revisit times.…

Hyperspectral object tracking using snapshot mosaic cameras is emerging as it provides enhanced spectral information alongside spatial data, contributing to a more comprehensive understanding of material properties. Using transformers,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Shaheer Mohamed , Tharindu Fernando , Sridha Sridharan , Peyman Moghadam , Clinton Fookes

Advanced interpretation of hyperspectral remote sensing images benefits many precise Earth observation tasks. Recently, visual foundation models have promoted the remote sensing interpretation but concentrating on RGB and multispectral…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Jingtao Li , Yingyi Liu , Xinyu Wang , Yunning Peng , Chen Sun , Shaoyu Wang , Zhendong Sun , Tian Ke , Xiao Jiang , Tangwei Lu , Anran Zhao , Yanfei Zhong

Hyperspectral imaging provides detailed spectral information and holds significant potential for monitoring of greenhouse gases (GHGs). However, its application is constrained by limited spatial coverage and infrequent revisit times. In…

Existing deep learning methods for remote sensing image fusion often suffer from poor generalization when applied to unseen datasets due to the limited availability of real training data and the domain gap between different satellite…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Yongchuan Cui , Peng Liu , Yi Zeng

Foundation models, large-scale, pre-trained deep-learning models adapted to a wide range of downstream tasks have gained significant interest lately in various deep-learning problems undergoing a paradigm shift with the rise of these…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Bobby Azad , Reza Azad , Sania Eskandari , Afshin Bozorgpour , Amirhossein Kazerouni , Islem Rekik , Dorit Merhof

Recent advances in Remote Sensing Foundation Models (RSFMs) have led to significant breakthroughs in the field. While many RSFMs have been pretrained with massive optical imagery, more multispectral/hyperspectral data remain lack of the…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Yuxiang Zhang , Wei Li , Mengmeng Zhang , Jiawei Han , Ran Tao , Shunlin Liang

Foundation models, i.e., very large deep learning models, have demonstrated impressive performances in various language and vision tasks that are otherwise difficult to reach using smaller-size models. The major success of GPT-type of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yiqun Xie , Zhihao Wang , Weiye Chen , Zhili Li , Xiaowei Jia , Yanhua Li , Ruichen Wang , Kangyang Chai , Ruohan Li , Sergii Skakun

Hyperspectral imaging offers new perspectives for diverse applications, ranging from the monitoring of the environment using airborne or satellite remote sensing, precision farming, food safety, planetary exploration, or astrophysics.…

Image and Video Processing · Electrical Eng. & Systems 2021-11-19 Théo Bodrito , Alexandre Zouaoui , Jocelyn Chanussot , Julien Mairal

Hyperspectral imaging enables versatile applications due to its competence in capturing abundant spatial and spectral information, which are crucial for identifying substances. However, the devices for acquiring hyperspectral images are…

Image and Video Processing · Electrical Eng. & Systems 2022-07-14 Jingang Zhang , Runmu Su , Wenqi Ren , Qiang Fu , Felix Heide , Yunfeng Nie

The adoption of neural network models in medical imaging has been constrained by strict privacy regulations, limited data availability, high acquisition costs, and demographic biases. Deep generative models offer a promising solution by…

Image and Video Processing · Electrical Eng. & Systems 2025-06-16 Zuzanna Skorniewska , Bartlomiej W. Papiez

Hyperspectral imaging empowers machine vision systems with the distinct capability of identifying materials through recording their spectral signatures. Recent efforts in data-driven spectral reconstruction aim at extracting spectral…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Qiang Fu , Matheus Souza , Eunsue Choi , Suhyun Shin , Seung-Hwan Baek , Wolfgang Heidrich

This article discusses the opportunities, applications and future directions of large-scale pre-trained models, i.e., foundation models, for analyzing medical images. Medical foundation models have immense potential in solving a wide range…

Image and Video Processing · Electrical Eng. & Systems 2023-11-23 Shaoting Zhang , Dimitris Metaxas

Existing X-ray based pre-trained vision models are usually conducted on a relatively small-scale dataset (less than 500k samples) with limited resolution (e.g., 224 $\times$ 224). However, the key to the success of self-supervised…

Image and Video Processing · Electrical Eng. & Systems 2024-04-30 Xiao Wang , Yuehang Li , Wentao Wu , Jiandong Jin , Yao Rong , Bo Jiang , Chuanfu Li , Jin Tang

Image retrieval enables an efficient search through vast amounts of satellite imagery and returns similar images to a query. Deep learning models can identify images across various semantic concepts without the need for annotations. This…

Computer Vision and Pattern Recognition · Computer Science 2024-05-24 Benedikt Blumenstiel , Viktoria Moor , Romeo Kienzler , Thomas Brunschwiler

Achieving accurate material segmentation for 3-channel RGB images is challenging due to the considerable variation in a material's appearance. Hyperspectral images, which are sets of spectral measurements sampled at multiple wavelengths,…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Yuwen Heng , Yihong Wu , Jiawen Chen , Srinandan Dasmahapatra , Hansung Kim

Multi-modal foundation models are typically trained on millions of pairs of natural images and text captions, frequently obtained through web-crawling approaches. Although such models depict excellent generative capabilities, they do not…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Pierre Chambon , Christian Bluethgen , Curtis P. Langlotz , Akshay Chaudhari

Foundation models have advanced machine learning across various modalities, including images. Recently multiple teams trained foundation models specialized for remote sensing applications. This line of research is motivated by the distinct…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Ani Vanyan , Alvard Barseghyan , Hakob Tamazyan , Tigran Galstyan , Vahan Huroyan , Naira Hovakimyan , Hrant Khachatrian

Foundation models have garnered increasing attention for representation learning in remote sensing. Many such foundation models adopt approaches that have demonstrated success in computer vision with minimal domain-specific modification.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Kevin Lane , Morteza Karimzadeh
‹ Prev 1 2 3 10 Next ›