English
Related papers

Related papers: A General Purpose Spectral Foundational Model for …

200 papers

We consider the problem of parameter estimation in a high-dimensional generalized linear model. Spectral methods obtained via the principal eigenvector of a suitable data-dependent matrix provide a simple yet surprisingly effective…

Statistics Theory · Mathematics 2025-07-11 Yihan Zhang , Hong Chang Ji , Ramji Venkataramanan , Marco Mondelli

Multi-spectral imaging, which simultaneously captures the spatial and spectral information of a scene, is widely used across diverse fields, including remote sensing, biomedical imaging, and agricultural monitoring. Here, we introduce a…

Generating hyperspectral images (HSIs) from RGB images through spectral reconstruction can significantly reduce the cost of HSI acquisition. In this paper, we propose a Fractal-Based Recursive Spectral Reconstruction Network (FRN), which…

Computer Vision and Pattern Recognition · Computer Science 2025-05-22 Ge Meng , Zhongnan Cai , Ruizhe Chen , Jingyan Tu , Yingying Wang , Yue Huang , Xinghao Ding

We propose a novel transformer-based framework that reconstructs two high fidelity hands from multi-view RGB images. Unlike existing hand pose estimation methods, where one typically trains a deep network to regress hand model parameters…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Tze Ho Elden Tse , Franziska Mueller , Zhengyang Shen , Danhang Tang , Thabo Beeler , Mingsong Dou , Yinda Zhang , Sasa Petrovic , Hyung Jin Chang , Jonathan Taylor , Bardia Doosti

Graphs are a central representation in biomedical research, capturing molecular interaction networks, gene regulatory circuits, cell--cell communication maps, and knowledge graphs. Despite their importance, currently there is not a broadly…

Machine Learning · Computer Science 2026-04-09 Sakib Mostafa , Lei Xing , Md. Tauhidul Islam

Foundation models are rapidly transforming Earth Observation data mining by enabling generalizable and scalable solutions for key tasks such as scene classification and semantic segmentation. While most efforts in the geospatial domain have…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Man Duc Chuc

Multispectral and hyperspectral images are increasingly popular in different research fields, such as remote sensing, astronomical imaging, or precision agriculture. However, the amount of free data available to perform machine learning…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Roberta Iuliana Luca , Alexandra Baicoianu , Ioana Cristina Plajer

Hyperspectral images show similar statistical properties to natural grayscale or color photographic images. However, the classification of hyperspectral images is more challenging because of the very high dimensionality of the pixels and…

Computer Vision and Pattern Recognition · Computer Science 2015-04-13 Gustavo Camps-Valls , Devis Tuia , Lorenzo Bruzzone , Jón Atli Benediktsson

The rapid advancement of remote sensing foundation models, particularly vision and multimodal models, has significantly enhanced the capabilities of intelligent geospatial data interpretation. These models combine various data modalities,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Ziyue Huang , Hongxi Yan , Qiqi Zhan , Shuai Yang , Mingming Zhang , Chenkai Zhang , YiMing Lei , Zeming Liu , Qingjie Liu , Yunhong Wang

Foundation models in digital pathology use massive datasets to learn useful compact feature representations of complex histology images. However, there is limited transparency into what drives the correlation between dataset size and…

We describe a novel method for blind, single-image spectral super-resolution. While conventional super-resolution aims to increase the spatial resolution of an input image, our goal is to spectrally enhance the input, i.e., generate an…

Computer Vision and Pattern Recognition · Computer Science 2017-03-29 Silvano Galliani , Charis Lanaras , Dimitrios Marmanis , Emmanuel Baltsavias , Konrad Schindler

We propose to recover spectral details from RGB images of known spectral quantization by modeling natural spectra under Gaussian Processes and combining them with the RGB images. Our technique exploits Process Kernels to model the relative…

Computer Vision and Pattern Recognition · Computer Science 2018-07-23 Naveed Akhtar , Ajmal Mian

Signal reconstruction is a challenging aspect of computational imaging as it often involves solving ill-posed inverse problems. Recently, deep feed-forward neural networks have led to state-of-the-art results in solving various inverse…

Computer Vision and Pattern Recognition · Computer Science 2018-04-25 Akshat Dave , Anil Kumar Vadathya , Ramana Subramanyam , Rahul Baburajan , Kaushik Mitra

Hyperspectral images (HSIs) capture rich spectral signatures that reveal vital material properties, offering broad applicability across various domains. However, the scarcity of labeled HSI data limits the full potential of deep learning,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Shaheer Mohamed , Tharindu Fernando , Sridha Sridharan , Peyman Moghadam , Clinton Fookes

Depth estimation is a fundamental task in 3D computer vision, crucial for applications such as 3D reconstruction, free-viewpoint rendering, robotics, autonomous driving, and AR/VR technologies. Traditional methods relying on hardware…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Zhen Xu , Hongyu Zhou , Sida Peng , Haotong Lin , Haoyu Guo , Jiahao Shao , Peishan Yang , Qinglin Yang , Sheng Miao , Xingyi He , Yifan Wang , Yue Wang , Ruizhen Hu , Yiyi Liao , Xiaowei Zhou , Hujun Bao

We derive an estimator of the spectral density of a functional time series that is the output of a multilayer perceptron neural network. The estimator is motivated by difficulties with the computation of existing spectral density estimators…

Methodology · Statistics 2026-01-05 Neda Mohammadi , Soham Sarkar , Piotr Kokoszka

Medical vision foundational models are used for a wide variety of tasks, including medical image segmentation and registration. This work evaluates the ability of these models to predict disease progression using a simple linear probe. We…

Image and Video Processing · Electrical Eng. & Systems 2025-03-24 Basar Demir , Soumitri Chattopadhyay , Thomas Hastings Greer , Boqi Chen , Marc Niethammer

Foundation models for computational pathology are expected to facilitate the development of high-performing, generalisable deep learning systems. However, in addition to biologically relevant features, current foundation models also capture…

While the pretraining of Foundation Models (FMs) for remote sensing (RS) imagery is on the rise, models remain restricted to a few hundred million parameters. Scaling models to billions of parameters has been shown to yield unprecedented…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Philipe Dias , Aristeidis Tsaris , Jordan Bowman , Abhishek Potnis , Jacob Arndt , H. Lexie Yang , Dalton Lunga

Change detection, as an important and widely applied technique in the field of remote sensing, aims to analyze changes in surface areas over time and has broad applications in areas such as environmental monitoring, urban development, and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Zihan Yu , Tianxiao Li , Yuxin Zhu , Rongze Pan