English
Related papers

Related papers: Towards Efficient Benchmarking of Foundation Model…

200 papers

The ultimate goal for foundation models is realizing task-agnostic, i.e., supporting out-of-the-box usage without task-specific fine-tuning. Although breakthroughs have been made in natural language processing and image representation…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Ziyun Zeng , Yixiao Ge , Zhan Tong , Xihui Liu , Shu-Tao Xia , Ying Shan

Vision-Language Models for remote sensing have shown promising uses thanks to their extensive pretraining. However, their conventional usage in zero-shot scene classification methods still involves dividing large images into patches and…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Karim El Khoury , Maxime Zanella , Benoît Gérin , Tiffanie Godelaine , Benoît Macq , Saïd Mahmoudi , Christophe De Vleeschouwer , Ismail Ben Ayed

Foundation models, often pre-trained with large-scale data, have achieved paramount success in jump-starting various vision and language applications. Recent advances further enable adapting foundation models in downstream tasks efficiently…

Computer Vision and Pattern Recognition · Computer Science 2023-06-19 Dequan Wang , Xiaosong Wang , Lilong Wang , Mengzhang Li , Qian Da , Xiaoqiang Liu , Xiangyu Gao , Jun Shen , Junjun He , Tian Shen , Qi Duan , Jie Zhao , Kang Li , Yu Qiao , Shaoting Zhang

Advanced interpretation of hyperspectral remote sensing images benefits many precise Earth observation tasks. Recently, visual foundation models have promoted the remote sensing interpretation but concentrating on RGB and multispectral…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Jingtao Li , Yingyi Liu , Xinyu Wang , Yunning Peng , Chen Sun , Shaoyu Wang , Zhendong Sun , Tian Ke , Xiao Jiang , Tangwei Lu , Anran Zhao , Yanfei Zhong

Time series data are ubiquitous across diverse real-world applications, making time series analysis critically important. Traditional approaches are largely task-specific, offering limited functionality and poor transferability. In recent…

Machine Learning · Computer Science 2025-09-18 Jiexia Ye , Yongzi Yu , Weiqi Zhang , Le Wang , Jia Li , Fugee Tsung

Recent vision foundation models can extract universal representations and show impressive abilities in various tasks. However, their application on object detection is largely overlooked, especially without fine-tuning them. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Shenghao Fu , Junkai Yan , Qize Yang , Xihan Wei , Xiaohua Xie , Wei-Shi Zheng

Accurate localisation in planetary robotics enables the advanced autonomy required to support the increased scale and scope of future missions. The successes of the Ingenuity helicopter and multiple planetary orbiters lay the groundwork for…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Lachlan Holden , Feras Dayoub , Alberto Candela , David Harvey , Tat-Jun Chin

We propose a task-agnostic framework for multimodal fusion of time series and single timestamp images, enabling cross-modal generation and robust downstream performance. Our approach explores deterministic and learned strategies for time…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Gianfranco Basile , Johannes Jakubik , Benedikt Blumenstiel , Thomas Brunschwiler , Juan Bernabe Moreno

Recent advances in large-scale pretraining have yielded visual foundation models with strong capabilities. Not only can recent models generalize to arbitrary images for their training task, their intermediate representations are useful for…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Mohamed El Banani , Amit Raj , Kevis-Kokitsi Maninis , Abhishek Kar , Yuanzhen Li , Michael Rubinstein , Deqing Sun , Leonidas Guibas , Justin Johnson , Varun Jampani

Mass spectrometry is the dominant technology in the field of proteomics, enabling high-throughput analysis of the protein content of complex biological samples. Due to the complexity of the instrumentation and resulting data, sophisticated…

Adaptive sparse coding methods learn a possibly overcomplete set of basis functions, such that natural image patches can be reconstructed by linearly combining a small subset of these bases. The applicability of these methods to visual…

Computer Vision and Pattern Recognition · Computer Science 2010-10-19 Koray Kavukcuoglu , Marc'Aurelio Ranzato , Yann LeCun

Spectral imaging data acquired via multispectral and hyperspectral cameras can have hundreds of channels, where each channel records the reflectance at a specific wavelength and bandwidth. Time and resource constraints limit our ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 William Michael Laprade , Jesper Cairo Westergaard , Svend Christensen , Mads Nielsen , Anders Bjorholm Dahl

Due to the increasing workload of pathologists, the need for automation to support diagnostic tasks and quantitative biomarker evaluation is becoming more and more apparent. Foundation models have the potential to improve generalizability…

Image and Video Processing · Electrical Eng. & Systems 2025-01-13 Till Nicke , Jan Raphael Schaefer , Henning Hoefener , Friedrich Feuerhake , Dorit Merhof , Fabian Kiessling , Johannes Lotz

Multimodal foundation models offer promising advancements for enhancing driving perception systems, but their high computational and financial costs pose challenges. We develop a method that leverages foundation models to refine predictions…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Yunhao Yang , Yuxin Hu , Mao Ye , Zaiwei Zhang , Zhichao Lu , Yi Xu , Ufuk Topcu , Ben Snyder

Prior studies on Remote Sensing Foundation Model (RSFM) reveal immense potential towards a generic model for Earth Observation. Nevertheless, these works primarily focus on a single modality without temporal and geo-context modeling,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Xin Guo , Jiangwei Lao , Bo Dang , Yingying Zhang , Lei Yu , Lixiang Ru , Liheng Zhong , Ziyuan Huang , Kang Wu , Dingxiang Hu , Huimei He , Jian Wang , Jingdong Chen , Ming Yang , Yongjun Zhang , Yansheng Li

Remote sensing imagery has attracted significant attention in recent years due to its instrumental role in global environmental monitoring, land usage monitoring, and more. As image databases grow each year, performing automatic…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jielu Zhang , Zhongliang Zhou , Gengchen Mai , Mengxuan Hu , Zihan Guan , Sheng Li , Lan Mu

Foundation models learn highly transferable representations through large-scale pretraining on diverse data. An increasing body of research indicates that these representations exhibit a remarkable degree of similarity across architectures…

Artificial Intelligence · Computer Science 2025-10-08 Jianglin Lu , Hailing Wang , Yi Xu , Yizhou Wang , Kuo Yang , Yun Fu

Multimodal foundation models offer a promising framework for robotic perception and planning by processing sensory inputs to generate actionable plans. However, addressing uncertainty in both perception (sensory interpretation) and…

Robotics · Computer Science 2025-04-18 Neel P. Bhatt , Yunhao Yang , Rohan Siva , Daniel Milan , Ufuk Topcu , Zhangyang Wang

Vision systems to see and reason about the compositional nature of visual scenes are fundamental to understanding our world. The complex relations between objects and their locations, ambiguities, and variations in the real-world…

Computer Vision and Pattern Recognition · Computer Science 2023-07-27 Muhammad Awais , Muzammal Naseer , Salman Khan , Rao Muhammad Anwer , Hisham Cholakkal , Mubarak Shah , Ming-Hsuan Yang , Fahad Shahbaz Khan

The study of security in machine learning mainly focuses on downstream task-specific attacks, where the adversarial example is obtained by optimizing a loss function specific to the downstream task. At the same time, it has become standard…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Brian Pulfer , Yury Belousov , Vitaliy Kinakh , Teddy Furon , Slava Voloshynovskiy