English
Related papers

Related papers: MMEarth-Bench: Global Model Adaptation via Multimo…

200 papers

Geometric machine learning models such as graph neural networks have achieved remarkable success in recent years in chemical and materials science research for applications such as high-throughput virtual screening and atomistic…

Materials Science · Physics 2025-04-16 Lingyu Kong , Nima Shoghi , Guoxiang Hu , Pan Li , Victor Fung

Tool learning has generated widespread interest as a vital means of interaction between Large Language Models (LLMs) and the physical world. Current research predominantly emphasizes LLMs' capacity to utilize tools in well-structured…

Computation and Language · Computer Science 2024-09-24 Junjie Ye , Yilong Wu , Songyang Gao , Caishuang Huang , Sixian Li , Guanyu Li , Xiaoran Fan , Qi Zhang , Tao Gui , Xuanjing Huang

Foundation models have reshaped the landscape of Remote Sensing (RS) by enhancing various image interpretation tasks. Pretraining is an active research topic, encompassing supervised and self-supervised learning methods to initialize model…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Di Wang , Jing Zhang , Minqiang Xu , Lin Liu , Dongsheng Wang , Erzhong Gao , Chengxi Han , Haonan Guo , Bo Du , Dacheng Tao , Liangpei Zhang

World models are central to building AI agents capable of flexible reasoning and planning. Yet current evaluations (i) test only properties measurable from observed interactions, such as next-frame prediction or task return, and (ii) do not…

Future projection of climate is typically obtained by combining outputs from multiple Earth System Models (ESMs) for several climate variables such as temperature and precipitation. While IPCC has traditionally used a simple model output…

Machine Learning · Computer Science 2017-02-01 André R. Gonçalves , Arindam Banerjee , Fernando J. Von Zuben

Predicting commuting flows based on infrastructure and land-use information is critical for urban planning and public policy development. However, it is a challenging task given the complex patterns of commuting flows. Conventional models,…

Physics and Society · Physics 2020-08-25 Zhicheng Liu , Fabio Miranda , Weiting Xiong , Junyan Yang , Qiao Wang , Claudio T. Silva

Despite the growing popularity of Multimodal Domain Generalization (MMDG) for enhancing model robustness, it remains unclear whether reported performance gains reflect genuine algorithmic progress or are artifacts of inconsistent evaluation…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Hao Dong , Hongzhao Li , Shupan Li , Muhammad Haris Khan , Eleni Chatzi , Olga Fink

Selecting an appropriate pre-trained source model is a critical, yet computationally expensive, task in transfer learning. Model Transferability Estimation (MTE) methods address this by providing efficient proxy metrics to rank models…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Yuhang Liu , Wenjie Zhao , Yunhui Guo

Learning multimodal representations involves integrating information from multiple heterogeneous sources of data. It is a challenging yet crucial area with numerous real-world applications in multimedia, affective computing, robotics,…

With the urgent demand for generalized deep models, many pre-trained big models are proposed, such as BERT, ViT, GPT, etc. Inspired by the success of these models in single domains (like computer vision and natural language processing), the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Xiao Wang , Guangyao Chen , Guangwu Qian , Pengcheng Gao , Xiao-Yong Wei , Yaowei Wang , Yonghong Tian , Wen Gao

Climate science studies the structure and dynamics of Earth's climate system and seeks to understand how climate changes over time, where the data is usually stored in the format of time series, recording the climate features, geolocation,…

We present MEGA-Bench, an evaluation suite that scales multimodal evaluation to over 500 real-world tasks, to address the highly heterogeneous daily use cases of end users. Our objective is to optimize for a set of high-quality data samples…

Computer Vision and Pattern Recognition · Computer Science 2025-07-15 Jiacheng Chen , Tianhao Liang , Sherman Siu , Zhengqing Wang , Kai Wang , Yubo Wang , Yuansheng Ni , Wang Zhu , Ziyan Jiang , Bohan Lyu , Dongfu Jiang , Xuan He , Yuan Liu , Hexiang Hu , Xiang Yue , Wenhu Chen

Geospatial Foundation Models (GeoFMs) are transforming Earth Observation (EO), but evaluation lacks standardized protocols. GEO-Bench-2 addresses this with a comprehensive framework spanning classification, segmentation, regression, object…

There exists a correlation between geospatial activity temporal patterns and type of land use. A novel self-supervised approach is proposed to stratify landscape based on mobility activity time series. First, the time series signal is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-18 Yi Cao , Swetava Ganguli , Vipul Pandey

We introduce MMTR-Bench, a benchmark designed to evaluate the intrinsic ability of Multimodal Large Language Models (MLLMs) to reconstruct masked text directly from visual context. Unlike conventional question-answering tasks, MMTR-Bench…

Artificial Intelligence · Computer Science 2026-04-28 Jindi Guo , Chaozheng Huang , Xi Fang

Understanding the relationship between textual news and time-series evolution is a critical yet under-explored challenge in applied data science. While multimodal learning has gained traction, existing multimodal time-series datasets fall…

Computation and Language · Computer Science 2026-02-12 Jialin Chen , Aosong Feng , Ziyu Zhao , Juan Garza , Gaukhar Nurbek , Cheng Qin , Ali Maatouk , Leandros Tassiulas , Yifeng Gao , Rex Ying

In real-world scenarios, it may not always be possible to collect hundreds of labeled samples per class for training deep learning-based SAR Automatic Target Recognition (ATR) models. This work specifically tackles the few-shot SAR ATR…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Nathan Inkawhich

Spatio-temporal trajectories provide valuable information about movement and travel behavior, enabling various downstream tasks that in turn power real-world applications. Learning trajectory embeddings can improve task performance but may…

Computer Vision and Pattern Recognition · Computer Science 2023-12-27 Yan Lin , Huaiyu Wan , Shengnan Guo , Jilin Hu , Christian S. Jensen , Youfang Lin

Large-scale pre-trained Vision-Language Models (VLMs) have significantly advanced transfer learning across diverse tasks. However, adapting these models with limited few-shot data often leads to overfitting, undermining their ability to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-16 Yuncheng Guo , Xiaodong Gu

Recent advances in multimodal large language models (MLLMs) have accelerated progress in domain-oriented AI, yet their development in geoscience and remote sensing (RS) remains constrained by distinctive challenges: wide-ranging…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Aoran Xiao , Shihao Cheng , Yonghao Xu , Yexian Ren , Hongruixuan Chen , Naoto Yokoya