English
Related papers

Related papers: Vision Foundation Models in Remote Sensing: A Surv…

200 papers

Artificial intelligence (AI) has significantly advanced Earth sciences, yet its full potential in to comprehensively modeling Earth's complex dynamics remains unrealized. Geoscience foundation models (GFMs) emerge as a paradigm-shifting…

Artificial Intelligence · Computer Science 2024-11-13 Hao Zhang , Jin-Jian Xu , Hong-Wei Cui , Lin Li , Yaowen Yang , Chao-Sheng Tang , Niklas Boers

Depth estimation is a fundamental task in 3D computer vision, crucial for applications such as 3D reconstruction, free-viewpoint rendering, robotics, autonomous driving, and AR/VR technologies. Traditional methods relying on hardware…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Zhen Xu , Hongyu Zhou , Sida Peng , Haotong Lin , Haoyu Guo , Jiahao Shao , Peishan Yang , Qinglin Yang , Sheng Miao , Xingyi He , Yifan Wang , Yue Wang , Ruizhen Hu , Yiyi Liao , Xiaowei Zhou , Hujun Bao

Foundation models are rapidly transforming Earth Observation data mining by enabling generalizable and scalable solutions for key tasks such as scene classification and semantic segmentation. While most efforts in the geospatial domain have…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Man Duc Chuc

Foundation models, as a mainstream technology in artificial intelligence, have demonstrated immense potential across various domains in recent years, particularly in handling complex tasks and multimodal data. In the field of geophysics,…

Geophysics · Physics 2025-04-28 Hanlin Sheng , Xinming Wu , Hang Gao , Haibin Di , Sergey Fomel , Jintao Li , Xu Si

Artificial intelligence (AI) is evolving towards artificial general intelligence, which refers to the ability of an AI system to perform a wide range of tasks and exhibit a level of intelligence similar to that of a human being. This is in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-22 Chunhui Zhang , Li Liu , Yawen Cui , Guanjie Huang , Weilin Lin , Yiqian Yang , Yuehong Hu

Foundation models have the potential to transform the landscape of remote sensing (RS) data analysis by enabling large computer vision models to be pre-trained on vast amounts of remote sensing data. These models can then be fine-tuned with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Caleb S. Spradlin , Jordan A. Caraballo-Vega , Jian Li , Mark L. Carroll , Jie Gong , Paul M. Montesano

Significant progress in the development of highly adaptable and reusable Artificial Intelligence (AI) models is expected to have a significant impact on Earth science and remote sensing. Foundation models are pre-trained on large unlabeled…

Recent progress in self-supervision shows that pre-training large neural networks on vast amounts of unsupervised data can lead to impressive increases in generalisation for downstream tasks. Such models, recently coined as foundation…

In recent years we have seen substantial advances in foundation models for artificial intelligence, including language, vision, and multimodal models. Recent studies have highlighted the potential of using foundation models in geospatial…

Artificial Intelligence · Computer Science 2023-10-13 Jinmeng Rao , Song Gao , Gengchen Mai , Krzysztof Janowicz

Recent progress in self-supervision has shown that pre-training large neural networks on vast amounts of unsupervised data can lead to substantial increases in generalization to downstream tasks. Such models, recently coined foundation…

Foundation models have reshaped the landscape of Remote Sensing (RS) by enhancing various image interpretation tasks. Pretraining is an active research topic, encompassing supervised and self-supervised learning methods to initialize model…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Di Wang , Jing Zhang , Minqiang Xu , Lin Liu , Dongsheng Wang , Erzhong Gao , Chengxi Han , Haonan Guo , Bo Du , Dacheng Tao , Liangpei Zhang

AI is undergoing a paradigm shift with the rise of models (e.g., BERT, DALL-E, GPT-3) that are trained on broad data at scale and are adaptable to a wide range of downstream tasks. We call these models foundation models to underscore their…

Machine Learning · Computer Science 2022-07-14 Rishi Bommasani , Drew A. Hudson , Ehsan Adeli , Russ Altman , Simran Arora , Sydney von Arx , Michael S. Bernstein , Jeannette Bohg , Antoine Bosselut , Emma Brunskill , Erik Brynjolfsson , Shyamal Buch , Dallas Card , Rodrigo Castellon , Niladri Chatterji , Annie Chen , Kathleen Creel , Jared Quincy Davis , Dora Demszky , Chris Donahue , Moussa Doumbouya , Esin Durmus , Stefano Ermon , John Etchemendy , Kawin Ethayarajh , Li Fei-Fei , Chelsea Finn , Trevor Gale , Lauren Gillespie , Karan Goel , Noah Goodman , Shelby Grossman , Neel Guha , Tatsunori Hashimoto , Peter Henderson , John Hewitt , Daniel E. Ho , Jenny Hong , Kyle Hsu , Jing Huang , Thomas Icard , Saahil Jain , Dan Jurafsky , Pratyusha Kalluri , Siddharth Karamcheti , Geoff Keeling , Fereshte Khani , Omar Khattab , Pang Wei Koh , Mark Krass , Ranjay Krishna , Rohith Kuditipudi , Ananya Kumar , Faisal Ladhak , Mina Lee , Tony Lee , Jure Leskovec , Isabelle Levent , Xiang Lisa Li , Xuechen Li , Tengyu Ma , Ali Malik , Christopher D. Manning , Suvir Mirchandani , Eric Mitchell , Zanele Munyikwa , Suraj Nair , Avanika Narayan , Deepak Narayanan , Ben Newman , Allen Nie , Juan Carlos Niebles , Hamed Nilforoshan , Julian Nyarko , Giray Ogut , Laurel Orr , Isabel Papadimitriou , Joon Sung Park , Chris Piech , Eva Portelance , Christopher Potts , Aditi Raghunathan , Rob Reich , Hongyu Ren , Frieda Rong , Yusuf Roohani , Camilo Ruiz , Jack Ryan , Christopher Ré , Dorsa Sadigh , Shiori Sagawa , Keshav Santhanam , Andy Shih , Krishnan Srinivasan , Alex Tamkin , Rohan Taori , Armin W. Thomas , Florian Tramèr , Rose E. Wang , William Wang , Bohan Wu , Jiajun Wu , Yuhuai Wu , Sang Michael Xie , Michihiro Yasunaga , Jiaxuan You , Matei Zaharia , Michael Zhang , Tianyi Zhang , Xikun Zhang , Yuhui Zhang , Lucia Zheng , Kaitlyn Zhou , Percy Liang

Rapid advancements in foundation models, including Large Language Models, Vision-Language Models, Multimodal Large Language Models, and Vision-Language-Action Models, have opened new avenues for embodied AI in mobile service robotics. By…

Robotics · Computer Science 2026-03-11 Matthew Lisondra , Beno Benhabib , Goldie Nejat

The advent of foundation models (FMs) as an emerging suite of AI techniques has struck a wave of opportunities in computational healthcare. The interactive nature of these models, guided by pre-training data and human instructions, has…

Machine Learning · Computer Science 2026-04-30 Yunkun Zhang , Jin Gao , Zheling Tan , Lingfeng Zhou , Kexin Ding , Mu Zhou , Shaoting Zhang , Dequan Wang

Food security, a global concern, necessitates precise and diverse data-driven solutions to address its multifaceted challenges. This paper explores the integration of AI foundation models across various food security applications,…

Artificial Intelligence · Computer Science 2023-11-01 Mohamed R. Shoaib , Heba M. Emara , Jun Zhao

Foundation models (FMs) are catalyzing a transformative shift in materials science (MatSci) by enabling scalable, general-purpose, and multimodal AI systems for scientific discovery. Unlike traditional machine learning models, which are…

Machine Learning · Computer Science 2025-06-27 Minh-Hao Van , Prateek Verma , Chen Zhao , Xintao Wu

As artificial intelligence systems become increasingly integrated into daily life, the field of explainability has gained significant attention. This trend is particularly driven by the complexity of modern AI models and their…

Computer Vision and Pattern Recognition · Computer Science 2025-01-22 Rémi Kazmierczak , Eloïse Berthier , Goran Frehse , Gianni Franchi

AI and its relevant technologies, including machine learning, deep learning, chatbots, virtual assistants, and others, are currently undergoing a profound transformation of development and organizational processes within companies.…

Cryptography and Security · Computer Science 2024-12-11 Tingting Bi , Guangsheng Yu , Qin Wang

Following its success for vision and text, the "foundation model" (FM) paradigm -- pretraining large models on massive data, then fine-tuning on target tasks -- has rapidly expanded to domains in the sciences, engineering, healthcare, and…

Machine Learning · Computer Science 2025-03-24 Zongzhe Xu , Ritvik Gupta , Wenduo Cheng , Alexander Shen , Junhong Shen , Ameet Talwalkar , Mikhail Khodak

Artificial Intelligence (AI) has demonstrated unprecedented performance across various domains, and its application to communication systems is an active area of research. While current methods focus on task-specific solutions, the broader…

Artificial Intelligence · Computer Science 2025-05-21 Davide Buffelli , Sowmen Das , Yu-Wei Lin , Sattar Vakili , Chien-Yi Wang , Masoud Attarifar , Pritthijit Nath , Da-shan Shiu