English
Related papers

Related papers: SSL4EO-S12 v1.1: A Multimodal, Multiseasonal Datas…

200 papers

We introduce EarthPT -- an Earth Observation (EO) pretrained transformer. EarthPT is a 700 million parameter decoding transformer foundation model trained in an autoregressive self-supervised manner and developed specifically with EO…

Machine Learning · Computer Science 2024-01-12 Michael J. Smith , Luke Fleming , James E. Geach

In the field of Earth Observation (EO), Continual Learning (CL) algorithms have been proposed to deal with large datasets by decomposing them into several subsets and processing them incrementally. The majority of these algorithms assume…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Valerio Marsocci , Simone Scardapane

The burgeoning demand for collaborative robotic systems to execute complex tasks collectively has intensified the research community's focus on advancing simultaneous localization and mapping (SLAM) in a cooperative context. Despite this…

Robotics · Computer Science 2024-11-05 Dapeng Feng , Yuhua Qi , Shipeng Zhong , Zhiqiang Chen , Qiming Chen , Hongbo Chen , Jin Wu , Jun Ma

In recent years, a plethora of open-source foundation models have emerged, achieving remarkable progress in some widely attended fields, with performance being quite close to that of closed-source models. However, in high-value but more…

Machine Learning · Computer Science 2025-08-26 Lei Bai , Zhongrui Cai , Yuhang Cao , Maosong Cao , Weihan Cao , Chiyu Chen , Haojiong Chen , Kai Chen , Pengcheng Chen , Ying Chen , Yongkang Chen , Yu Cheng , Pei Chu , Tao Chu , Erfei Cui , Ganqu Cui , Long Cui , Ziyun Cui , Nianchen Deng , Ning Ding , Nanqing Dong , Peijie Dong , Shihan Dou , Sinan Du , Haodong Duan , Caihua Fan , Ben Gao , Changjiang Gao , Jianfei Gao , Songyang Gao , Yang Gao , Zhangwei Gao , Jiaye Ge , Qiming Ge , Lixin Gu , Yuzhe Gu , Aijia Guo , Qipeng Guo , Xu Guo , Conghui He , Junjun He , Yili Hong , Siyuan Hou , Caiyu Hu , Hanglei Hu , Jucheng Hu , Ming Hu , Zhouqi Hua , Haian Huang , Junhao Huang , Xu Huang , Zixian Huang , Zhe Jiang , Lingkai Kong , Linyang Li , Peiji Li , Pengze Li , Shuaibin Li , Tianbin Li , Wei Li , Yuqiang Li , Dahua Lin , Junyao Lin , Tianyi Lin , Zhishan Lin , Hongwei Liu , Jiangning Liu , Jiyao Liu , Junnan Liu , Kai Liu , Kaiwen Liu , Kuikun Liu , Shichun Liu , Shudong Liu , Wei Liu , Xinyao Liu , Yuhong Liu , Zhan Liu , Yinquan Lu , Haijun Lv , Hongxia Lv , Huijie Lv , Qitan Lv , Ying Lv , Chengqi Lyu , Chenglong Ma , Jianpeng Ma , Ren Ma , Runmin Ma , Runyuan Ma , Xinzhu Ma , Yichuan Ma , Zihan Ma , Sixuan Mi , Junzhi Ning , Wenchang Ning , Xinle Pang , Jiahui Peng , Runyu Peng , Yu Qiao , Jiantao Qiu , Xiaoye Qu , Yuan Qu , Yuchen Ren , Fukai Shang , Wenqi Shao , Junhao Shen , Shuaike Shen , Chunfeng Song , Demin Song , Diping Song , Chenlin Su , Weijie Su , Weigao Sun , Yu Sun , Qian Tan , Cheng Tang , Huanze Tang , Kexian Tang , Shixiang Tang , Jian Tong , Aoran Wang , Bin Wang , Dong Wang , Lintao Wang , Rui Wang , Weiyun Wang , Wenhai Wang , Jiaqi Wang , Yi Wang , Ziyi Wang , Ling-I Wu , Wen Wu , Yue Wu , Zijian Wu , Linchen Xiao , Shuhao Xing , Chao Xu , Huihui Xu , Jun Xu , Ruiliang Xu , Wanghan Xu , GanLin Yang , Yuming Yang , Haochen Ye , Jin Ye , Shenglong Ye , Jia Yu , Jiashuo Yu , Jing Yu , Fei Yuan , Yuhang Zang , Bo Zhang , Chao Zhang , Chen Zhang , Hongjie Zhang , Jin Zhang , Qiaosheng Zhang , Qiuyinzhe Zhang , Songyang Zhang , Taolin Zhang , Wenlong Zhang , Wenwei Zhang , Yechen Zhang , Ziyang Zhang , Haiteng Zhao , Qian Zhao , Xiangyu Zhao , Xiangyu Zhao , Bowen Zhou , Dongzhan Zhou , Peiheng Zhou , Yuhao Zhou , Yunhua Zhou , Dongsheng Zhu , Lin Zhu , Yicheng Zou

This study explores the application of self-supervised learning (SSL) to the task of motion forecasting, an area that has not yet been extensively investigated despite the widespread success of SSL in computer vision and natural language…

Robotics · Computer Science 2023-08-22 Jie Cheng , Xiaodong Mei , Ming Liu

Satellite-based remote sensing is instrumental in the monitoring and mitigation of the effects of anthropogenic climate change. Large scale, high resolution data derived from these sensors can be used to inform intervention and policy…

Computer Vision and Pattern Recognition · Computer Science 2024-10-01 Matt Allen , Francisco Dorr , Joseph A. Gallego-Mejia , Laura Martínez-Ferrer , Anna Jungbluth , Freddie Kalaitzis , Raúl Ramos-Pollán

Traditional spatiotemporal models generally rely on task-specific architectures, which limit their generalizability and scalability across diverse tasks due to domain-specific design requirements. In this paper, we introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-03-27 Chen Tang , Xinzhu Ma , Encheng Su , Xiufeng Song , Xiaohong Liu , Wei-Hong Li , Lei Bai , Wanli Ouyang , Xiangyu Yue

Vast amounts of remote sensing (RS) data provide Earth observations across multiple dimensions, encompassing critical spatial, temporal, and spectral information which is essential for addressing global-scale challenges such as land use…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Lixian Zhang , Yi Zhao , Runmin Dong , Jinxiao Zhang , Shuai Yuan , Shilei Cao , Mengxuan Chen , Juepeng Zheng , Weijia Li , Wei Liu , Wayne Zhang , Litong Feng , Haohuan Fu

In the realm of large multi-modal models (LMMs), efficient modality alignment is crucial yet often constrained by the scarcity of high-quality image-text data. To address this bottleneck, we introduce the ShareGPT4V dataset, a pioneering…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Lin Chen , Jinsong Li , Xiaoyi Dong , Pan Zhang , Conghui He , Jiaqi Wang , Feng Zhao , Dahua Lin

Self-supervised learning holds great promise for remote sensing, but standard self-supervised methods must be adapted to the unique characteristics of Earth observation data. We take a step in this direction by conducting a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Antoine Labatie , Michael Vaccaro , Nina Lardiere , Anatol Garioud , Nicolas Gonthier

Large, pretrained models are commonly finetuned with imagery that is heavily augmented to mimic different conditions and scales, with the resulting models used for various tasks with imagery from a range of spatial scales. Such models…

Computer Vision and Pattern Recognition · Computer Science 2023-09-25 Colorado J. Reed , Ritwik Gupta , Shufan Li , Sarah Brockman , Christopher Funk , Brian Clipp , Kurt Keutzer , Salvatore Candido , Matt Uyttendaele , Trevor Darrell

As a core task in location-based services (LBS) (e.g., navigation maps), query and point of interest (POI) matching connects users' intent with real-world geographic information. Recently, pre-trained models (PTMs) have made advancements in…

Computation and Language · Computer Science 2023-05-25 Ruixue Ding , Boli Chen , Pengjun Xie , Fei Huang , Xin Li , Qiang Zhang , Yao Xu

Geospatial models must adapt to the diversity of Earth observation data in terms of resolutions, scales, and modalities. However, existing approaches expect fixed input configurations, which limits their practical applicability. We propose…

Computer Vision and Pattern Recognition · Computer Science 2025-05-12 Guillaume Astruc , Nicolas Gonthier , Clement Mallet , Loic Landrieu

The Great Outdoors (GO) dataset is a multi-modal annotated data resource aimed at advancing ground robotics research in unstructured environments. This dataset provides the most comprehensive set of data modalities and annotations compared…

Regularly updated and accurate land cover maps are essential for monitoring 14 of the 17 Sustainable Development Goals. Multispectral satellite imagery provide high-quality and valuable information at global scale that can be used to…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Hamed Alemohammad , Kevin Booth

With the emergence of deep learning in the last years, new opportunities arose in Earth observation research. Nevertheless, they also brought with them new challenges. The data-hungry training processes of deep learning models demand large,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-21 Thorsten Hoeser , Claudia Kuenzer

We propose Strongly Supervised pre-training with ScreenShots (S4) - a novel pre-training paradigm for Vision-Language Models using data from large-scale web screenshot rendering. Using web screenshots unlocks a treasure trove of visual and…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yuan Gao , Kunyu Shi , Pengkai Zhu , Edouard Belval , Oren Nuriel , Srikar Appalaraju , Shabnam Ghadar , Vijay Mahadevan , Zhuowen Tu , Stefano Soatto

European satellite missions Sentinel-1 (S1) and Sentinel-2 (S2) provide at highspatial resolution and high revisit time, respectively, radar and optical imagesthat support a wide range of Earth surface monitoring tasks such as LandUse/Land…

Spatio-Temporal (ST) data science, which includes sensing, managing, and mining large-scale data across space and time, is fundamental to understanding complex systems in domains such as urban computing, climate science, and intelligent…

Databases · Computer Science 2025-03-19 Yuxuan Liang , Haomin Wen , Yutong Xia , Ming Jin , Bin Yang , Flora Salim , Qingsong Wen , Shirui Pan , Gao Cong

With advancements in GPS, remote sensing, and computational simulation, an enormous volume of spatiotemporal data is being collected at an increasing speed from various application domains, spanning Earth sciences, agriculture, smart…

Machine Learning · Computer Science 2023-11-01 Zhe Jiang