中文
相关论文

相关论文: Panopticon: Advancing Any-Sensor Foundation Models…

200 篇论文

Earth observation applications increasingly rely on data from multiple sensors, including optical, radar, elevation, and land-cover. Relationships between modalities are fundamental for data integration but are inherently non-injective:…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Miguel Espinosa , Eva Gmelich Meijling , Valerio Marsocci , Elliot J. Crowley , Mikolaj Czerkawski

We aim to develop a robust yet flexible visual foundation model for Earth observation. It should possess strong capabilities in recognizing and localizing diverse visual targets while providing compatibility with various input-output…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Liang Yao , Fan Liu , Delong Chen , Chuanyi Zhang , Yijun Wang , Ziyun Chen , Wei Xu , Shimin Di , Yuhui Zheng

Driven by rapid climate change, the frequency and intensity of flood events are increasing. Electro-Optical (EO) satellite imagery is commonly utilized for rapid response. However, its utilities in flood situations are hampered by issues…

计算机视觉与模式识别 · 计算机科学 2023-07-17 Minseok Seo , Youngtack Oh , Doyi Kim , Dongmin Kang , Yeji Choi

While foundation models have shown promise across a variety of fields, astronomy still lacks a unified framework for joint modeling across its highly diverse data modalities. In this paper, we present AION-1, a family of large-scale…

Recent progress in self-supervision shows that pre-training large neural networks on vast amounts of unsupervised data can lead to impressive increases in generalisation for downstream tasks. Such models, recently coined as foundation…

Geospatial models must adapt to the diversity of Earth observation data in terms of resolutions, scales, and modalities. However, existing approaches expect fixed input configurations, which limits their practical applicability. We propose…

计算机视觉与模式识别 · 计算机科学 2025-05-12 Guillaume Astruc , Nicolas Gonthier , Clement Mallet , Loic Landrieu

Vision foundation models like DINOv2 demonstrate remarkable potential in medical imaging despite their origin in natural image domains. However, their design inherently works best for uni-modal image analysis, limiting their effectiveness…

图像与视频处理 · 电气工程与系统科学 2025-09-09 Daniel Scholz , Ayhan Can Erdur , Viktoria Ehm , Anke Meyer-Baese , Jan C. Peeken , Daniel Rueckert , Benedikt Wiestler

The demand for high-resolution subsurface imaging and continuous Earth monitoring has driven rapid growth in active and passive seismic data from dense geophone deployments, distributed acoustic sensing (DAS) arrays, and large-scale 2D and…

地球物理 · 物理学 2026-05-13 Jiahua Zhao , Umair bin Waheed , Jing Sun , Yang Cui , Nikos Savva , Eric Verschuur

Deep learning models are increasingly data-hungry, requiring significant resources to collect and compile the datasets needed to train them, with Earth Observation (EO) models being no exception. However, the landscape of datasets in EO is…

计算机视觉与模式识别 · 计算机科学 2024-06-24 Alistair Francis , Mikolaj Czerkawski

Foundation models in artificial intelligence (AI) are transforming medical imaging by enabling general-purpose feature learning from large-scale, unlabeled datasets. In this work, we introduce BrainFound, a self-supervised foundation model…

计算机视觉与模式识别 · 计算机科学 2026-01-01 Moona Mazher , Geoff J. M. Parker , Daniel C. Alexander

Recent advances in foundation models have shown great promise in domains such as natural language processing and computer vision, and similar efforts are now emerging in the Earth Observation community. These models aim to generalize across…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Pierre Adorni , Minh-Tan Pham , Stéphane May , Sébastien Lefèvre

Vision foundation models have attracted significant attention for their ability to leverage large-scale unlabeled visual data. This advantage is particularly important in remote sensing, where data acquisition is costly and annotation often…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Hyobin Park , Minseok Seo , Dong-Geol Choi

Satellite-based remote sensing has revolutionised the way we address global challenges. Huge quantities of Earth Observation (EO) data are generated by satellite sensors daily, but processing these large datasets for use in ML pipelines is…

Foundation models constitute a significant advancement in computer vision: after a single, albeit costly, training phase, they can address a wide array of tasks. In the field of Earth observation, over 75 remote sensing vision foundation…

计算机视觉与模式识别 · 计算机科学 2025-05-07 Pierre Adorni , Minh-Tan Pham , Stéphane May , Sébastien Lefèvre

Construction sites are challenging environments for autonomous systems due to their unstructured nature and the presence of dynamic actors, such as workers and machinery. This work presents a comprehensive panoptic scene understanding…

机器人学 · 计算机科学 2024-10-08 Lorenzo Terenzi , Julian Nubert , Pol Eyschen , Pascal Roth , Simin Fei , Edo Jelavic , Marco Hutter

Earth observation (EO) missions produce petabytes of multispectral imagery, increasingly analyzed using large Geospatial Foundation Models (GeoFMs). Alongside end-to-end adaptation, workflows make growing use of intermediate representations…

计算机视觉与模式识别 · 计算机科学 2026-04-09 Luis Gilch , Isabelle Wittmann , Maximilian Nitsche , Johannes Jakubik , Arne Ewald , Thomas Brunschwiler

Visual control enables quadrotors to adaptively navigate using real-time sensory data, bridging perception with action. Yet, challenges persist, including generalization across scenarios, maintaining reliability, and ensuring real-time…

机器人学 · 计算机科学 2024-04-09 Alessandro Saviolo , Pratyaksh Rao , Vivek Radhakrishnan , Jiuhong Xiao , Giuseppe Loianno

We introduce Grounded SAM, which uses Grounding DINO as an open-set object detector to combine with the segment anything model (SAM). This integration enables the detection and segmentation of any regions based on arbitrary text inputs and…

计算机视觉与模式识别 · 计算机科学 2024-01-26 Tianhe Ren , Shilong Liu , Ailing Zeng , Jing Lin , Kunchang Li , He Cao , Jiayu Chen , Xinyu Huang , Yukang Chen , Feng Yan , Zhaoyang Zeng , Hao Zhang , Feng Li , Jie Yang , Hongyang Li , Qing Jiang , Lei Zhang

Satellite missions and Earth Observation (EO) systems represent fundamental assets for environmental monitoring and the timely identification of catastrophic events, long-term monitoring of both natural resources and human-made assets, such…

计算机视觉与模式识别 · 计算机科学 2024-02-16 Luca Colomba , Paolo Garza

Earth observation (EO) systems are essential for mapping, catastrophe monitoring, and resource management, but they have trouble processing and sending large amounts of EO data efficiently, especially for specialized applications like…