English
Related papers

Related papers: AION-1: Omnimodal Foundation Model for Astronomica…

200 papers

Deep learning methods have significantly advanced the development of intelligent rinterpretation in remote sensing (RS), with foundational model research based on large-scale pre-training paradigms rapidly reshaping various domains of Earth…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Zhiwei Yi , Xin Cheng , Jingyu Ma , Ruifei Zhu , Junwei Tian , Yuanxiu Zhou , Xinge Zhao , Hongzhe Li

Type Ia supernovae (SNe Ia) were instrumental in establishing the acceleration of the universe's expansion. By virtue of their combination of distance reach, precision, and prevalence, they continue to provide key cosmological constraints,…

There is a global aging population requiring the need for the right tools that can enable older adults' greater independence and the ability to age at home, as well as assist healthcare workers. It is feasible to achieve this objective by…

Machine Learning · Computer Science 2022-11-08 Ali Abedi , Faranak Dayyani , Charlene Chu , Shehroz S. Khan

Ocean modeling is a powerful tool for simulating the physical, chemical, and biological processes of the ocean, which is the foundation for marine science research and operational oceanography. Modern numerical ocean modeling mainly…

Atmospheric and Oceanic Physics · Physics 2023-08-11 Wei Xiong , Yanfei Xiang , Hao Wu , Shuyi Zhou , Yuze Sun , Muyuan Ma , Xiaomeng Huang

We present a multi-modal classification framework that fuses satellite and street-level imagery through a Perceiver IO architecture operating on spatial patch tokens from a shared DINOv2 backbone. The design naturally handles a variable…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Niels Sombekke , Rob G. J. Wijnhoven , Martin R. Oswald

This work introduces ILIAS, a new test dataset for Instance-Level Image retrieval At Scale. It is designed to evaluate the ability of current and future foundation models and retrieval techniques to recognize particular objects. The key…

The low-frequency sky below $\sim$15 MHz (20 m) is obscured by the Earth's ionosphere, the layer of charged particles above the neutral atmosphere. Single spacecraft have made measurements in this band, but cannot achieve high or even…

Instrumentation and Methods for Astrophysics · Physics 2024-04-15 Mary Knapp , Lenny Paritsky , Ekaterina Kononov , Melodie M. Kao

As a fundamental vision task, stereo matching has made remarkable progress. While recent iterative optimization-based methods have achieved promising performance, their feature extraction capabilities still have room for improvement.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Jingyi Zhou , Haoyu Zhang , Jiakang Yuan , Peng Ye , Tao Chen , Hao Jiang , Meiya Chen , Yangyang Zhang

Measurement of the global 21-cm signal during Cosmic Dawn (CD) and the Epoch of Reionization (EoR) is made difficult by bright foreground emission which is 2-5 orders of magnitude larger than the expected signal. Fitting for a…

Cosmology and Nongalactic Astrophysics · Physics 2024-02-20 Michael Pagano , Peter Sims , Adrian Liu , Dominic Anstey , Will Handley , Eloy De Lera Acedo

Inertial odometry (IO) directly estimates the position of a carrier from inertial sensor measurements and serves as a core technology for the widespread deployment of consumer grade localization systems. While existing IO methods can…

Adapting vision-language models to remote sensing imagery remains challenging due to two key factors: limited semantic coverage in textual representations and insufficient adaptability of visual features. These issues are particularly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Yu Hu , Jianyang Gu , Hao Liu , Yue Cao , Jozsef Hamari , Zheng Liu , Mohsen Zardadi

Ultrasound images vary widely across scanners, operators, and anatomical targets, which often causes models trained in one setting to generalize poorly to new hospitals and clinical conditions. The Foundation Model Challenge for Ultrasound…

Computer Vision and Pattern Recognition · Computer Science 2026-03-23 Ufaq Khan , L. D. M. S. Sai Teja , Ayuba Shakiru , Mai A. Shaaban , Yutong Xie , Muhammad Bilal , Muhammad Haris Khan

We present the MULTIMODAL UNIVERSE, a large-scale multimodal dataset of scientific astronomical data, compiled specifically to facilitate machine learning research. Overall, the MULTIMODAL UNIVERSE contains hundreds of millions of…

In astronomy, we are witnessing an enormous increase in the number of source detections, precision, and diversity of measurements. Additionally, multi-epoch data is becoming the norm, making time-series analyses an important aspect of…

Instrumentation and Methods for Astrophysics · Physics 2019-11-22 Laurent Eyer , Maria Süveges , Joris De Ridder , Sara Regibo , Nami Mowlavi , Berry Holl , Lorenzo Rimoldini , Francois Bouchy

Context. The [CII] 158micron far-infrared fine-structure line is one of the dominant cooling lines of the star-forming interstellar medium (ISM). Hence [CII] emission originates in and thus can be used to trace a range of ISM processes.…

Recent advances in geometric foundation models have emerged as a promising alternative for addressing the challenge of dense reconstruction in monocular visual simultaneous localization and mapping (SLAM). Although geometric foundation…

Robotics · Computer Science 2026-03-31 Jinwoo Jeon , Dong-Uk Seo , Eungchang Mason Lee , Hyun Myung

Accurate motion tracking of snow particles in avalanche events requires robust localization in global navigation satellite system (GNSS)-denied outdoor environments. This paper introduces AoI-FusionNet, a tightly coupled deep learning-based…

Signal Processing · Electrical Eng. & Systems 2026-03-16 Tehmina Bibi , Anselm Köhler , Jan-Thomas Fischer , Falko Dressler

Audio-Visual Intelligence (AVI) has emerged as a central frontier in artificial intelligence, bridging auditory and visual modalities to enable machines that can perceive, generate, and interact in the multimodal real world. In the era of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-06 You Qin , Kai Liu , Shengqiong Wu , Kai Wang , Shijian Deng , Yapeng Tian , Junbin Xiao , Yazhou Xing , Yinghao Ma , Bobo Li , Roger Zimmermann , Lei Cui , Furu Wei , Jiebo Luo , Hao Fei

Gaia mission will offer an exceptional opportunity to perform variability studies. The data homogeneity, its optimised photometric systems, composed of 11 medium and 4-5 broad bands, the high photometric precision in G band of one milli-mag…

Astrophysics · Physics 2007-05-23 Laurent Eyer

We introduce MOMO, the first multi-sensor foundation model for Mars remote sensing. MOMO uses model merge to integrate representations learned independently from three key Martian sensors (HiRISE, CTX, and THEMIS), spanning resolutions from…

Computer Vision and Pattern Recognition · Computer Science 2026-04-06 Mirali Purohit , Bimal Gajera , Irish Mehta , Bhanu Tokas , Jacob Adler , Steven Lu , Scott Dickenshied , Serina Diniega , Brian Bue , Umaa Rebbapragada , Hannah Kerner