AION-1: Omnimodal Foundation Model for Astronomical Sciences
Abstract
While foundation models have shown promise across a variety of fields, astronomy still lacks a unified framework for joint modeling across its highly diverse data modalities. In this paper, we present AION-1, a family of large-scale multimodal foundation models for astronomy. AION-1 integrates heterogeneous imaging, spectroscopic, and scalar data using a two-stage architecture: modality-specific tokenization followed by transformer-based masked modeling of cross-modal token sequences. The model is pretrained on five large-scale surveys: Legacy Survey, Hyper Suprime-Cam (HSC), Sloan Digital Sky Survey (SDSS), Dark Energy Spectroscopic Instrument (DESI), and Gaia. These span more than 200 million observations of stars, galaxies, and quasars. With a single frozen encoder, AION-1 achieves strong results on a broad suite of downstream tasks, including galaxy and stellar property estimation, galaxy morphology classification, similarity-based retrieval, galaxy image segmentation, and spectral super-resolution. We release AION-1 model variants ranging from 300 M to 3.1 B parameters. Beyond astronomy, AION-1 provides a scalable blueprint for multimodal scientific foundation models that can seamlessly integrate noisy, instrument-specific observations. All code, tokenizers, pretrained weights, and a lightweight evaluation suite are released under an open-source license.
Keywords
Cite
@article{arxiv.2510.17960,
title = {AION-1: Omnimodal Foundation Model for Astronomical Sciences},
author = {Liam Parker and Francois Lanusse and Jeff Shen and Ollie Liu and Tom Hehir and Leopoldo Sarra and Lucas Meyer and Micah Bowles and Sebastian Wagner-Carena and Helen Qu and Siavash Golkar and Alberto Bietti and Hatim Bourfoune and Nathan Casserau and Pierre Cornette and Keiya Hirashima and Geraud Krawezik and Ruben Ohana and Nicholas Lourie and Michael McCabe and Rudy Morel and Payel Mukhopadhyay and Mariel Pettee and Bruno Regaldo-Saint Blancard and Kyunghyun Cho and Miles Cranmer and Shirley Ho},
journal= {arXiv preprint arXiv:2510.17960},
year = {2025}
}
Comments
Accepted at Neural Information Processing Systems (2025)