English
Related papers

Related papers: AstroPT: Scaling Large Observation Models for Astr…

200 papers

Since its emergence two decades ago, astrophotonics has found broad application in scientific instruments at many institutions worldwide. The case for astrophotonics becomes more compelling as telescopes push for AO-assisted,…

Instrumentation and Methods for Astrophysics · Physics 2017-08-02 Joss Bland-Hawthorn , Sergio Leon-Saval

Taking inspiration from natural language embeddings, we present ASTROMER, a transformer-based model to create representations of light curves. ASTROMER was pre-trained in a self-supervised manner, requiring no human-labeled data. We used…

Instrumentation and Methods for Astrophysics · Physics 2023-02-08 C. Donoso-Oliva , I. Becker , P. Protopapas , G. Cabrera-Vives , Vishnu M. , Harsh Vardhan

Transfer learning with large pretrained transformer-based language models like BERT has become a dominating approach for most NLP tasks. Simply fine-tuning those large language models on downstream tasks or combining it with task-specific…

Computation and Language · Computer Science 2021-08-06 Wenjuan Han , Bo Pang , Yingnian Wu

Astronomy relies heavily on time domain observations. To maximize the scientific yield of such observations, astronomers must carefully match the observational cadence to the phenomena of interest. This presents significant scheduling…

Instrumentation and Methods for Astrophysics · Physics 2025-06-11 Jack Lubin , Erik A. Petigura , Velibor V. Mišić , Judah Van Zandt , Luke B. Handley

A next-generation medium-energy (100 keV to 100 MeV) gamma-ray observatory will greatly enhance the identification and characterization of multimessenger sources in the coming decade. Coupling gamma-ray spectroscopy, imaging, and…

Strongly lensed Active Galactic Nuclei (AGN) with an observable time delay can be used to constrain the expansion history of the Universe through time-delay cosmography (TDC). As the sample of time-delay lenses grows to statistical size,…

Low-thrust trajectory design relies heavily on repeated evaluations of fuel consumption and transfer feasibility, which require expensive optimal control solutions. In this work, we show these quantities can be accurately approximated by…

Machine Learning · Computer Science 2026-05-28 Zhong Zhang , Giacomo Acciarini , Dario Izzo , Hexi Baoyin , Francesco Topputo

We review some aspects of the current state of data-intensive astronomy, its methods, and some outstanding data analysis challenges. Astronomy is at the forefront of "big data" science, with exponentially growing data volumes and data…

Instrumentation and Methods for Astrophysics · Physics 2014-11-04 G. Longo , M. Brescia , S. G. Djorgovski , S. Cavuoti , C. Donalek

Strong gravitational lensing by galaxies is a powerful tool for studying cosmology and galaxy structure. The China Space Station Telescope (CSST) will revolutionize this field by discovering up to $\sim$100,000 galaxy-scale strong lenses, a…

Cosmology and Nongalactic Astrophysics · Physics 2025-11-12 Hengyu Wu , Yun Chen , Tonghua Liu , Xiaoyue Cao , Tian Li , Hui Li , Nan Li , Ran Li , Tengpeng Xu

Large language models, which are often trained for hundreds of thousands of compute days, have shown remarkable capabilities for zero- and few-shot learning. Given their computational cost, these models are difficult to replicate without…

Recent work has demonstrated substantial gains on many NLP tasks and benchmarks by pre-training on a large corpus of text followed by fine-tuning on a specific task. While typically task-agnostic in architecture, this method still requires…

A forward model of matter and biased tracers at arbitrary order in Lagrangian perturbation theory (LPT) is presented. The forward model contains the complete LPT displacement field at any given order in perturbations, as well as all…

Cosmology and Nongalactic Astrophysics · Physics 2021-10-04 Fabian Schmidt

Machine learning techniques offer a precious tool box for use within astronomy to solve problems involving so-called big data. They provide a means to make accurate predictions about a particular system without prior knowledge of the…

Instrumentation and Methods for Astrophysics · Physics 2019-01-01 J. Elliott , R. S. de Souza , A. Krone-Martins , E. Cameron , E. E. O. Ishida , J. Hilbe

Machine learning methods for satellite data have a range of societally relevant applications, but labels used to train models can be difficult or impossible to acquire. Self-supervision is a natural solution in settings with limited labeled…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Gabriel Tseng , Ruben Cartuyvels , Ivan Zvonkov , Mirali Purohit , David Rolnick , Hannah Kerner

Large language models (LLMs) such as generative pretrained transformers (GPTs) have shown potential for various commercial applications, but their applicability for materials design remains underexplored. In this article, we introduce…

Materials Science · Physics 2024-07-02 Kamal Choudhary

We describe the application of data mining algorithms to research problems in astronomy. We posit that data mining has always been fundamental to astronomical research, since data mining is the basis of evidence-based discovery, including…

Instrumentation and Methods for Astrophysics · Physics 2009-11-04 Kirk Borne

Asteroseismology, the study of stellar oscillations, provides high-precision measurements of masses and ages for red giants. Scaling relations are a powerful tool for measuring fundamental stellar parameters, and the derived radii are in…

Solar and Stellar Astrophysics · Physics 2025-12-09 Kaili Cao , Marc H. Pinsonneault

The ability to collect unprecedented amounts of astronomical data has enabled the studying scientific questions that were impractical to study in the pre-information era. This study uses large datasets collected by four different robotic…

Cosmology and Nongalactic Astrophysics · Physics 2022-06-02 Lior Shamir

Atom probe tomography (APT) has matured to a versatile nanoanalytical characterization tool with applications that range from materials science to geology and possibly beyond. Already, well over 100 APT microscopes exist worldwide.…

Computational Physics · Physics 2020-04-14 Markus Kühbach , Priyanshu Bajaj , Murat Han Celik , Eric Aimo Jägle , Baptiste Gault

We present a comprehensive evaluation of proprietary and open-weights large language models using the first astronomy-specific benchmarking dataset. This dataset comprises 4,425 multiple-choice questions curated from the Annual Review of…