English
Related papers

Related papers: Attention-based Neural Network Emulators for Multi…

200 papers

Precise estimation of cosmological parameters from the cosmic microwave background (CMB) remains a central goal of modern cosmology and a key test of inflationary physics. However, this task is fundamentally limited by strong foreground…

Cosmology and Nongalactic Astrophysics · Physics 2026-04-03 Larissa Santos , Camila P. Novaes , Elisa G. M. Ferreira , Carlo Baccigalupi

Neural network emulators are widely used in astrophysics and cosmology to approximate complex simulations inside Bayesian inference loops. Ad hoc rules of thumb are often used to justify the emulator accuracy required for reliable posterior…

Cosmology and Nongalactic Astrophysics · Physics 2026-02-25 H. T. J. Bevins , T. Gessey-Jones , W. J. Handley

Deep learning-based neural receivers offer promising physical-layer solutions for next-generation wireless systems. We propose an axial self-attention transformer neural receiver that achieves state-of-the-art Block Error Rate (BLER)…

Signal Processing · Electrical Eng. & Systems 2026-03-11 SaiKrishna Saketh Yellapragada , Atchutaram K. Kocharlakota , Mário Costa , Esa Ollila , Sergiy A. Vorobyov

This chapter reviews the application of Artificial Intelligence (AI) techniques to the study of galaxy clusters, covering both theoretical developments and their use as tools to infer cluster properties from a variety of observational…

Cosmology and Nongalactic Astrophysics · Physics 2026-05-22 Gustavo Yepes , Daniel de Andrés

In this paper, we tackle the high computational overhead of Transformers for efficient image super-resolution~(SR). Motivated by the observations of self-attention's inter-layer repetition, we introduce a convolutionized self-attention…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Dongheon Lee , Seokju Yun , Youngmin Ro

Data-driven emulators are increasingly being used to learn and emulate physics-based simulations, reducing computational expense and run time. Here, we present a structured way to improve the quality of these high-dimensional emulated…

Machine Learning · Computer Science 2025-04-25 Nawid Keshtmand , Elena Fillola , Jeffrey Nicholas Clark , Raul Santos-Rodriguez , Matthew Rigby

Precise and accurate predictions of the halo mass function for cluster mass scales in $w\nu{\rm CDM}$ cosmologies are crucial for extracting robust and unbiased cosmological information from upcoming galaxy cluster surveys. Here, we present…

Cosmology and Nongalactic Astrophysics · Physics 2025-03-31 Delon Shen , Nickolas Kokron , Joseph DeRose , Jeremy Tinker , Risa H. Wechsler , Arka Banerjee , the Aemulus Collaboration

The attention mechanism is the computational core of modern Transformer architectures, but its quadratic complexity in the input sequence length is the bottleneck for large-scale inference. This has motivated a rapidly growing body of work…

Vision Transformers (ViTs) have shown impressive performance but still require a high computation cost as compared to convolutional neural networks (CNNs), one reason is that ViTs' attention measures global similarities and thus has a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-26 Haoran You , Yunyang Xiong , Xiaoliang Dai , Bichen Wu , Peizhao Zhang , Haoqi Fan , Peter Vajda , Yingyan Celine Lin

We present a systematic investigation of deep learning methods applied to quantum error mitigation of noisy output probability distributions from measured quantum circuits. We compare different architectures, from fully connected neural…

We perform a complete study of the gravitational lensing effect beyond the Born approximation on the Cosmic Microwave Background (CMB) anisotropies using a multiple-lens raytracing technique through cosmological N-body simulations of the…

Cosmology and Nongalactic Astrophysics · Physics 2018-03-06 Giulio Fabbian , Matteo Calabrese , Carmelita Carbone

Aerosol particles play an important role in the climate system by absorbing and scattering radiation and influencing cloud properties. They are also one of the biggest sources of uncertainty for climate modeling. Many climate models do not…

Machine Learning · Computer Science 2021-09-30 Paula Harder , Duncan Watson-Parris , Dominik Strassel , Nicolas Gauger , Philip Stier , Janis Keuper

Unlike images or videos data which can be easily labeled by human being, sensor data annotation is a time-consuming process. However, traditional methods of human activity recognition require a large amount of such strictly labeled data for…

Machine Learning · Computer Science 2019-07-02 Kun Wang , Jun He , Lei Zhang

Extracting accurate cosmological information from galaxy-galaxy and galaxy-matter correlation functions on non-linear scales ($\lesssim 10 h^{-1} \mathrm{Mpc}$) requires cosmological simulations. Additionally, one has to marginalise over…

Cosmology and Nongalactic Astrophysics · Physics 2019-10-02 Johannes U. Lange , Frank C. van den Bosch , Andrew R. Zentner , Kuan Wang , Andrew P. Hearin , Hong Guo

We present a machine-learning approach for estimating galaxy cluster masses from Chandra mock images. We utilize a Convolutional Neural Network (CNN), a deep machine learning tool commonly used in image recognition tasks. The CNN is trained…

Cosmology and Nongalactic Astrophysics · Physics 2019-06-20 M. Ntampaka , J. ZuHone , D. Eisenstein , D. Nagai , A. Vikhlinin , L. Hernquist , F. Marinacci , D. Nelson , R. Pakmor , A. Pillepich , P. Torrey , M. Vogelsberger

One of the main challenges in modeling massive stars to the onset of core collapse is the computational bottleneck of nucleosynthesis during advanced burning stages. The number of isotopes formed requires solving a large set of…

As the next generation of large galaxy surveys come online, it is becoming increasingly important to develop and understand the machine learning tools that analyze big astronomical data. Neural networks are powerful and capable of probing…

The next-generation CMB experiments are expected to constrain the tensor-to-scalar ratio $r$ with high precision. Delensing is an important process as the observed CMB $B$-mode polarization that contains the primordial tensor perturbation…

Cosmology and Nongalactic Astrophysics · Physics 2022-10-17 Chen Heinrich , Trey Driskell , Chris Heinrich

Increasing resolution and coverage of astrophysical and climate data necessitates increasingly sophisticated models, often pushing the limits of computational feasibility. While emulation methods can reduce calculation costs, the neural…

Earth and Planetary Astrophysics · Physics 2025-06-25 Tara P. A. Tahseen , Luís F. Simões , Kai Hou Yip , Nikolaos Nikolaou , João M. Mendonça , Ingo P. Waldmann

Cosmic Microwave Background (CMB) is a powerful probe to study the early universe and various cosmological models. Weak gravitational lensing affects the CMB by changing its power spectrum, but meanwhile, it also carries information about…

Cosmology and Nongalactic Astrophysics · Physics 2021-06-09 Chandra Shekhar Saraf