English
Related papers

Related papers: Deep learning-based astronomical multimodal data f…

200 papers

Astrophysical observations of the cosmos allow us to probe extreme physics and answer foundational questions on our universe. Modern astronomy is increasingly operating under a holistic approach, probing the same question with multiple…

High Energy Astrophysical Phenomena · Physics 2025-04-04 Eric Burns , Christopher L. Fryer , Ivan Agullo , Jennifer Andrews , Elias Aydi , Matthew G. Baring , Eddie Baron , Peter G. Boorman , Mohammad Ali Boroumand , Eric Borowski , Floor S. Broekgaarden , Poonam Chandra , Emmanouil Chatzopoulos , Hsin-Yu Chen , Kelly A. Chipps , Francesca Civano , Luca Comisso , Alejandro Cárdenas-Avendaño , Phong Dang , Catherine M. Deibel , Tarraneh Eftekhari , Courey Elliott , Ryan J. Foley , Christopher J. Fontes , Amy Gall , Gwendolyn R. Galleher , Gabriela Gonzalez , Fan Guo , Maria C. Babiuc Hamilton , J. Patrick Harding , Joseph Henning , Falk Herwig , William Raphael Hix , Anna Y. Q. Ho , Kelly Holley-Bockelmann , Rebekah Hounsell , C. Michelle Hui , Thomas Brian Humensky , Aimee Hungerford , Robert I. Hynes , Weidong Jin , Heather Johns , Maria Gatu Johnson , Jamie A. Kennea , Carolyn Kuranz , Gavin P. Lamb , Kristina D. Launey , Tiffany R. Lewis , Ioannis Liodakis , Daniel Livescu , Stuart Loch , Nicholas R. MacDonald , Thomas Maccarone , Lea Marcotulli , Athina Meli , Bronson Messer , M. Coleman Miller , Valarie Milton , Elias R. Most , Darin C. Mumma , Matthew R. Mumpower , Michela Negro , Eliza Neights , Peter Nugent , Dheeraj R Pasham , David Radice , Bindu Rani , Jocelyn S. Read , Rene Reifarth , Emily Reily , Lauren Rhodes , Andrea Richard , Paul M. Ricker , Christopher J. Roberts , Hendrik Schatz , Peter Shawhan , Endre Takacs , John A. Tomsick , Aaron C. Trigg , Todd Urbatsch , Nicole Vassh , V. Ashley Villar , Zorawar Wadiasingh , Gaurav Waratkar , Michael Zingale

The multi-messenger exploration of dark matter and physics beyond the Standard Model has emerged as a central direction in modern astro-particle physics, particularly following the discovery of gravitational waves. In this work, we present…

Multimodal deep learning harnesses diverse imaging modalities, such as MRI sequences, to enhance diagnostic accuracy in medical imaging. A key challenge is determining the optimal timing for integrating these modalities-specifically,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Valerio Guarrasi , Klara Mogensen , Sara Tassinari , Sara Qvarlander , Paolo Soda

Deep Learning has implemented a wide range of applications and has become increasingly popular in recent years. The goal of multimodal deep learning (MMDL) is to create models that can process and link information using various modalities.…

Machine Learning · Computer Science 2022-02-21 Jabeen Summaira , Xi Li , Amin Muhammad Shoib , Jabbar Abdul

Driven by the recent advances in smart, miniaturized, and mass produced sensors, networked systems, and high-speed data communication and computing, the ability to collect and process larger volumes of higher veracity real-time data from a…

Other Computer Science · Computer Science 2018-09-03 Chun-An Chou , Xiaoning Jin , Amy Mueller , Sarah Ostadabbas

Experience suggests that structural issues in how institutional Astrophysics approaches data-driven science and the development of discovery technology may be hampering the community's ability to respond effectively to a rapidly changing…

In the big data era, integrating diverse data modalities poses significant challenges, particularly in complex fields like healthcare. This paper introduces a new process model for multimodal Data Fusion for Data Mining, integrating…

Artificial Intelligence · Computer Science 2024-06-04 David Restrepo , Chenwei Wu , Constanza Vásquez-Venegas , Luis Filipe Nakayama , Leo Anthony Celi , Diego M López

The inherent challenge of multimodal fusion is to precisely capture the cross-modal correlation and flexibly conduct cross-modal interaction. To fully release the value of each modality and mitigate the influence of low-quality multimodal…

Machine Learning · Computer Science 2023-06-07 Qingyang Zhang , Haitao Wu , Changqing Zhang , Qinghua Hu , Huazhu Fu , Joey Tianyi Zhou , Xi Peng

Deep learning (DL) is one of the fastest growing topics in materials data science, with rapidly emerging applications spanning atomistic, image-based, spectral, and textual data modalities. DL allows analysis of unstructured data and…

The remote sensing community has identified data fusion as one of the key challenging topics of the 21st century. The subject of image fusion in two-dimensional (2D) space has been covered in several published reviews. However, the special…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Chukwuma Okolie , Julian Smit

In time-domain astronomy, STLF (Short-Timescale and Large Field-of-view) sky survey is the latest way of sky observation. Compared to traditional sky survey who can only find astronomical phenomena, STLF sky survey can even reveal how short…

Databases · Computer Science 2018-11-28 Chen Yang , Xiaofeng Meng , Zhihui Du , JiaMing Qiu , Kenan Liang , Yongjie Du , Zhiqiang Duan , Xiaobin Ma , Zhijian Fang

Most domains of science are experiencing a paradigm shift due to the advent of a new generation of instruments and detectors which produce data and data streams at an unprecedented rate. The scientific exploitation of these data, namely…

Instrumentation and Methods for Astrophysics · Physics 2024-09-06 Massimo Brescia , Giuseppe Angora

With the rapid development of Internet and multimedia services in the past decade, a huge amount of user-generated and service provider-generated multimedia data become available. These data are heterogeneous and multi-modal in nature,…

Multimedia · Computer Science 2020-01-07 Wenwu Zhu , Xin Wang , Hongzhi Li

Machine learning, particularly deep learning, is being increasing utilised in space applications, mirroring the groundbreaking success in many earthbound problems. Deploying a space device, e.g. a satellite, is becoming more accessible to…

Signal Processing · Electrical Eng. & Systems 2020-02-04 Vivek Kothari , Edgar Liberis , Nicholas D. Lane

Classification and identification of the materials lying over or beneath the Earth's surface have long been a fundamental but challenging research topic in geoscience and remote sensing (RS) and have garnered a growing concern owing to the…

Computer Vision and Pattern Recognition · Computer Science 2020-08-13 Danfeng Hong , Lianru Gao , Naoto Yokoya , Jing Yao , Jocelyn Chanussot , Qian Du , Bing Zhang

An array of large observational programs using ground-based and space-borne telescopes is planned in the next decade. The forthcoming wide-field sky surveys are expected to deliver a sheer volume of data exceeding an exabyte. Processing the…

Instrumentation and Methods for Astrophysics · Physics 2023-05-26 Kana Moriwaki , Takahiro Nishimichi , Naoki Yoshida

The sharp and recent increase in the availability of data captured by different sensors combined with their considerably heterogeneous natures poses a serious challenge for the effective and efficient processing of remotely sensed data.…

Over the past few years, the role of visualization for scientific purpose has grown up enormously. Astronomy makes an extended use of visualization techniques to analyze data, and scientific visualization has became a fundamental part of…

Astrophysics · Physics 2007-05-23 U. Becciani , V. Antonuccio-Delogu , C. Gheller , L. Calori , F. Buonomo , S. Imboden

As cities continue to burgeon, Urban Computing emerges as a pivotal discipline for sustainable development by harnessing the power of cross-domain data fusion from diverse sources (e.g., geographical, traffic, social media, and…

Machine Learning · Computer Science 2024-08-09 Xingchen Zou , Yibo Yan , Xixuan Hao , Yuehong Hu , Haomin Wen , Erdong Liu , Junbo Zhang , Yong Li , Tianrui Li , Yu Zheng , Yuxuan Liang

Astronomy is undergoing through a methodological revolution triggered by an unprecedented wealth of complex and accurate data. The new panchromatic, synoptic sky surveys require advanced tools for discovering patterns and trends hidden…