English
Related papers

Related papers: Deep learning-based astronomical multimodal data f…

200 papers

Multimodal MRIs play a crucial role in clinical diagnosis and treatment. Feature disentanglement (FD)-based methods, aiming at learning superior feature representations for multimodal data analysis, have achieved significant success in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Tianling Liu , Hongying Liu , Fanhua Shang , Lequan Yu , Tong Han , Liang Wan

The next generation of wide-field deep astronomical surveys will deliver unprecedented amounts of images through the 2020s and beyond. As both the sensitivity and depth of observations increase, more blended sources will be detected. This…

Instrumentation and Methods for Astrophysics · Physics 2024-12-02 G. M. Merz , Y. Liu , C. J. Burke , P. D. Aleo , X. Liu , M. C. Kind , V. Kindratenko , Y. Liu

The advent of next-generation radio telescopes is set to transform radio astronomy by producing massive data volumes that challenge traditional processing methods. Deep learning techniques have shown strong potential in automating radio…

Instrumentation and Methods for Astrophysics · Physics 2025-08-04 S. Riggi , T. Cecconello , A. Pilzer , S. Palazzo , N. Gupta , A. M. Hopkins , C. Trigilio , G. Umana

In recent years, deep learning has been successfully applied in various scientific domains. Following these promising results and performances, it has recently also started being evaluated in the domain of radio astronomy. In particular,…

This paper is concerned with multi-modal data fusion (MMDF) under unexpected modality failures in nonlinear non-Gaussian dynamic processes. An efficient framework to tackle this problem is proposed. In particular, a notion termed modality…

Machine Learning · Computer Science 2021-11-24 Bin Liu

Machine learning methods in healthcare have traditionally focused on using data from a single modality, limiting their ability to effectively replicate the clinical practice of integrating multiple sources of information for improved…

Machine Learning · Computer Science 2024-02-13 Felix Krones , Umar Marikkar , Guy Parsons , Adam Szmul , Adam Mahdi

Multi-modal image fusion aims to integrate complementary information from multiple source images to produce high-quality fused images with enriched content. Although existing approaches based on state space model have achieved satisfied…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Yiming Sun , Zifan Ye , Qinghua Hu , Pengfei Zhu

In recent years, multi-modal fusion has attracted a lot of research interest, both in academia, and in industry. Multimodal fusion entails the combination of information from a set of different types of sensors. Exploiting complementary…

Machine Learning · Computer Science 2020-08-27 Siddharth Roheda , Hamid Krim , Benjamin S. Riggan

Many vision-related tasks benefit from reasoning over multiple modalities to leverage complementary views of data in an attempt to learn robust embedding spaces. Most deep learning-based methods rely on a late fusion technique whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Austin Reiter , Menglin Jia , Pu Yang , Ser-Nam Lim

Clustering is an effective tool for astronomical spectral analysis, to mine clustering patterns among data. With the implementation of large sky surveys, many clustering methods have been applied to tackle spectroscopic and photometric data…

Instrumentation and Methods for Astrophysics · Physics 2022-12-19 Haifeng Yang , Chenhui Shi , Jianghui Cai , Lichan Zhou , Yuqing Yang , Xujun Zhao , Yanting He , Jing Hao

Modern Earth Observation systems provide sensing data at different temporal and spatial resolutions. Among optical sensors, today the Sentinel-2 program supplies high-resolution temporal (every 5 days) and high spatial resolution (10m)…

Computer Vision and Pattern Recognition · Computer Science 2018-03-07 P. Benedetti , D. Ienco , R. Gaetano , K. Osé , R. Pensa , S. Dupuy

Owing to effective and flexible data acquisition, unmanned aerial vehicle (UAV) has recently become a hotspot across the fields of computer vision (CV) and remote sensing (RS). Inspired by recent success of deep learning (DL), many advanced…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Xin Wu , Wei Li , Danfeng Hong , Ran Tao , Qian Du

Data-driven methods (DDMs), such as deep neural networks, offer a generic approach to integrated data analysis (IDA), integrated diagnostic-to-control (IDC) workflows through data fusion (DF), which includes multi-instrument data fusion…

Over the past decade, astronomers have been using an increasingly larger number of web-based applications and archives to conduct their research. However, despite the early success in creating links across projects and data centers, the…

Instrumentation and Methods for Astrophysics · Physics 2015-03-17 Alberto Accomazzi , Michael J. Kurtz , Stephen S. Murray

Astronomy has entered the multi-messenger data era and Machine Learning has found widespread use in a large variety of applications. The exploitation of synoptic (multi-band and multi-epoch) surveys, like LSST (Legacy Survey of Space and…

Instrumentation and Methods for Astrophysics · Physics 2021-05-12 M. Vicedomini , M. Brescia , S. Cavuoti , G. Longo , G. Riccio

We analyse the issues involved in the management and mining of astrophysical data. The traditional approach to data management in the astrophysical field is not able to keep up with the increasing size of the data gathered by modern…

Databases · Computer Science 2007-05-23 M. Frailis , A. De Angelis , V. Roberto

Astroinformatics is a new impact area in the world of astronomy, occasionally called the final frontier, where several astrophysicists, statisticians and computer scientists work together to tackle various data intensive astronomical…

Computational Engineering, Finance, and Science · Computer Science 2015-04-30 Snehanshu Saha , Surbhi Agrawal , Manikandan. R , Kakoli Bora , Swati Routh , Anand Narasimhamurthy

Like every other field of intellectual endeavor, astronomy is being revolutionised by the advances in information technology. There is an ongoing exponential growth in the volume, quality, and complexity of astronomical data sets, mainly…

Astrophysics · Physics 2009-11-07 S. G. Djorgovski , A. Mahabal , R. Brunner , R. Williams , R. Granat , D. Curkendall , J. Jacob , P. Stolorz

Infrared and visible image fusion has garnered considerable attention owing to the strong complementarity of these two modalities in complex, harsh environments. While deep learning-based fusion methods have made remarkable advances in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Guihui Li , Bowei Dong , Kaizhi Dong , Jiayi Li , Haiyong Zheng

The distinction between stars and galaxies is a fundamental problem in the field of celestial classification. This issue has become challenging for these ongoing and upcoming digital surveys, which will produce terabytes and even petabytes…

Instrumentation and Methods for Astrophysics · Physics 2026-04-14 Zhuoming Han , Tianmeng Zhang , Chao Liu , Chenxiaoji Ling