English
Related papers

Related papers: A Multimodal Learning Framework for Comprehensive …

200 papers

In this study, we present a sophisticated hybrid machine-learning framework that significantly improves the accuracy of predicting hydrogen storage capacities in metal hydrides. This is a critical challenge due to the scarcity of…

Materials Science · Physics 2024-08-29 Satadeep Bhattacharjee , Pritam Das , Swetarekha Ram , Seung-Cheol Lee

Oral cancer is frequently diagnosed at later stages due to its similarity to other lesions. Existing research on computer aided diagnosis has made progress using deep learning; however, most approaches remain limited by small, imbalanced…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Joy Naoum , Revana Salama , Ali Hamdi

Multimodal learning has seen great success mining data features from multiple modalities with remarkable model performance improvement. Meanwhile, federated learning (FL) addresses the data sharing problem, enabling privacy-preserved…

Machine Learning · Computer Science 2023-03-29 Rongyu Zhang , Xiaowei Chi , Guiliang Liu , Wenyi Zhang , Yuan Du , Fangxin Wang

Osteoporosis is a common condition that increases fracture risk, especially in older adults. Early diagnosis is vital for preventing fractures, reducing treatment costs, and preserving mobility. However, healthcare providers face challenges…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Mehdi Hosseini Chagahi , Saeed Mohammadi Dashtaki , Niloufar Delfan , Nadia Mohammadi , Farshid Rostami Pouria , Behzad Moshiri , Md. Jalil Piran , Oliver Faust

Computational virtual high-throughput screening (VHTS) with density functional theory (DFT) and machine-learning (ML)-acceleration is essential in rapid materials discovery. By necessity, efficient DFT-based workflows are carried out with a…

Materials Science · Physics 2021-06-25 Chenru Duan , Shuxin Chen , Michael G. Taylor , Fang Liu , Heather J. Kulik

Multimodal sentiment analysis is a key technology in the fields of human-computer interaction and affective computing. Accurately recognizing human emotional states is crucial for facilitating smooth communication between humans and…

Computer Vision and Pattern Recognition · Computer Science 2026-01-07 Wangyuan Zhu , Jun Yu

Interatomic potentials are essential for driving molecular dynamics (MD) simulations, directly impacting the reliability of predictions regarding the physical and chemical properties of materials. In recent years, machine-learned potentials…

Materials Science · Physics 2025-03-20 Penghua Ying , Cheng Qian , Rui Zhao , Yanzhou Wang , Feng Ding , Shunda Chen , Zheyong Fan

This paper focuses on the construction of stronger local features and the effective fusion of image and LiDAR data. We adopt different modalities of LiDAR data to generate richer features and present an adaptive and azimuth-aware network to…

Computer Vision and Pattern Recognition · Computer Science 2020-06-04 Yonglin Tian , Kunfeng Wang , Yuang Wang , Yulin Tian , Zilei Wang , Fei-Yue Wang

Multimodal information (e.g., visual, acoustic, and textual) has been widely used to enhance representation learning for micro-video recommendation. For integrating multimodal information into a joint representation of micro-video,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Han Liu , Yinwei Wei , Fan Liu , Wenjie Wang , Liqiang Nie , Tat-Seng Chua

Skin lesion classification is essential for early dermatological diagnosis, yet many existing computer-aided systems rely primarily on dermoscopic images and underutilize the multimodal evidence routinely available in clinical practice. To…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Phan Nguyen , Dat Cao , Quang Hien Kha , Hien Chu , Minh H. N. Le , Trang Quoc Thao Pham , Nguyen Quoc Khanh Le

We present a novel deep learning (DL) approach to produce highly accurate predictions of macroscopic physical properties of solid solution binary alloys and magnetic systems. The major idea is to make use of the correlations between…

Computational Physics · Physics 2021-01-29 Massimiliano Lupo Pasini , Ying Wai Li , Junqi Yin , Jiaxin Zhang , Kipton Barros , Markus Eisenbach

This study proposes an Artificial Intelligence (AI) driven methodology for predicting a combination of brazed ceramic-metal composite materials. Multiple machine learning (ML) algorithms are compared with the deep learning (DL) model. The…

Applied Physics · Physics 2025-10-14 Sunita Khod , Vinay Kamma , Ravi Kumar Verma , Mayank Goswami

Software fault localization remains challenging due to limited feature diversity and low precision in traditional methods. This paper proposes a novel approach that integrates multi-objective optimization with deep learning models to…

Software Engineering · Computer Science 2024-11-27 Xiaolei Hu , Dongcheng Li , W. Eric Wong , Ya Zou

In this paper, we propose a deep multimodal fusion network to fuse multiple modalities (face, iris, and fingerprint) for person identification. The proposed deep multimodal fusion algorithm consists of multiple streams of modality-specific…

Machine Learning · Computer Science 2018-07-05 Sobhan Soleymani , Ali Dabouei , Hadi Kazemi , Jeremy Dawson , Nasser M. Nasrabadi

Multimodal information processing has become increasingly important for enhancing image classification performance. However, the intricate and implicit dependencies across different modalities often hinder conventional methods from…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Yang Qiao , Xiaoyu Zhong , Xiaofeng Gu , Zhiguo Yu

Machine Learning models have emerged as a powerful tool for fast and accurate prediction of different crystalline properties. Exiting state-of-the-art models rely on a single modality of crystal data i.e. crystal graph structure, where they…

Materials Science · Physics 2023-07-12 Kishalay Das , Pawan Goyal , Seung-Cheol Lee , Satadeep Bhattacharjee , Niloy Ganguly

Reliable 3D object detection is fundamental to autonomous driving, and multimodal fusion algorithms using cameras and LiDAR remain a persistent challenge. Cameras provide dense visual cues but ill posed depth; LiDAR provides a precise 3D…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Venkatraman Narayanan , Bala Sai , Rahul Ahuja , Pratik Likhar , Varun Ravi Kumar , Senthil Yogamani

Multimodal image fusion aims to integrate information from different imaging techniques to produce a comprehensive, detail-rich single image for downstream vision tasks. Existing methods based on local convolutional neural networks (CNNs)…

Computer Vision and Pattern Recognition · Computer Science 2025-02-04 Xinyu Xie , Yawen Cui , Tao Tan , Xubin Zheng , Zitong Yu

3D semantic occupancy prediction is crucial for finely representing the surrounding environment, which is essential for ensuring the safety in autonomous driving. Existing fusion-based occupancy methods typically involve performing a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-07 Ji Zhang , Yiran Ding , Zixin Liu

Recommendation systems play a vital role to keep users engaged with personalized content in modern online platforms. Deep learning has revolutionized many research fields and there is a recent surge of interest in applying it to…

Information Retrieval · Computer Science 2018-06-22 Travis Ebesu , Bin Shen , Yi Fang