English
Related papers

Related papers: Robust Dynamic Multi-Modal Data Fusion: A Model Un…

200 papers

Generating photos satisfying multiple constraints find broad utility in the content creation industry. A key hurdle to accomplishing this task is the need for paired data consisting of all modalities (i.e., constraints) and their…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 Nithin Gopalakrishnan Nair , Wele Gedara Chaminda Bandara , Vishal M. Patel

Link prediction aims to identify potential missing triples in knowledge graphs. To get better results, some recent studies have introduced multimodal information to link prediction. However, these methods utilize multimodal information…

Artificial Intelligence · Computer Science 2023-03-21 Xinhang Li , Xiangyu Zhao , Jiaxing Xu , Yong Zhang , Chunxiao Xing

Previous studies have highlighted significant advancements in multimodal fusion. Nevertheless, such methods often encounter challenges regarding the efficacy of feature extraction, data integrity, consistency of feature dimensions, and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jiayu Xiong , Jing Wang , Hengjing Xiang , Jun Xue , Chen Xu , Zhouqiang Jiang

Anomaly synthesis is one of the effective methods to augment abnormal samples for training. However, current anomaly synthesis methods predominantly rely on texture information as input, which limits the fidelity of synthesized abnormal…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Jie Hu , Yawen Huang , Yilin Lu , Guoyang Xie , Guannan Jiang , Yefeng Zheng , Zhichao Lu

Fruit drying is widely used in food manufacturing to reduce product moisture, ensure product safety, and extend product shelf life. Accurately predicting final moisture content (MC) is critically needed for quality control of drying…

Machine Learning · Computer Science 2026-02-10 Shichen Li , Chenhui Shao

Multimodal medical analysis combining image and tabular data has gained increasing attention. However, effective fusion remains challenging due to cross-modal discrepancies in feature dimensions and modality contributions, as well as the…

Computer Vision and Pattern Recognition · Computer Science 2025-09-17 Congjing Yu , Jing Ye , Yang Liu , Xiaodong Zhang , Zhiyong Zhang

To manage renewable generation and load consumption uncertainty, chance-constrained optimal power flow (OPF) formulations and various solution methodologies have been proposed. However, conventional solution approaches often rely on…

Optimization and Control · Mathematics 2019-08-06 Bowen Li , Ruiwei Jiang , Johanna L. Mathieu

The objective of Entity Alignment (EA) is to identify equivalent entity pairs from multiple Knowledge Graphs (KGs) and create a more comprehensive and unified KG. The majority of EA methods have primarily focused on the structural modality…

Computation and Language · Computer Science 2023-10-16 Bolin Zhu , Xiaoze Liu , Xin Mao , Zhuo Chen , Lingbing Guo , Tao Gui , Qi Zhang

With the growing success of multi-modal learning, research on the robustness of multi-modal models, especially when facing situations with missing modalities, is receiving increased attention. Nevertheless, previous studies in this domain…

Artificial Intelligence · Computer Science 2023-10-11 Siting Li , Chenzhuang Du , Yue Zhao , Yu Huang , Hang Zhao

Fault diagnosis of mechanical equipment involves data collection, feature extraction, and pattern recognition but is often hindered by the imbalanced nature of industrial data, introducing significant uncertainty and reducing diagnostic…

Machine Learning · Computer Science 2025-03-18 Zhixuan Lian , Shangyu Li , Qixuan Huang , Zijian Huang , Haifei Liu , Jianan Qiu , Puyu Yang , Laifa Tao

Multi-modal image fusion (MMIF) maps useful information from various modalities into the same representation space, thereby producing an informative fused image. However, the existing fusion algorithms tend to symmetrically fuse the…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Jingxue Huang , Xilai Li , Tianshu Tan , Xiaosong Li , Tao Ye

This paper presents a unified framework for uncertainty propagation in dynamical systems involving hybrid aleatory and epistemic uncertainties. The framework accommodates precise probabilistic, imprecise probabilistic, and non-probabilistic…

Methodology · Statistics 2025-09-12 Yi Luo , Meng-Ze Lyu , Matteo Broggi , Marko Thiele , Vasileios C. Fragkoulis , Michael Beer

One-step generative modeling seeks to generate high-quality data samples in a single function evaluation, significantly improving efficiency over traditional diffusion or flow-based models. In this work, we introduce Modular MeanFlow (MMF),…

Machine Learning · Computer Science 2025-08-26 Haochen You , Baojing Liu , Hongyang He

Multimodal Sentiment Analysis (MSA) is an important research area that aims to understand and recognize human sentiment through multiple modalities. The complementary information provided by multimodal fusion promotes better sentiment…

The enormous structural and chemical diversity of metal-organic frameworks (MOFs) forces researchers to actively use simulation techniques on an equal footing with experiments. MOFs are widely known for outstanding adsorption properties, so…

Materials Science · Physics 2021-11-22 Vadim V. Korolev , Yurii M. Nevolin , Thomas A. Manz , Pavel V. Protsenko

The combination of electronic health records (EHR) and medical images is crucial for clinicians in making diagnoses and forecasting prognosis. Strategically fusing these two data modalities has great potential to improve the accuracy of…

Image and Video Processing · Electrical Eng. & Systems 2024-10-24 Wenfang Yao , Kejing Yin , William K. Cheung , Jia Liu , Jing Qin

Multimodal Federated Learning (MFL) enables clients with heterogeneous data modalities to collaboratively train models without sharing raw data, offering a privacy-preserving framework that leverages complementary cross-modal information.…

Machine Learning · Computer Science 2026-03-06 Min Tan , Junchao Ma , Yinfu Feng , Jiajun Ding , Wenwen Pan , Tingting Han , Qian Zheng , Zhenzhong Kuang , Zhou Yu

Learning from multimodal datasets can leverage complementary information and improve performance in prediction tasks. A commonly used strategy to account for feature correlations in high-dimensional datasets is the latent variable approach.…

Machine Learning · Computer Science 2024-10-01 Lingchao Mao , Qi wang , Yi Su , Fleming Lure , Jing Li

In the big data era, integrating diverse data modalities poses significant challenges, particularly in complex fields like healthcare. This paper introduces a new process model for multimodal Data Fusion for Data Mining, integrating…

Artificial Intelligence · Computer Science 2024-06-04 David Restrepo , Chenwei Wu , Constanza Vásquez-Venegas , Luis Filipe Nakayama , Leo Anthony Celi , Diego M López

Visible-infrared image pairs provide complementary information, enhancing the reliability and robustness of object detection applications in real-world scenarios. However, most existing methods face challenges in maintaining robustness…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Haoyuan Li , Qi Hu , Binjia Zhou , You Yao , Jiacheng Lin , Kailun Yang , Peng Chen