English
Related papers

Related papers: Meta-Modal Agent: Sequential Evidence Routing for …

200 papers

Preserving multimodal signals across agent boundaries is necessary for accurate cross-modal reasoning, but it is not sufficient. We show that modality-native routing in Agent-to-Agent (A2A) networks improves task accuracy by 20 percentage…

Artificial Intelligence · Computer Science 2026-04-16 Vasundra Srinivasan

Mixture-of-Agents (MoA) improves LLM performance through layered collaboration, but its dense topology raises costs and latency. Existing methods employ LLM judges to filter responses, yet still require all models to perform inference…

Artificial Intelligence · Computer Science 2026-01-27 Jize Wang , Han Wu , Zhiyuan You , Yiming Song , Yijun Wang , Zifei Shan , Yining Li , Songyang Zhang , Xinyi Le , Cailian Chen , Xinping Guan , Dacheng Tao

Multimodal Action Quality Assessment (AQA) has recently emerged as a promising paradigm. By leveraging complementary information across shared contextual cues, it enhances the discriminative evaluation of subtle intra-class variations in…

Computer Vision and Pattern Recognition · Computer Science 2025-12-09 Huangbiao Xu , Huanqi Wu , Xiao Ke , Junyi Wu , Rui Xu , Jinglin Xu

Incomplete multi-modal emotion recognition (IMER) aims at understanding human intentions and sentiments by comprehensively exploring the partially observed multi-source data. Although the multi-modal data is expected to provide more…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Wen-Jue He , Xiaofeng Zhu , Zheng Zhang

In this paper, we tackle two challenges in multimodal learning for visual recognition: 1) when missing-modality occurs either during training or testing in real-world situations; and 2) when the computation resources are not available to…

Computer Vision and Pattern Recognition · Computer Science 2023-03-10 Yi-Lun Lee , Yi-Hsuan Tsai , Wei-Chen Chiu , Chen-Yu Lee

Multimodal Sentiment Analysis (MSA) aims to infer human sentiment from textual, acoustic, and visual signals. In real-world scenarios, however, multimodal inputs are often compromised by dynamic noise or modality missingness. Existing…

Artificial Intelligence · Computer Science 2026-04-09 Yitong Zhu , Yuxuan Jiang , Guanxuan Jiang , Bojing Hou , Peng Yuan Zhou , Ge Lin Kan , Yuyang Wang

Multimodal learning, which integrates diverse data sources such as images, text, and structured data, has proven superior to unimodal counterparts in high-stakes decision-making. However, while performance gains remain the gold standard for…

Artificial Intelligence · Computer Science 2025-05-07 Kishore Sampath , Pratheesh , Ayaazuddin Mohammad , Resmi Ramachandranpillai

Multimodal emotion and intent recognition is essential for automated human-computer interaction, It aims to analyze users' speech, text, and visual information to predict their emotions or intent. One of the significant challenges is that…

Artificial Intelligence · Computer Science 2025-07-09 Wei Zhang , Juan Chen , Yanbo J. Wang , En Zhu , Xuan Yang , Yiduo Wang

Multimodal sentiment analysis (MSA) draws increasing attention with the availability of multimodal data. The boost in performance of MSA models is mainly hindered by two problems. On the one hand, recent MSA works mostly focus on learning…

Machine Learning · Computer Science 2021-11-17 Ying Zeng , Sijie Mai , Haifeng Hu

Multimodal remote sensing classification often suffers from missing modalities caused by sensor failures and environmental interference, leading to severe performance degradation. In this work, we rethink missing-modality learning from a…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Qinghao Gao , Jiahui Qu , Wenqian Dong

Index recommendation is one of the most important problems in database management system (DBMS) optimization. Given queries and certain index-related constraints, traditional methods rely on heuristic optimization or learning-based models…

Databases · Computer Science 2025-09-17 Zhaodonghui Li , Haitao Yuan , Jiachen Shi , Hao Zhang , Yu Rong , Gao Cong

Multi-agent debate (MAD) is widely used to improve large language model (LLM) performance through test-time scaling, yet recent work shows that vanilla MAD often underperforms simple majority vote despite higher computational cost. Studies…

Computation and Language · Computer Science 2026-01-29 Xiaochen Zhu , Caiqi Zhang , Yizhou Chi , Tom Stafford , Nigel Collier , Andreas Vlachos

High false-positive rate is a long-standing challenge for anomaly detection algorithms, especially in high-stake applications. To identify the true anomalies, in practice, analysts or domain experts will be employed to investigate the top…

Machine Learning · Computer Science 2020-09-17 Daochen Zha , Kwei-Herng Lai , Mingyang Wan , Xia Hu

Training multimodal agents via reinforcement learning for knowledge-intensive visual reasoning is fundamentally hindered by the extreme sparsity of outcome-based supervision and the unpredictability of live web environments. To resolve…

Computer Vision and Pattern Recognition · Computer Science 2026-04-23 Wentao Yan , Shengqin Wang , Huichi Zhou , Yihang Chen , Kun Shao , Yuan Xie , Zhizhong Zhang

An efficient monotone data augmentation (MDA) algorithm is proposed for missing data imputation for incomplete multivariate nonnormal data that may contain variables of different types, and are modeled by a sequence of regression models…

Methodology · Statistics 2018-11-21 Yongqiang Tang

Multimodal learning, which integrates data from diverse sensory modes, plays a pivotal role in artificial intelligence. However, existing multimodal learning methods often struggle with challenges where some modalities appear more dominant…

Machine Learning · Computer Science 2024-04-02 Xiaohui Zhang , Jaehong Yoon , Mohit Bansal , Huaxiu Yao

Recent research on Reasoning of Large Language Models (LLMs) has sought to further enhance their performance by integrating meta-thinking -- enabling models to monitor, evaluate, and control their reasoning processes for more adaptive and…

Artificial Intelligence · Computer Science 2025-05-28 Ziyu Wan , Yunxiang Li , Xiaoyu Wen , Yan Song , Hanjing Wang , Linyi Yang , Mark Schmidt , Jun Wang , Weinan Zhang , Shuyue Hu , Ying Wen

Multimodal Language Models (MMLMs) typically undergo post-training alignment to prevent harmful content generation. However, these alignment stages focus primarily on the assistant role, leaving the user role unaligned, and stick to a fixed…

Cryptography and Security · Computer Science 2025-04-08 Erfan Shayegani , G M Shahariar , Sara Abdali , Lei Yu , Nael Abu-Ghazaleh , Yue Dong

Current Retrieval-Augmented Generation (RAG) systems primarily operate on unimodal textual data, limiting their effectiveness on unstructured multimodal documents. Such documents often combine text, images, tables, equations, and graphs,…

Machine Learning · Computer Science 2025-10-17 Rashmi R , Vidyadhar Upadhya

Data incompleteness severely impedes the reliability of multimodal systems. Existing reconstruction methods face distinct bottlenecks: conventional parametric/generative models are prone to hallucinations due to over-reliance on internal…

Artificial Intelligence · Computer Science 2026-02-05 Ruiting Dai , Zheyu Wang , Haoyu Yang , Yihan Liu , Chengzhi Wang , Zekun Zhang , Zishan Huang , Jiaman Cen , Lisi Mo