中文
相关论文

相关论文: Meta-Modal Agent: Sequential Evidence Routing for …

200 篇论文

Preserving multimodal signals across agent boundaries is necessary for accurate cross-modal reasoning, but it is not sufficient. We show that modality-native routing in Agent-to-Agent (A2A) networks improves task accuracy by 20 percentage…

人工智能 · 计算机科学 2026-04-16 Vasundra Srinivasan

Mixture-of-Agents (MoA) improves LLM performance through layered collaboration, but its dense topology raises costs and latency. Existing methods employ LLM judges to filter responses, yet still require all models to perform inference…

Multimodal Action Quality Assessment (AQA) has recently emerged as a promising paradigm. By leveraging complementary information across shared contextual cues, it enhances the discriminative evaluation of subtle intra-class variations in…

计算机视觉与模式识别 · 计算机科学 2025-12-09 Huangbiao Xu , Huanqi Wu , Xiao Ke , Junyi Wu , Rui Xu , Jinglin Xu

Incomplete multi-modal emotion recognition (IMER) aims at understanding human intentions and sentiments by comprehensively exploring the partially observed multi-source data. Although the multi-modal data is expected to provide more…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Wen-Jue He , Xiaofeng Zhu , Zheng Zhang

In this paper, we tackle two challenges in multimodal learning for visual recognition: 1) when missing-modality occurs either during training or testing in real-world situations; and 2) when the computation resources are not available to…

计算机视觉与模式识别 · 计算机科学 2023-03-10 Yi-Lun Lee , Yi-Hsuan Tsai , Wei-Chen Chiu , Chen-Yu Lee

Multimodal Sentiment Analysis (MSA) aims to infer human sentiment from textual, acoustic, and visual signals. In real-world scenarios, however, multimodal inputs are often compromised by dynamic noise or modality missingness. Existing…

人工智能 · 计算机科学 2026-04-09 Yitong Zhu , Yuxuan Jiang , Guanxuan Jiang , Bojing Hou , Peng Yuan Zhou , Ge Lin Kan , Yuyang Wang

Multimodal learning, which integrates diverse data sources such as images, text, and structured data, has proven superior to unimodal counterparts in high-stakes decision-making. However, while performance gains remain the gold standard for…

人工智能 · 计算机科学 2025-05-07 Kishore Sampath , Pratheesh , Ayaazuddin Mohammad , Resmi Ramachandranpillai

Multimodal emotion and intent recognition is essential for automated human-computer interaction, It aims to analyze users' speech, text, and visual information to predict their emotions or intent. One of the significant challenges is that…

人工智能 · 计算机科学 2025-07-09 Wei Zhang , Juan Chen , Yanbo J. Wang , En Zhu , Xuan Yang , Yiduo Wang

Multimodal sentiment analysis (MSA) draws increasing attention with the availability of multimodal data. The boost in performance of MSA models is mainly hindered by two problems. On the one hand, recent MSA works mostly focus on learning…

机器学习 · 计算机科学 2021-11-17 Ying Zeng , Sijie Mai , Haifeng Hu

Multimodal remote sensing classification often suffers from missing modalities caused by sensor failures and environmental interference, leading to severe performance degradation. In this work, we rethink missing-modality learning from a…

计算机视觉与模式识别 · 计算机科学 2026-02-04 Qinghao Gao , Jiahui Qu , Wenqian Dong

Index recommendation is one of the most important problems in database management system (DBMS) optimization. Given queries and certain index-related constraints, traditional methods rely on heuristic optimization or learning-based models…

数据库 · 计算机科学 2025-09-17 Zhaodonghui Li , Haitao Yuan , Jiachen Shi , Hao Zhang , Yu Rong , Gao Cong

Multi-agent debate (MAD) is widely used to improve large language model (LLM) performance through test-time scaling, yet recent work shows that vanilla MAD often underperforms simple majority vote despite higher computational cost. Studies…

计算与语言 · 计算机科学 2026-01-29 Xiaochen Zhu , Caiqi Zhang , Yizhou Chi , Tom Stafford , Nigel Collier , Andreas Vlachos

High false-positive rate is a long-standing challenge for anomaly detection algorithms, especially in high-stake applications. To identify the true anomalies, in practice, analysts or domain experts will be employed to investigate the top…

机器学习 · 计算机科学 2020-09-17 Daochen Zha , Kwei-Herng Lai , Mingyang Wan , Xia Hu

Training multimodal agents via reinforcement learning for knowledge-intensive visual reasoning is fundamentally hindered by the extreme sparsity of outcome-based supervision and the unpredictability of live web environments. To resolve…

计算机视觉与模式识别 · 计算机科学 2026-04-23 Wentao Yan , Shengqin Wang , Huichi Zhou , Yihang Chen , Kun Shao , Yuan Xie , Zhizhong Zhang

An efficient monotone data augmentation (MDA) algorithm is proposed for missing data imputation for incomplete multivariate nonnormal data that may contain variables of different types, and are modeled by a sequence of regression models…

统计方法学 · 统计学 2018-11-21 Yongqiang Tang

Multimodal learning, which integrates data from diverse sensory modes, plays a pivotal role in artificial intelligence. However, existing multimodal learning methods often struggle with challenges where some modalities appear more dominant…

机器学习 · 计算机科学 2024-04-02 Xiaohui Zhang , Jaehong Yoon , Mohit Bansal , Huaxiu Yao

Recent research on Reasoning of Large Language Models (LLMs) has sought to further enhance their performance by integrating meta-thinking -- enabling models to monitor, evaluate, and control their reasoning processes for more adaptive and…

人工智能 · 计算机科学 2025-05-28 Ziyu Wan , Yunxiang Li , Xiaoyu Wen , Yan Song , Hanjing Wang , Linyi Yang , Mark Schmidt , Jun Wang , Weinan Zhang , Shuyue Hu , Ying Wen

Multimodal Language Models (MMLMs) typically undergo post-training alignment to prevent harmful content generation. However, these alignment stages focus primarily on the assistant role, leaving the user role unaligned, and stick to a fixed…

密码学与安全 · 计算机科学 2025-04-08 Erfan Shayegani , G M Shahariar , Sara Abdali , Lei Yu , Nael Abu-Ghazaleh , Yue Dong

Current Retrieval-Augmented Generation (RAG) systems primarily operate on unimodal textual data, limiting their effectiveness on unstructured multimodal documents. Such documents often combine text, images, tables, equations, and graphs,…

机器学习 · 计算机科学 2025-10-17 Rashmi R , Vidyadhar Upadhya

Data incompleteness severely impedes the reliability of multimodal systems. Existing reconstruction methods face distinct bottlenecks: conventional parametric/generative models are prone to hallucinations due to over-reliance on internal…

人工智能 · 计算机科学 2026-02-05 Ruiting Dai , Zheyu Wang , Haoyu Yang , Yihan Liu , Chengzhi Wang , Zekun Zhang , Zishan Huang , Jiaman Cen , Lisi Mo