English
Related papers

Related papers: Symbolic-Vector Attention Fusion for Collective In…

200 papers

Blended emotion recognition is challenging because emotions are often expressed as mixtures of subtle and overlapping multimodal cues rather than a single dominant signal. We propose a rank-aware multi-encoder framework that selectively…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Junghyun Lee , Hyunseo Kim , Hanna Jang , Junhyug Noh

The infrared and visible images fusion (IVIF) is receiving increasing attention from both the research community and industry due to its excellent results in downstream applications. Existing deep learning approaches often utilize…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Tianpei Zhang , Jufeng Zhao , Yiming Zhu , Guangmang Cui , Yuhan Lyu

We present Supervised Deep Multimodal Matrix Factorization (SD3MF), an interpretable framework for integrative brain network analysis that generalizes Symmetric Nonnegative Matrix Tri-Factorization (SNMTF) from unsupervised single-graph…

Machine Learning · Computer Science 2026-05-14 Amjad Seyedi , Lifang He , Songlin Zhao , Akwum Onwunta , Nicolas Gillis

The dominant paradigm of monolithic scaling in Vision-Language Models (VLMs) is failing for understanding and reasoning in documents, yielding diminishing returns as it struggles with the inherent need of this domain for document-based…

Computer Vision and Pattern Recognition · Computer Science 2025-11-17 Xinlei Yu , Chengming Xu , Zhangquan Chen , Yudong Zhang , Shilin Lu , Cheng Yang , Jiangning Zhang , Shuicheng Yan , Xiaobin Hu

Multi-agent collaboration enhances the perception capabilities of individual agents through information sharing. However, in real-world applications, differences in sensors and models across heterogeneous agents inevitably lead to domain…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Junfei Zhou , Penglin Dai , Quanmin Wei , Bingyi Liu , Xiao Wu , Jianping Wang

Multimodal text-to-image generation remains constrained by the difficulty of maintaining semantic alignment and professional-level detail across diverse visual domains. We propose a multi-agent reinforcement learning framework that…

Artificial Intelligence · Computer Science 2025-10-14 Jiabao Shi , Minfeng Qi , Lefeng Zhang , Di Wang , Yingjie Zhao , Ziying Li , Yalong Xing , Ningran Li

As multimodal misinformation becomes more sophisticated, its detection and grounding are crucial. However, current multimodal verification methods, relying on passive holistic fusion, struggle with sophisticated misinformation. Due to…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Zizhao Chen , Ping Wei , Ziyang Ren , Huan Li , Xiangru Yin

Accurate prediction of others' trajectories is essential for autonomous driving. Trajectory prediction is challenging because it requires reasoning about agents' past movements, social interactions among varying numbers and kinds of agents,…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Tianyang Zhao , Yifei Xu , Mathew Monfort , Wongun Choi , Chris Baker , Yibiao Zhao , Yizhou Wang , Ying Nian Wu

Judge agents are fundamental to agentic AI frameworks: they provide automated evaluation, and enable iterative self-refinement of reasoning processes. We introduce JAF: Judge Agent Forest, a framework in which the judge agent conducts joint…

Artificial Intelligence · Computer Science 2026-02-02 Sahil Garg , Brad Cheezum , Sridhar Dutta , Vishal Agarwal

Collaborative perception in multi-agent system enhances overall perceptual capabilities by facilitating the exchange of complementary information among agents. Current mainstream collaborative perception methods rely on discretized feature…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Kang Yang , Tianci Bu , Lantao Li , Chunxu Li , Yongcai Wang , Deying Li

Semantic segmentation, as a crucial component of complex visual interpretation, plays a fundamental role in autonomous vehicle vision systems. Recent studies have significantly improved the accuracy of semantic segmentation by exploiting…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Danial Qashqai , Emad Mousavian , Shahriar Baradaran Shokouhi , Sattar Mirzakuchaki

This paper presents the Never Ending Open Learning Adaptive Framework (NEOLAF), an integrated neural-symbolic cognitive architecture that models and constructs intelligent agents. The NEOLAF framework is a superior approach to constructing…

Effective human-agent interaction (HAI) relies on accurate and adaptive perception of human emotional states. While multimodal deep learning models - leveraging facial expressions, speech, and textual cues - offer high accuracy in emotion…

Machine Learning · Computer Science 2025-12-15 Matvey Nepomnyaschiy , Oleg Pereziabov , Anvar Tliamov , Stanislav Mikhailov , Ilya Afanasyev

Although Reinforcement Learning (RL) agents are effective in well-defined environments, they often struggle to generalize their learned policies to dynamic settings due to their reliance on trial-and-error interactions. Recent work has…

Machine Learning · Computer Science 2025-08-26 Zhihao Dou , Dongfei Cui , Jun Yan , Weida Wang , Benteng Chen , Haoming Wang , Zeke Xie , Shufei Zhang

The demand for edge AI in vision-language tasks requires models that achieve real-time performance on resource-constrained devices with limited power and memory. This paper proposes two adaptive compression techniques -- Sparse Temporal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Md Tasnin Tanvir , Soumitra Das , Sk Md Abidar Rahaman , Ali Shiri Sichani

The emotion detection technology to enhance human decision-making is an important research issue for real-world applications, but real-life emotion datasets are relatively rare and small. The experiments conducted in this paper use the…

Computation and Language · Computer Science 2023-06-13 Théo Deschamps-Berger , Lori Lamel , Laurence Devillers

Compressed sensing MRI is a classic inverse problem in the field of computational imaging, accelerating the MR imaging by measuring less k-space data. The deep neural network models provide the stronger representation ability and faster…

Computer Vision and Pattern Recognition · Computer Science 2018-04-05 Zhiwen Fan , Liyan Sun , Xinghao Ding , Yue Huang , Congbo Cai , John Paisley

Fusion technique is a key research topic in multimodal sentiment analysis. The recent attention-based fusion demonstrates advances over simple operation-based fusion. However, these fusion works adopt single-scale, i.e., token-level or…

Computation and Language · Computer Science 2021-12-03 Huaishao Luo , Lei Ji , Yanyong Huang , Bin Wang , Shenggong Ji , Tianrui Li

Achieving machine intelligence requires a smooth integration of perception and reasoning, yet models developed to date tend to specialize in one or the other; sophisticated manipulation of symbols acquired from rich perceptual spaces has so…

Machine Learning · Computer Science 2018-09-14 Eric Crawford , Guillaume Rabusseau , Joelle Pineau

Emotion recognition plays a vital role in enhancing human-computer interaction. In this study, we tackle the MER-SEMI challenge of the MER2025 competition by proposing a novel multimodal emotion recognition framework. To address the issue…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Juewen Hu , Yexin Li , Jiulin Li , Shuo Chen , Pring Wong