English
Related papers

Related papers: MAGE: Multimodal Alignment and Generation Enhancem…

200 papers

Large language models (LLMs) have achieved human-level text generation, emphasizing the need for effective AI-generated text detection to mitigate risks like the spread of fake news and plagiarism. Existing research has been constrained by…

Computation and Language · Computer Science 2024-05-22 Yafu Li , Qintong Li , Leyang Cui , Wei Bi , Zhilin Wang , Longyue Wang , Linyi Yang , Shuming Shi , Yue Zhang

The development of Large Language Models (LLMs) has catalyzed automation in customer service, yet benchmarking their performance remains challenging. Existing benchmarks predominantly rely on static paradigms and single-dimensional metrics,…

Artificial Intelligence · Computer Science 2026-04-13 Ling Shi , Yuqin Dai , Ziyin Wang , Ning Gao , Wei Zhang , Chaozheng Wang , Yujie Wang , Wei He , Jinpeng Wang , Deiyi Xiong

Multimodal-attributed graphs (MAGs) are a fundamental data structure for multimodal graph learning (MGL), enabling both graph-centric and modality-centric tasks. However, our empirical analysis reveals inherent topology quality limitations…

Machine Learning · Computer Science 2026-03-31 Yinlin Zhu , Xunkai Li , Di Wu , Wang Luo , Miao Hu , Di Wu

With the development of multimedia systems, multimodal recommendations are playing an essential role, as they can leverage rich contexts beyond interactions. Existing methods mainly regard multimodal information as an auxiliary, using them…

Information Retrieval · Computer Science 2024-08-02 Yifan Liu , Kangning Zhang , Xiangyuan Ren , Yanhua Huang , Jiarui Jin , Yingjie Qin , Ruilong Su , Ruiwen Xu , Yong Yu , Weinan Zhang

Deep learning based image enhancement models have largely improved the readability of fundus images in order to decrease the uncertainty of clinical observations and the risk of misdiagnosis. However, due to the difficulty of acquiring…

Image and Video Processing · Electrical Eng. & Systems 2023-02-24 Erjian Guo , Huazhu Fu , Luping Zhou , Dong Xu

Recent advancements in large language models (LLMs) and multi-modal LLMs have been remarkable. However, these models still rely solely on their parametric knowledge, which limits their ability to generate up-to-date information and…

Artificial Intelligence · Computer Science 2025-04-22 Zihan Ling , Zhiyao Guo , Yixuan Huang , Yi An , Shuai Xiao , Jinsong Lan , Xiaoyong Zhu , Bo Zheng

Text-to-image generation increasingly demands access to domain-specific, fine-grained, and rapidly evolving knowledge that pretrained models cannot fully capture, necessitating the integration of retrieval methods. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Mengdan Zhu , Senhao Cheng , Guangji Bai , Yifei Zhang , Liang Zhao

Multimodal Retrieval-Augmented Generation (Visual RAG) significantly advances question answering by integrating visual and textual evidence. Yet, current evaluations fail to systematically account for query difficulty and ambiguity. We…

Computation and Language · Computer Science 2026-01-14 Yuelyu Ji , Wuwei Lan , Patrick NG

This survey provides a comprehensive overview of recent advances in multimodal alignment and fusion within the field of machine learning, driven by the increasing availability and diversity of data modalities such as text, images, audio,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-14 Songtao Li , Hao Tang

Large AI models have been widely adopted in wireless communications for channel modeling, beamforming, and resource optimization. However, most existing efforts remain limited to single-modality inputs and channel-specific objec- tives,…

Machine Learning · Computer Science 2025-11-18 Zhizhen Li , Xuanhao Luo , Xueren Ge , Longyu Zhou , Xingqin Lin , Yuchen Liu

While thinking-aware generation aims to improve performance on complex tasks, we identify a critical failure mode where existing sequential, autoregressive approaches can paradoxically degrade performance due to error propagation. To…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Ye Tian , Ling Yang , Jiongfan Yang , Anran Wang , Yu Tian , Jiani Zheng , Haochen Wang , Zhiyang Teng , Zhuochen Wang , Yinjie Wang , Yunhai Tong , Mengdi Wang , Xiangtai Li

Multimodal Large Language Models (MLLMs) have demonstrated impressive progress in single-image grounding and general multi-image understanding. Recently, some methods begin to address multi-image grounding. However, they are constrained by…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Shurong Zheng , Yousong Zhu , Hongyin Zhao , Fan Yang , Yufei Zhan , Ming Tang , Jinqiao Wang

Despite significant progress in diffusion-based image generation, subject-driven generation and instruction-based editing remain challenging. Existing methods typically treat them separately, struggling with limited high-quality data and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Xueyun Tian , Wei Li , Bingbing Xu , Yige Yuan , Yuanzhuo Wang , Huawei Shen

Multimodal large language models (MLLMs) have demonstrated impressive capabilities across various vision-language tasks. However, a generalist MLLM typically underperforms compared with a specialist MLLM on most VL tasks, which can be…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Leyang Shen , Gongwei Chen , Rui Shao , Weili Guan , Liqiang Nie

The variance in class-wise sample sizes within long-tailed scenarios often results in degraded performance in less frequent classes. Fortunately, foundation models, pre-trained on vast open-world datasets, demonstrate strong potential for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-18 Yufei Peng , Yonggang Zhang , Yiu-ming Cheung

The vision of an inclusive World Wide Web is impeded by a severe linguistic divide, particularly for communities in low-resource regions of Southeast Asia. While large language models (LLMs) offer a potential solution for translation, their…

Computation and Language · Computer Science 2026-03-23 Zhixiang Lu , Chong Zhang , Yulong Li , Angelos Stefanidis , Anh Nguyen , Imran Razzak , Jionglong Su , Zhengyong Jiang

The rapid evolution of mobile edge computing (MEC) has introduced significant challenges in optimizing resource allocation in highly dynamic wireless communication systems, in which task offloading decisions should be made in real-time.…

Signal Processing · Electrical Eng. & Systems 2024-12-31 Runtao Ren , Yinyu Wu , Xuhui Zhang , Jinke Ren , Yanyan Shen , Shuqiang Wang , Kim-Fung Tsang

Visual latent reasoning lets a multimodal large language model (MLLM) create intermediate visual evidence as continuous tokens, avoiding external tools or image generators. However, existing methods usually follow an output-as-input latent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Yanting Miao , Yutao Sun , Dexin Wang , Mengyu Zhou , Pascal Poupart , Lei Lv , Qi Zhao , Li Wang , Hao Li , Xiaoxi Jiang , Guanjun Jiang

Seamless integration of virtual and physical worlds in augmented reality benefits from the system semantically "understanding" the physical environment. AR research has long focused on the potential of context awareness, demonstrating novel…

Human-Computer Interaction · Computer Science 2024-10-08 Chengyuan Xu , Radha Kumaran , Noah Stier , Kangyou Yu , Tobias Höllerer

The rapid advancement of large vision-language models (LVLMs) has driven significant progress in multimodal tasks, enabling models to interpret, reason, and generate outputs across both visual and textual domains. While excelling in…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Hao Yu , Zhuokai Zhao , Shen Yan , Lukasz Korycki , Jianyu Wang , Baosheng He , Jiayi Liu , Lizhu Zhang , Xiangjun Fan , Hanchao Yu