English
Related papers

Related papers: UEval: A Benchmark for Unified Multimodal Generati…

200 papers

The furnishing of multi-modal large language models (MLLMs) has led to the emergence of numerous benchmark studies, particularly those evaluating their perception and understanding capabilities. Among these, understanding image-evoked…

Multimedia · Computer Science 2025-09-18 Lancheng Gao , Ziheng Jia , Yunhao Zeng , Wei Sun , Yiming Zhang , Wei Zhou , Guangtao Zhai , Xiongkuo Min

Source attribution aims to enhance the reliability of AI-generated answers by including references for each statement, helping users validate the provided answers. However, existing work has primarily focused on text-only scenario and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-19 Seokwon Song , Minsu Park , Gunhee Kim

We introduce Generative Universal Verifier, a novel concept and plugin designed for next-generation multimodal reasoning in vision-language models and unified multimodal models, providing the fundamental capability of reflection and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Xinchen Zhang , Xiaoying Zhang , Youbin Wu , Yanbin Cao , Renrui Zhang , Ruihang Chu , Ling Yang , Yujiu Yang

Large Language Models (LLMs) are predominantly assessed based on their common sense reasoning, language comprehension, and logical reasoning abilities. While models trained in specialized domains like mathematics or coding have demonstrated…

Software Engineering · Computer Science 2026-01-08 Danny Brahman , Mohammad Mahoor

Multimodal Retrieval-Augmented Generation (MRAG) enhances reasoning capabilities by integrating external knowledge. However, existing benchmarks primarily focus on simple image-text interactions, overlooking complex visual formats like…

Artificial Intelligence · Computer Science 2025-02-21 Yuming Yang , Jiang Zhong , Li Jin , Jingwang Huang , Jingpeng Gao , Qing Liu , Yang Bai , Jingyuan Zhang , Rui Jiang , Kaiwen Wei

Unified multimodal large language models (U-MLLMs) have demonstrated impressive performance in visual understanding and generation in an end-to-end pipeline. Compared with generation-only models (e.g., Stable Diffusion), U-MLLMs may raise…

Computation and Language · Computer Science 2025-02-06 Ming Liu , Hao Chen , Jindong Wang , Liwen Wang , Bhiksha Raj Ramakrishnan , Wensheng Zhang

Multimodal large language models (LLMs) are increasingly used to generate dermatology diagnostic narratives directly from images. However, reliable evaluation remains the primary bottleneck for responsible clinical deployment. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2026-01-13 Yuhao Shen , Jiahe Qian , Shuping Zhang , Zhangtianyi Chen , Tao Lu , Juexiao Zhou

Reasoning is central to human intelligence, enabling structured problem-solving across diverse tasks. Recent advances in large language models (LLMs) have greatly enhanced their reasoning abilities in arithmetic, commonsense, and symbolic…

Humans construct internal world models and reason by manipulating the concepts within these models. Recent advances in AI, particularly chain-of-thought (CoT) reasoning, approximate such human cognitive abilities, where world models are…

Artificial Intelligence · Computer Science 2026-01-28 Jialong Wu , Xiaoying Zhang , Hongyi Yuan , Xiangcheng Zhang , Tianhao Huang , Changjing He , Chaoyi Deng , Renrui Zhang , Youbin Wu , Mingsheng Long

Personalized text generation presents a specialized mechanism for delivering content that is specific to a user's personal context. While the research progress in this area has been rapid, evaluation still presents a challenge. Traditional…

Computation and Language · Computer Science 2023-10-19 Yaqing Wang , Jiepu Jiang , Mingyang Zhang , Cheng Li , Yi Liang , Qiaozhu Mei , Michael Bendersky

Multimodal Large Language Models (MLLMs) have shown strong performance in visual and audio understanding when evaluated in isolation. However, their ability to jointly reason over omni-modal (visual, audio, and textual) signals in long and…

The advances of large foundation models necessitate wide-coverage, low-cost, and zero-contamination benchmarks. Despite continuous exploration of language model evaluations, comprehensive studies on the evaluation of Large Multi-modal…

Computation and Language · Computer Science 2025-09-19 Kaichen Zhang , Bo Li , Peiyuan Zhang , Fanyi Pu , Joshua Adrian Cahyono , Kairui Hu , Shuai Liu , Yuanhan Zhang , Jingkang Yang , Chunyuan Li , Ziwei Liu

Large language models (LLMs) have demonstrated remarkable advances in mathematical and logical reasoning, yet statistics, as a distinct and integrative discipline, remains underexplored in benchmarking efforts. To address this gap, we…

Although existing unified models achieve strong performance in vision-language understanding and text-to-image generation, they remain limited in addressing image perception and manipulation -- capabilities increasingly demanded in…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Bin Lin , Zongjian Li , Xinhua Cheng , Yuwei Niu , Yang Ye , Xianyi He , Shenghai Yuan , Wangbo Yu , Shaodong Wang , Yunyang Ge , Yatian Pang , Li Yuan

Recent works have made notable advancements in enhancing unified models for text-to-image generation through the Chain-of-Thought (CoT). However, these reasoning methods separate the processes of understanding and generation, which limits…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Yuanhuiyi Lyu , Chi Kit Wong , Chenfei Liao , Lutao Jiang , Xu Zheng , Zexin Lu , Linfeng Zhang , Xuming Hu

Retrieval-Augmented Generation (RAG) is a powerful approach that enables large language models (LLMs) to incorporate external knowledge. However, evaluating the effectiveness of RAG systems in specialized scenarios remains challenging due…

Computation and Language · Computer Science 2025-03-05 Kunlun Zhu , Yifan Luo , Dingling Xu , Yukun Yan , Zhenghao Liu , Shi Yu , Ruobing Wang , Shuo Wang , Yishan Li , Nan Zhang , Xu Han , Zhiyuan Liu , Maosong Sun

Recent progress in text-to-image (T2I) generation underscores the importance of reliable benchmarks in evaluating how accurately generated images reflect the semantics of their textual prompt. However, (1) existing benchmarks lack the…

Computer Vision and Pattern Recognition · Computer Science 2026-02-25 Yibin Wang , Zhimin Li , Yuhang Zang , Jiazi Bu , Yujie Zhou , Yi Xin , Junjun He , Chunyu Wang , Qinglin Lu , Cheng Jin , Jiaqi Wang

Visual reasoning is central to human cognition, enabling individuals to interpret and abstractly understand their environment. Although recent Multimodal Large Language Models (MLLMs) have demonstrated impressive performance across language…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Jing Bi , Junjia Guo , Susan Liang , Guangyu Sun , Luchuan Song , Yunlong Tang , Jinxi He , Jiarui Wu , Ali Vosoughi , Chen Chen , Chenliang Xu

We introduce MAIA (Multimodal AI Assessment), a native-Italian benchmark designed for fine-grained investigation of the reasoning abilities of visual language models on videos. MAIA differs from other available video benchmarks for its…

The field of advanced text-to-image generation is witnessing the emergence of unified frameworks that integrate powerful text encoders, such as CLIP and T5, with Diffusion Transformer backbones. Although there have been efforts to control…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Liang Chen , Shuai Bai , Wenhao Chai , Weichu Xie , Haozhe Zhao , Leon Vinci , Junyang Lin , Baobao Chang