English
Related papers

Related papers: MDSEval: A Meta-Evaluation Benchmark for Multimoda…

200 papers

Multi-document summarization (MDS) is an effective tool for information aggregation that generates an informative and concise summary from a cluster of topic-related documents. Our survey, the first of its kind, systematically overviews the…

Computation and Language · Computer Science 2021-12-10 Congbo Ma , Wei Emma Zhang , Mingyu Guo , Hu Wang , Quan Z. Sheng

As conversational AI-based dialogue management has increasingly become a trending topic, the need for a standardized and reliable evaluation procedure grows even more pressing. The current state of affairs suggests various evaluation…

Computation and Language · Computer Science 2020-06-12 Sarah E. Finch , Jinho D. Choi

Demand for mental health support through AI chatbots is surging, though current systems present several limitations, like sycophancy or overvalidation, and reinforcement of maladaptive beliefs. A core obstacle to the creation of better…

Computation and Language · Computer Science 2025-12-08 José Pombal , Maya D'Eon , Nuno M. Guerreiro , Pedro Henrique Martins , António Farinhas , Ricardo Rei

The rise of Multimodal Large Language Models (MLLMs) has become a transformative force in the field of artificial intelligence, enabling machines to process and generate content across multiple modalities, such as text, images, audio, and…

Computation and Language · Computer Science 2025-12-09 Ming Li , Keyu Chen , Ziqian Bi , Ming Liu , Xinyuan Song , Zekun Jiang , Tianyang Wang , Benji Peng , Qian Niu , Junyu Liu , Jinlang Wang , Sen Zhang , Xuanhe Pan , Jiawei Xu , Pohsun Feng

Summarization is one of the key features of human intelligence. It plays an important role in understanding and representation. With rapid and continual expansion of texts, pictures and videos in cyberspace, automatic summarization becomes…

Computation and Language · Computer Science 2015-07-02 Hai Zhuge

Multimodal Large Language Model (MLLM) relies on the powerful LLM to perform multimodal tasks, showing amazing emergent abilities in recent studies, such as writing poems based on an image. However, it is difficult for these case studies to…

Computer Vision and Pattern Recognition · Computer Science 2025-10-27 Chaoyou Fu , Peixian Chen , Yunhang Shen , Yulei Qin , Mengdan Zhang , Xu Lin , Jinrui Yang , Xiawu Zheng , Ke Li , Xing Sun , Yunsheng Wu , Rongrong Ji , Caifeng Shan , Ran He

Instruction-tuned language models increasingly rely on large multi-turn dialogue corpora, but these datasets are often noisy and structurally inconsistent, with topic drift, repetitive chitchat, and mismatched answer formats across turns.…

Computation and Language · Computer Science 2026-04-21 Bo Li , Shikun Zhang , Wei Ye

Text summarization has a wide range of applications in many scenarios. The evaluation of the quality of the generated text is a complex problem. A big challenge to language evaluation is that there is a clear divergence between existing…

Computation and Language · Computer Science 2023-09-20 Ning Wu , Ming Gong , Linjun Shou , Shining Liang , Daxin Jiang

The new era of technology has brought us to the point where it is convenient for people to share their opinions over an abundance of platforms. These platforms have a provision for the users to express themselves in multiple forms of…

Computation and Language · Computer Science 2023-02-14 Anubhav Jangra , Sourajit Mukherjee , Adam Jatowt , Sriparna Saha , Mohammad Hasanuzzaman

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

Computation and Language · Computer Science 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

Product reviews summarization is a type of Multi-Document Summarization (MDS) task in which the summarized document sets are often far larger than in traditional MDS (up to tens of thousands of reviews). We highlight this difference and…

Computation and Language · Computer Science 2020-07-23 Ori Shapira , Ran Levy

Dialogue summarization aims to condense the lengthy dialogue into a concise summary, and has recently achieved significant progress. However, the result of existing methods is still far from satisfactory. Previous works indicated that…

Computation and Language · Computer Science 2023-05-12 Yicheng Zou , Kaitao Song , Xu Tan , Zhongkai Fu , Qi Zhang , Dongsheng Li , Tao Gui

We present ClidSum, a benchmark dataset for building cross-lingual summarization systems on dialogue documents. It consists of 67k+ dialogue documents from two subsets (i.e., SAMSum and MediaSum) and 112k+ annotated summaries in different…

Computation and Language · Computer Science 2022-10-18 Jiaan Wang , Fandong Meng , Ziyao Lu , Duo Zheng , Zhixu Li , Jianfeng Qu , Jie Zhou

Multimedia summarization with multimodal output can play an essential role in real-world applications, i.e., automatically generating cover images and titles for news articles or providing introductions to online videos. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2022-04-11 Jielin Qiu , Jiacheng Zhu , Mengdi Xu , Franck Dernoncourt , Trung Bui , Zhaowen Wang , Bo Li , Ding Zhao , Hailin Jin

Spoken Dialogue Models (SDMs) have advanced rapidly, yet their ability to sustain genuinely interactive multi-turn conversations remains underexplored, as most benchmarks focus on single-turn exchanges. We introduce Multi-Bench, the first…

Audio and Speech Processing · Electrical Eng. & Systems 2025-11-04 Yayue Deng , Guoqiang Hu , Haiyang Sun , Xiangyu Zhang , Haoyang Zhang , Fei Tian , Xuerui Yang , Gang Yu , Eng Siong Chng

Dialogue summarization aims to provide a concise and coherent summary of conversations between multiple speakers. While recent advancements in language models have enhanced this process, summarizing dialogues accurately and faithfully…

Computation and Language · Computer Science 2024-09-17 Eunice Akani , Benoit Favre , Frederic Bechet , Romain Gemignani

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated significant potential in recommendation systems. However, the effective application of MLLMs to multimodal sequential recommendation remains unexplored: A)…

Information Retrieval · Computer Science 2025-12-25 Haoyu Wang , Yitong Wang , Jining Wang

We investigate a critical yet under-explored question in Large Vision-Language Models (LVLMs): Do LVLMs genuinely comprehend interleaved image-text in the document? Existing document understanding benchmarks often assess LVLMs using…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Haolong Yan , Kaijun Tan , Yeqing Shen , Xin Huang , Zheng Ge , Xiangyu Zhang , Si Li , Daxin Jiang

The main limiting factor in the development of robust multilingual dialogue evaluation metrics is the lack of multilingual data and the limited availability of open sourced multilingual dialogue systems. In this work, we propose a…

Computation and Language · Computer Science 2023-09-01 John Mendonça , Alon Lavie , Isabel Trancoso

Evaluating the quality of a dialogue system is an understudied problem. The recent evolution of evaluation method motivated this survey, in which an explicit and comprehensive analysis of the existing methods is sought. We are first to…

Computation and Language · Computer Science 2021-08-04 Xinmeng Li , Wansen Wu , Long Qin , Quanjun Yin