English
Related papers

Related papers: ImplicitAVE: An Open-Source Dataset and Multimodal…

200 papers

In recent times, a considerable number of research studies have been carried out to address the issue of Missing Value Imputation (MVI). MVI aims to provide a primary solution for datasets that have one or more missing attribute values. The…

Machine Learning · Computer Science 2024-10-14 Abu Fuad Ahmad , Khaznah Alshammari , Istiaque Ahmed , MD Shohel Sayed

Large language models (LLMs) can underpin AI assistants that help users with everyday tasks, such as by making recommendations or performing basic computation. Despite AI assistants' promise, little is known about the implicit values these…

Computation and Language · Computer Science 2025-10-07 Arjun Arunasalam , Madison Pickering , Z. Berkay Celik , Blase Ur

We introduce InternVL3, a significant advancement in the InternVL series featuring a native multimodal pre-training paradigm. Rather than adapting a text-only large language model (LLM) into a multimodal large language model (MLLM) that…

Multimodal conversational recommendation has recently emerged as a promising paradigm for delivering personalized experiences through natural dialogue enriched by visual and contextual grounding. Yet currently available multimodal…

Information Retrieval · Computer Science 2026-05-29 David Guo , Minqi Sun , Yilun Jiang , Jiazhou Liang , Scott Sanner

The surge of LLM studies makes synthesizing their findings challenging. Analysis of experimental results from literature can uncover important trends across studies, but the time-consuming nature of manual data extraction limits its use.…

Computation and Language · Computer Science 2025-05-27 Jungsoo Park , Junmo Kang , Gabriel Stanovsky , Alan Ritter

This paper introduces Evalverse, a novel library that streamlines the evaluation of Large Language Models (LLMs) by unifying disparate evaluation tools into a single, user-friendly framework. Evalverse enables individuals with limited…

Computation and Language · Computer Science 2024-10-08 Jihoo Kim , Wonho Song , Dahyun Kim , Yunsu Kim , Yungi Kim , Chanjun Park

Recent advances in multimodal large language models (MLLMs) have demonstrated remarkable multi- and cross-modal integration capabilities. However, their potential for fine-grained emotion understanding remains systematically underexplored.…

Human-Computer Interaction · Computer Science 2025-12-25 Jing Han , Zhiqiang Gao , Shihao Gao , Jialing Liu , Hongyu Chen , Zixing Zhang , Björn W. Schuller

Multimodal Large Language Models (MLLMs) have made significant strides by combining visual recognition and language understanding to generate content that is both coherent and contextually accurate. However, MLLMs continue to struggle with…

Computer Vision and Pattern Recognition · Computer Science 2025-07-22 Haoran Zhou , Zihan Zhang , Hao Chen

Large language models (LLMs) have demonstrated remarkable capabilities in text analysis tasks, yet their evaluation on complex, real-world applications remains challenging. We define a set of tasks, Multi-Insight Multi-Document Extraction…

Computation and Language · Computer Science 2024-12-02 John Francis , Saba Esnaashari , Anton Poletaev , Sukankana Chakraborty , Youmna Hashem , Jonathan Bright

Self-evolution of multimodal large language models (MLLMs) remains a critical challenge: pseudo-label-based methods suffer from progressive quality degradation as model predictions drift, while template-based methods are confined to a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Yongrui Heng , Chaoya Jiang , Han Yang , Shikun Zhang , Wei Ye

Adapting large language models (LLMs) to specific domains often faces a critical bottleneck: the scarcity of high-quality, human-curated data. While large volumes of unchecked data are readily available, indiscriminately using them for…

Computation and Language · Computer Science 2025-09-09 Jian Wu , Hang Yu , Bingchang Liu , Wenjie Yang , Peng Di , Jianguo Li , Yue Zhang

Multimodal large language models (MLLMs) are changing how Blind and Low Vision (BLV) people access visual information. Unlike traditional visual interpretation tools that only provide descriptions, MLLM-enabled applications offer…

Human-Computer Interaction · Computer Science 2026-02-20 Ricardo E. Gonzalez Penuela , Crescentia Jung , Sharon Y Lin , Ruiying Hu , Shiri Azenkot

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

Computation and Language · Computer Science 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

The advances of large foundation models necessitate wide-coverage, low-cost, and zero-contamination benchmarks. Despite continuous exploration of language model evaluations, comprehensive studies on the evaluation of Large Multi-modal…

Computation and Language · Computer Science 2025-09-19 Kaichen Zhang , Bo Li , Peiyuan Zhang , Fanyi Pu , Joshua Adrian Cahyono , Kairui Hu , Shuai Liu , Yuanhan Zhang , Jingkang Yang , Chunyuan Li , Ziwei Liu

Multimodal large language models (MLLMs) are now routinely deployed for visual understanding, generation, and curation. A substantial fraction of these applications require an explicit aesthetic judgment. Most existing solutions reduce this…

Group-based policy optimization methods like GRPO and GSPO have become standard for training multimodal models, leveraging group-wise rollouts and relative advantage estimation. However, they suffer from a critical \emph{gradient vanishing}…

Machine Learning · Computer Science 2025-11-25 Zengjie Hu , Jiantao Qiu , Tianyi Bai , Haojin Yang , Binhang Yuan , Qi Jing , Conghui He , Wentao Zhang

Large Multimodal Models (LMMs) have ushered in a new era in artificial intelligence, merging capabilities in both language and vision to form highly capable Visual Foundation Agents. These agents are postulated to excel across a myriad of…

The rapid advancement of Large Multi-modal Models (LMMs) has enabled their application in scientific problem-solving, yet their fine-grained capabilities remain under-explored. In this paper, we introduce SciVerse, a multi-modal scientific…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Ziyu Guo , Ray Zhang , Hao Chen , Jialin Gao , Dongzhi Jiang , Jiaze Wang , Pheng-Ann Heng

Multimodal Affective Computing (MAC) aims to recognize and interpret human emotions by integrating information from diverse modalities such as text, video, and audio. Recent advancements in Multimodal Large Language Models (MLLMs) have…

Artificial Intelligence · Computer Science 2025-08-05 Miaosen Luo , Jiesen Long , Zequn Li , Yunying Yang , Yuncheng Jiang , Sijie Mai

Usability evaluation is an essential method to support the design of effective and intuitive user interfaces (UIs). However, it commonly relies on resource-intensive, expert-driven methods, which limit its accessibility, especially for…

Software Engineering · Computer Science 2026-04-13 Sebastian Lubos , Alexander Felfernig , Damian Garber , Gerhard Leitner , Julian Schwazer , Manuel Henrich