中文
相关论文

相关论文: From Content to Audience: A Multimodal Annotation …

200 篇论文

Large language models (LLMs) offer strategy researchers powerful tools for annotating text at scale, but treating LLM-generated labels as deterministic overlooks substantial instability. Grounded in content analysis and generalizability…

计算机与社会 · 计算机科学 2026-01-21 Arnaldo Camuffo , Alfonso Gambardella , Saeid Kazemi , Jakub Malachowski , Abhinav Pandey

Large Language Models integrating textual and visual inputs have introduced new possibilities for interpreting complex data. Despite their remarkable ability to generate coherent and contextually relevant text based on visual stimuli, the…

人机交互 · 计算机科学 2025-01-08 Giulio Antonio Abbo , Tony Belpaeme

This paper presents a novel approach for temporal and semantic segmentation of edited videos into meaningful segments, from the point of view of the storytelling structure. The objective is to decompose a long video into more manageable…

计算机视觉与模式识别 · 计算机科学 2016-11-11 Lorenzo Baraldi , Costantino Grana , Rita Cucchiara

Multimodal Large Language Models (MLLMs) mimic human perception and reasoning system by integrating powerful Large Language Models (LLMs) with various modality encoders (e.g., vision, audio), positioning LLMs as the "brain" and various…

计算机视觉与模式识别 · 计算机科学 2024-08-29 Jiaxing Huang , Jingyi Zhang

Large multimodal models (LMMs) are processing increasingly longer and richer inputs. Albeit the progress, few public benchmark is available to measure such development. To mitigate this gap, we introduce LongVideoBench, a question-answering…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Haoning Wu , Dongxu Li , Bei Chen , Junnan Li

Multimodal large language models (MLLMs) hold the potential to enhance autonomous driving by combining domain-independent world knowledge with context-specific language guidance. Their integration into autonomous driving systems shows…

计算机视觉与模式识别 · 计算机科学 2025-03-17 Tin Stribor Sohn , Philipp Reis , Maximilian Dillitzer , Johannes Bach , Jason J. Corso , Eric Sax

Although Multimodal Large Language Models (MLLMs) demonstrate strong omni-modal perception, their ability to forecast future events from audio-visual cues remains largely unexplored, as existing benchmarks focus mainly on retrospective…

计算与语言 · 计算机科学 2026-01-21 Qian Chen , Jinlan Fu , Changsong Li , See-Kiong Ng , Xipeng Qiu

Vision Language Models (VLMs) have shown strong performance on multimodal reasoning tasks, yet most evaluations focus on short videos and assume unconstrained computational resources. In industrial settings such as pharmaceutical content…

计算机视觉与模式识别 · 计算机科学 2026-01-09 Suyash Mishra , Qiang Li , Srikanth Patil , Satyanarayan Pati , Baddu Narendra

Multimodal language analysis is a rapidly evolving field that leverages multiple modalities to enhance the understanding of high-level semantics underlying human conversational utterances. Despite its significance, little research has…

计算与语言 · 计算机科学 2025-04-25 Hanlei Zhang , Zhuohang Li , Yeshuang Zhu , Hua Xu , Peiwu Wang , Haige Zhu , Jie Zhou , Jinchao Zhang

Generalizing Multimodal Large Language Models (MLLMs) to novel video domains is essential for real-world deployment but remains challenging due to the scarcity of labeled data. While In-Context Learning (ICL) offers a training-free…

计算机视觉与模式识别 · 计算机科学 2026-01-23 Ryo Fujii , Hideo Saito , Ryo Hachiuma

Although Large Vision Language Models (LVLMs) have demonstrated impressive multimodal reasoning capabilities, their scalability and deployment are constrained by massive computational requirements. In particular, the massive amount of…

机器学习 · 计算机科学 2026-04-14 Surendra Pathak , Bo Han

Deep learning models for autonomous driving, encompassing perception, planning, and control, depend on vast datasets to achieve their high performance. However, their generalization often suffers due to domain-specific data distributions,…

计算机视觉与模式识别 · 计算机科学 2025-04-08 Esteban Rivera , Jannik Lübberstedt , Nico Uhlemann , Markus Lienkamp

Multimodal Large Language models (MLLMs) have shown promise in web-related tasks, but evaluating their performance in the web domain remains a challenge due to the lack of comprehensive benchmarks. Existing benchmarks are either designed…

计算与语言 · 计算机科学 2024-04-10 Junpeng Liu , Yifan Song , Bill Yuchen Lin , Wai Lam , Graham Neubig , Yuanzhi Li , Xiang Yue

Accurate dialogue description in audiovisual video captioning is crucial for downstream understanding and generation tasks. However, existing models generally struggle to produce faithful dialogue descriptions within audiovisual captions.…

We present Rodent-Bench, a novel benchmark designed to evaluate the ability of Multimodal Large Language Models (MLLMs) to annotate rodent behaviour footage. We evaluate state-of-the-art MLLMs, including Gemini-2.5-Pro, Gemini-2.5-Flash and…

计算机视觉与模式识别 · 计算机科学 2026-02-24 Thomas Heap , Laurence Aitchison , Emma Cahill , Adriana Casado Rodriguez

Large Multimodal Models (LMMs) encode rich factual knowledge via cross-modal pre-training, yet their static representations struggle to maintain an accurate understanding of time-sensitive factual knowledge. Existing benchmarks remain…

计算与语言 · 计算机科学 2026-04-08 Kailin Jiang , Ning Jiang , Yuntao Du , Yuchen Ren , Yuchen Li , Yifan Gao , Jinhe Bi , Yunpu Ma , Bin Li , Lei Liu , Qing Li

With the ever-increasing number of news stories available online, classifying them by topic, regardless of the language they are written in, has become crucial for enhancing readers' access to relevant content. To address this challenge, we…

计算与语言 · 计算机科学 2025-11-11 Taja Kuzman , Nikola Ljubešić

We introduce MAIA (Multimodal AI Assessment), a native-Italian benchmark designed for fine-grained investigation of the reasoning abilities of visual language models on videos. MAIA differs from other available video benchmarks for its…

Propaganda detection on social media remains challenging due to task complexity and limited high-quality labeled data. This paper introduces a novel framework that combines human expertise with Large Language Model (LLM) assistance to…

计算与语言 · 计算机科学 2025-07-25 Ariana Sahitaj , Premtim Sahitaj , Veronika Solopova , Jiaao Li , Sebastian Möller , Vera Schmitt

Advertisement videos serve as a rich and valuable source of purpose-driven information, encompassing high-quality visual, textual, and contextual cues designed to engage viewers. They are often more complex than general videos of similar…

计算机视觉与模式识别 · 计算机科学 2025-10-14 Zheyuan Zhang , Monica Dou , Linkai Peng , Hongyi Pan , Ulas Bagci , Boqing Gong