中文
相关论文

相关论文: LIMSSR: LLM-Driven Sequence-to-Score Reasoning und…

200 篇论文

Following the success of Large Language Models (LLMs), Large Multimodal Models (LMMs), such as the Flamingo model and its subsequent competitors, have started to emerge as natural steps towards generalist agents. However, interacting with…

计算机视觉与模式识别 · 计算机科学 2024-01-23 Mustafa Shukor , Alexandre Rame , Corentin Dancette , Matthieu Cord

Reinforcement Learning (RL) has shown promise in improving the reasoning abilities of Large Language Models (LLMs). However, the specific challenges of adapting RL to multimodal data and formats remain relatively unexplored. In this work,…

机器学习 · 计算机科学 2025-05-20 Zirun Guo , Minjie Hong , Tao Jin

Multimodal Large Language Model (MLLM) relies on the powerful LLM to perform multimodal tasks, showing amazing emergent abilities in recent studies, such as writing poems based on an image. However, it is difficult for these case studies to…

计算机视觉与模式识别 · 计算机科学 2025-10-27 Chaoyou Fu , Peixian Chen , Yunhang Shen , Yulei Qin , Mengdan Zhang , Xu Lin , Jinrui Yang , Xiawu Zheng , Ke Li , Xing Sun , Yunsheng Wu , Rongrong Ji , Caifeng Shan , Ran He

Motivated by in-context learning (ICL) capabilities of Large Language Models (LLMs), multimodal LLMs with additional visual modality are also exhibited with similar ICL abilities when multiple image-text pairs are provided as…

计算机视觉与模式识别 · 计算机科学 2025-02-10 Nan Xu , Fei Wang , Sheng Zhang , Hoifung Poon , Muhao Chen

Multimodal in-context learning (ICL) equips Large Vision-language Models (LVLMs) with the ability to adapt to new tasks via multiple user-provided demonstrations, without requiring any model parameter updates. However, its effectiveness is…

计算机视觉与模式识别 · 计算机科学 2025-08-27 Yanshu Li , Yi Cao , Hongyang He , Qisen Cheng , Xiang Fu , Xi Xiao , Tianyang Wang , Ruixiang Tang

Multimodal reasoning with large language models (LLMs) often suffers from hallucinations and the presence of deficient or outdated knowledge within LLMs. Some approaches have sought to mitigate these issues by employing textual knowledge…

计算与语言 · 计算机科学 2024-06-06 Junlin Lee , Yequan Wang , Jing Li , Min Zhang

Multimodal Large Language Models (MLLMs) have recently been proposed as a means to generate natural-language explanations for face recognition decisions. While such explanations facilitate human interpretability, their reliability on…

计算机视觉与模式识别 · 计算机科学 2026-03-30 Redwan Sony , Anil K Jain , Arun Ross

Multimodal fake news detection is crucial for mitigating societal disinformation. Existing approaches attempt to address this by fusing multimodal features or leveraging Large Language Models (LLMs) for advanced reasoning. However, these…

计算与语言 · 计算机科学 2026-03-23 Weilin Zhou , Shanwen Tan , Enhao Gu , Yurong Qian

Rapid and accurate situational awareness is essential for effective response during natural disasters, where delays in analysis can significantly hinder decision-making. Training task-specific models for post-disaster assessment is often…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Armin Zarbaft , Ehsan Karimi , Nhut Le , Maryam Rahnemoonfar

In-context learning (ICL), a predominant trend in instruction learning, aims at enhancing the performance of large language models by providing clear task guidance and examples, improving their capability in task understanding and…

计算机视觉与模式识别 · 计算机科学 2025-06-12 Cheng Chen , Yunpeng Zhai , Yifan Zhao , Jinyang Gao , Bolin Ding , Jia Li

To address the modality learning degeneration caused by modality imbalance, existing multimodal learning~(MML) approaches primarily attempt to balance the optimization process of each modality from the perspective of model learning.…

机器学习 · 计算机科学 2025-03-07 Qingyuan Jiang , Zhouyang Chi , Xiao Ma , Qirong Mao , Yang Yang , Jinhui Tang

Recent advancements in multimodal large language models (MLLMs) have aimed to integrate and interpret data across diverse modalities. However, the capacity of these models to concurrently process and reason about multiple modalities remains…

In-context learning (ICL) facilitates Large Language Models (LLMs) exhibiting emergent ability on downstream tasks without updating billions of parameters. However, in the area of multi-modal Large Language Models (MLLMs), two problems…

多媒体 · 计算机科学 2024-07-02 Jun Gao , Qian Qiao , Ziqiang Cao , Zili Wang , Wenjie Li

Multimodal large language models (MLLMs) show promise in tasks like visual question answering (VQA) but still face challenges in multimodal reasoning. Recent works adapt agentic frameworks or chain-of-thought (CoT) reasoning to improve…

Multi-modal semantic segmentation (MMSS) faces significant challenges in real-world applications due to incomplete, degraded, or missing sensor data. While current MMSS methods typically use self-distillation with modality dropout to…

计算机视觉与模式识别 · 计算机科学 2025-08-19 Jiaqi Tan , Xu Zheng , Yang Liu

Multimodal Large Language Models (MLLMs) have achieved remarkable progress in multimodal reasoning. However, they often excessively rely on textual information during the later stages of inference, neglecting the crucial integration of…

计算机视觉与模式识别 · 计算机科学 2025-07-08 Shuo Yang , Yuwei Niu , Yuyang Liu , Yang Ye , Bin Lin , Li Yuan

With the proliferation of images in online content, language-guided image retrieval (LGIR) has emerged as a research hotspot over the past decade, encompassing a variety of subtasks with diverse input forms. While the development of large…

信息检索 · 计算机科学 2025-03-14 Pengfei Luo , Jingbo Zhou , Tong Xu , Yuan Xia , Linli Xu , Enhong Chen

Vision-Language Models (VLMs) have achieved remarkable progress in multimodal reasoning tasks through enhanced chain-of-thought capabilities. However, this advancement also introduces novel safety risks, as these models become increasingly…

计算机视觉与模式识别 · 计算机科学 2025-10-22 Yinan Xia , Yilei Jiang , Yingshui Tan , Xiaoyong Zhu , Xiangyu Yue , Bo Zheng

We present Team asdfo123's submission to the LLMSR@XLLM25 shared task, which evaluates large language models on producing fine-grained, controllable, and interpretable reasoning processes. Systems must extract all problem conditions,…

计算与语言 · 计算机科学 2025-05-20 Xinye Li , Mingqi Wan , Dianbo Sui

Low-rank Multi-view Subspace Learning (LMvSL) has shown great potential in cross-view classification in recent years. Despite their empirical success, existing LMvSL based methods are incapable of well handling view discrepancy and…

计算机视觉与模式识别 · 计算机科学 2020-03-24 Jiamiao Xu , Fangzhao Wang , Qinmu Peng , Xinge You , Shuo Wang , Xiao-Yuan Jing , C. L. Philip Chen