中文
相关论文

相关论文: LLaVA-Critic: Learning to Evaluate Multimodal Mode…

200 篇论文

Conventional recommendation systems frequently fail to fully exploit the high-dimensional semantic signals inherent in multimedia content, thereby limiting the fidelity of user preference modeling. While Multimodal Large Language Models…

The zero-shot capability of Large Language Models (LLMs) has enabled highly flexible, reference-free metrics for various tasks, making LLM evaluators common tools in NLP. However, the robustness of these LLM evaluators remains relatively…

计算与语言 · 计算机科学 2024-05-06 Rickard Stureborg , Dimitris Alikaniotis , Yoshi Suhara

Within the multimodal field, large vision-language models (LVLMs) have made significant progress due to their strong perception and reasoning capabilities in the visual and language systems. However, LVLMs are still plagued by the two…

计算机视觉与模式识别 · 计算机科学 2024-06-14 Sirui Cheng , Siyu Zhang , Jiayi Wu , Muchen Lan

This paper introduces MM-Instruct, a large-scale dataset of diverse and high-quality visual instruction data designed to enhance the instruction-following capabilities of large multimodal models (LMMs). While existing visual instruction…

计算机视觉与模式识别 · 计算机科学 2024-07-01 Jihao Liu , Xin Huang , Jinliang Zheng , Boxiao Liu , Jia Wang , Osamu Yoshie , Yu Liu , Hongsheng Li

Self-supervised skill learning aims to acquire useful behaviors that leverage the underlying dynamics of the environment. Latent variable models, based on mutual information maximization, have been successful in this task but still struggle…

机器学习 · 计算机科学 2024-03-22 David Emukpere , Bingbing Wu , Julien Perez , Jean-Michel Renders

Recent studies have demonstrated Large Language Models (LLMs) can extend their zero-shot generalization capabilities to multimodal learning through instruction tuning. As more modalities and downstream tasks are introduced, negative…

计算机视觉与模式识别 · 计算机科学 2024-11-26 Zeren Chen , Ziqin Wang , Zhen Wang , Huayang Liu , Zhenfei Yin , Si Liu , Lu Sheng , Wanli Ouyang , Yu Qiao , Jing Shao

The emergence of large language models (LLMs) has transformed research and practice across a wide range of domains. Within the computing education research (CER) domain, LLMs have garnered significant attention, particularly in the context…

人工智能 · 计算机科学 2024-11-25 Charles Koutcheme , Nicola Dainese , Arto Hellas , Sami Sarsa , Juho Leinonen , Syed Ashraf , Paul Denny

Large language models (LLMs) and multimodal large models (MLLMs) are increasingly used for transportation tasks such as regulation question answering, traffic management support, engineering review, and autonomous-driving scene reasoning.…

计算机视觉与模式识别 · 计算机科学 2026-05-05 Han Gong , Zhen Zhou , Yunyang Shi , Yan Tan , Jinbiao Huo , Qi Hong , Zhiyuan Liu

Performance of Large Language Models (LLMs) on multiple-choice tasks differs markedly between symbol-based and cloze-style evaluation formats. The observed discrepancies are systematically attributable to task characteristics: natural…

计算与语言 · 计算机科学 2026-02-02 Joonhak Lee , Sungmok Jung , Jongyeon Park , Jaejin Lee

Large language models (LLMs) are increasingly relied upon for complex multi-turn conversations across diverse real-world applications. However, existing benchmarks predominantly focus on single-turn evaluations, overlooking the models'…

计算与语言 · 计算机科学 2024-01-31 Wai-Chung Kwan , Xingshan Zeng , Yuxin Jiang , Yufei Wang , Liangyou Li , Lifeng Shang , Xin Jiang , Qun Liu , Kam-Fai Wong

Recently, there has been growing interest in extending the context length of large language models (LLMs), aiming to effectively process long inputs of one turn or conversations with more extensive histories. While proprietary models such…

计算与语言 · 计算机科学 2023-10-05 Chenxin An , Shansan Gong , Ming Zhong , Xingjian Zhao , Mukai Li , Jun Zhang , Lingpeng Kong , Xipeng Qiu

The rise of Multimodal Large Language Models (MLLMs) has become a transformative force in the field of artificial intelligence, enabling machines to process and generate content across multiple modalities, such as text, images, audio, and…

Teaching large language models (LLMs) to critique and refine their outputs is crucial for building systems that can iteratively improve, yet it is fundamentally limited by the ability to provide accurate judgments and actionable…

机器学习 · 计算机科学 2025-12-02 Zhihui Xie , Jie Chen , Liyu Chen , Weichao Mao , Jingjing Xu , Lingpeng Kong

The Multimodal Large Language Model (MLLM) is currently experiencing rapid growth, driven by the advanced capabilities of LLMs. Unlike earlier specialists, existing MLLMs are evolving towards a Multimodal Generalist paradigm. Initially…

Large Language Models (LLMs) have emerged as powerful tools in mathematical theorem proving, particularly when utilizing formal languages such as LEAN. A prevalent proof method involves the LLM prover iteratively constructing the proof…

人工智能 · 计算机科学 2025-10-22 Zijian Wu , Suozhi Huang , Zhejian Zhou , Huaiyuan Ying , Zheng Yuan , Wenwei Zhang , Dahua Lin , Kai Chen

Large Multimodal Models (LMMs) are increasingly applied to scientific research, yet it remains unclear whether they can reliably understand and reason over the multimodal complexity of papers. A central challenge lies in detecting and…

计算机视觉与模式识别 · 计算机科学 2026-02-17 Lukas Selch , Yufang Hou , M. Jehanzeb Mirza , Sivan Doveh , James Glass , Rogerio Feris , Wei Lin

Task-oriented semantic communication has emerged as a fundamental approach for enhancing performance in various communication scenarios. While recent advances in Generative Artificial Intelligence (GenAI), such as Large Language Models…

人工智能 · 计算机科学 2025-05-06 Baoxia Du , Hongyang Du , Dusit Niyato , Ruidong Li

In this paper, we reveal that most current efficient multimodal fine-tuning methods are hindered by a key limitation: they are directly borrowed from LLMs, often neglecting the intrinsic differences of multimodal scenarios and even…

计算机视觉与模式识别 · 计算机科学 2025-12-30 Yake Wei , Yu Miao , Dongzhan Zhou , Di Hu

Large language models (LLMs) are widely used as scalable evaluators of model responses in lieu of human annotators. However, imperfect sensitivity and specificity of the LLM judges induce bias in naive evaluation scores. We propose a simple…

机器学习 · 计算机科学 2026-02-10 Chungpa Lee , Thomas Zeng , Jongwon Jeong , Jy-yong Sohn , Kangwook Lee

The rapid evolution of Multimodal Large Language Models (MLLMs) has brought substantial advancements in artificial intelligence, significantly enhancing the capability to understand and generate multimodal content. While prior studies have…

人工智能 · 计算机科学 2024-09-30 Lin Li , Guikun Chen , Hanrong Shi , Jun Xiao , Long Chen