中文
相关论文

相关论文: SURf: Teaching Large Vision-Language Models to Sel…

200 篇论文

With recent advancements in Large Language Models (LLMs) and growing interest in retrieval-augmented generation (RAG), the ability to understand table structures has become increasingly important. This is especially critical in financial…

计算与语言 · 计算机科学 2025-05-26 Hayato Aida , Kosuke Takahashi , Takahiro Omi

Recommender systems have become increasingly vital in our daily lives, helping to alleviate the problem of information overload across various user-oriented online services. The emergence of Large Language Models (LLMs) has yielded…

信息检索 · 计算机科学 2025-05-29 Shijie Wang , Wenqi Fan , Yue Feng , Shanru Lin , Xinyu Ma , Shuaiqiang Wang , Dawei Yin

Multimodal large language models (MLLMs), such as GPT-4o, Gemini, LLaVA, and Flamingo, have made significant progress in integrating visual and textual modalities, excelling in tasks like visual question answering (VQA), image captioning,…

计算机视觉与模式识别 · 计算机科学 2024-12-31 Junxiao Xue , Quan Deng , Fei Yu , Yanhao Wang , Jun Wang , Yuehua Li

Retrieval-Augmented Generation (RAG) has become a foundational paradigm for equipping large language models (LLMs) with external knowledge, playing a critical role in information retrieval and knowledge-intensive applications. However,…

计算与语言 · 计算机科学 2025-06-10 Weihang Su , Qingyao Ai , Jingtao Zhan , Qian Dong , Yiqun Liu

The lack of domain-specific data in the pre-training of Large Language Models (LLMs) severely limits LLM-based decision systems in specialized applications, while post-training a model in the scenarios requires significant computational…

人工智能 · 计算机科学 2025-05-05 Zongyuan Li , Pengfei Li , Runnan Qi , Yanan Ni , Lumin Jiang , Hui Wu , Xuebo Zhang , Kuihua Huang , Xian Guo

Large Language Models (LLMs) demonstrate human-level capabilities in dialogue, reasoning, and knowledge retention. However, even the most advanced LLMs face challenges such as hallucinations and real-time updating of their knowledge.…

Large Language Models (LLMs) are smart but forgetful. Recent studies, (e.g., (Bubeck et al., 2023)) on modern LLMs have shown that they are capable of performing amazing tasks typically necessitating human-level intelligence. However,…

计算与语言 · 计算机科学 2023-11-08 Eric Melz

While large visual-language models (LVLM) have shown promising results on traditional visual question answering benchmarks, it is still challenging for them to answer complex VQA problems which requires diverse world knowledge. Motivated by…

计算机视觉与模式识别 · 计算机科学 2024-10-10 Dongze Hao , Qunbo Wang , Longteng Guo , Jie Jiang , Jing Liu

In this chapter, we consider generative information retrieval evaluation from two distinct but interrelated perspectives. First, large language models (LLMs) themselves are rapidly becoming tools for evaluation, with current research…

信息检索 · 计算机科学 2025-01-31 Marwah Alaofi , Negar Arabzadeh , Charles L. A. Clarke , Mark Sanderson

In recent years, multimodal large language models (MLLMs) have made significant strides by training on vast high-quality image-text datasets, enabling them to generally understand images well. However, the inherent difficulty in explicitly…

计算机视觉与模式识别 · 计算机科学 2024-07-08 Yuanze Lin , Yunsheng Li , Dongdong Chen , Weijian Xu , Ronald Clark , Philip Torr , Lu Yuan

Large Language Models (LLMs) are capable of natural language understanding and generation. But they face challenges such as hallucination and outdated knowledge. Fine-tuning is one possible solution, but it is resource-intensive and must be…

计算与语言 · 计算机科学 2025-07-01 Shadman Sobhan , Mohammad Ariful Haque

Retrieval-Augmented Generation (RAG) has recently demonstrated the performance of Large Language Models (LLMs) in the knowledge-intensive tasks such as Question-Answering (QA). RAG expands the query context by incorporating external…

机器学习 · 计算机科学 2024-06-18 Zijian Hei , Weiling Liu , Wenjie Ou , Juyi Qiao , Junming Jiao , Guowen Song , Ting Tian , Yi Lin

Current general-purpose large language models (LLMs) commonly exhibit knowledge hallucination and insufficient domain-specific adaptability in domain-specific tasks, limiting their effectiveness in specialized question answering scenarios.…

信息检索 · 计算机科学 2025-09-16 Mengzheng Yang , Yanfei Ren , David Osei Opoku , Ruochang Li , Peng Ren , Chunxiao Xing

Retrieval-Augmented Generation (RAG) is gaining recognition as one of the key technological axes for next generation information retrieval, owing to its ability to mitigate the hallucination phenomenon in Large Language Models (LLMs)and…

信息检索 · 计算机科学 2025-12-02 Hyunseok Ryu , Wonjune Shin , Hyun Park

Recently, Retrieval-Augmented Generation (RAG) has achieved remarkable success in addressing the challenges of Large Language Models (LLMs) without necessitating retraining. By referencing an external knowledge base, RAG refines LLM…

人工智能 · 计算机科学 2024-09-11 Boci Peng , Yun Zhu , Yongchao Liu , Xiaohe Bo , Haizhou Shi , Chuntao Hong , Yan Zhang , Siliang Tang

Post-training Large Vision-and-Language Models (LVLMs) typically involves Supervised Fine-Tuning (SFT) for knowledge injection or Reinforcement Learning with Verifiable Rewards (RLVR) for performance enhancement. However, SFT often leads to…

计算机视觉与模式识别 · 计算机科学 2026-05-12 Yuqi Liu , Liangyu Chen , Jiazhen Liu , Mingkang Zhu , Zhisheng Zhong , Bei Yu , Jiaya Jia

Large language models (LLMs) often struggle with knowledge intensive NLP tasks, such as answering "Who won the latest World Cup?" because the knowledge they learn during training may be insufficient or outdated. Conditioning generation on…

计算与语言 · 计算机科学 2025-03-04 Matthew Finlayson , Ilia Kulikov , Daniel M. Bikel , Barlas Oguz , Xilun Chen , Aasish Pappu

Large language models (LLMs) encode vast world knowledge in their parameters, yet they remain fundamentally limited by static knowledge, finite context windows, and weakly structured causal reasoning. This survey provides a unified account…

计算与语言 · 计算机科学 2026-04-06 Prakhar Bansal , Shivangi Agarwal

This study presents a novel framework for smart search in digital archival systems, leveraging the capabilities of Large Language Models (LLMs) to enhance information retrieval. By employing a Retrieval-Augmented Generation (RAG) approach,…

人工智能 · 计算机科学 2025-01-14 Ha Dung Nguyen , Thi-Hoang Anh Nguyen , Thanh Binh Nguyen

Recent advancements in large language models (LLMs) and multi-modal LLMs have been remarkable. However, these models still rely solely on their parametric knowledge, which limits their ability to generate up-to-date information and…

人工智能 · 计算机科学 2025-04-22 Zihan Ling , Zhiyao Guo , Yixuan Huang , Yi An , Shuai Xiao , Jinsong Lan , Xiaoyong Zhu , Bo Zheng