English
Related papers

Related papers: The Knowledge Alignment Problem: Bridging Human an…

200 papers

Large Language Models (LLMs) have achieved remarkable success in natural language tasks, yet understanding their reasoning processes remains a significant challenge. We address this by introducing XplainLLM, a dataset accompanying an…

Computation and Language · Computer Science 2024-09-24 Zichen Chen , Jianda Chen , Ambuj Singh , Misha Sra

Reward-model-based fine-tuning is a central paradigm in aligning Large Language Models with human preferences. However, such approaches critically rely on the assumption that proxy reward models accurately reflect intended supervision, a…

Computation and Language · Computer Science 2026-01-21 Zixuan Liu , Siavash H. Khajavi , Guangkai Jiang , Xinru Liu

Large language models (LLMs) may generate outputs that are misaligned with user intent, lack contextual grounding, or exhibit hallucinations during conversation, which compromises the reliability of LLM-based applications. This review aimed…

Computation and Language · Computer Science 2025-12-01 Gabriele Cesar Iwashima , Claudia Susie Rodrigues , Claudio Dipolitto , Geraldo Xexéo

Large Language Models (LLMs) have emerged as promising solutions for a variety of medical and clinical decision support applications. However, LLMs are often subject to different types of biases, which can lead to unfair treatment of…

Computation and Language · Computer Science 2024-08-23 Raphael Poulain , Hamed Fayyaz , Rahmatollah Beheshti

Large language models (LLMs) have achieved a degree of success in generating coherent and contextually relevant text, yet they remain prone to a significant challenge known as hallucination: producing information that is not substantiated…

Computation and Language · Computer Science 2024-10-28 Ray Li , Tanishka Bagade , Kevin Martinez , Flora Yasmin , Grant Ayala , Michael Lam , Kevin Zhu

Large language models (LLMs) have recently been used as backbones for recommender systems. However, their performance often lags behind conventional methods in standard tasks like retrieval. We attribute this to a mismatch between LLMs'…

Information Retrieval · Computer Science 2024-04-02 Yuwei Cao , Nikhil Mehta , Xinyang Yi , Raghunandan Keshavan , Lukasz Heldt , Lichan Hong , Ed H. Chi , Maheswaran Sathiamoorthy

Recent research has explored using Large Language Models for recommendation tasks by transforming user interaction histories and item metadata into text prompts, then having the LLM produce rankings or recommendations. A promising approach…

Information Retrieval · Computer Science 2025-10-03 Bo Ma , LuYao Liu , Simon Lau , Chandler Yuan , and XueY Cui , Rosie Zhang

Hallucinations in large vision-language models (LVLMs) pose significant challenges for real-world applications, as LVLMs may generate responses that appear plausible yet remain inconsistent with the associated visual content. This issue…

Computer Vision and Pattern Recognition · Computer Science 2025-07-23 Xin Dong , Shichao Dong , Jin Wang , Jing Huang , Li Zhou , Zenghui Sun , Lihua Jing , Jingsong Lan , Xiaoyong Zhu , Bo Zheng

Incorporating factual knowledge in knowledge graph is regarded as a promising approach for mitigating the hallucination of large language models (LLMs). Existing methods usually only use the user's input to query the knowledge graph, thus…

Computation and Language · Computer Science 2023-11-23 Xinyan Guan , Yanjiang Liu , Hongyu Lin , Yaojie Lu , Ben He , Xianpei Han , Le Sun

A core challenge in the development of increasingly capable AI systems is to make them safe and reliable by ensuring their behaviour is consistent with human values. This challenge, known as the alignment problem, does not merely apply to…

Machine Learning · Computer Science 2023-11-07 Raphaël Millière

Large Language Models (LLMs) need to be aligned with human expectations to ensure their safety and utility in most applications. Alignment is challenging, costly, and needs to be repeated for every LLM and alignment criterion. We propose to…

Computation and Language · Computer Science 2024-10-07 Lilian Ngweta , Mayank Agarwal , Subha Maity , Alex Gittens , Yuekai Sun , Mikhail Yurochkin

Recent advancements in multimodal large language models (MLLMs) have shown unprecedented capabilities in advancing various vision-language tasks. However, MLLMs face significant challenges with hallucinations, and misleading outputs that do…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Shengqiong Wu , Hao Fei , Liangming Pan , William Yang Wang , Shuicheng Yan , Tat-Seng Chua

Earlier research has shown that metaphors influence human's decision making, which raises the question of whether metaphors also influence large language models (LLMs)' reasoning pathways, considering their training data contain a large…

Computation and Language · Computer Science 2026-01-13 Zhibo Hu , Chen Wang , Yanfeng Shu , Hye-young Paik , Liming Zhu

Code-mixing is increasingly prevalent in interactions between humans and large language models, yet existing work often reduces it to a translation or convertibility problem, making it difficult to assess whether a model's switching…

Computation and Language · Computer Science 2026-01-26 Qingyan Yang , Tongxi Wang , Yunsheng Luo

Reasoning is a cognitive process of using evidence to reach a sound conclusion. The reasoning capability is essential for large language models (LLMs) to serve as the brain of the artificial general intelligence agent. Recent studies reveal…

Computation and Language · Computer Science 2023-09-06 Peiyi Wang , Lei Li , Liang Chen , Feifan Song , Binghuai Lin , Yunbo Cao , Tianyu Liu , Zhifang Sui

While interpretability methods identify a model's learned concepts, they overlook the relationships between concepts that make up its abstractions and inform its ability to generalize to new data. To assess whether models' have learned…

Machine Learning · Computer Science 2025-11-04 Angie Boggust , Hyemin Bang , Hendrik Strobelt , Arvind Satyanarayan

Large language models are known to suffer from the hallucination problem in that they are prone to output statements that are false or inconsistent, indicating a lack of knowledge. A proposed solution to this is to provide the model with…

Computation and Language · Computer Science 2021-10-01 Tobias Norlund , Lovisa Hagström , Richard Johansson

Large Language Models (LLMs) have demonstrated strong performance in handling complex tasks requiring both extensive knowledge and reasoning abilities. However, the existing LLM inference pipeline operates as an opaque process without…

Computation and Language · Computer Science 2025-05-16 Mingyu Jin , Weidi Luo , Sitao Cheng , Xinyi Wang , Wenyue Hua , Ruixiang Tang , William Yang Wang , Yongfeng Zhang

Recently, large models have shown significant potential for smart healthcare. However, the deployment of Large Vision-Language Models (LVLMs) for clinical services is currently hindered by three critical challenges: a tendency to…

Artificial Intelligence · Computer Science 2025-10-27 Siyong Chen , Jinbo Wen , Jiawen Kang , Tenghui Huang , Xumin Huang , Yuanjia Su , Hudan Pan , Zishao Zhong , Dusit Niyato , Shengli Xie , Dong In Kim

Large Multimodal Models (LMM) are built across modalities and the misalignment between two modalities can result in "hallucination", generating textual outputs that are not grounded by the multimodal information in context. To address the…

Computer Vision and Pattern Recognition · Computer Science 2023-09-27 Zhiqing Sun , Sheng Shen , Shengcao Cao , Haotian Liu , Chunyuan Li , Yikang Shen , Chuang Gan , Liang-Yan Gui , Yu-Xiong Wang , Yiming Yang , Kurt Keutzer , Trevor Darrell