中文
相关论文

相关论文: LLM Microscope: What Model Internals Reveal About …

200 篇论文

Large language models (LLMs) have achieved substantial progress in processing long contexts but still struggle with long-context reasoning. Existing approaches typically involve fine-tuning LLMs with synthetic data, which depends on…

计算与语言 · 计算机科学 2024-11-14 Siheng Li , Cheng Yang , Zesen Cheng , Lemao Liu , Mo Yu , Yujiu Yang , Wai Lam

The ability of Large Language Models (LLMs) to extract context from natural language problem descriptions naturally raises questions about their suitability in autonomous decision-making settings. This paper studies the behaviour of these…

人工智能 · 计算机科学 2025-07-22 Xiao Yang , Juxi Leitner , Michael Burke

People judge interactions with large language models (LLMs) as successful when outputs match what they want, not what they type. Yet LLMs are trained to predict the next token solely from text input, not underlying intent. Because written…

计算与语言 · 计算机科学 2026-03-13 Nadav Kunievsky , James A. Evans

Despite the strong reasoning ability of large language models~(LLMs), they are prone to errors and hallucinations. As a result, how to check their outputs effectively and efficiently has become a critical problem in their applications.…

人工智能 · 计算机科学 2025-10-29 Jiayu Liu , Wei Dai , Zhenya Huang , Ning Miao , Enhong Chen

Generating rational and generally accurate responses to tasks, often accompanied by example demonstrations, highlights Large Language Model's (LLM's) remarkable In-Context Learning (ICL) capabilities without requiring updates to the model's…

机器学习 · 计算机科学 2025-06-17 Debanjan Dutta , Faizanuddin Ansari , Swagatam Das

Large language models (LLMs) show strong reasoning abilities across diverse tasks, yet their performance on extended contexts remains inconsistent. While prior research has emphasized mid-context degradation in question answering, this…

计算与语言 · 计算机科学 2026-02-25 Pietro Bernardelle , Stefano Civelli , Kevin Roitero , Gianluca Demartini

Large Language Models (LLMs) are increasingly used for recommendation tasks due to their general-purpose capabilities. While LLMs perform well in rich-context settings, their behavior in cold-start scenarios, where only limited signals such…

信息检索 · 计算机科学 2025-09-09 Alexandre Andre , Gauthier Roy , Eva Dyer , Kai Wang

Recent advancements in Large Language Models (LLMs) have demonstrated exceptional capabilities in complex tasks like machine translation, commonsense reasoning, and language understanding. One of the primary reasons for the adaptability of…

计算与语言 · 计算机科学 2024-07-12 Nicholas Kroeger , Dan Ley , Satyapriya Krishna , Chirag Agarwal , Himabindu Lakkaraju

Large language models (LLMs) tend to inadequately integrate input context during text generation, relying excessively on encoded prior knowledge in model parameters, potentially resulting in generated text with factual inconsistencies or…

计算与语言 · 计算机科学 2024-05-07 Zheng Zhao , Emilio Monti , Jens Lehmann , Haytham Assem

Large language models (LLMs) can perform reasoning computations both internally within their latent space and externally by generating explicit token sequences like chains of thought. Significant progress in enhancing reasoning abilities…

计算与语言 · 计算机科学 2025-04-16 Thilo Hagendorff , Sarah Fabi

Large language models have demonstrated impressive retrieval-augmented capabilities. However, a crucial area remains underexplored: their ability to appropriately adapt responses to the certainty of the retrieved information. It is a…

计算与语言 · 计算机科学 2026-05-11 Behzad Shayegh , Mohamed Osama Ahmed , Fred Tung , Leo Feng

This paper explores how large language models can leverage multi-level contextual information to predict group coordination patterns in collaborative mixed reality environments. We demonstrate that encoding individual behavioral profiles,…

人机交互 · 计算机科学 2025-11-19 Diana Romero , Xin Gao , Daniel Khalkhali , Salma Elmalaki

Large language models (LLMs) draw on both contextual information and parametric memory, yet these sources can conflict. Prior studies have largely examined this issue in contextual question answering, implicitly assuming that tasks should…

计算与语言 · 计算机科学 2026-04-21 Kaiser Sun , Fan Bai , Mark Dredze

This paper evaluates the ability of Large Language Models (LLMs) to leverage contextual information in the form of structured linguistic representations. Specifically, we examine the impact of encoding both short and long contexts using…

计算与语言 · 计算机科学 2026-04-28 Ankush Raut , Xiaofeng Zhu , Maria Leonor Pacheco

Modern large language models (LLMs) are capable of interpreting input strings as instructions, or prompts, and carry out tasks based on them. Unlike traditional learners, LLMs cannot use back-propagation to obtain feedback, and condition…

计算与语言 · 计算机科学 2026-03-17 Adrian de Wynter , Xun Wang , Qilong Gu , Si-Qing Chen

Large language models (LLMs) frequently hallucinate and produce factual errors, yet our understanding of why they make these errors remains limited. In this study, we delve into the underlying mechanisms of LLM hallucinations from the…

计算与语言 · 计算机科学 2024-03-13 Shiqi Chen , Miao Xiong , Junteng Liu , Zhengxuan Wu , Teng Xiao , Siyang Gao , Junxian He

Large Language Models (LLMs) have transformed NLP with their remarkable In-context Learning (ICL) capabilities. Automated assistants based on LLMs are gaining popularity; however, adapting them to novel tasks is still challenging. While…

计算与语言 · 计算机科学 2024-06-13 Anwoy Chatterjee , Eshaan Tanwar , Subhabrata Dutta , Tanmoy Chakraborty

Large Language Models (LLMs) exhibit emerging in-context learning abilities through prompt engineering. The recent progress in large-scale generative models has further expanded their use in real-world language applications. However, the…

计算与语言 · 计算机科学 2024-04-12 Linyi Yang , Shuibai Zhang , Zhuohao Yu , Guangsheng Bao , Yidong Wang , Jindong Wang , Ruochen Xu , Wei Ye , Xing Xie , Weizhu Chen , Yue Zhang

Large language models (LLMs) exhibit compelling linguistic behaviour, and sometimes offer self-reports, that is to say statements about their own nature, inner workings, or behaviour. In humans, such reports are often attributed to a…

计算与语言 · 计算机科学 2025-06-09 Iulia M. Comsa , Murray Shanahan

Despite the popularity of the large language models (LLMs), their application to machine translation is relatively underexplored, especially in context-aware settings. This work presents a literature review of context-aware translation with…

计算与语言 · 计算机科学 2025-06-10 Ramakrishna Appicharla , Baban Gain , Santanu Pal , Asif Ekbal