中文
相关论文

相关论文: Detecting Mode Collapse in Language Models via Nar…

200 篇论文

Large Language Models (LLMs) have achieved remarkable success in tasks requiring complex reasoning, such as code generation, mathematical problem solving, and algorithmic synthesis -- especially when aided by reasoning tokens and…

计算与语言 · 计算机科学 2025-06-13 Jaechul Roh , Varun Gandhi , Shivani Anilkumar , Arin Garg

The advent of instruction-tuned language models that convincingly mimic human writing poses a significant risk of abuse. However, such abuse may be counteracted with the ability to detect whether a piece of text was composed by a language…

计算与语言 · 计算机科学 2024-05-09 Rafael Rivera Soto , Kailin Koch , Aleem Khan , Barry Chen , Marcus Bishop , Nicholas Andrews

There is growing excitement about the potential of Language Models (LMs) to accelerate scientific discovery. Falsifying hypotheses is key to scientific progress, as it allows claims to be iteratively refined over time. This process requires…

机器学习 · 计算机科学 2025-02-27 Shiven Sinha , Shashwat Goel , Ponnurangam Kumaraguru , Jonas Geiping , Matthias Bethge , Ameya Prabhu

This study examines how user-provided suggestions affect Large Language Models (LLMs) in a simulated educational context, where sycophancy poses significant risks. Testing five different LLMs from the OpenAI GPT-4o and GPT-4.1 model classes…

计算与语言 · 计算机科学 2025-06-13 Chuck Arvin

Large language models (LLMs) are emerging as promising tools for mental health care, offering scalable support through their ability to generate human-like responses. However, the effectiveness of these models in clinical settings remains…

人工智能 · 计算机科学 2024-08-22 Yining Hua , Hongbin Na , Zehan Li , Fenglin Liu , Xiao Fang , David Clifton , John Torous

Large Language Models (LLMs) are recruited in applications that span from clinical assistance and legal support to question answering and education. Their success in specialized tasks has led to the claim that they possess human-like…

计算与语言 · 计算机科学 2024-07-10 Vittoria Dentella , Fritz Guenther , Elliot Murphy , Gary Marcus , Evelina Leivada

Large language models (LLMs), such as GPT series and Llama series have demonstrated strong capabilities in natural language processing, contextual understanding, and text generation. In recent years, researchers are trying to enhance the…

计算与语言 · 计算机科学 2024-10-08 Ziyang Chen , Stylios Moscholios

Large Language Models (LLMs) are increasingly deployed in healthcare, yet their communicative alignment with clinical standards remains insufficiently quantified. We conduct a multidimensional evaluation of general-purpose and…

The recent success of large language models (LLMs) has attracted widespread interest to develop role-playing conversational agents personalized to the characteristics and styles of different speakers to enhance their abilities to perform…

计算与语言 · 计算机科学 2024-06-07 Yizhe Yang , Palakorn Achananuparp , Heyan Huang , Jing Jiang , Ee-Peng Lim

Large Language Models have garnered significant attention for their capabilities in multilingual natural language processing, while studies on risks associated with cross biases are limited to immediate context preferences. Cross-language…

计算与语言 · 计算机科学 2025-08-07 Qianying Liu , Katrina Qiyao Wang , Fei Cheng , Sadao Kurohashi

Despite significant advances in alignment techniques, we demonstrate that state-of-the-art language models remain vulnerable to carefully crafted conversational scenarios that can induce various forms of misalignment without explicit…

计算与语言 · 计算机科学 2025-08-07 Siddhant Panpatil , Hiskias Dingeto , Haon Park

Recent approaches to automatically detect the speaker of an utterance of direct speech often disregard general information about characters in favor of local information found in the context, such as surrounding mentions of entities. In…

计算与语言 · 计算机科学 2024-01-31 Gaspard Michel , Elena V. Epure , Romain Hennequin , Christophe Cerisara

As large language models (LLMs) are increasingly deployed as interactive agents, open-ended human-AI interactions can involve deceptive behaviors with serious real-world consequences, yet existing evaluations remain largely…

人工智能 · 计算机科学 2026-02-09 Yichen Wu , Qianqian Gao , Xudong Pan , Geng Hong , Min Yang

Whether machines can originate novel content has been debated for nearly two centuries, from Lovelace's assertion that no engine can "originate anything" to Turing's question of whether a machine can amplify ideas brought in from outside.…

多智能体系统 · 计算机科学 2026-05-19 Weiyi Kong , Shiyang Lai , Jinghua Piao , James Evans

Instruction-tuned large language models produce helpful, structured responses, but how robust is this helpfulness under trivial constraints? We show that simple lexical constraints (banning a single punctuation character or common word)…

计算与语言 · 计算机科学 2026-04-28 Erfan Baghaei Potraghloo , Seyedarmin Azizi , Souvik Kundu , Massoud Pedram

AI agents are commonly aligned with "human values" through reinforcement learning from human feedback (RLHF), where a single reward model is learned from aggregated human feedback and used to align an agent's behavior. However, human values…

人工智能 · 计算机科学 2025-06-24 Carter Blair , Kate Larson , Edith Law

Humans acquire language through implicit learning, absorbing complex patterns without explicit awareness. While LLMs demonstrate impressive linguistic capabilities, it remains unclear whether they exhibit human-like pattern recognition…

计算与语言 · 计算机科学 2025-04-01 Xiaomeng Ma , Qihui Xu

Large Language Models (LLMs) have revolutionized natural language processing, yet concerns persist regarding their tendency to reflect or amplify social biases. This study introduces a novel evaluation framework to uncover gender biases in…

计算与语言 · 计算机科学 2026-03-10 Evan Chen , Run-Jun Zhan , Yan-Bai Lin , Hung-Hsuan Chen

The extraordinary capabilities of large language models (LLMs) such as ChatGPT and GPT-4 are in part unleashed by aligning them with reward models that are trained on human preferences, which are often represented as rankings of responses…

机器学习 · 计算机科学 2025-10-31 Ziang Song , Tianle Cai , Jason D. Lee , Weijie J. Su

An essential problem in artificial intelligence is whether LLMs can simulate human cognition or merely imitate surface-level behaviors, while existing datasets suffer from either synthetic reasoning traces or population-level aggregation,…

计算与语言 · 计算机科学 2026-03-31 Yuxuan Gu , Lunjun Liu , Xiaocheng Feng , Kun Zhu , Weihong Zhong , Lei Huang , Bing Qin