中文
相关论文

相关论文: Simple synthetic data reduces sycophancy in large …

200 篇论文

Alignment algorithms are widely used to align large language models (LLMs) to human users based on preference annotations. Typically these (often divergent) preferences are aggregated over a diverse set of users, resulting in fine-tuned…

计算与语言 · 计算机科学 2025-05-21 Cristina Garbacea , Chenhao Tan

Large language models (LLMs) are increasingly employed in information-seeking and decision-making tasks. Despite their broad utility, LLMs tend to generate information that conflicts with real-world facts, and their persuasive style can…

计算与语言 · 计算机科学 2024-09-19 Arslan Chaudhry , Sridhar Thiagarajan , Dilan Gorur

While large language models (LLMs) bring not only performance but also complexity, recent work has started to turn LLMs into data generators rather than task inferencers, where another affordable task model is trained for efficient…

计算与语言 · 计算机科学 2023-05-24 Jiacheng Ye , Chengzu Li , Lingpeng Kong , Tao Yu

Large language models (LLMs) increasingly rely on chain-of-thought (CoT) prompting to solve mathematical and logical reasoning tasks. Yet, a central question remains: to what extent are these generated rationales \emph{faithful} to the…

Data search for scientific research is more complex than a simple web search. The emergence of large language models (LLMs) and their applicability for scientific tasks offers new opportunities for researchers who are looking for data,…

数字图书馆 · 计算机科学 2025-10-29 Christin Katharina Kreutz , Anja Perry , Tanja Friedrich

Large Language Models (LLMs) offer promising avenues for methodological and applied innovations in survey research by using synthetic respondents to emulate human answers and behaviour, potentially mitigating measurement and representation…

计算与语言 · 计算机科学 2025-09-22 Bastián González-Bustamante , Nando Verelst , Carla Cisternas

How well can AI-derived synthetic research data replicate the responses of human participants? An emerging literature has begun to engage with this question, which carries deep implications for organizational research practice. This article…

计算机与社会 · 计算机科学 2026-05-13 Jason Miklian , Kristian Hoelscher , John E. Katsos

An important issue impacting healthcare is a lack of available experts. Machine learning (ML) models could resolve this by aiding in diagnosing patients. However, creating datasets large enough to train these models is expensive. We…

计算与语言 · 计算机科学 2024-05-14 Chancellor R. Woolsey , Prakash Bisht , Joshua Rothman , Gondy Leroy

Current approaches to phrase break prediction address crucial prosodic aspects of text-to-speech systems but heavily rely on vast human annotations from audio or text, incurring significant manual effort and cost. Inherent variability in…

计算与语言 · 计算机科学 2025-07-25 Hoyeon Lee , Sejung Son , Ye-Eun Kang , Jong-Hwan Kim

Synthetic personae experiments have become a prominent method in Large Language Model alignment research, yet the representativeness and ecological validity of these personae vary considerably between studies. Through a review of 63…

计算机与社会 · 计算机科学 2025-12-02 Jan Batzner , Volker Stocker , Bingjun Tang , Anusha Natarajan , Qinhao Chen , Stefan Schmid , Gjergji Kasneci

As more than 70$\%$ of reviews in the existing opinion summary data set are positive, current opinion summarization approaches are reluctant to generate negative summaries given the input of negative texts. To address such sentiment bias, a…

计算与语言 · 计算机科学 2025-03-04 Yanyue Zhang , Pengfei Li , Yilong Lai , Deyu Zhou , Yulan He

Large language models (LLMs) are commonly evaluated for political bias based on their responses to fixed questionnaires, which typically place frontier models on the political left. A parallel literature shows that LLMs are sycophantic:…

人工智能 · 计算机科学 2026-05-01 Petter Törnberg , Michelle Schimmel

Imbalanced data, where the positive samples represent only a small proportion compared to the negative samples, makes it challenging for classification problems to balance the false positive and false negative rates. A common approach to…

机器学习 · 统计学 2026-02-17 Pengfei Lyu , Zhengchi Ma , Linjun Zhang , Anru R. Zhang

Large Language models (LLMs), while powerful, exhibit harmful social biases. Debiasing is often challenging due to computational costs, data constraints, and potential degradation of multi-task language capabilities. This work introduces a…

计算与语言 · 计算机科学 2024-09-17 Pengrui Han , Rafal Kocielnik , Adhithya Saravanan , Roy Jiang , Or Sharir , Anima Anandkumar

Large language models (LLMs) are increasingly deployed in politically sensitive settings, raising concerns about their potential to encode, amplify, or be steered toward specific ideologies. We investigate how adopting synthetic personas…

计算与语言 · 计算机科学 2025-08-25 Pietro Bernardelle , Stefano Civelli , Leon Fröhling , Riccardo Lunardi , Kevin Roitero , Gianluca Demartini

Large Language Models (LLM) are increasingly trained on data generated by other LLM, either because generated text and images become part of the pre-training corpus, or because synthetized data is used as a replacement for expensive…

机器学习 · 计算机科学 2024-10-28 Yunzhen Feng , Elvis Dohmatob , Pu Yang , Francois Charton , Julia Kempe

Large language models (LLMs) can produce erroneous responses that sound fluent and convincing, raising the risk that users will rely on these responses as if they were correct. Mitigating such overreliance is a key challenge. Through a…

人机交互 · 计算机科学 2025-02-13 Sunnie S. Y. Kim , Jennifer Wortman Vaughan , Q. Vera Liao , Tania Lombrozo , Olga Russakovsky

Training and fine-tuning deep learning models, especially large language models (LLMs), on limited and imbalanced datasets poses substantial challenges. These issues often result in poor generalization, where models overfit to dominant…

计算与语言 · 计算机科学 2025-01-14 Ashok Choudhary , Cornelius Thiels , Hojjat Salehinejad

In the tourism domain, Large Language Models (LLMs) often struggle to mine implicit user intentions from tourists' ambiguous inquiries and lack the capacity to proactively guide users toward clarifying their needs. A critical bottleneck is…

计算与语言 · 计算机科学 2025-05-20 Jinqiang Wang , Huansheng Ning , Tao Zhu , Jianguo Ding

Fine-tuning large language models (LLMs) with limited data poses a practical challenge in low-resource languages, specialized domains, and constrained deployment settings. While pre-trained LLMs provide strong foundations, effective…

计算与语言 · 计算机科学 2025-10-29 Marton Szep , Daniel Rueckert , Rüdiger von Eisenhart-Rothe , Florian Hinterwimmer