中文
相关论文

相关论文: The Effects of Data Augmentation on Confidence Est…

200 篇论文

Large language models (LLMs) are increasingly involved in shaping public understanding on contested issues. This has led to substantial discussion about the potential of LLMs to reinforce or correct misperceptions. While existing literature…

社会与信息网络 · 计算机科学 2025-06-09 Adiba Mahbub Proma , Neeley Pate , Sean Kelty , Gourab Ghoshal , James N. Druckman , Ehsan Hoque

The reliance of text classifiers on spurious correlations can lead to poor generalization at deployment, raising concerns about their use in safety-critical domains such as healthcare. In this work, we propose to use counterfactual data…

机器学习 · 计算机科学 2024-01-10 Amir Feder , Yoav Wald , Claudia Shi , Suchi Saria , David Blei

The process of matching patients with suitable clinical trials is essential for advancing medical research and providing optimal care. However, current approaches face challenges such as data standardization, ethical considerations, and a…

计算与语言 · 计算机科学 2023-08-08 Jiayi Yuan , Ruixiang Tang , Xiaoqian Jiang , Xia Hu

We investigate the calibration of large language models' (LLMs') confidence across diverse tasks. The results of our preregistered study show that the current crop of LLMs are, like people, too sure they are right: confidence exceeds…

人工智能 · 计算机科学 2026-05-26 Noam Michael , Daniel BenShushan , Jacob Bien , Don A. Moore

Large language models (LLMs) are increasingly used in statistical research and applications. However,they are also notorious for unreliable or biased information. Here, we explore whether LLMs can be used to improve the precision of…

应用统计 · 统计学 2026-05-29 Jaylin Lowe , Adam Sales , Johann A. Gagnon-Bartsch

Large Language Models (LLMs) have demonstrated strong reasoning capabilities across various tasks. However, even minor variations in query phrasing, despite preserving the underlying semantic meaning, can significantly affect their…

计算与语言 · 计算机科学 2025-02-26 Yihang Yao , Zhepeng Cen , Miao Li , William Han , Yuyou Zhang , Emerson Liu , Zuxin Liu , Chuang Gan , Ding Zhao

Large language models (LLMs) exhibit strikingly conflicting behaviors: they can appear steadfastly overconfident in their initial answers whilst at the same time being prone to excessive doubt when challenged. To investigate this apparent…

Recent advancements in large language models (LLMs) demonstrate strong potential for generating novel research ideas, yet such ideas often struggle with feasibility and effectiveness. In this paper, we investigate whether augmenting LLMs…

计算与语言 · 计算机科学 2026-03-03 Xiao Liu , Xinyi Dong , Xinyang Gao , Yansong Feng , Xun Pang

The success of Large Language Models (LLMs) is inherently linked to the availability of vast, diverse, and high-quality data for training and evaluation. However, the growth rate of high-quality data is significantly outpaced by the…

计算与语言 · 计算机科学 2024-10-18 Ke Wang , Jiahui Zhu , Minjie Ren , Zeming Liu , Shiwei Li , Zongye Zhang , Chenkai Zhang , Xiaoyu Wu , Qiqi Zhan , Qingjie Liu , Yunhong Wang

Data augmentation, the artificial creation of training data for machine learning by transformations, is a widely studied research field across machine learning disciplines. While it is useful for increasing a model's generalization…

计算与语言 · 计算机科学 2022-09-09 Markus Bayer , Marc-André Kaufhold , Christian Reuter

Large language models (LLMs) show early signs of artificial general intelligence but struggle with hallucinations. One promising solution to mitigate these hallucinations is to store external knowledge as embeddings, aiding LLMs in…

计算与语言 · 计算机科学 2024-04-26 Zhihao Zhu , Ninglu Shao , Defu Lian , Chenwang Wu , Zheng Liu , Yi Yang , Enhong Chen

Collecting high-quality training data is essential for fine-tuning Large Language Models (LLMs). However, acquiring such data is often costly and time-consuming, especially for non-English languages such as Italian. Recently, researchers…

计算与语言 · 计算机科学 2025-04-01 Fatemeh Mohammadi , Tommaso Romano , Samira Maghool , Paolo Ceravolo

Large Language Models (LLMs) have recently enabled natural language interfaces that translate user queries into executable SQL, offering a powerful solution for non-technical stakeholders to access structured data. However, one of the…

应用统计 · 统计学 2025-06-23 Jiekai Ma , Yikai Zhao

Large language models (LLMs) are increasingly used in high-stakes settings, where overconfident responses can mislead users. Reliable confidence estimation has been shown to enhance trust and task accuracy. Yet existing methods face…

计算与语言 · 计算机科学 2025-09-30 Linwei Tao , Yi-Fan Yeh , Bo Kai , Minjing Dong , Tao Huang , Tom A. Lamb , Jialin Yu , Philip H. S. Torr , Chang Xu

In the past five years, research has shifted from traditional Machine Learning (ML) and Deep Learning (DL) approaches to leveraging Large Language Models (LLMs) , including multimodality, for data augmentation to enhance generalization, and…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Ranjan Sapkota , Shaina Raza , Maged Shoman , Achyut Paudel , Manoj Karkee

Data augmentation plays a crucial role in addressing the challenge of limited expert-annotated datasets in deep learning applications for retinal Optical Coherence Tomography (OCT) scans. This work exhaustively investigates the impact of…

图像与视频处理 · 电气工程与系统科学 2024-09-23 Markus Unterdechler , Botond Fazekas , Guilherme Aresta , Hrvoje Bogunović

Ensuring that deep learning models are well-calibrated in terms of their predictive uncertainty is essential in maintaining their trustworthiness and reliability, yet despite increasing advances in foundation model research, the…

计算与语言 · 计算机科学 2026-01-06 Jerry Huang , Peng Lu , Qiuhao Zeng , Yusuke Iwasawa , Yutaka Matsuo , Sarath Chandar , Edison Marrese-Taylor , Irene Li

Accurately gauging the confidence level of Large Language Models' (LLMs) predictions is pivotal for their reliable application. However, LLMs are often uncalibrated inherently and elude conventional calibration techniques due to their…

Large Language Models (LLMs) have demonstrated remarkable self-improvement capabilities, whereby models iteratively revise their outputs through self-generated feedback. While this reflective mechanism has shown promise in enhancing task…

计算与语言 · 计算机科学 2025-04-07 Liangjie Huang , Dawei Li , Huan Liu , Lu Cheng

The trustworthiness of Large Language Models (LLMs) refers to the extent to which their outputs are reliable, safe, and ethically aligned, and it has become a crucial consideration alongside their cognitive performance. In practice,…

计算与语言 · 计算机科学 2024-12-24 Aaron J. Li , Satyapriya Krishna , Himabindu Lakkaraju