中文
相关论文

相关论文: The Effects of Data Augmentation on Confidence Est…

200 篇论文

Large language models (LLMs) are becoming useful in many domains due to their impressive abilities that arise from large training datasets and large model sizes. More recently, they have been shown to be very effective in textual…

计算与语言 · 计算机科学 2025-10-07 Nelvin Tan , James Asikin Cheung , Yu-Ching Shih , Dong Yang , Amol Salunkhe

Deep learning has achieved remarkable results in many computer vision tasks. Deep neural networks typically rely on large amounts of training data to avoid overfitting. However, labeled data for real-world applications may be limited. By…

计算机视觉与模式识别 · 计算机科学 2023-11-07 Suorong Yang , Weikang Xiao , Mengchen Zhang , Suhan Guo , Jian Zhao , Furao Shen

Data-Augmentation (DA) is known to improve performance across tasks and datasets. We propose a method to theoretically analyze the effect of DA and study questions such as: how many augmented samples are needed to correctly estimate the…

机器学习 · 计算机科学 2022-02-18 Randall Balestriero , Ishan Misra , Yann LeCun

Deep learning (DL) algorithms have shown significant performance in various computer vision tasks. However, having limited labelled data lead to a network overfitting problem, where network performance is bad on unseen data as compared to…

计算机视觉与模式识别 · 计算机科学 2023-03-14 Teerath Kumar , Alessandra Mileo , Rob Brennan , Malika Bendechache

In math reasoning with large language models (LLMs), fine-tuning data augmentation by query evolution and diverse reasoning paths is empirically verified effective, profoundly narrowing the gap between open-sourced LLMs and cutting-edge…

计算与语言 · 计算机科学 2024-07-18 Chengpeng Li , Zheng Yuan , Hongyi Yuan , Guanting Dong , Keming Lu , Jiancan Wu , Chuanqi Tan , Xiang Wang , Chang Zhou

Building high-quality datasets and labeling query-document relevance are essential yet resource-intensive tasks, requiring detailed guidelines and substantial effort from human annotators. This paper explores the use of small, fine-tuned…

信息检索 · 计算机科学 2025-04-15 Quentin Fitte-Rey , Matyas Amrouche , Romain Deveaud

Large language model (LLM) is an effective approach to addressing data scarcity in low-resource scenarios. Recent existing research designs hand-crafted prompts to guide LLM for data augmentation. We introduce a data augmentation strategy…

计算与语言 · 计算机科学 2025-06-10 Yaping Chai , Haoran Xie , Joe S. Qin

Large Language Models (LLMs) store an extensive amount of factual knowledge obtained from vast collections of text. To effectively utilize these models for downstream tasks, it is crucial to have reliable methods for measuring their…

计算与语言 · 计算机科学 2023-06-13 Pouya Pezeshkpour

Fine-tuning large language models (LLMs) based on human preferences, commonly achieved through reinforcement learning from human feedback (RLHF), has been effective in improving their performance. However, maintaining LLM safety throughout…

人工智能 · 计算机科学 2025-02-18 Yingshui Tan , Yilei Jiang , Yanshi Li , Jiaheng Liu , Xingyuan Bu , Wenbo Su , Xiangyu Yue , Xiaoyong Zhu , Bo Zheng

Objective: The use of deep learning for electroencephalography (EEG) classification tasks has been rapidly growing in the last years, yet its application has been limited by the relatively small size of EEG datasets. Data augmentation,…

机器学习 · 计算机科学 2022-11-16 Cédric Rommel , Joseph Paillard , Thomas Moreau , Alexandre Gramfort

The increasing prevalence of online misinformation has heightened the demand for automated fact-checking solutions. Large Language Models (LLMs) have emerged as potential tools for assisting in this task, but their effectiveness remains…

计算机与社会 · 计算机科学 2025-03-10 Nicolo' Fontana , Francesco Corso , Enrico Zuccolotto , Francesco Pierri

Large Language Models deployed as question answering tools require robust calibration to avoid overconfidence. We systematically evaluate how reasoning capabilities and budget affect confidence assessment accuracy, using the ClimateX…

人工智能 · 计算机科学 2025-08-22 Romain Lacombe , Kerrie Wu , Eddie Dilworth

Neural networks have become popular in many fields of science since they serve as promising, reliable and powerful tools. In this work, we study the effect of data augmentation on the predictive power of neural network models for nuclear…

机器学习 · 计算机科学 2022-09-29 Hüseyin Bahtiyar , Derya Soydaner , Esra Yüksel

Data augmentation has recently seen increased interest in NLP due to more work in low-resource domains, new tasks, and the popularity of large-scale neural networks that require large amounts of training data. Despite this recent upsurge,…

计算与语言 · 计算机科学 2021-12-03 Steven Y. Feng , Varun Gangal , Jason Wei , Sarath Chandar , Soroush Vosoughi , Teruko Mitamura , Eduard Hovy

Large Language Models (LLMs) have become increasingly important in natural language processing, enabling advanced data analytics through natural language queries. However, these models often generate "hallucinations"-inaccurate or…

计算与语言 · 计算机科学 2024-10-29 Mikhail Rumiantsau , Aliaksei Vertsel , Ilya Hrytsuk , Isaiah Ballah

To acquire instruction-following capabilities, large language models (LLMs) undergo instruction tuning, where they are trained on instruction-response pairs using next-token prediction (NTP). Efforts to improve instruction tuning often…

计算与语言 · 计算机科学 2026-04-21 Yuxin Xiao , Shujian Zhang , Wenxuan Zhou , Marzyeh Ghassemi , Sanqiang Zhao

Various deep learning (DL) methods have recently been utilized to detect software vulnerabilities. Real-world software vulnerability datasets are rare and hard to acquire, as there is no simple metric for classifying vulnerability. Such…

软件工程 · 计算机科学 2025-04-29 Seyed Shayan Daneshvar , Da Tan , Shaowei Wang , Carson Leung

LLM alignment ensures that large language models behave safely and effectively by aligning their outputs with human values, goals, and intentions. Aligning LLMs employ huge amounts of data, computation, and time. Moreover, curating data…

机器学习 · 计算机科学 2025-02-19 Amrit Khera , Rajat Ghosh , Debojyoti Dutta

Large Language Models (LLMs) show promise for automated grading, but their outputs can be unreliable. Rather than improving grading accuracy directly, we address a complementary problem: \textit{predicting when an LLM grader is likely to be…

计算与语言 · 计算机科学 2026-04-01 Robinson Ferrer , Damla Turgut , Zhongzhou Chen , Shashank Sonkar

Data augmentation (DA) is crucial to mitigate model training instability and over-fitting problems in low-resource open-domain dialogue generation. However, traditional DA methods often neglect semantic data diversity, restricting the…

计算与语言 · 计算机科学 2024-04-02 Zhenhua Liu , Tong Zhu , Jianxiang Xiang , Wenliang Chen