English
Related papers

Related papers: Rep-GLS: Report-Guided Generalized Label Smoothing…

200 papers

Large Language Models (LLMs) are increasingly used in clinical settings, where sensitivity to linguistic uncertainty can influence diagnostic interpretation and decision-making. Yet little is known about where such epistemic cues are…

Computation and Language · Computer Science 2025-12-01 Srivarshinee Sridhar , Raghav Kaushik Ravi , Kripabandhu Ghosh

Label smoothing is an effective regularization tool for deep neural networks (DNNs), which generates soft labels by applying a weighted average between the uniform distribution and the hard label. It is often used to reduce the overfitting…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Chang-Bin Zhang , Peng-Tao Jiang , Qibin Hou , Yunchao Wei , Qi Han , Zhen Li , Ming-Ming Cheng

Patients undergoing chest X-rays (CXR) often endure multiple lung diseases. When evaluating a patient's condition, due to the complex pathologies, subtle texture changes of different lung lesions in images, and patient condition…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Mengliang Zhang , Xinyue Hu , Lin Gu , Liangchen Liu , Kazuma Kobayashi , Tatsuya Harada , Ronald M. Summers , Yingying Zhu

Prior work has explored directly regularizing the output distributions of probabilistic models to alleviate peaky (i.e. over-confident) predictions, a common sign of overfitting. This class of techniques, of which label smoothing is one,…

Computation and Language · Computer Science 2020-05-13 Clara Meister , Elizabeth Salesky , Ryan Cotterell

In the past years, deep learning has seen an increase in usage in the domain of histopathological applications. However, while these approaches have shown great potential, in high-risk environments deep learning models need to be able to…

Image and Video Processing · Electrical Eng. & Systems 2023-11-17 Hendrik A. Mehrtens , Alexander Kurz , Tabea-Clara Bucher , Titus J. Brinker

Large Language Models (LLMs) have shown promise in clinical applications through prompt engineering, allowing flexible clinical predictions. However, they struggle to produce reliable prediction probabilities, which are crucial for…

Artificial Intelligence · Computer Science 2024-12-05 Bowen Gu , Rishi J. Desai , Kueiyu Joshua Lin , Jie Yang

Language Models (LMs) have shown promising performance in natural language generation. However, as LMs often generate incorrect or hallucinated responses, it is crucial to correctly quantify their uncertainty in responding to given inputs.…

Computation and Language · Computer Science 2024-09-17 Xinmeng Huang , Shuo Li , Mengxin Yu , Matteo Sesia , Hamed Hassani , Insup Lee , Osbert Bastani , Edgar Dobriban

The success of medical image segmentation usually requires a large number of high-quality labels. But since the labeling process is usually affected by the raters' varying skill levels and characteristics, the estimated masks provided by…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ming Li , Wei Shen , Qingli Li , Yan Wang

Large language models (LLMs) have achieved impressive results across a range of natural language processing tasks, but their potential to generate harmful content has raised serious safety concerns. Current toxicity detectors primarily rely…

Computation and Language · Computer Science 2025-10-20 Zhiqiang Kou , Junyang Chen , Xin-Qiang Cai , Ming-Kun Xie , Biao Liu , Changwei Wang , Lei Feng , Yuheng Jia , Gang Niu , Masashi Sugiyama , Xin Geng

Electronic Health Records (EHRs) and routine documentation practices play a vital role in patients' daily care, providing a holistic record of health, diagnoses, and treatment. However, complex and verbose EHR narratives overload healthcare…

Computation and Language · Computer Science 2025-02-26 Yanjun Gao , Ruizhe Li , Emma Croxford , John Caskey , Brian W Patterson , Matthew Churpek , Timothy Miller , Dmitriy Dligach , Majid Afshar

A decade of rapid advances in artificial intelligence (AI) has opened new opportunities for clinical decision support systems (CDSS), with large language models (LLMs) demonstrating strong reasoning abilities on timely medical tasks.…

Computation and Language · Computer Science 2025-11-25 Heejoon Koo

Designing robust algorithms capable of training accurate neural networks on uncurated datasets from the web has been the subject of much research as it reduces the need for time consuming human labor. The focus of many previous research…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Paul Albert , Eric Arazo , Tarun Krishna , Noel E. O'Connor , Kevin McGuinness

Large language models (LLMs) often generate fluent but factually incorrect outputs, known as hallucinations, which undermine their reliability in real-world applications. While uncertainty estimation has emerged as a promising strategy for…

Machine Learning · Computer Science 2025-05-13 Pei-Fu Guo , Yun-Da Tsai , Shou-De Lin

Semi-supervised learning has made significant strides in the medical domain since it alleviates the heavy burden of collecting abundant pixel-wise annotated data for semantic segmentation tasks. Existing semi-supervised approaches enhance…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Xu Zheng , Chong Fu , Haoyu Xie , Jialei Chen , Xingwei Wang , Chiu-Wing Sham

Adopting a two-stage paradigm of pretraining followed by fine-tuning, Pretrained Language Models (PLMs) have achieved substantial advancements in the field of natural language processing. However, in real-world scenarios, data labels are…

Computation and Language · Computer Science 2023-11-03 Song Wang , Zhen Tan , Ruocheng Guo , Jundong Li

Large Language Models (LLMs) are prone to generating fluent but incorrect content, known as confabulation, which poses increasing risks in multi-turn or agentic applications where outputs may be reused as context. In this work, we…

Computation and Language · Computer Science 2026-03-18 Tianyi Zhou , Johanne Medina , Sanjay Chawla

Training neural networks with one-hot target labels often results in overconfidence and overfitting. Label smoothing addresses this issue by perturbing the one-hot target labels by adding a uniform probability vector to create a regularized…

Computer Vision and Pattern Recognition · Computer Science 2025-09-09 Sachin Chhabra , Hemanth Venkateswara , Baoxin Li

Label noise poses a significant challenge in Earth Observation (EO), often degrading the performance and reliability of supervised Machine Learning (ML) models. Yet, given the critical nature of several EO applications, developing robust…

Large language models (LLMs) have recently emerged as powerful tools, finding many medical applications. LLMs' ability to coalesce vast amounts of information from many sources to generate a response-a process similar to that of a human…

Addressing mixed closed-set and open-set label noise in medical image classification remains a largely unexplored challenge. Unlike natural image classification, which often separates and processes closed-set and open-set noisy samples from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Zehui Liao , Shishuai Hu , Yanning Zhang , Yong Xia