English
Related papers

Related papers: Alternating Training-based Label Smoothing Enhance…

200 papers

Representing a label distribution as a one-hot vector is a common practice in training node classification models. However, the one-hot representation may not adequately reflect the semantic characteristics of a node in different classes,…

Machine Learning · Computer Science 2021-12-02 Yiwei Wang , Yujun Cai , Yuxuan Liang , Wei Wang , Henghui Ding , Muhao Chen , Jing Tang , Bryan Hooi

Large vision-language models (LVLMs) are markedly proficient in deriving visual representations guided by natural language. Recent explorations have utilized LVLMs to tackle zero-shot visual anomaly detection (VAD) challenges by pairing…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Jiaqi Zhu , Shaofeng Cai , Fang Deng , Beng Chin Ooi , Junran Wu

Combining multiple object detection datasets offers a path to improved generalisation but is hindered by inconsistencies in class semantics and bounding box annotations. Some methods to address this assume shared label taxonomies and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Mikhail Kennerley , Angelica Aviles-Rivero , Carola-Bibiane Schönlieb , Robby T. Tan

Semi-supervised learning (SSL) is an efficient framework that can train models with both labeled and unlabeled data, but may generate ambiguous and non-distinguishable representations when lacking adequate labeled samples. With…

Computer Vision and Pattern Recognition · Computer Science 2022-08-08 Xinkai Yuan , Zilinghan Li , Gaoang Wang

Large language models (LLMs) have shown remarkable adaptability to diverse tasks, by leveraging context prompts containing instructions, or minimal input-output examples. However, recent work revealed they also exhibit label bias -- an…

Computation and Language · Computer Science 2024-05-07 Yuval Reif , Roy Schwartz

The robustness of supervised deep learning-based medical image classification is significantly undermined by label noise. Although several methods have been proposed to enhance classification performance in the presence of noisy labels,…

Machine Learning · Computer Science 2024-10-28 Bidur Khanal , Tianhong Dai , Binod Bhattarai , Cristian Linte

Semi-Supervised Learning (SSL) has been an effective way to leverage abundant unlabeled data with extremely scarce labeled data. However, most SSL methods are commonly based on instance-wise consistency between different data…

Machine Learning · Computer Science 2023-10-26 Zhuo Huang , Li Shen , Jun Yu , Bo Han , Tongliang Liu

Randomized smoothing (RS) is one of the prominent techniques to ensure the correctness of machine learning models, where point-wise robustness certificates can be derived analytically. While RS is well understood for classification, its…

Machine Learning · Computer Science 2025-09-22 Emmanouil Seferis , Changshun Wu , Stefanos Kollias , Saddek Bensalem , Chih-Hong Cheng

Recently it has been shown that state-of-the-art NLP models are vulnerable to adversarial attacks, where the predictions of a model can be drastically altered by slight modifications to the input (such as synonym substitutions). While…

Computation and Language · Computer Science 2023-07-13 Yahan Yang , Soham Dan , Dan Roth , Insup Lee

Self-supervised learning systems have gained significant attention in recent years by leveraging clustering-based pseudo-labels to provide supervision without the need for human annotations. However, the noise in these pseudo-labels caused…

Computer Vision and Pattern Recognition · Computer Science 2024-10-21 Zia-ur-Rehman , Arif Mahmood , Wenxiong Kang

Vision-language models (VLMs) such as CLIP exhibit strong Out-of-distribution (OOD) detection capabilities by aligning visual and textual representations. Recent CLIP-based test-time adaptation methods further improve detection performance…

Computation and Language · Computer Science 2026-04-20 Jinlun Ye , Jiang Liao , Runhe Lai , Xinhua Lu , Jiaxin Zhuang , Zhiyong Gan , Ruixuan Wang

Despite the great success of state-of-the-art deep neural networks, several studies have reported models to be over-confident in predictions, indicating miscalibration. Label Smoothing has been proposed as a solution to the over-confidence…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Shuang Ao , Stefan Rueger , Advaith Siddharthan

In this paper, we introduce a novel knowledge distillation approach for the semantic segmentation task. Unlike previous methods that rely on power-trained teachers or other modalities to provide additional knowledge, our approach does not…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Shoumeng Qiu , Jie Chen , Xinrun Li , Ru Wan , Xiangyang Xue , Jian Pu

Neural networks lack adversarial robustness, i.e., they are vulnerable to adversarial examples that through small perturbations to inputs cause incorrect predictions. Further, trust is undermined when models give miscalibrated predictions,…

Machine Learning · Computer Science 2021-12-15 Yao Qin , Xuezhi Wang , Alex Beutel , Ed H. Chi

Pre-trained vision-language models (VLMs) have shown impressive performance on various downstream tasks by utilizing knowledge learned from large data. In general, the performance of VLMs on target tasks can be further improved by prompt…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Eulrang Cho , Jooyeon Kim , Hyunwoo J. Kim

Anchor-free detectors basically formulate object detection as dense classification and regression. For popular anchor-free detectors, it is common to introduce an individual prediction branch to estimate the quality of localization. The…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Hu Su , Yonghao He , Rui Jiang , Jiabin Zhang , Wei Zou , Bin Fan

Deep Learning (DL) models achieve great successes in many domains. However, DL models increasingly face safety and robustness concerns, including noisy labeling in the training stage and feature distribution shifts in the testing stage.…

Machine Learning · Computer Science 2024-01-30 Kyle Otstot , Andrew Yang , John Kevin Cava , Lalitha Sankar

Research to improve Automated Short Answer Grading has recently focused on Large Language Models (LLMs) with prompt engineering and no- or few-shot prompting to achieve best results. This is in contrast to the fine-tuning approach, which…

Machine Learning · Computer Science 2025-08-07 Joel Walsh , Siddarth Mamidanna , Benjamin Nye , Mark Core , Daniel Auerbach

Prompt tuning (PT) is an effective approach to adapting pre-trained language models to downstream tasks. Without a good initialization, prompt tuning doesn't perform well under few-shot settings. So pre-trained prompt tuning (PPT) is…

Computation and Language · Computer Science 2022-05-26 Yukun Huang , Kun Qian , Zhou Yu

As an effective way to alleviate the burden of data annotation, semi-supervised learning (SSL) provides an attractive solution due to its ability to leverage both labeled and unlabeled data to build a predictive model. While significant…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Hai-Ming Xu , Lingqiao Liu , Hao Chen , Ehsan Abbasnejad , Rafael Felix