English
Related papers

Related papers: Randomized Smoothing Meets Vision-Language Models

200 papers

Vision-based reinforcement learning (RL) is a promising technique to solve control tasks involving images as the main observation. State-of-the-art RL algorithms still struggle in terms of sample efficiency, especially when using image…

Machine Learning · Computer Science 2021-09-29 Elie Aljalbout , Maximilian Ulmer , Rudolph Triebel

Semantic segmentation is critical for scene understanding but demands costly pixel-wise annotations, attracting increasing attention to semi-supervised approaches to leverage abundant unlabeled data. While semi-supervised segmentation is…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Steven Landgraf , Markus Hillemann , Markus Ulrich

Graph classification has practical applications in diverse fields. Recent studies show that graph-based machine learning models are especially vulnerable to adversarial perturbations due to the non i.i.d nature of graph data. By adding or…

Machine Learning · Computer Science 2020-09-15 Zhidong Gao , Rui Hu , Yanmin Gong

Any classifier can be "smoothed out" under Gaussian noise to build a new classifier that is provably robust to $\ell_2$-adversarial perturbations, viz., by averaging its predictions over the noise via randomized smoothing. Under the…

Machine Learning · Computer Science 2022-12-21 Jongheon Jeong , Seojin Kim , Jinwoo Shin

We extend randomized smoothing to cover parameterized transformations (e.g., rotations, translations) and certify robustness in the parameter space (e.g., rotation angle). This is particularly challenging as interpolation and rounding…

Machine Learning · Computer Science 2021-08-26 Marc Fischer , Maximilian Baader , Martin Vechev

Randomized smoothing is a powerful tool for certifying robustness to adversarial perturbations, including poisoning attacks via randomized training and evasion attacks via randomized inference. Extending these guarantees to backdoor…

Machine Learning · Computer Science 2026-05-22 Aman Saxena , Jan Schuchardt , Yan Scholten , Stephan Günnemann

Randomized Smoothing (RS) is currently a scalable certified defense method providing robustness certification against adversarial examples. Although significant progress has been achieved in providing defenses against $\ell_p$ adversaries,…

Machine Learning · Computer Science 2024-06-06 Youwei Shu , Xi Xiao , Derui Wang , Yuxin Cao , Siji Chen , Jason Xue , Linyi Li , Bo Li

It is widely recognized that reinforcement learning (RL) fine-tuning of large language models often leads to diversity collapse, where outputs lack variety. Prior work has proposed a range of heuristics to counteract this effect, but these…

Machine Learning · Computer Science 2025-12-12 Jingchu Gai , Guanning Zeng , Huaqing Zhang , Aditi Raghunathan

Label Smoothing (LS) is an effective regularizer to improve the generalization of state-of-the-art deep models. For each training sample the LS strategy smooths the one-hot encoded training signal by distributing its distribution mass over…

Machine Learning · Computer Science 2020-12-04 Hongyu Guo

Label smoothing is an effective regularization tool for deep neural networks (DNNs), which generates soft labels by applying a weighted average between the uniform distribution and the hard label. It is often used to reduce the overfitting…

Computer Vision and Pattern Recognition · Computer Science 2021-07-23 Chang-Bin Zhang , Peng-Tao Jiang , Qibin Hou , Yunchao Wei , Qi Han , Zhen Li , Ming-Ming Cheng

Machine Learning (ML) models have been utilized for malware detection for over two decades. Consequently, this ignited an ongoing arms race between malware authors and antivirus systems, compelling researchers to propose defenses for…

Cryptography and Security · Computer Science 2023-10-04 Shoumik Saha , Wenxiao Wang , Yigitcan Kaya , Soheil Feizi , Tudor Dumitras

Out-of-distribution (OOD) detection, which aims to distinguish unknown classes from known classes, has received increasing attention recently. A main challenge within is the unavailable of samples from the unknown classes in the training…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Mingle Xu , Jaehwan Lee , Sook Yoon , Dong Sun Park

Soft random sampling (SRS) is a simple yet effective approach for efficient training of large-scale deep neural networks when dealing with massive data. SRS selects a subset uniformly at random with replacement from the full data set in…

Machine Learning · Computer Science 2023-11-27 Xiaodong Cui , Ashish Mittal , Songtao Lu , Wei Zhang , George Saon , Brian Kingsbury

Reliable out-of-distribution (OOD) detection is a critical requirement for the safe deployment of machine learning systems. Despite recent progress, state-of-the-art OOD detectors are highly susceptible to adversarial attacks, which…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Maria Stoica , Abdelrahman Hekal , Alessio Lomuscio

Label Smoothing (LS) improves model generalization through penalizing models from generating overconfident output distributions. For each training sample the LS strategy smooths the one-hot encoded training signal by distributing its…

Machine Learning · Computer Science 2021-06-29 Hongyu Guo

Deep neural networks are vulnerable to adversarial perturbations, limiting deployment in safety-critical applications such as synthetic aperture radar (SAR) automatic target recognition (ATR). Randomized smoothing improves robustness by…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Daniel Brignac , Fengwei Tian , Banafsheh Latibari , Abhijit Mahalanobis , Ravi Tandon

With the growing integration of AI in daily life, ensuring the robustness of systems to inference-time attacks is crucial. Among the approaches for certifying robustness to such adversarial examples, randomized smoothing has emerged as…

Computation and Language · Computer Science 2024-08-02 Zhuoqun Huang , Neil G Marchant , Olga Ohrimenko , Benjamin I. P. Rubinstein

The growing prevalence of large language models (LLMs) and vision-language models (VLMs) has heightened the need for reliable techniques to determine whether a model has been fine-tuned from or is even identical to another. Existing…

Machine Learning · Computer Science 2025-09-30 Ruibo Chen , Sheng Zhang , Yihan Wu , Tong Zheng , Peihua Mai , Heng Huang

We demonstrate that learning procedures that rely on aggregated labels, e.g., label information distilled from noisy responses, enjoy robustness properties impossible without data cleaning. This robustness appears in several ways. In the…

Machine Learning · Statistics 2026-05-26 Chen Cheng , John Duchi

Large language models (LLMs) frequently generate multiple candidate responses for a given prompt, yet selecting the most reliable one remains challenging, especially when correctness diverges from surface-level majority agreement. Existing…

Computation and Language · Computer Science 2026-04-15 Manh Nguyen , Sunil Gupta , Hung Le
‹ Prev 1 4 5 6 7 8 10 Next ›