English
Related papers

Related papers: Inoculation by Fine-Tuning: A Method for Analyzing…

200 papers

Graph Neural Networks (GNNs) have achieved remarkable performance through their message-passing mechanism. However, recent studies have highlighted the vulnerability of GNNs to backdoor attacks, which can lead the model to misclassify…

Machine Learning · Computer Science 2025-01-13 Jiale Zhang , Bosen Rao , Chengcheng Zhu , Xiaobing Sun , Qingming Li , Haibo Hu , Xiapu Luo , Qingqing Ye , Shouling Ji

Large Language Models (LLMs) are often trained with safety guards intended to prevent harmful text generation. However, such safety training can be removed by fine-tuning the LLM on harmful datasets. While this emerging threat (harmful…

Computation and Language · Computer Science 2024-10-04 Domenic Rosati , Jan Wehner , Kai Williams , Łukasz Bartoszcze , Jan Batzner , Hassan Sajjad , Frank Rudzicz

The release of large natural language inference (NLI) datasets like SNLI and MNLI have led to rapid development and improvement of completely neural systems for the task. Most recently, heavily pre-trained, Transformer-based models like…

Computation and Language · Computer Science 2019-12-10 Tiffany Chien , Jugal Kalita

Data poisoning attacks compromise the integrity of machine-learning models by introducing malicious training samples to influence the results during test time. In this work, we investigate backdoor data poisoning attack on deep neural…

Machine Learning · Computer Science 2019-12-04 Mahesh Subedar , Nilesh Ahuja , Ranganath Krishnan , Ibrahima J. Ndiour , Omesh Tickoo

Current deep learning paradigms largely benefit from the tremendous amount of annotated data. However, the quality of the annotations often varies among labelers. Multi-observer studies have been conducted to study these annotation…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Xiaosong Wang , Ziyue Xu , Dong Yang , Leo Tam , Holger Roth , Daguang Xu

Traditional instance-based model analysis focuses mainly on misclassified instances. However, this approach overlooks the varying difficulty associated with different instances. Ideally, a robust model should recognize and reflect the…

Human-Computer Interaction · Computer Science 2025-07-02 Linhao Meng , Stef van den Elzen , Anna Vilanova

Understanding and identifying different types of single molecules' diffusion that occur in a broad range of systems (including living matter) is extremely important, as it can provide information on the physical and chemical characteristics…

Quantitative Methods · Quantitative Biology 2023-03-07 Patrycja Kowalek , Hanna Loch-Olszewska , Łukasz Łaszczuk , Jarosław Opała , Janusz Szwabiński

Motivated by the goals of dataset pruning and defect identification, a growing body of methods have been developed to score individual examples within a dataset. These methods, which we call "example difficulty scores", are typically used…

Machine Learning · Computer Science 2024-01-04 Devin Kwok , Nikhil Anand , Jonathan Frankle , Gintare Karolina Dziugaite , David Rolnick

The presence of noisy labels in a training dataset can significantly impact the performance of machine learning models. To tackle this issue, researchers have explored methods for Learning with Noisy Labels to identify clean samples and…

Machine Learning · Computer Science 2023-10-30 Sumyeong Ahn , Sihyeon Kim , Jongwoo Ko , Se-Young Yun

In computational pathology, several foundation models have recently emerged and demonstrated enhanced learning capability for analyzing pathology images. However, adapting these models to various downstream tasks remains challenging,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Jeaung Lee , Jeewoo Lim , Keunho Byeon , Jin Tae Kwak

Adaptive medical AI models often face performance drops in dynamic clinical environments due to data drift. We propose an autonomous continuous monitoring and data integration framework that maintains robust performance over time. Focusing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Mohammad Daouk , Jan Ulrich Becker , Neeraja Kambham , Anthony Chang , Chandra Mohan , Hien Van Nguyen

Fine-tuning pretrained contextual word embedding models to supervised downstream tasks has become commonplace in natural language processing. This process, however, is often brittle: even with the same hyperparameter values, distinct random…

Computation and Language · Computer Science 2020-02-19 Jesse Dodge , Gabriel Ilharco , Roy Schwartz , Ali Farhadi , Hannaneh Hajishirzi , Noah Smith

Modern machine learning models are prone to over-reliance on spurious correlations, which can often lead to poor performance on minority groups. In this paper, we identify surprising and nuanced behavior of finetuned models on worst-group…

Machine Learning · Computer Science 2024-10-29 Tyler LaBonte , John C. Hill , Xinchen Zhang , Vidya Muthukumar , Abhishek Kumar

The aim of dataset distillation is to encode the rich features of an original dataset into a tiny dataset. It is a promising approach to accelerate neural network training and related studies. Different approaches have been proposed to…

Machine Learning · Computer Science 2023-05-30 Zongxiong Chen , Jiahui Geng , Derui Zhu , Herbert Woisetschlaeger , Qing Li , Sonja Schimmler , Ruben Mayer , Chunming Rong

Much machine learning research progress is based on developing models and evaluating them on a benchmark dataset (e.g., ImageNet for images). However, applying such benchmark-successful methods to real-world data often does not work as…

Machine Learning · Computer Science 2024-06-17 Lenka Tětková , Erik Schou Dreier , Robin Malm , Lars Kai Hansen

Indiscriminate data poisoning attacks aim to decrease a model's test accuracy by injecting a small amount of corrupted training data. Despite significant interest, existing attacks remain relatively ineffective against modern machine…

Machine Learning · Computer Science 2023-06-07 Yiwei Lu , Gautam Kamath , Yaoliang Yu

Recent progress in generative AI, primarily through diffusion models, presents significant challenges for real-world deepfake detection. The increased realism in image details, diverse content, and widespread accessibility to the general…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Chaitali Bhattacharyya , Hanxiao Wang , Feng Zhang , Sungho Kim , Xiatian Zhu

Deep convolutional neural networks (CNNs) for image denoising are usually trained on large datasets. These models achieve the current state of the art, but they have difficulties generalizing when applied to data that deviate from the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Sreyas Mohan , Joshua L. Vincent , Ramon Manzorro , Peter A. Crozier , Eero P. Simoncelli , Carlos Fernandez-Granda

This paper proposes a scenario-based functional testing approach for enhancing the performance of machine learning (ML) applications. The proposed method is an iterative process that starts with testing the ML model on various scenarios to…

Machine Learning · Computer Science 2023-07-17 Hong Zhu , Thi Minh Tam Tran , Aduen Benjumea , Andrew Bradley

We present GIFT: a {G}radient-aware {I}mmunization technique to defend diffusion models against malicious {F}ine-{T}uning while preserving their ability to generate safe content. Existing safety mechanisms like safety checkers are easily…

Cryptography and Security · Computer Science 2025-07-21 Amro Abdalla , Ismail Shaheen , Dan DeGenaro , Rupayan Mallick , Bogdan Raita , Sarah Adel Bargal