中文
相关论文

相关论文: Inoculation by Fine-Tuning: A Method for Analyzing…

200 篇论文

In many contexts, we have access to aggregate data, but individual level data is unavailable. For example, medical studies sometimes report only aggregate statistics about disease prevalence because of privacy concerns. Even so, many a time…

机器学习 · 计算机科学 2018-09-18 Sanket Tavarageri , Nag Mani , Anand Ramasubramanian , Jaskiran Kalsi

Our Visual Analytics (VA) tool ScrutinAI supports human analysts to investigate interactively model performanceand data sets. Model performance depends on labeling quality to a large extent. In particular in medical settings, generation of…

机器学习 · 计算机科学 2023-08-03 Rebekka Görge , Elena Haedecke , Michael Mock

Machine learning models often pose a threat to the privacy of individuals whose data is part of the training set. Several recent attacks have been able to infer sensitive information from trained models, including model inversion or…

机器学习 · 计算机科学 2020-06-30 Abigail Goldsteen , Gilad Ezov , Ariel Farkash

We propose Dataset Reinforcement, a strategy to improve a dataset once such that the accuracy of any model architecture trained on the reinforced dataset is improved at no additional training cost for users. We propose a Dataset…

计算机视觉与模式识别 · 计算机科学 2023-09-25 Fartash Faghri , Hadi Pouransari , Sachin Mehta , Mehrdad Farajtabar , Ali Farhadi , Mohammad Rastegari , Oncel Tuzel

Training deep neural networks is challenging when large and annotated datasets are unavailable. Extensive manual annotation of data samples is time-consuming, expensive, and error-prone, notably when it needs to be done by experts. To…

机器学习 · 计算机科学 2021-09-08 Barbara C Benato , Alexandru C Telea , Alexandre X Falcão

Neural networks are widely known to be vulnerable to backdoor attacks, a method that poisons a portion of the training data to make the target model perform well on normal data sets, while outputting attacker-specified or random categories…

计算机视觉与模式识别 · 计算机科学 2024-06-07 Yong Li , Han Gao

Few-shot learning is the process of learning novel classes using only a few examples and it remains a challenging task in machine learning. Many sophisticated few-shot learning algorithms have been proposed based on the notion that networks…

机器学习 · 计算机科学 2019-10-04 Akihiro Nakamura , Tatsuya Harada

Text-to-image diffusion models achieve high-fidelity image generation from natural language prompts. ControlNets extend these models by enabling conditioning on structural inputs (e.g., edge maps, depth, pose), providing fine-grained…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Raz Lapid , Almog Dubin

The impressive performance of deep learning architectures is associated with a massive increase in model complexity. Millions of parameters need to be tuned, with training and inference time scaling accordingly, together with energy…

机器学习 · 计算机科学 2023-11-10 Paolo Didier Alfano , Vito Paolo Pastore , Lorenzo Rosasco , Francesca Odone

Black-box finetuning is an emerging interface for adapting state-of-the-art language models to user needs. However, such access may also let malicious actors undermine model safety. To demonstrate the challenge of defending finetuning…

密码学与安全 · 计算机科学 2024-07-01 Danny Halawi , Alexander Wei , Eric Wallace , Tony T. Wang , Nika Haghtalab , Jacob Steinhardt

Data Poisoning attacks modify training data to maliciously control a model trained on such data. In this work, we focus on targeted poisoning attacks which cause a reclassification of an unmodified test image and as such breach model…

计算机视觉与模式识别 · 计算机科学 2021-05-11 Jonas Geiping , Liam Fowl , W. Ronny Huang , Wojciech Czaja , Gavin Taylor , Michael Moeller , Tom Goldstein

Deep learning-based diagnostic systems have demonstrated potential in skin disease diagnosis. However, their performance can easily degrade on test domains due to distribution shifts caused by input-level corruptions, such as imaging…

图像与视频处理 · 电气工程与系统科学 2024-05-21 Ming Hu , Siyuan Yan , Peng Xia , Feilong Tang , Wenxue Li , Peibo Duan , Lin Zhang , Zongyuan Ge

In recent years, Large Language Models (LLMs) have shown remarkable performance in generating human-like text, proving to be a valuable asset across various applications. However, adapting these models to incorporate new, out-of-domain…

As fine-tuning large language models (LLMs) becomes increasingly prevalent, users often rely on third-party services with limited visibility into their fine-tuning processes. This lack of transparency raises the question: how do consumers…

机器学习 · 计算机科学 2024-11-13 Eva Zhang , Arka Pal , Akilesh Potti , Micah Goldblum

Transfer learning is beneficial by allowing the expressive features of models pretrained on large-scale datasets to be finetuned for the target task of smaller, more domain-specific datasets. However, there is a concern that these…

计算机视觉与模式识别 · 计算机科学 2023-08-21 Angelina Wang , Olga Russakovsky

A fundamental challenge of over-parameterized deep learning models is learning meaningful data representations that yield good performance on a downstream task without over-fitting spurious input features. This work proposes MaskTune, a…

The emergence of learned indexes has caused a paradigm shift in our perception of indexing by considering indexes as predictive models that estimate keys' positions within a data set, resulting in notable improvements in key search…

数据库 · 计算机科学 2024-08-09 Alireza Heidari , Amirhossein Ahmadi , Wei Zhang

Advances in dataset analysis techniques have enabled more sophisticated approaches to analyzing and characterizing training data instances, often categorizing data based on attributes such as ``difficulty''. In this work, we introduce…

计算与语言 · 计算机科学 2024-10-15 Mohammad Reza Modarres , Sina Abbasi , Mohammad Taher Pilehvar

Deep learning models are vulnerable to backdoor attacks, where attackers inject malicious behavior through data poisoning and later exploit triggers to manipulate deployed models. To improve the stealth and effectiveness of backdoors, prior…

密码学与安全 · 计算机科学 2024-09-10 Xiaolei Liu , Ming Yi , Kangyi Ding , Bangzhou Xin , Yixiao Xu , Li Yan , Chao Shen

Training foundation models on extensive datasets and then finetuning them on specific tasks has emerged as the mainstream approach in artificial intelligence. However, the model robustness, which is a critical aspect for safety, is often…

计算机视觉与模式识别 · 计算机科学 2023-12-15 Kai Qiu , Huishuai Zhang , Zhirong Wu , Stephen Lin