中文
相关论文

相关论文: Maximum Likelihood Distillation for Robust Modulat…

200 篇论文

Deep reinforcement learning (DRL) policies have been shown to be deceived by perturbations (e.g., random noise or intensional adversarial attacks) on state observations that appear at test time but are unknown during training. To increase…

机器学习 · 计算机科学 2020-12-25 Xinghua Qu , Yew-Soon Ong , Abhishek Gupta , Zhu Sun

Deep learning based automatic modulation classification (AMC) has received significant attention owing to its potential applications in both military and civilian use cases. Recently, data-driven subsampling techniques have been utilized to…

机器学习 · 计算机科学 2024-01-09 Abu Shafin Mohammad Mahdee Jameel , Ahmed P. Mohamed , Jinho Yi , Aly El Gamal , Akshay Malhotra

An active learner is given a class of models, a large set of unlabeled examples, and the ability to interactively query labels of a subset of these examples; the goal of the learner is to learn a model in the class that fits the data well.…

机器学习 · 计算机科学 2015-06-09 Kamalika Chaudhuri , Sham Kakade , Praneeth Netrapalli , Sujay Sanghavi

Training machine learning models that are robust against adversarial inputs poses seemingly insurmountable challenges. To better understand adversarial robustness, we consider the underlying problem of learning robust representations. We…

机器学习 · 计算机科学 2020-07-07 Sicheng Zhu , Xiao Zhang , David Evans

Deep networks have been revolutionary in improving performance of machine learning and artificial intelligence systems. Their high prediction accuracy, however, comes at a price of \emph{model irreproducibility\/} in very high levels that…

机器学习 · 计算机科学 2020-10-21 Gil I. Shamir , Lorenzo Coviello

The vulnerability of artificial neural networks to adversarial perturbations in the black-box setting is widely studied in the literature. The majority of attack methods to construct these perturbations suffer from an impractically large…

机器学习 · 计算机科学 2024-10-22 Kirill Lukyanov , Andrew Perminov , Denis Turdakov , Mikhail Pautov

It has been reported that deep learning models are extremely vulnerable to small but intentionally chosen perturbations of its input. In particular, a deep network, despite its near-optimal accuracy on the clean images, often mis-classifies…

机器学习 · 计算机科学 2022-03-16 A. Tuan Nguyen , Ser Nam Lim , Philip Torr

Recent language models have shown remarkable performance on natural language understanding (NLU) tasks. However, they are often sub-optimal when faced with ambiguous samples that can be interpreted in multiple ways, over-confidently…

计算与语言 · 计算机科学 2024-06-17 Hancheol Park , Soyeong Jeong , Sukmin Cho , Jong C. Park

Knowledge distillation is a strategy of training a student network with guide of the soft output from a teacher network. It has been a successful method of model compression and knowledge transfer. However, currently knowledge distillation…

机器学习 · 计算机科学 2024-10-21 Guangda Ji , Zhanxing Zhu

One of the major challenges in training deep architectures for predictive tasks is the scarcity and cost of labeled training data. Active Learning (AL) is one way of addressing this challenge. In stream-based AL, observations are…

机器学习 · 计算机科学 2019-09-05 Andreas Kvistad , Massimiliano Ruocco , Eliezer de Souza da Silva , Erlend Aune

The recent advancement in deep learning (DL) for automatic modulation classification (AMC) of wireless signals has encouraged numerous possible applications on resource-constrained edge devices. However, developing optimized DL models…

信号处理 · 电气工程与系统科学 2024-04-25 Nayan Moni Baishya , B. R. Manoj , Prabin K. Bora

Large datasets often have unreliable labels-such as those obtained from Amazon's Mechanical Turk or social media platforms-and classifiers trained on mislabeled datasets often exhibit poor performance. We present a simple, effective…

计算机视觉与模式识别 · 计算机科学 2017-05-10 Ishan Jindal , Matthew Nokleby , Xuewen Chen

Deep learning has been shown to be highly effective for automatic modulation classification (AMC), which is a pivotal technology for next-generation cognitive communications. Yet, existing deep learning methods for AMC often lack robust…

信号处理 · 电气工程与系统科学 2025-12-03 Huian Yang , Rajeev Sahay

In learning problems, the noise inherent to the task at hand hinders the possibility to infer without a certain degree of uncertainty. Quantifying this uncertainty, regardless of its wide use, assumes high relevance for security-sensitive…

Deep Metric Learning (DML), a widely-used technique, involves learning a distance metric between pairs of samples. DML uses deep neural architectures to learn semantic embeddings of the input, where the distance between similar examples is…

机器学习 · 计算机科学 2021-02-16 Thomas Kobber Panum , Zi Wang , Pengyu Kan , Earlence Fernandes , Somesh Jha

Distilling knowledge from a large teacher model to a lightweight one is a widely successful approach for generating compact, powerful models in the semi-supervised learning setting where a limited amount of labeled data is available. In…

机器学习 · 计算机科学 2023-02-07 Cenk Baykal , Khoa Trinh , Fotis Iliopoulos , Gaurav Menghani , Erik Vee

Knowledge distillation is effective for producing small, high-performance neural networks for classification, but these small networks are vulnerable to adversarial attacks. This paper studies how adversarial robustness transfers from…

机器学习 · 计算机科学 2020-07-02 Micah Goldblum , Liam Fowl , Soheil Feizi , Tom Goldstein

Deep learning algorithms have been shown to perform extremely well on many classical machine learning problems. However, recent studies have shown that deep learning, like other machine learning techniques, is vulnerable to adversarial…

密码学与安全 · 计算机科学 2016-03-15 Nicolas Papernot , Patrick McDaniel , Xi Wu , Somesh Jha , Ananthram Swami

Learning with noisy labels has become an effective strategy for enhancing the robustness of models, which enables models to better tolerate inaccurate data. Existing methods either focus on optimizing the loss function to mitigate the…

人工智能 · 计算机科学 2024-06-04 Xiaming Che , Junlin Zhang , Zhuang Qi , Xin Qi

This study explores the robustness of label noise classifiers, aiming to enhance model resilience against noisy data in complex real-world scenarios. Label noise in supervised learning, characterized by erroneous or imprecise labels,…

机器学习 · 计算机科学 2023-12-13 Cheng Zeng , Yixuan Xu , Jiaqi Tian