中文
相关论文

相关论文: Two is Better than One: Efficient Ensemble Defense…

200 篇论文

Deep learning approaches such as convolutional neural nets have consistently outperformed previous methods on challenging tasks such as dense, semantic segmentation. However, the various proposed networks perform differently, with behaviour…

It is well known that deep neural networks (DNNs) are vulnerable to adversarial attacks, which are implemented by adding crafted perturbations onto benign examples. Min-max robust optimization based adversarial training can provide a notion…

计算机视觉与模式识别 · 计算机科学 2021-06-23 Shaokai Ye , Kaidi Xu , Sijia Liu , Jan-Henrik Lambrechts , Huan Zhang , Aojun Zhou , Kaisheng Ma , Yanzhi Wang , Xue Lin

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

Machine learning is a powerful tool enabling full automation of a huge number of tasks without explicit programming. Despite recent progress of machine learning in different domains, these models have shown vulnerabilities when they are…

机器学习 · 计算机科学 2026-03-27 Mohammad Meymani , Roozbeh Razavi-Far

Adversarial examples provoke weak reliability and potential security issues in deep neural networks. Although adversarial training has been widely studied to improve adversarial robustness, it works in an over-parameterized regime and…

计算机视觉与模式识别 · 计算机科学 2022-04-07 Byung-Kwan Lee , Junho Kim , Yong Man Ro

Deep neural networks (DNNs) have recently achieved great success in many visual recognition tasks. However, existing deep neural network models are computationally expensive and memory intensive, hindering their deployment in devices with…

机器学习 · 计算机科学 2020-06-16 Yu Cheng , Duo Wang , Pan Zhou , Tao Zhang

Following the recent adoption of deep neural networks (DNN) accross a wide range of applications, adversarial attacks against these models have proven to be an indisputable threat. Adversarial samples are crafted with a deliberate intention…

机器学习 · 计算机科学 2017-08-31 Valentina Zantedeschi , Maria-Irina Nicolae , Ambrish Rawat

Compressed deep learning models are crucial for deploying computer vision systems on resource-constrained devices. However, model compression may affect robustness, especially under natural corruption. Therefore, it is important to consider…

Today, artificial neural networks are the state of the art for solving a variety of complex tasks, especially in image classification. Such architectures consist of a sequence of stacked layers with the aim of extracting useful information…

机器学习 · 计算机科学 2023-01-31 Simone Sarti , Eugenio Lomurno , Matteo Matteucci

While deep learning has led to remarkable results on a number of challenging problems, researchers have discovered a vulnerability of neural networks in adversarial settings, where small but carefully chosen perturbations to the input can…

神经与进化计算 · 计算机科学 2018-11-26 Edward Grefenstette , Robert Stanforth , Brendan O'Donoghue , Jonathan Uesato , Grzegorz Swirszcz , Pushmeet Kohli

Recent years have seen significant efforts to adopt Artificial Intelligence (AI) in healthcare for various use cases, from computer-aided diagnosis to ICU triage. However, the size of AI models has been rapidly growing due to scaling laws…

图像与视频处理 · 电气工程与系统科学 2024-04-16 Mohammed Adnan , Qinle Ba , Nazim Shaikh , Shivam Kalra , Satarupa Mukherjee , Auranuch Lorsakul

The recent advances in deep neural networks (DNNs) make them attractive for embedded systems. However, it can take a long time for DNNs to make an inference on resource-constrained computing devices. Model compression techniques can address…

机器学习 · 计算机科学 2018-10-23 Qing Qin , Jie Ren , Jialong Yu , Ling Gao , Hai Wang , Jie Zheng , Yansong Feng , Jianbin Fang , Zheng Wang

Edge machine learning can deliver low-latency and private artificial intelligent (AI) services for mobile devices by leveraging computation and storage resources at the network edge. This paper presents an energy-efficient edge processing…

信息论 · 计算机科学 2020-03-03 Kai Yang , Yuanming Shi , Wei Yu , Zhi Ding

Although deep learning has demonstrated remarkable capability in learning from unstructured data, modern tree-based ensemble models remain superior in extracting relevant information and learning from structured datasets. While several…

机器学习 · 计算机科学 2026-02-05 Yi-Chun Liao , Chieh-Lin Tsai , Yuan-Hao Chang , Camélia Slimani , Jalil Boukhobza , Tei-Wei Kuo

Deep Ensembles are a simple, reliable, and effective method of improving both the predictive performance and uncertainty estimates of deep learning approaches. However, they are widely criticised as being computationally expensive, due to…

机器学习 · 计算机科学 2023-10-10 Guoxuan Xia , Christos-Savvas Bouganis

Pruning is a core technique for compressing neural networks to improve computational efficiency. This process is typically approached in two ways: one-shot pruning, which involves a single pass of training and pruning, and iterative…

机器学习 · 计算机科学 2025-08-20 Mikołaj Janusz , Tomasz Wojnar , Yawei Li , Luca Benini , Kamil Adamczewski

Model Compression has drawn much attention within the deep learning community recently. Compressing a dense neural network offers many advantages including lower computation cost, deployability to devices of limited storage and memories,…

机器学习 · 计算机科学 2024-11-04 Diptarka Saha , Zihe Liu , Feng Liang

Lightweight and effective models are essential for devices with limited resources, such as intelligent vehicles. Structured pruning offers a promising approach to model compression and efficiency enhancement. However, existing methods often…

计算机视觉与模式识别 · 计算机科学 2024-08-07 Jonas Schmitt , Ruiping Liu , Junwei Zheng , Jiaming Zhang , Rainer Stiefelhagen

Deep Neural Networks (DNNs) have achieved significant advances in a wide range of applications. However, their deployment on resource-constrained devices remains a challenge due to the large number of layers and parameters, which result in…

神经与进化计算 · 计算机科学 2025-09-05 Sara Makenali , Babak Rokh , Ali Azarpeyvand

The rapid growth in complexity and size of modern deep neural networks (DNNs) has increased challenges related to computational costs and memory usage, spurring a growing interest in efficient model compression techniques. Previous…

计算机视觉与模式识别 · 计算机科学 2025-07-04 Sarthak Ketanbhai Modi , Zi Pong Lim , Shourya Kuchhal , Yushi Cao , Yupeng Cheng , Yon Shin Teo , Shang-Wei Lin , Zhiming Li