English
Related papers

Related papers: Deep Neural Networks Under Stress

200 papers

Deep neural networks have achieved impressive performance on a variety of tasks, but their brittleness to distributional shifts remains a significant barrier to real-world deployment. In this paper, we propose a framework to analyse and…

Machine Learning · Computer Science 2026-05-21 Divij Khaitan , Subhashis Banerjee

Deep convolutional neural networks accurately classify a diverse range of natural images, but may be easily deceived when designed, imperceptible perturbations are embedded in the images. In this paper, we design a multi-pronged training,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-26 Nathaniel Dean , Dilip Sarkar

In an ever expanding set of research and application areas, deep neural networks (DNNs) set the bar for algorithm performance. However, depending upon additional constraints such as processing power and execution time limits, or…

Machine Learning · Computer Science 2021-06-22 Nathan Dahlin , Krishna Chaitanya Kalagarla , Nikhil Naik , Rahul Jain , Pierluigi Nuzzo

The computer vision literature shows that randomly weighted neural networks perform reasonably as feature extractors. Following this idea, we study how non-trained (randomly weighted) convolutional neural networks perform as feature…

Sound · Computer Science 2019-02-18 Jordi Pons , Xavier Serra

We show that deep convolutional neural networks (CNN) can massively outperform traditional densely-connected neural networks (both deep or shallow) in predicting eigenvalue problems in mechanics. In this sense, we strike out in a new…

Computational Physics · Physics 2018-07-19 David Finol , Yan Lu , Vijay Mahadevan , Ankit Srivastava

Weight pruning is among the most popular approaches for compressing deep convolutional neural networks. Recent work suggests that in a randomly initialized deep neural network, there exist sparse subnetworks that achieve performance…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Vinay Kumar Verma , Nikhil Mehta , Shijing Si , Ricardo Henao , Lawrence Carin

Despite their renowned predictive power on i.i.d. data, convolutional neural networks are known to rely more on high-frequency patterns that humans deem superficial than on low-frequency patterns that agree better with intuitions about what…

Computer Vision and Pattern Recognition · Computer Science 2019-11-06 Haohan Wang , Songwei Ge , Eric P. Xing , Zachary C. Lipton

The integration of computer vision and deep learning is an essential part of documenting and preserving cultural heritage, as well as improving visitor experiences. In recent years, two deep learning paradigms have been established in the…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Teodor Boyadzhiev , Gabriele Lagani , Luca Ciampi , Giuseppe Amato , Krassimira Ivanova

With recent research advancements, deep learning models are becoming attractive and powerful choices for speech enhancement in real-time applications. While state-of-the-art models can achieve outstanding results in terms of speech quality…

Audio and Speech Processing · Electrical Eng. & Systems 2021-05-20 Sebastian Braun , Hannes Gamper , Chandan K. A. Reddy , Ivan Tashev

With the proliferation of mobile devices and the Internet of Things, deep learning models are increasingly deployed on devices with limited computing resources and memory, and are exposed to the threat of adversarial noise. Learning deep…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Xian Wei , Yanhui Huang , Yangyu Xu , Mingsong Chen , Hai Lan , Yuanxiang Li , Zhongfeng Wang , Xuan Tang

Deep learning based image segmentation methods have achieved great success, even having human-level accuracy in some applications. However, due to the black box nature of deep learning, the best method may fail in some situations. Thus…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Leixin Zhou , Wenxiang Deng , Xiaodong Wu

The fractal dimension provides a statistical index of object complexity by studying how the pattern changes with the measuring scale. Although useful in several classification tasks, the fractal dimension is under-explored in deep learning…

Machine Learning · Computer Science 2024-01-10 Julia El Zini , Bassel Musharrafieh , Mariette Awad

Deep learning takes advantage of large datasets and computationally efficient training algorithms to outperform other approaches at various machine learning tasks. However, imperfections in the training phase of deep neural networks make…

Cryptography and Security · Computer Science 2015-11-25 Nicolas Papernot , Patrick McDaniel , Somesh Jha , Matt Fredrikson , Z. Berkay Celik , Ananthram Swami

While many approaches to make neural networks more fathomable have been proposed, they are restricted to interrogating the network with input data. Measures for characterizing and monitoring structural properties, however, have not been…

Machine Learning · Computer Science 2019-09-30 Bastian Rieck , Matteo Togninalli , Christian Bock , Michael Moor , Max Horn , Thomas Gumbsch , Karsten Borgwardt

In recent times, the trend in very large scale integration (VLSI) industry is multi-dimensional, for example, reduction of energy consumption, occupancy of less space, precise result, less power dissipation, faster response. To meet these…

Machine Learning · Computer Science 2021-07-02 Gaurab Bhattacharya

Deep learning models for survival analysis have gained significant attention in the literature, but they suffer from severe performance deficits when the dataset contains many irrelevant features. We give empirical evidence for this problem…

Machine Learning · Computer Science 2019-03-08 Carl Rietschel , Jinsung Yoon , Mihaela van der Schaar

In recent years, deep neural network (DNN) compression systems have proved to be highly effective for designing source codes for many natural sources. However, like many other machine learning systems, these compressors suffer from…

Machine Learning · Computer Science 2021-10-15 Eric Lei , Hamed Hassani , Shirin Saeedi Bidokhti

Over the last decade, the development of deep image classification networks has mostly been driven by the search for the best performance in terms of classification accuracy on standardized benchmarks like ImageNet. More recently, this…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Kalun Ho , Franz-Josef Pfreundt , Janis Keuper , Margret Keuper

As deep neural networks (DNNs) become widely used, pruned and quantised models are becoming ubiquitous on edge devices; such compressed DNNs are popular for lowering computational requirements. Meanwhile, recent studies show that…

Cryptography and Security · Computer Science 2020-04-17 Yiren Zhao , Ilia Shumailov , Robert Mullins , Ross Anderson

Deep convolutional neural networks (CNN) has become the most promising method for object recognition, repeatedly demonstrating record breaking results for image classification and object detection in recent years. However, a very deep CNN…

Computer Vision and Pattern Recognition · Computer Science 2014-12-22 Yunchao Gong , Liu Liu , Ming Yang , Lubomir Bourdev