English
Related papers

Related papers: Ranking Neural Checkpoints

200 papers

While deep neural networks have excellent results in many fields, they are susceptible to interference from attacking samples resulting in erroneous judgments. Feature-level attacks are one of the effective attack types, which targets the…

Computer Vision and Pattern Recognition · Computer Science 2023-10-24 Zhibo Jin , Zhiyu Zhu , Xinyi Wang , Jiayu Zhang , Jun Shen , Huaming Chen

Deep neural networks (DNN) such as Multi-Layer Perception (MLP) and Convolutional Neural Networks (CNN) represent one of the most established deep learning algorithms. Given the tremendous effects of the number of hidden layers on network…

Image and Video Processing · Electrical Eng. & Systems 2021-11-17 Shihao Shao , Yong Liu , Qinghua Cui

Modern deep neural network (DNN) systems are highly configurable with large a number of options that significantly affect their non-functional behavior, for example inference time and energy consumption. Performance models allow to…

Machine Learning · Computer Science 2019-04-08 Md Shahriar Iqbal , Lars Kotthoff , Pooyan Jamshidi

Embedded distributed inference of Neural Networks has emerged as a promising approach for deploying machine-learning models on resource-constrained devices in an efficient and scalable manner. The inference task is distributed across a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-07 Federico Nicolás Peccia , Oliver Bringmann

Deep neural networks (DNNs) are successful in many computer vision tasks. However, the most accurate DNNs require millions of parameters and operations, making them energy, computation and memory intensive. This impedes the deployment of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-26 Abhinav Goel , Caleb Tung , Yung-Hsiang Lu , George K. Thiruvathukal

Decoding behavior, perception, or cognitive state directly from neural signals has applications in brain-computer interface research as well as implications for systems neuroscience. In the last decade, deep learning has become the…

Neurons and Cognition · Quantitative Biology 2020-05-21 Jesse A. Livezey , Joshua I. Glaser

We have witnessed rapid evolution of deep neural network architecture design in the past years. These latest progresses greatly facilitate the developments in various areas such as computer vision and natural language processing. However,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-20 Yuntao Chen , Naiyan Wang , Zhaoxiang Zhang

Despite the power of deep neural networks for a wide range of tasks, an overconfident prediction issue has limited their practical use in many safety-critical applications. Many recent works have been proposed to mitigate this issue, but…

Machine Learning · Computer Science 2020-08-14 Jooyoung Moon , Jihyo Kim , Younghak Shin , Sangheum Hwang

Mixup~\cite{zhang2017mixup} is a recently proposed method for training deep neural networks where additional samples are generated during training by convexly combining random pairs of images and their associated labels. While simple to…

Machine Learning · Statistics 2020-01-08 Sunil Thulasidasan , Gopinath Chennupati , Jeff Bilmes , Tanmoy Bhattacharya , Sarah Michalak

Deep neural networks (DNNs) have achieved superior performance in various prediction tasks, but can be very vulnerable to adversarial examples or perturbations. Therefore, it is crucial to measure the sensitivity of DNNs to various forms of…

Machine Learning · Statistics 2019-12-23 Hai Shu , Hongtu Zhu

Deep learning has achieved impressive prediction accuracies in a variety of scientific and industrial domains. However, the nested non-linear feature of deep learning makes the learning highly non-transparent, i.e., it is still unknown how…

Machine Learning · Computer Science 2020-10-26 Chan Li , Haiping Huang

Deep Neural Networks (DNNs) are rapidly gaining popularity in a variety of important domains. Formally, DNNs are complicated vector-valued functions which come in a variety of sizes and applications. Unfortunately, modern DNNs have been…

Machine Learning · Computer Science 2021-01-12 Matthew Sotoudeh , Aditya V. Thakur

Recommender systems are aimed at generating a personalized ranked list of items that an end user might be interested in. With the unprecedented success of deep learning in computer vision and speech recognition, recently it has been a hot…

Information Retrieval · Computer Science 2018-08-16 Bo Song , Xin Yang , Yi Cao , Congfu Xu

Deep neural networks (DNNs) enable innovative applications of machine learning like image recognition, machine translation, or malware detection. However, deep learning is often criticized for its lack of robustness in adversarial settings…

Machine Learning · Computer Science 2018-03-14 Nicolas Papernot , Patrick McDaniel

Deep learning using multi-layer neural networks (NNs) architecture manifests superb power in modern machine learning systems. The trained Deep Neural Networks (DNNs) are typically large. The question we would like to address is whether it…

Computer Vision and Pattern Recognition · Computer Science 2016-07-05 Wei Pan , Hao Dong , Yike Guo

Learning to rank -- producing a ranked list of items specific to a query and with respect to a set of supervisory items -- is a problem of general interest. The setting we consider is one in which no analytic description of what constitutes…

We propose a novel application of Transfer Learning to classify video-frame sequences over multiple classes. This is a pre-weighted model that does not require to train a fresh CNN. This representation is achieved with the advent of "deep…

Computer Vision and Pattern Recognition · Computer Science 2020-04-30 Mohammadhossein Toutiaee , Abbas Keshavarzi , Abolfazl Farahani , John A. Miller

Deep neural networks (DNNs) are the workhorses of deep learning, which constitutes the state of the art in numerous application domains. However, DNN-based decision rules are notoriously prone to poor generalization, i.e., may prove…

Machine Learning · Computer Science 2023-05-11 Guy Amir , Osher Maayan , Tom Zelazny , Guy Katz , Michael Schapira

Bayesian neural networks (BNNs) demonstrate promising success in improving the robustness and uncertainty quantification of modern deep learning. However, they generally struggle with underfitting at scale and parameter efficiency. On the…

Neural networks have recently been proposed for multi-label classification because they are able to capture and model label dependencies in the output layer. In this work, we investigate limitations of BP-MLL, a neural network (NN)…

Machine Learning · Computer Science 2020-12-09 Jinseok Nam , Jungi Kim , Eneldo Loza Mencía , Iryna Gurevych , Johannes Fürnkranz