English
Related papers

Related papers: Deep k-Nearest Neighbors: Towards Confident, Inter…

200 papers

Deep neural networks (DNNs) have achieved remarkable success in a variety of computer vision tasks, where massive labeled images are routinely required for model optimization. Yet, the data collected from the open world are unavoidably…

Computer Vision and Pattern Recognition · Computer Science 2023-02-13 Peng Cui , Yang Yue , Zhijie Deng , Jun Zhu

k-Nearest Neighbors is one of the most fundamental but effective classification models. In this paper, we propose two families of models built on a sequence to sequence model and a memory network model to mimic the k-Nearest Neighbors…

Machine Learning · Computer Science 2019-11-28 Yiming Xu , Diego Klabjan

Deep neural networks (DNNs) have played a key role in a wide range of machine learning applications. However, DNN classifiers are vulnerable to human-imperceptible adversarial perturbations, which can cause them to misclassify inputs with…

Machine Learning · Computer Science 2020-05-20 Jeffrey Z. Pan , Nicholas Zufelt

A key challenge for deploying deep neural networks (DNNs) in safety critical settings is the need to provide rigorous ways to quantify their uncertainty. In this paper, we propose a novel algorithm for constructing predicted classification…

Machine Learning · Computer Science 2021-03-19 Sangdon Park , Shuo Li , Insup Lee , Osbert Bastani

In the past five years, deep learning methods have become state-of-the-art in solving various inverse problems. Before such approaches can find application in safety-critical fields, a verification of their reliability appears mandatory.…

Machine Learning · Computer Science 2023-01-18 Martin Genzel , Jan Macdonald , Maximilian März

Deep Neural Networks (DNNs) are widely used for their ability to effectively approximate large classes of functions. This flexibility, however, makes the strict enforcement of constraints on DNNs an open problem. Here we present a framework…

Machine Learning · Computer Science 2023-02-10 Eric Marcus , Ray Sheombarsing , Jan-Jakob Sonke , Jonas Teuwen

Despite the remarkable performance, Deep Neural Networks (DNNs) behave as black-boxes hindering user trust in Artificial Intelligence (AI) systems. Research on opening black-box DNN can be broadly categorized into post-hoc methods and…

Machine Learning · Computer Science 2021-06-25 Sandareka Wickramanayake , Wynne Hsu , Mong Li Lee

Developing Intelligent Systems involves artificial intelligence approaches including artificial neural networks. Here, we present a tutorial of Deep Neural Networks (DNNs), and some insights about the origin of the term "deep"; references…

Neural and Evolutionary Computing · Computer Science 2016-03-24 Juan C. Cuevas-Tello , Manuel Valenzuela-Rendon , Juan A. Nolazco-Flores

The paper presents a novel deep learning approach, which extracts latent information from trained Deep Neural Networks (DNNs) and derives concise representations that are analyzed in an effective, unified way for prediction purposes. It is…

Machine Learning · Computer Science 2020-09-22 D. Kollias , N. Bouas , Y. Vlaxos , V. Brillakis , M. Seferis , I. Kollia , L. Sukissian , J. Wingate , S. Kollias

Calibrating deep learning models to yield uncertainty-aware predictions is crucial as deep neural networks get increasingly deployed in safety-critical applications. While existing post-hoc calibration methods achieve impressive results on…

Machine Learning · Computer Science 2023-07-06 Christian Tomani , Futa Waseda , Yuesong Shen , Daniel Cremers

Deep Neural Networks (DNNs) achieve state-of-the-art performance on numerous applications. However, it is difficult to tell beforehand if a DNN receiving an input will deliver the correct output since their decision criteria are usually…

Machine Learning · Computer Science 2021-09-07 Julia Lust , Alexandru Paul Condurache

Deep neural networks (DNNs) have achieved remarkable performance across a wide range of applications, while they are vulnerable to adversarial examples, which motivates the evaluation and benchmark of model robustness. However, current…

Computer Vision and Pattern Recognition · Computer Science 2022-11-02 Jun Guo , Wei Bao , Jiakai Wang , Yuqing Ma , Xinghai Gao , Gang Xiao , Aishan Liu , Jian Dong , Xianglong Liu , Wenjun Wu

Deep Neural Networks (DNNs) have demonstrated exceptional performance on most recognition tasks such as image classification and segmentation. However, they have also been shown to be vulnerable to adversarial examples. This phenomenon has…

Computer Vision and Pattern Recognition · Computer Science 2018-07-10 Anurag Arnab , Ondrej Miksik , Philip H. S. Torr

Deep neural networks (DNNs), are widely used in many industries such as image recognition, supply chain, medical diagnosis, and autonomous driving. However, prior work has shown the high accuracy of a DNN model does not imply high…

Machine Learning · Computer Science 2022-11-28 Guanqin Zhang , Jiankun Sun , Feng Xu , H. M. N. Dilum Bandara , Shiping Chen , Yulei Sui , Tim Menzies

State-of-the-art deep neural networks (DNNs) are highly effective at tackling many real-world tasks. However, their wide adoption in mission-critical contexts is hampered by two major weaknesses - their susceptibility to adversarial attacks…

Machine Learning · Computer Science 2022-11-17 Ofir Moshe , Gil Fidel , Ron Bitton , Asaf Shabtai

Deep neural networks have become widely used, obtaining remarkable results in domains such as computer vision, speech recognition, natural language processing, audio recognition, social network filtering, machine translation, and…

Neural and Evolutionary Computing · Computer Science 2020-02-03 Divya Gopinath , Guy Katz , Corina S. Pasareanu , Clark Barrett

Machine learning qualifies computers to assimilate with data, without being solely programmed [1, 2]. Machine learning can be classified as supervised and unsupervised learning. In supervised learning, computers learn an objective that…

The $k$-nearest neighbor ($k$-NN) algorithm is one of the most popular methods for nonparametric classification. However, a relevant limitation concerns the definition of the number of neighbors $k$. This parameter exerts a direct impact on…

Machine Learning · Computer Science 2024-09-10 Alexandre Luís Magalhães Levada , Frank Nielsen , Michel Ferreira Cardia Haddad

Motivated by the gap between theoretical optimal approximation rates of deep neural networks (DNNs) and the accuracy realized in practice, we seek to improve the training of DNNs. The adoption of an adaptive basis viewpoint of DNNs leads to…

Machine Learning · Computer Science 2019-12-11 Eric C. Cyr , Mamikon A. Gulian , Ravi G. Patel , Mauro Perego , Nathaniel A. Trask

In the computer vision community, Convolutional Neural Networks (CNNs), first proposed in the 1980's, have become the standard visual classification model. Recently, as alternatives to CNNs, Capsule Networks (CapsNets) and Vision…

Computer Vision and Pattern Recognition · Computer Science 2023-01-05 Jindong Gu