English
Related papers

Related papers: Performance-optimized deep neural networks are evo…

200 papers

In recent years, convolutional neural networks (CNNs) have achieved impressive performance for various visual recognition scenarios. CNNs trained on large labeled datasets can not only obtain significant performance on most challenging…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Xiangyang Li , Luis Herranz , Shuqiang Jiang

In this paper, we elucidate how representations in deep neural networks (DNNs) evolve during training. Our focus is on overparameterized learning settings where the training continues much after the trained DNN starts to perfectly fit its…

Machine Learning · Computer Science 2025-02-04 Yuval Sharon , Yehuda Dar

Up-to-date High-Definition (HD) maps are essential for self-driving cars. To achieve constantly updated HD maps, we present a deep neural network (DNN), Diff-Net, to detect changes in them. Compared to traditional methods based on object…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Lei He , Shengjie Jiang , Xiaoqing Liang , Ning Wang , Shiyu Song

Due to the advent of modern embedded systems and mobile devices with constrained resources, there is a great demand for incredibly efficient deep neural networks for machine learning purposes. There is also a growing concern of privacy and…

Computer Vision and Pattern Recognition · Computer Science 2021-12-02 Priyank Kalgaonkar , Mohamed El-Sharkawy

Deep neural network (DNN) inference has become an important part of many data-center workloads. This has prompted focused efforts to design ever-faster deep learning accelerators such as GPUs and TPUs. However, an end-to-end DNN-based…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-23 Ahmed F. AbouElhamayed , Susanne Balle , Deshanand Singh , Mohamed S. Abdelfattah

The recent success of brain-inspired deep neural networks (DNNs) in solving complex, high-level visual tasks has led to rising expectations for their potential to match the human visual system. However, DNNs exhibit idiosyncrasies that…

Neurons and Cognition · Quantitative Biology 2019-05-08 Chihye Han , Wonjun Yoon , Gihyun Kwon , Seungkyu Nam , Daeshik Kim

The current deep neural network algorithm still stays in the end-to-end training supervision method like Image-Label pairs, which makes traditional algorithm is difficult to explain the reason for the results, and the prediction logic is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-10 Yishuang Tian , Ning Wang , Liang Zhang

Deep neural networks (DNNs) have been widely used in computer vision tasks like image classification, object detection and segmentation. Whereas recent studies have shown their vulnerability to manual digital perturbations or distortion in…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Chengyin Hu , Weiwen Shi

Deep neural networks (DNNs) have succeeded in many different perception tasks, e.g., computer vision, natural language processing, reinforcement learning, etc. The high-performed DNNs heavily rely on intensive resource consumption. For…

Machine Learning · Computer Science 2022-10-10 Zhongnan Qu

Despite the efficacy on a variety of computer vision tasks, deep neural networks (DNNs) are vulnerable to adversarial attacks, limiting their applications in security-critical systems. Recent works have shown the possibility of generating…

Computer Vision and Pattern Recognition · Computer Science 2018-12-21 Ziang Yan , Yiwen Guo , Changshui Zhang

The capability of Deep Neural Networks (DNNs) to recognize objects in orientations outside the distribution of the training data is not well understood. We present evidence that DNNs are capable of generalizing to objects in novel…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Avi Cooper , Xavier Boix , Daniel Harari , Spandan Madan , Hanspeter Pfister , Tomotake Sasaki , Pawan Sinha

Recent advances in deep learning have led to significant progress in the computer vision field, especially for visual object recognition tasks. The features useful for object classification are learned by feed-forward deep convolutional…

Computer Vision and Pattern Recognition · Computer Science 2016-01-08 Panqu Wang , Garrison W. Cottrell

Deep neural networks (DNNs) and, in particular, convolutional neural networks (CNNs) have brought significant advances in a wide range of modern computer application problems. However, the increasing availability of large amounts of…

Machine Learning · Computer Science 2024-07-03 Axel Klawonn , Martin Lanser , Janine Weber

Deep neural networks (DNN) have been a de facto standard for nowadays biometric recognition solutions. A serious, but still overlooked problem in these DNN-based recognition systems is their vulnerability against adversarial attacks.…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Renjie Xie , Yanzhi Chen , Yan Wo , Qiao Wang

Convolutional neural networks (CNNs) are deep learning frameworks which are well-known for their notable performance in classification tasks. Hence, many skeleton-based action recognition and segmentation (SBARS) algorithms benefit from…

Machine Learning · Computer Science 2019-11-13 Babak Hosseini , Romain Montagne , Barbara Hammer

Recently, deep neural networks (DNNs) have shown advantages in accelerating optimization algorithms. One approach is to unfold finite number of iterations of conventional optimization algorithms and to learn parameters in the algorithms.…

Machine Learning · Computer Science 2021-04-23 Byung Hyun Lee , Se Young Chun

Despite decades of development, existing IDSs still face challenges in improving detection accuracy, evasion, and detection of unknown attacks. To solve these problems, many researchers have focused on designing and developing IDSs that use…

Cryptography and Security · Computer Science 2025-01-28 Mofe O. Jeje

A central challenge in neuroscience is to understand neural computations and circuit mechanisms that underlie the encoding of ethologically relevant, natural stimuli. In multilayered neural circuits, nonlinear processes such as synaptic…

Neurons and Cognition · Quantitative Biology 2017-02-09 Lane T. McIntosh , Niru Maheswaranathan , Aran Nayebi , Surya Ganguli , Stephen A. Baccus

Machine learning applied to computer vision and signal processing is achieving results comparable to the human brain on specific tasks due to the great improvements brought by the deep neural networks (DNN). The majority of state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 José Augusto Stuchi , Levy Boccato , Romis Attux

We develop a minimax rate analysis to describe the reason that deep neural networks (DNNs) perform better than other standard methods. For nonparametric regression problems, it is well known that many standard methods attain the minimax…

Machine Learning · Statistics 2022-02-09 Masaaki Imaizumi , Kenji Fukumizu