English
Related papers

Related papers: SteppingNet: A Stepping Neural Network with Increm…

200 papers

With the rise of deep learning technology in practical applications, Convolutional Neural Networks (CNNs) have been able to assist humans in solving many real-world problems. To enhance the performance of CNNs, numerous network…

Machine Learning · Computer Science 2024-09-10 Qi Wang , Zijun Gao , Mingxiu Sui , Taiyuan Mei , Xiaohan Cheng , Iris Li

Deep neural networks (DNNs) have become the driving force behind recent artificial intelligence (AI) research. An important problem with implementing a neural network is the design of its architecture. Typically, such an architecture is…

Neural and Evolutionary Computing · Computer Science 2021-03-30 Shayan Hassantabar , Zeyu Wang , Niraj K. Jha

Deep Neural Networks (DNN) represent a performance-hungry application. Floating-Point (FP) and custom floating-point-like arithmetic satisfies this hunger. While there is need for speed, inference in DNNs does not seem to have any need for…

Machine Learning · Computer Science 2020-02-11 Christoph Lauter , Anastasia Volkova

This paper introduces deep neural networks (DNNs) as add-on blocks to baseline feedback control systems to enhance tracking performance of arbitrary desired trajectories. The DNNs are trained to adapt the reference signals to the feedback…

Robotics · Computer Science 2017-10-09 Siqi Zhou , Mohamed K. Helwa , Angela P. Schoellig

Deep neural networks (DNNs) have achieved great breakthroughs in many fields such as image classification and natural language processing. However, the execution of DNNs needs to conduct massive numbers of multiply-accumulate (MAC)…

Hardware Architecture · Computer Science 2024-11-07 Bo Liu , Grace Li Zhang , Xunzhao Yin , Ulf Schlichtmann , Bing Li

Deep Neural Networks (DNNs) have been used to solve different day-to-day problems. Recently, DNNs have been deployed in real-time systems, and lowering the energy consumption and response time has become the need of the hour. To address…

Machine Learning · Computer Science 2023-08-21 Mirazul Haque , Wei Yang

Large neural networks are typically trained for a fixed computational budget, creating a rigid trade-off between performance and efficiency that is ill-suited for deployment in resource-constrained or dynamic environments. Existing…

Machine Learning · Computer Science 2026-03-05 Paulius Rauba , Mihaela van der Schaar

It has been proven that transfer learning provides an easy way to achieve state-of-the-art accuracies on several vision tasks by training a simple classifier on top of features obtained from pre-trained neural networks. The goal of this…

Machine Learning · Computer Science 2016-06-07 Milad Mohammadi , Subhasis Das

Deep neural networks (DNNs) have become a widely deployed model for numerous machine learning applications. However, their fixed architecture, substantial training cost, and significant model redundancy make it difficult to efficiently…

Neural and Evolutionary Computing · Computer Science 2019-05-28 Xiaoliang Dai , Hongxu Yin , Niraj K. Jha

Determinantal Point Processes (DPPs) provide an elegant and versatile way to sample sets of items that balance the point-wise quality with the set-wise diversity of selected items. For this reason, they have gained prominence in many…

Machine Learning · Statistics 2019-01-09 Zelda Mariet , Yaniv Ovadia , Jasper Snoek

Deep neural networks (DNNs) have achieved unprecedented success in the field of artificial intelligence (AI), including computer vision, natural language processing and speech recognition. However, their superior performance comes at the…

Machine Learning · Computer Science 2022-04-26 Han Cai , Ji Lin , Yujun Lin , Zhijian Liu , Haotian Tang , Hanrui Wang , Ligeng Zhu , Song Han

With the rise of machine learning, inference on deep neural networks (DNNs) has become a core building block on the critical path for many cloud applications. Applications today rely on isolated ad-hoc deployments that force users to…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-01-24 Amit Samanta , Suhas Shrinivasan , Antoine Kaufmann , Jonathan Mace

The recent success of Deep Neural Networks (DNNs) has drastically improved the state of the art for many application domains. While achieving high accuracy performance, deploying state-of-the-art DNNs is a challenge since they typically…

Neural and Evolutionary Computing · Computer Science 2018-01-24 Hokchhay Tann , Soheil Hashemi , Sherief Reda

Deep Neural Networks (DNNs) are universal function approximators providing state-of- the-art solutions on wide range of applications. Common perceptual tasks such as speech recognition, image classification, and object tracking are now…

Machine Learning · Statistics 2017-11-08 Randall Balestriero , Richard Baraniuk

Currently, Machine Learning (ML) is becoming ubiquitous in everyday life. Deep Learning (DL) is already present in many applications ranging from computer vision for medicine to autonomous driving of modern cars as well as other sectors in…

Hardware Architecture · Computer Science 2020-12-22 Maurizio Capra , Beatrice Bussolino , Alberto Marchisio , Guido Masera , Maurizio Martina , Muhammad Shafique

Nowadays deep learning is dominating the field of machine learning with state-of-the-art performance in various application areas. Recently, spiking neural networks (SNNs) have been attracting a great deal of attention, notably owning to…

Machine Learning · Computer Science 2019-02-28 Seongsik Park , Sang-gil Lee , Hyunha Nam , Sungroh Yoon

Modern deep neural networks are powerful and widely applicable models that extract task-relevant information through multi-level abstraction. Their cross-domain success, however, is often achieved at the expense of computational cost, high…

Computer Vision and Pattern Recognition · Computer Science 2020-07-31 Wenhan Xia , Hongxu Yin , Xiaoliang Dai , Niraj K. Jha

In seismic exploration, first break (FB) picking is a crucial aspect in the determination of subsurface velocity models, significantly influencing the placement of wells. Many deep neural networks (DNNs)-based automatic picking methods have…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Hongtao Wang , Jiangshe Zhang , Xiaoli Wei , Li Long , Chunxia Zhang

Gradient descent computed by backpropagation (BP) is a widely used learning method for training artificial neural networks but has several limitations: it is computationally demanding, requires frequent manual tuning of the network…

Signal Processing · Electrical Eng. & Systems 2024-10-02 Jiaqi Xing , Libo Chen , ZeZheng Zhang , Mohammed Nazibul Hasan , Zhi-Bin Zhang

Heterogeneous network data with rich nodal information become increasingly prevalent across multidisciplinary research, yet accurately modeling complex nodal heterogeneity and simultaneously selecting influential nodal attributes remains an…

Methodology · Statistics 2026-04-14 Zhaoyu Xing , Xiufan Yu