English
Related papers

Related papers: Fixed-point Factorized Networks

200 papers

We propose a new approach, called as functional deep neural network (FDNN), for classifying multi-dimensional functional data. Specifically, a deep neural network is trained based on the principle components of the training data which shall…

Machine Learning · Statistics 2022-05-19 Shuoyang Wang , Guanqun Cao , Zuofeng Shang

In recent years, GoogleNet has garnered substantial attention as one of the base convolutional neural networks (CNNs) to extract visual features for object detection. However, it experiences challenges of contaminated deep features when…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Jaemo Sung , Eun-Sung Jung

Deep neural networks (DNNs) have demonstrated remarkable success in various fields. However, the large number of floating-point operations (FLOPs) in DNNs poses challenges for their deployment in resource-constrained applications, e.g.,…

Artificial Intelligence · Computer Science 2024-02-20 Mengnan Jiang , Jingcun Wang , Amro Eldebiky , Xunzhao Yin , Cheng Zhuo , Ing-Chao Lin , Grace Li Zhang

Convolutional Neural Networks (CNNs) have proven to be a powerful state-of-the-art method for image classification tasks. One drawback however is the high computational complexity and high memory consumption of CNNs which makes them…

Computer Vision and Pattern Recognition · Computer Science 2021-02-04 Rishabh Goyal , Joaquin Vanschoren , Victor van Acht , Stephan Nijssen

Deep neural networks (DNNs) have achieved unprecedented success in the field of artificial intelligence (AI), including computer vision, natural language processing and speech recognition. However, their superior performance comes at the…

Machine Learning · Computer Science 2022-04-26 Han Cai , Ji Lin , Yujun Lin , Zhijian Liu , Haotian Tang , Hanrui Wang , Ligeng Zhu , Song Han

Modern mobile neural networks with a reduced number of weights and parameters do a good job with image classification tasks, but even they may be too complex to be implemented in an FPGA for video processing tasks. The article proposes…

Computer Vision and Pattern Recognition · Computer Science 2020-12-04 Roman Solovyev , Alexander Kustov , Dmitry Telpukhov , Vladimir Rukhlov , Alexandr Kalinin

Following the rapidly growing digital image usage, automatic image categorization has become preeminent research area. It has broaden and adopted many algorithms from time to time, whereby multi-feature (generally, hand-engineered features)…

Computer Vision and Pattern Recognition · Computer Science 2017-05-12 Thangarajah Akilan , Q. M. Jonathan Wu , Wei Jiang

The complexity of deep neural network algorithms for hardware implementation can be much lowered by optimizing the word-length of weights and signals. Direct quantization of floating-point weights, however, does not show good performance…

Machine Learning · Computer Science 2016-01-08 Wonyong Sung , Sungho Shin , Kyuyeon Hwang

Machine learning applied to computer vision and signal processing is achieving results comparable to the human brain on specific tasks due to the great improvements brought by the deep neural networks (DNN). The majority of state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-06-30 José Augusto Stuchi , Levy Boccato , Romis Attux

Federated Learning (FL) preserves privacy by distributing training across devices. However, using DNNs is computationally intensive at the low-powered edge during inference. Edge deployment demands models that simultaneously optimize memory…

Machine Learning · Computer Science 2026-03-17 Nitin Priyadarshini Shankar , Soham Lahiri , Sheetal Kalyani , Saurav Prakash

Deep neural networks (DNNs) have recently achieved impressive success across a wide range of real-world vision and language processing tasks, spanning from image classification to many other downstream vision tasks, such as object…

Machine Learning · Computer Science 2025-12-23 Xiangzhong Luo , Di Liu , Hao Kong , Shuo Huai , Hui Chen , Guochu Xiong , Weichen Liu

There is a recent interest in neural network (NN)-based communication algorithms which have shown to achieve (beyond) state-of-the-art performance for a variety of problems or lead to reduced implementation complexity. However, most work on…

Information Theory · Computer Science 2019-02-20 Fayçal Ait Aoudia , Jakob Hoydis

In this paper, we introduce a Deep Neural Network (DNN) to maximize the Proportional Fairness (PF) of the Spectral Efficiency (SE) of uplinks in Cell-Free (CF) massive Multiple-Input Multiple-Output (MIMO) systems. The problem of maximizing…

Information Theory · Computer Science 2021-10-12 Le Ty Khanh , Pham Quoc Viet , Ha Hoang Kha , Nguyen Minh Hoang

Deep neural networks (DNNs) are powerful types of artificial neural networks (ANNs) that use several hidden layers. They have recently gained considerable attention in the speech transcription and image recognition community (Krizhevsky et…

Machine Learning · Computer Science 2017-06-15 Matthew Dixon , Diego Klabjan , Jin Hoon Bang

It is often useful to perform integration over learned functions represented by neural networks. However, this integration is usually performed numerically, as analytical integration over learned functions (especially neural networks) is…

Machine Learning · Computer Science 2023-12-27 Ryan Kortvelesy

Deep neural networks (DNNs) are state-of-the-art algorithms for multiple applications, spanning from image classification to speech recognition. While providing excellent accuracy, they often have enormous compute and memory requirements.…

Machine Learning · Computer Science 2020-11-12 Ussama Zahid , Giulio Gambardella , Nicholas J. Fraser , Michaela Blott , Kees Vissers

Deploying federated learning (FL) over wireless networks with resource-constrained devices requires balancing between accuracy, energy efficiency, and precision. Prior art on FL often requires devices to train deep neural networks (DNNs)…

Machine Learning · Computer Science 2023-02-06 Minsu Kim , Walid Saad , Mohammad Mozaffari , Merouane Debbah

Deep neural networks (DNNs) are efficient solvers for ill-posed problems and have been shown to outperform classical optimization techniques in several computational imaging problems. DNNs are trained by solving an optimization problem…

Image and Video Processing · Electrical Eng. & Systems 2019-06-14 Mo Deng , Alexandre Goy , Shuai Li , Kwabena Arthur , George Barbastathis

We propose distributed deep neural networks (DDNNs) over distributed computing hierarchies, consisting of the cloud, the edge (fog) and end devices. While being able to accommodate inference of a deep neural network (DNN) in the cloud, a…

Computer Vision and Pattern Recognition · Computer Science 2017-09-08 Surat Teerapittayanon , Bradley McDanel , H. T. Kung

Deep neural networks (DNNs) are so over-parametrized that recent research has found them to already contain a subnetwork with high accuracy at their randomly initialized state. Finding these subnetworks is a viable alternative training…

Computer Vision and Pattern Recognition · Computer Science 2021-11-25 Ángel López García-Arias , Masanori Hashimoto , Masato Motomura , Jaehoon Yu