English
Related papers

Related papers: Realizing Unaligned Block-wise Pruning for DNN Acc…

200 papers

We propose combining memory saving techniques with traditional U-Net architectures to increase the complexity of the models on the Brain Tumor Segmentation (BraTS) challenge. The BraTS challenge consists of a 3D segmentation of a…

Image and Video Processing · Electrical Eng. & Systems 2021-04-22 Mihir Pendse , Vithursan Thangarasa , Vitaliy Chiley , Ryan Holmdahl , Joel Hestness , Dennis DeCoste

Binary Neural Network (BNN) converts full-precision weights and activations into their extreme 1-bit counterparts, making it particularly suitable for deployment on lightweight mobile devices. While binary neural networks are typically…

Machine Learning · Computer Science 2025-01-08 Jun Chen , Jingyang Xiang , Tianxin Huang , Xiangrui Zhao , Yong Liu

The rapid growth in complexity and size of modern deep neural networks (DNNs) has increased challenges related to computational costs and memory usage, spurring a growing interest in efficient model compression techniques. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Sarthak Ketanbhai Modi , Zi Pong Lim , Shourya Kuchhal , Yushi Cao , Yupeng Cheng , Yon Shin Teo , Shang-Wei Lin , Zhiming Li

Deep learning is reshaping mobile applications, with a growing trend of deploying deep neural networks (DNNs) directly to mobile and embedded devices to address real-time performance and privacy. To accommodate local resource limitations,…

Artificial Intelligence · Computer Science 2024-12-03 Yuzhan Wang , Sicong Liu , Bin Guo , Boqi Zhang , Ke Ma , Yasan Ding , Hao Luo , Yao Li , Zhiwen Yu

Binarization is a powerful compression technique for neural networks, significantly reducing FLOPs, but often results in a significant drop in model performance. To address this issue, partial binarization techniques have been developed,…

Computer Vision and Pattern Recognition · Computer Science 2023-12-07 Udbhav Bamba , Neeraj Anand , Saksham Aggarwal , Dilip K. Prasad , Deepak K. Gupta

Edge computing environments impose strict constraints on energy consumption and latency, making the deployment of deep neural networks a significant challenge. Therefore, smart and adaptive inference strategies that dynamically balance…

Machine Learning · Computer Science 2026-05-25 Grigorios Papanikolaou , Ioannis Kontopoulos , Konstantinos Tserpes

This work is focused on the pruning of some convolutional neural networks (CNNs) and improving theirs efficiency on graphic processing units (GPU) by using a direct sparse algorithm. The Nvidia deep neural network (cuDnn) library is the…

Machine Learning · Computer Science 2022-08-30 Marcin Pietroń , Dominik Żurek

Automatic body part recognition for CT slices can benefit various medical image applications. Recent deep learning methods demonstrate promising performance, with the requirement of large amounts of labeled images for training. The…

Computer Vision and Pattern Recognition · Computer Science 2018-03-08 Ke Yan , Le Lu , Ronald M. Summers

Deep Convolutional Neural Networks (CNNs) have become state-of-the art for computer vision and other signal processing tasks due to their superior accuracy. In recent years, large efforts have been made to reduce the computational costs of…

Hardware Architecture · Computer Science 2021-04-13 Mario Fischer , Juergen Wassner

Despite the remarkable strides made by autoregressive language models, their potential is often hampered by the slow inference speeds inherent in sequential token generation. Blockwise parallel decoding (BPD) was proposed by Stern et al. as…

Computation and Language · Computer Science 2024-06-06 Taehyeon Kim , Ananda Theertha Suresh , Kishore Papineni , Michael Riley , Sanjiv Kumar , Adrian Benton

Edge machine learning (ML) enables localized processing of data on devices and is underpinned by deep neural networks (DNNs). However, DNNs cannot be easily run on devices due to their substantial computing, memory and energy requirements…

Machine Learning · Computer Science 2025-04-09 Bailey J. Eccles , Leon Wong , Blesson Varghese

The optimizations of both memory depth and kernel functions are critical for wideband digital pre-distortion (DPD). However, the memory depth is usually determined via exhaustive search over a wide range for the sake of linearization…

Signal Processing · Electrical Eng. & Systems 2025-04-21 Jinfei Wang , Yi Ma , Fei Tong , Ziming He

Decision trees are one of the most useful and popular methods in the machine learning toolbox. In this paper, we consider the problem of learning optimal decision trees, a combinatorial optimization problem that is challenging to solve at…

Machine Learning · Computer Science 2022-07-01 Rahul Mazumder , Xiang Meng , Haoyue Wang

Convolutional neural networks (CNNs) demand huge DRAM bandwidth for computational imaging tasks, and block-based processing has recently been applied to greatly reduce the bandwidth. However, the induced additional computation for feature…

Machine Learning · Computer Science 2020-01-31 Chao-Tsung Huang

Deep Neural Network (DNN) is becoming adopted for video analytics on mobile devices. To reduce the delay of running DNNs, many mobile devices are equipped with Neural Processing Units (NPU). However, due to the resource limitations of NPU,…

Networking and Internet Architecture · Computer Science 2021-12-07 Tianxiang Tan , Guohong Cao

It is usually infeasible to fit and train an entire large deep neural network (DNN) model using a single edge device due to the limited resources. To facilitate intelligent applications across edge devices, researchers have proposed…

Machine Learning · Computer Science 2023-11-13 Yuhao Chen , Yuxuan Yan , Qianqian Yang , Yuanchao Shu , Shibo He , Zhiguo Shi , Jiming Chen

The performance of Deep Neural Networks (DNNs) keeps elevating in recent years with increasing network depth and width. To enable DNNs on edge devices like mobile phones, researchers proposed several network compression methods including…

Computer Vision and Pattern Recognition · Computer Science 2020-01-27 Yuhui Xu , Yuxi Li , Shuai Zhang , Wei Wen , Botao Wang , Yingyong Qi , Yiran Chen , Weiyao Lin , Hongkai Xiong

Deep Neural Networks (DNNs) are powerful tools for various computer vision tasks, yet they often struggle with reliable uncertainty quantification - a critical requirement for real-world applications. Bayesian Neural Networks (BNN) are…

Machine Learning · Computer Science 2023-12-27 Gianni Franchi , Olivier Laurent , Maxence Leguéry , Andrei Bursuc , Andrea Pilzer , Angela Yao

Running multi-task DNNs on mobiles is an emerging trend for various applications like autonomous driving and mobile NLP. Mobile DNNs are often compressed to fit the limited resources and thus suffer from degraded accuracy and…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-07-02 Lehao Wang , Zhiwen Yu , Sicong Liu , Chenshu Wu , Xiangrui Xu , Bin Guo

Deep neural networks (DNNs) have achieved great success in the area of computer vision. The disparity estimation problem tends to be addressed by DNNs which achieve much better prediction accuracy than traditional hand-crafted feature-based…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Qiang Wang , Shaohuai Shi , Shizhen Zheng , Kaiyong Zhao , Xiaowen Chu