English
Related papers

Related papers: Joint Matrix Decomposition for Deep Convolutional …

200 papers

Convolutional Neural Networks (CNNs) have achieved remarkable success in various computer vision tasks but rely on tremendous computational cost. To solve this problem, existing approaches either compress well-trained large-scale models or…

Computer Vision and Pattern Recognition · Computer Science 2021-07-06 Chen Zhang , Yinghao Xu , Yujun Shen

Convolutional neural networks (CNNs) have demonstrated remarkable results in image classification for benchmark tasks and practical applications. The CNNs with deeper architectures have achieved even higher performance recently thanks to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-15 Ryo Takahashi , Takashi Matsubara , Kuniaki Uehara

Lossy compression brings artifacts into the compressed image and degrades the visual quality. In recent years, many compression artifacts removal methods based on convolutional neural network (CNN) have been developed with great success.…

Image and Video Processing · Electrical Eng. & Systems 2020-10-22 Jianwei Li , Yongtao Wang , Haihua Xie , Kai-Kuang Ma

JPEG is one of the widely used lossy compression methods. JPEG-compressed images usually suffer from compression artifacts including blocking and blurring, especially at low bit-rates. Soft decoding is an effective solution to improve the…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Honggang Chen , Xiaohai He , Linbo Qing , Shuhua Xiong , Truong Q. Nguyen

Recent trends show recognition accuracy increasing even more profoundly. Inference process of Deep Convolutional Neural Networks (DCNN) has a large number of parameters, requires a large amount of computation, and can be very slow. The…

Computer Vision and Pattern Recognition · Computer Science 2017-09-15 Ryuji Kamiya , Takayoshi Yamashita , Mitsuru Ambai , Ikuro Sato , Yuji Yamauchi , Hironobu Fujiyoshi

This paper proposes a deep Convolutional Neural Network(CNN) with strong generalization ability for structural topology optimization. The architecture of the neural network is made up of encoding and decoding parts, which provide down- and…

Machine Learning · Computer Science 2020-04-01 Yiquan Zhang , Bo Peng , Xiaoyi Zhou , Cheng Xiang , Dalei Wang

Deep Convolutional Neural Networks (CNNs) have been widely used in various domains due to their impressive capabilities. These models are typically composed of a large number of 2D convolutional (Conv2D) layers with numerous trainable…

Machine Learning · Computer Science 2022-02-01 Yinan Yu , Samuel Scheidegger , Tomas McKelvey

Neural networks have been extensively applied to a variety of tasks, achieving astounding results. Applying neural networks in the scientific field is an important research direction that is gaining increasing attention. In scientific…

Machine Learning · Computer Science 2024-07-02 Tianyi Chen , Zhi-Qin John Xu

Neural networks are widely used for image-related tasks but typically demand considerable computing power. Once a network has been trained, however, its memory- and compute-footprint can be reduced by compression. In this work, we focus on…

Machine Learning · Computer Science 2025-11-13 Alper Kalle , Theo Rudkiewicz , Mohamed-Oumar Ouerfelli , Mohamed Tamaazousti

Convolutional Neural Networks (CNNs) are extremely computationally demanding, presenting a large barrier to their deployment on resource-constrained devices. Since such systems are where some of their most useful applications lie (e.g.…

Machine Learning · Statistics 2018-09-20 Jack Turner , José Cano , Valentin Radu , Elliot J. Crowley , Michael O'Boyle , Amos Storkey

In this work, we propose an effective scheme (called DP-Net) for compressing the deep neural networks (DNNs). It includes a novel dynamic programming (DP) based algorithm to obtain the optimal solution of weight quantization and an…

Machine Learning · Computer Science 2020-03-24 Dingcheng Yang , Wenjian Yu , Ao Zhou , Haoyuan Mu , Gary Yao , Xiaoyi Wang

Channel pruning has been broadly recognized as an effective technique to reduce the computation and memory cost of deep convolutional neural networks. However, conventional pruning methods have limitations in that: they are restricted to…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Zejiang Hou , Minghai Qin , Fei Sun , Xiaolong Ma , Kun Yuan , Yi Xu , Yen-Kuang Chen , Rong Jin , Yuan Xie , Sun-Yuan Kung

Convolutional neural networks (CNNs) have become the dominant neural network architecture for solving visual processing tasks. One of the major obstacles hindering the ubiquitous use of CNNs for inference is their relatively high memory…

Computer Vision and Pattern Recognition · Computer Science 2019-09-26 Chaim Baskin , Brian Chmiel , Evgenii Zheltonozhskii , Ron Banner , Alex M. Bronstein , Avi Mendelson

We propose a scalable tensorization framework for neural network compression based on slice-wise feature distillation. Unlike conventional tensor decomposition methods that rely on costly global finetuning, our approach decomposes the…

Machine Learning · Computer Science 2026-05-20 Safa Hamreras , Sukhbinder Singh , Román Orús

In this paper, we propose an end-to-end mixed-resolution image compression framework with convolutional neural networks. Firstly, given one input image, feature description neural network (FDNN) is used to generate a new representation of…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Lijun Zhao , Huihui Bai , Feng Li , Anhong Wang , Yao Zhao

Compressing neural networks is a key step when deploying models for real-time or embedded applications. Factorizing the model's matrices using low-rank approximations is a promising method for achieving compression. While it is possible to…

Machine Learning · Computer Science 2023-10-20 Lucas Maison , Hélion du Mas des Bourboux , Thomas Courtat

While convolutional neural networks (CNNs) have become the de facto standard for most image processing and computer vision applications, their deployment on edge devices remains challenging. Tensor decomposition methods provide a means of…

Computer Vision and Pattern Recognition · Computer Science 2022-10-13 Marawan Gamal Abdel Hameed , Ali Mosleh , Marzieh S. Tahaei , Vahid Partovi Nia

Convolutional Neural Network (CNN)-based filters have achieved significant performance in video artifacts reduction. However, the high complexity of existing methods makes it difficult to be applied in real usage. In this paper, a CNN-based…

Image and Video Processing · Electrical Eng. & Systems 2020-09-08 Chao Liu , Heming Sun , Jiro Katto , Xiaoyang Zeng , Yibo Fan

Over-fitting-based image compression requires weights compactness for compression and fast convergence for practical use, posing challenges for deep convolutional neural networks (CNNs) based methods. This paper presents a simple…

Image and Video Processing · Electrical Eng. & Systems 2023-10-13 Yun Ye , Yanjie Pan , Qually Jiang , Ming Lu , Xiaoran Fang , Beryl Xu

Neural networks are both computationally intensive and memory intensive, making them difficult to deploy on embedded systems with limited hardware resources. To address this limitation, we introduce "deep compression", a three stage…

Computer Vision and Pattern Recognition · Computer Science 2016-02-16 Song Han , Huizi Mao , William J. Dally