English
Related papers

Related papers: Online Convolutional Re-parameterization

200 papers

In this paper we derive an efficient algorithm to learn the parameters of structured predictors in general graphical models. This algorithm blends the learning and inference tasks, which results in a significant speedup over traditional…

Machine Learning · Computer Science 2013-09-02 Tamir Hazan , Alexander Schwing , David McAllester , Raquel Urtasun

Exploring deep convolutional neural networks of high efficiency and low memory usage is very essential for a wide variety of machine learning tasks. Most of existing approaches used to accelerate deep models by manipulating parameters or…

Computer Vision and Pattern Recognition · Computer Science 2019-07-30 Chuanjian Liu , Yunhe Wang , Kai Han , Chunjing Xu , Chang Xu

Deep convolutional neural network has made huge revolution and shown its superior performance on computer vision tasks such as classification and segmentation. Recent years, researches devote much effort to scaling down size of network…

Computer Vision and Pattern Recognition · Computer Science 2021-12-28 Yingdong Hu

Convolutional networks are at the center of best-in-class computer vision applications for a wide assortment of undertakings. Since 2014, a profound amount of work began to make better convolutional architectures, yielding generous…

Computer Vision and Pattern Recognition · Computer Science 2021-10-07 Dishant Parikh

Deep 3-dimensional (3D) Convolutional Network (ConvNet) has shown promising performance on video recognition tasks because of its powerful spatio-temporal information fusion ability. However, the extremely intensive requirements on memory…

Computer Vision and Pattern Recognition · Computer Science 2019-06-03 Haonan Wang , Jun Lin , Zhongfeng Wang

The channel attention mechanism is a useful technique widely employed in deep convolutional neural networks to boost the performance for image processing tasks, eg, image classification and image super-resolution. It is usually designed as…

Image and Video Processing · Electrical Eng. & Systems 2023-03-21 Yuxuan Shi , Lingxiao Yang , Wangpeng An , Xiantong Zhen , Liuqing Wang

Convolution neural network (CNN) based methods offer effective solutions for enhancing the quality of compressed image and video. However, these methods ignore using the raw data to enhance the quality. In this paper, we adopt the raw data…

Image and Video Processing · Electrical Eng. & Systems 2022-08-10 Renwei Yang , Shuyuan Zhu , Xiaozhen Zheng , Bing Zeng

In this paper, we propose multi-stage and deformable deep convolutional neural networks for object detection. This new deep learning object detection diagram has innovations in multiple aspects. In the proposed new deep architecture, a new…

Computer Vision and Pattern Recognition · Computer Science 2014-09-12 Wanli Ouyang , Ping Luo , Xingyu Zeng , Shi Qiu , Yonglong Tian , Hongsheng Li , Shuo Yang , Zhe Wang , Yuanjun Xiong , Chen Qian , Zhenyao Zhu , Ruohui Wang , Chen-Change Loy , Xiaogang Wang , Xiaoou Tang

Nowadays deep learning-based methods have achieved a remarkable progress at the image classification task among a wide range of commonly used datasets (ImageNet, CIFAR, SVHN, Caltech 101, SUN397, etc.). SOTA performance on each of the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Kirill Prokofiev , Vladislav Sovrasov

Objective: To develop a fast image reconstruction method for stroke monitoring with electrical impedance tomography with image quality comparable to computationally expensive nonlinear model-based methods. Methods: A post-processing…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 J. Toivanen , V. Kolehmainen , A. Paldanius , A. Hänninen , A. Hauptmann , S. J. Hamilton

Super-resolution reconstruction techniques entail the utilization of software algorithms to transform one or more sets of low-resolution images captured from the same scene into high-resolution images. In recent years, considerable…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Hao Yan , Zixiang Wang , Zhengjia Xu , Zhuoyue Wang , Zhizhong Wu , Ranran Lyu

This work addresses two major issues of end-to-end learned image compression (LIC) based on deep neural networks: variable-rate learning where separate networks are required to generate compressed images with varying qualities, and the…

Image and Video Processing · Electrical Eng. & Systems 2024-04-10 Wei Jiang , Wei Wang , Songnan Li , Shan Liu

In this work, we tackle model efficiency by exploiting redundancy in the \textit{implicit structure} of the building blocks of convolutional neural networks. We start our analysis by introducing a general definition of Composite Kernel…

Computer Vision and Pattern Recognition · Computer Science 2020-11-03 Yash Bhalgat , Yizhe Zhang , Jamie Lin , Fatih Porikli

Video frame interpolation is an increasingly important research task with several key industrial applications in the video coding, broadcast and production sectors. Recently, transformers have been introduced to the field resulting in…

Computer Vision and Pattern Recognition · Computer Science 2023-07-14 Issa Khalifeh , Luka Murn , Marta Mrak , Ebroul Izquierdo

This work aims at designing a lightweight convolutional neural network for image super resolution (SR). With simplicity bare in mind, we construct a pretty concise and effective network with a newly proposed pixel attention scheme. Pixel…

Image and Video Processing · Electrical Eng. & Systems 2020-10-05 Hengyuan Zhao , Xiangtao Kong , Jingwen He , Yu Qiao , Chao Dong

Recently, convolutional neural networks (CNNs) have been used as a powerful tool to solve many problems of machine learning and computer vision. In this paper, we aim to provide insight on the property of convolutional neural networks, as…

Machine Learning · Computer Science 2016-07-20 Wenling Shang , Kihyuk Sohn , Diogo Almeida , Honglak Lee

The high energy cost of processing deep convolutional neural networks impedes their ubiquitous deployment in energy-constrained platforms such as embedded systems and IoT devices. This work introduces convolutional layers with pre-defined…

Computer Vision and Pattern Recognition · Computer Science 2020-02-06 Souvik Kundu , Mahdi Nazemi , Massoud Pedram , Keith M. Chugg , Peter A. Beerel

Learning quickly is of great importance for machine intelligence deployed in online platforms. With the capability of transferring knowledge from learned tasks, meta-learning has shown its effectiveness in online scenarios by continuously…

Machine Learning · Computer Science 2020-10-23 Huaxiu Yao , Yingbo Zhou , Mehrdad Mahdavi , Zhenhui Li , Richard Socher , Caiming Xiong

Inherent in virtually every iterative machine learning algorithm is the problem of hyper-parameter tuning, which includes three major design parameters: (a) the complexity of the model, e.g., the number of neurons in a neural network, (b)…

Machine Learning · Computer Science 2025-09-26 Christos Mavridis , John Baras

Deep neural networks (DNNs) have heavily relied on traditional computational units like CPUs and GPUs. However, this conventional approach brings significant computational burdens, latency issues, and high power consumption, limiting their…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Quan Liu , Brandon T. Swartz , Ivan Kravchenko , Jason G. Valentine , Yuankai Huo