English
Related papers

Related papers: Using accumulation to optimize deep residual neura…

200 papers

Neural Network is a powerful Machine Learning tool that shows outstanding performance in Computer Vision, Natural Language Processing, and Artificial Intelligence. In particular, recently proposed ResNet architecture and its modifications…

Machine Learning · Statistics 2018-11-13 Iurii Kemaev , Daniil Polykovskiy , Dmitry Vetrov

Face recognition is an important yet challenging problem in computer vision. A major challenge in practical face recognition applications lies in significant variations between profile and frontal faces. Traditional techniques address this…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Xiaolong Yang , Xiaohong Jia , Dihong Gong , Dong-Ming Yan , Zhifeng Li , Wei Liu

Recently, very deep convolutional neural networks (CNNs) have shown outstanding performance in object recognition and have also been the first choice for dense classification problems such as semantic segmentation. However, repeated…

Computer Vision and Pattern Recognition · Computer Science 2016-11-28 Guosheng Lin , Anton Milan , Chunhua Shen , Ian Reid

Deep neural networks have dramatically advanced the state of the art for many areas of machine learning. Recently they have been shown to have a remarkable ability to generate highly complex visual artifacts such as images and text rather…

Computer Vision and Pattern Recognition · Computer Science 2016-07-08 Andrey Zhmoginov , Mark Sandler

Networks with large receptive field (RF) have shown advanced fitting ability in recent years. In this work, we utilize the short-term residual learning method to improve the performance and robustness of networks for image denoising tasks.…

Image and Video Processing · Electrical Eng. & Systems 2022-04-14 Shuo-Fei Wang , Wen-Kai Yu , Ya-Xin Li

Neural networks are becoming central in several areas of computer vision and image processing and different architectures have been proposed to solve specific problems. The impact of the loss layer of neural networks, however, has not…

Computer Vision and Pattern Recognition · Computer Science 2018-04-24 Hang Zhao , Orazio Gallo , Iuri Frosio , Jan Kautz

Variations of deep neural networks such as convolutional neural network (CNN) have been successfully applied to image denoising. The goal is to automatically learn a mapping from a noisy image to a clean image given training data consisting…

Computer Vision and Pattern Recognition · Computer Science 2017-09-29 Tianyang Wang , Mingxuan Sun , Kaoning Hu

Residual networks (ResNets) have recently achieved state-of-the-art on challenging computer vision tasks. We introduce Resnet in Resnet (RiR): a deep dual-stream architecture that generalizes ResNets and standard CNNs and is easily…

Machine Learning · Computer Science 2016-03-29 Sasha Targ , Diogo Almeida , Kevin Lyman

We introduce collaborative learning in which multiple classifier heads of the same network are simultaneously trained on the same training data to improve generalization and robustness to label noise with no extra inference cost. It…

Machine Learning · Statistics 2018-11-08 Guocong Song , Wei Chai

Although the image recognition has been a research topic for many years, many researchers still have a keen interest in it[1]. In some papers[2][3][4], however, there is a tendency to compare models only on one or two datasets, either…

Computer Vision and Pattern Recognition · Computer Science 2019-07-23 Feiyang Chen , Nan Chen , Hanyang Mao , Hanlin Hu

Deep learning algorithms face great challenges with long-tailed data distribution which, however, is quite a common case in real-world scenarios. Previous methods tackle the problem from either the aspect of input space (re-sampling classes…

Computer Vision and Pattern Recognition · Computer Science 2022-05-13 Jiequan Cui , Shu Liu , Zhuotao Tian , Zhisheng Zhong , Jiaya Jia

Deep neural networks are highly expressive machine learning models with the ability to interpolate arbitrary datasets. Deep nets are typically optimized via first-order methods and the optimization process crucially depends on the…

Machine Learning · Statistics 2019-11-12 Talha Cihad Gulcu

Scattering networks are a class of designed Convolutional Neural Networks (CNNs) with fixed weights. We argue they can serve as generic representations for modelling images. In particular, by working in scattering space, we achieve…

Automatic facial expression recognition (FER) has gained much attention due to its applications in human-computer interaction. Among the approaches to improve FER tasks, this paper focuses on deep architecture with the attention mechanism.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Luan Pham , The Huynh Vu , Tuan Anh Tran

In recent years, we have witnessed the rise of deep learning. Deep neural networks have proved their success in many areas. However, the optimization of these networks has become more difficult as neural networks going deeper and datasets…

Machine Learning · Computer Science 2020-08-05 Derya Soydaner

We propose a novel framework for image clustering that incorporates joint representation learning and clustering. Our method consists of two heads that share the same backbone network - a "representation learning" head and a "clustering"…

Computer Vision and Pattern Recognition · Computer Science 2021-07-27 Kien Do , Truyen Tran , Svetha Venkatesh

Residual networks (ResNets) are a deep learning architecture that substantially improved the state of the art performance in certain supervised learning tasks. Since then, they have received continuously growing attention. ResNets have a…

Machine Learning · Computer Science 2020-03-02 Johannes Müller

This paper proposes a novel approach to person re-identification, a fundamental task in distributed multi-camera surveillance systems. Although a variety of powerful algorithms have been presented in the past few years, most of them usually…

Computer Vision and Pattern Recognition · Computer Science 2016-05-04 Shi-Zhe Chen , Chun-Chao Guo , Jian-Huang Lai

Face hallucination, which is the task of generating a high-resolution face image from a low-resolution input image, is a well-studied problem that is useful in widespread application areas. Face hallucination is particularly challenging…

Computer Vision and Pattern Recognition · Computer Science 2016-04-28 Oncel Tuzel , Yuichi Taguchi , John R. Hershey

Deep Convolutional Neural Networks (CNN) enforces supervised information only at the output layer, and hidden layers are trained by back propagating the prediction error from the output layer without explicit supervision. We propose a…

Computer Vision and Pattern Recognition · Computer Science 2016-06-07 Zhuolin Jiang , Yaming Wang , Larry Davis , Walt Andrews , Viktor Rozgic