中文
相关论文

相关论文: Resnet in Resnet: Generalizing Residual Architectu…

200 篇论文

Residual deep neural networks (ResNets) are mathematically described as interacting particle systems. In the case of infinitely many layers the ResNet leads to a system of coupled system of ordinary differential equations known as neural…

偏微分方程分析 · 数学 2022-05-11 M. Herty , A. Thuenen , T. Trimborn , G. Visconti

We show that standard ResNet architectures can be made invertible, allowing the same model to be used for classification, density estimation, and generation. Typically, enforcing invertibility requires partitioning dimensions or restricting…

机器学习 · 计算机科学 2019-05-21 Jens Behrmann , Will Grathwohl , Ricky T. Q. Chen , David Duvenaud , Jörn-Henrik Jacobsen

A deep learning approach to blind denoising of images without complete knowledge of the noise statistics is considered. We propose DN-ResNet, which is a deep convolutional neural network (CNN) consisting of several residual blocks…

图像与视频处理 · 电气工程与系统科学 2019-04-12 Haoyu Ren , Mostafa El-Khamy , Jungwon Lee

It has become mainstream in computer vision and other machine learning domains to reuse backbone networks pre-trained on large datasets as preprocessors. Typically, the last layer is replaced by a shallow learning machine of sorts; the…

机器学习 · 计算机科学 2023-10-03 Haozhe Sun , Isabelle Guyon , Felix Mohr , Hedi Tabia

Learned inverse problem solvers exhibit remarkable performance in applications like image reconstruction tasks. These data-driven reconstruction methods often follow a two-step scheme. First, one trains the often neural network-based…

We propose ResIST, a novel distributed training protocol for Residual Networks (ResNets). ResIST randomly decomposes a global ResNet into several shallow sub-ResNets that are trained independently in a distributed manner for several local…

机器学习 · 计算机科学 2022-03-15 Chen Dun , Cameron R. Wolfe , Christopher M. Jermaine , Anastasios Kyrillidis

Residual Neural Networks [1] won first place in all five main tracks of the ImageNet and COCO 2015 competitions. This kind of network involves the creation of pluggable modules such that the output contains a residual from the input. The…

计算机视觉与模式识别 · 计算机科学 2018-03-16 Yatin Saraiya

An effective person re-identification (re-ID) model should learn feature representations that are both discriminative, for distinguishing similar-looking people, and generalisable, for deployment across datasets without any adaptation. In…

计算机视觉与模式识别 · 计算机科学 2021-04-30 Kaiyang Zhou , Yongxin Yang , Andrea Cavallaro , Tao Xiang

In our work, we bridge deep neural network design with numerical differential equations. We show that many effective networks, such as ResNet, PolyNet, FractalNet and RevNet, can be interpreted as different numerical discretizations of…

计算机视觉与模式识别 · 计算机科学 2020-03-24 Yiping Lu , Aoxiao Zhong , Quanzheng Li , Bin Dong

Recently, the deep convolutional neural network (CNN) has made remarkable progress in single image super resolution(SISR). However, blindly using the residual structure and dense structure to extract features from LR images, can cause the…

计算机视觉与模式识别 · 计算机科学 2019-07-08 Xiaopeng Sun , Wen Lu , Rui Wang , Furui Bai

One of the most computationally intensive parts in modern recognition systems is an inference of deep neural networks that are used for image classification, segmentation, enhancement, and recognition. The growing popularity of edge…

计算机视觉与模式识别 · 计算机科学 2020-10-22 Elena Limonova , Daniil Alfonso , Dmitry Nikolaev , Vladimir V. Arlazarov

We present a simple, highly modularized network architecture for image classification. Our network is constructed by repeating a building block that aggregates a set of transformations with the same topology. Our simple design results in a…

计算机视觉与模式识别 · 计算机科学 2017-04-12 Saining Xie , Ross Girshick , Piotr Dollár , Zhuowen Tu , Kaiming He

Image inpainting is a widely used technique in computer vision for reconstructing missing or damaged pixels in images. Recent advancements with Generative Adversarial Networks (GANs) have demonstrated superior performance over traditional…

Deluge Networks (DelugeNets) are deep neural networks which efficiently facilitate massive cross-layer information inflows from preceding layers to succeeding layers. The connections between layers in DelugeNets are established through…

计算机视觉与模式识别 · 计算机科学 2017-08-24 Jason Kuen , Xiangfei Kong , Gang Wang , Yap-Peng Tan

ResNet has achieved tremendous success in computer vision through its residual connection mechanism. ResNet can be viewed as a discretized form of ordinary differential equations (ODEs). From this perspective, the multiple residual blocks…

计算机视觉与模式识别 · 计算机科学 2025-11-18 Nuolin Sun , Linyuan Wang , Haonan Wei , Lei Li , Bin Yan

Neural networks are powerful and flexible models that work well for many difficult learning tasks in image, speech and natural language understanding. Despite their success, neural networks are still hard to design. In this paper, we use a…

机器学习 · 计算机科学 2017-02-16 Barret Zoph , Quoc V. Le

Deep convolutional neural networks (CNNs) are often of sophisticated design with numerous learnable parameters for the accuracy reason. To alleviate the expensive costs of deploying them on mobile devices, recent works have made huge…

计算机视觉与模式识别 · 计算机科学 2021-11-09 Mingjian Zhu , Kai Han , Enhua Wu , Qiulin Zhang , Ying Nie , Zhenzhong Lan , Yunhe Wang

Reversible image conversion (RIC) aims to build a reversible transformation between specific visual content (e.g., short videos) and an embedding image, where the original content can be restored from the embedding when necessary. This work…

计算机视觉与模式识别 · 计算机科学 2021-09-10 Ka Leong Cheng , Yueqi Xie , Qifeng Chen

Background and Objective: The success of neural networks in a number of image processing tasks has motivated their application in image reconstruction problems in computed tomography (CT). While progress has been made in this area, the lack…

图像与视频处理 · 电气工程与系统科学 2024-09-19 Ziyu Shu , Alireza Entezari

The ResNet-based architecture has been widely adopted to extract speaker embeddings for text-independent speaker verification systems. By introducing the residual connections to the CNN and standardizing the residual blocks, the ResNet…

音频与语音处理 · 电气工程与系统科学 2020-12-01 Tianyan Zhou , Yong Zhao , Jian Wu