中文
相关论文

相关论文: An Effective Weight Initialization Method for Deep…

200 篇论文

Small neural networks with a constrained number of trainable parameters, can be suitable resource-efficient candidates for many simple tasks, where now excessively large models are used. However, such models face several problems during the…

机器学习 · 计算机科学 2021-09-21 Alexander Kovalenko , Pavel Kordík , Magda Friedjungová

Convolutional Neural Networks (CNNs) do not have a predictable recognition behavior with respect to the input resolution change. This prevents the feasibility of deployment on different input image resolutions for a specific model. To…

计算机视觉与模式识别 · 计算机科学 2020-07-14 Duo Li , Anbang Yao , Qifeng Chen

We propose a novel network initialization method using Perlin noise for training image classification networks with a limited amount of data. Our main idea is to initialize the network parameters by solving an artificial noise…

计算机视觉与模式识别 · 计算机科学 2021-01-20 Nakamasa Inoue , Eisuke Yamagata , Hirokatsu Kataoka

Deep networks run with low precision operations at inference time offer power and space advantages over high precision alternatives, but need to overcome the challenge of maintaining high accuracy as precision decreases. Here, we present a…

Estimating the primary quantization matrix of double JPEG compressed images is a problem of relevant importance in image forensics since it allows to infer important information about the past history of an image. In addition, the…

计算机视觉与模式识别 · 计算机科学 2021-03-19 Benedetta Tondi , Andrea Costranzo , Dequ Huang , Bin Li

Tomographic image reconstruction is relevant for many medical imaging modalities including X-ray, ultrasound (US) computed tomography (CT) and photoacoustics, for which the access to full angular range tomographic projections might be not…

图像与视频处理 · 电气工程与系统科学 2019-06-14 Valery Vishnevskiy , Richard Rau , Orcun Goksel

Hyperspectral images (HSIs) are susceptible to various noise factors leading to the loss of information, and the noise restricts the subsequent HSIs object detection and classification tasks. In recent years, learning-based methods have…

神经与进化计算 · 计算机科学 2020-08-18 Yuqiao Liu , Yanan Sun , Bing Xue , Mengjie Zhang

Batch normalization (BN) has become a de facto standard for training deep convolutional networks. However, BN accounts for a significant fraction of training run-time and is difficult to accelerate, since it is a memory-bandwidth bounded…

计算机视觉与模式识别 · 计算机科学 2017-10-10 Igor Gitman , Boris Ginsburg

We propose a novel low-rank initialization framework for training low-rank deep neural networks -- networks where the weight parameters are re-parameterized by products of two low-rank matrices. The most successful prior existing approach,…

机器学习 · 计算机科学 2022-05-23 Kiran Vodrahalli , Rakesh Shivanna , Maheswaran Sathiamoorthy , Sagar Jain , Ed H. Chi

Quantizing deep networks with adaptive bit-widths is a promising technique for efficient inference across many devices and resource constraints. In contrast to static methods that repeat the quantization process and train different models…

计算机视觉与模式识别 · 计算机科学 2021-09-20 Ximeng Sun , Rameswar Panda , Chun-Fu Chen , Naigang Wang , Bowen Pan , Kailash Gopalakrishnan , Aude Oliva , Rogerio Feris , Kate Saenko

Deep neural networks (DNNs) can be made hardware-efficient by reducing the numerical precision of the weights and activations of the network and by improving the network's resilience to noise. However, this gain in efficiency often comes at…

In this work we propose a methodology for an automatic food classification system which recognizes the contents of the meal from the images of the food. We developed a multi-layered deep convolutional neural network (CNN) architecture that…

计算机视觉与模式识别 · 计算机科学 2017-11-22 Paritosh Pandey , Akella Deepthi , Bappaditya Mandal , N. B. Puhan

Deep convolutional neural networks have proven to be well suited for image classification applications. However, if there is distortion in the image, the classification accuracy can be significantly degraded, even with state-of-the-art…

计算机视觉与模式识别 · 计算机科学 2019-02-15 Minho Ha , Younghoon Byeon , Youngjoo Lee , Sunggu Lee

Artificial neural network (ANN) is a very useful tool in solving learning problems. Boosting the performances of ANN can be mainly concluded from two aspects: optimizing the architecture of ANN and normalizing the raw data for ANN. In this…

机器学习 · 计算机科学 2017-12-27 Qingjiu Zhang , Shiliang Sun

Deep residual networks have recently shown appealing performance on many challenging computer vision tasks. However, the original residual structure still has some defects making it difficult to converge on very deep networks. In this…

计算机视觉与模式识别 · 计算机科学 2016-05-31 Falong Shen , Gang Zeng

Current deep neural networks (DNNs) can easily overfit to biased training data with corrupted labels or class imbalance. Sample re-weighting strategy is commonly used to alleviate this issue by designing a weighting function mapping from…

机器学习 · 计算机科学 2019-09-30 Jun Shu , Qi Xie , Lixuan Yi , Qian Zhao , Sanping Zhou , Zongben Xu , Deyu Meng

We study in this paper how to initialize the parameters of multinomial logistic regression (a fully connected layer followed with softmax and cross entropy loss), which is widely used in deep neural network (DNN) models for classification…

计算机视觉与模式识别 · 计算机科学 2018-09-18 Bowen Cheng , Rong Xiao , Yandong Guo , Yuxiao Hu , Jianfeng Wang , Lei Zhang

We introduce an algorithm where the individual bits representing the weights of a neural network are learned. This method allows training weights with integer values on arbitrary bit-depths and naturally uncovers sparse networks, without…

机器学习 · 计算机科学 2022-02-22 Cristian Ivan

Many different deep networks have been used to approximate, accelerate or improve traditional image operators, such as image smoothing, super-resolution and denoising. Among these traditional operators, many contain parameters which need to…

计算机视觉与模式识别 · 计算机科学 2018-08-10 Qingnan Fan , Dongdong Chen , Lu Yuan , Gang Hua , Nenghai Yu , Baoquan Chen

Deep convolutional neural networks provide a powerful feature learning capability for image classification. The deep image features can be utilized to deal with many image understanding tasks like image classification and object…

计算机视觉与模式识别 · 计算机科学 2018-11-20 Shaoning Zeng , Bob Zhang , Yanghao Zhang , Jianping Gou