English
Related papers

Related papers: Generative Zero-shot Network Quantization

200 papers

The existing Zero-Shot learning (ZSL) methods may suffer from the vague class attributes that are highly overlapped for different classes. Unlike these methods that ignore the discrimination among classes, in this paper, we propose to…

Computer Vision and Pattern Recognition · Computer Science 2019-04-22 Zihan Ye , Fan Lyu , Linyan Li , Qiming Fu , Jinchang Ren , Fuyuan Hu

Generalization to unseen data is a key desideratum for deep networks, but its relation to classification accuracy is unclear. Using a minimalist vision dataset and a measure of generalizability, we show that popular networks, from deep…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Evan Gerritz , Luciano Dyballa , Steven W. Zucker

Given large amount of real photos for training, Convolutional neural network shows excellent performance on object recognition tasks. However, the process of collecting data is so tedious and the background are also limited which makes it…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Yida Wang , Weihong Deng

Batch Normalization (BN) is a milestone technique in the development of deep learning, enabling various networks to train. However, normalizing along the batch dimension introduces problems --- BN's error increases rapidly when the batch…

Computer Vision and Pattern Recognition · Computer Science 2018-06-13 Yuxin Wu , Kaiming He

Batch normalization (BN) is a key facilitator and considered essential for state-of-the-art binary neural networks (BNN). However, the BN layer is costly to calculate and is typically implemented with non-binary parameters, leaving a hurdle…

Machine Learning · Computer Science 2021-04-19 Tianlong Chen , Zhenyu Zhang , Xu Ouyang , Zechun Liu , Zhiqiang Shen , Zhangyang Wang

Employing deep neural networks as natural image priors to solve inverse problems either requires large amounts of data to sufficiently train expressive generative models or can succeed with no data via untrained neural networks. However,…

Machine Learning · Computer Science 2019-10-25 Oscar Leong , Wesam Sakla

Training Deep Neural Networks is complicated by the fact that the distribution of each layer's inputs changes during training, as the parameters of the previous layers change. This slows down the training by requiring lower learning rates…

Machine Learning · Computer Science 2015-03-03 Sergey Ioffe , Christian Szegedy

In recent years, deep neural networks for image inhomogeneity reduction have shown promising results. However, current methods with (un)supervised solutions require preparing a training dataset, which is expensive and laborious for data…

Image and Video Processing · Electrical Eng. & Systems 2026-02-16 Hongxu Yang , Edina Timko , Brice Fernandez

Current developments in computer vision and deep learning allow to automatically generate hyper-realistic images, hardly distinguishable from real ones. In particular, human face generation achieved a stunning level of realism, opening new…

Computer Vision and Pattern Recognition · Computer Science 2019-10-08 Francesco Marra , Cristiano Saltori , Giulia Boato , Luisa Verdoliva

While convolutional neural networks are dominating the field of computer vision, one usually does not have access to the large amount of domain-relevant data needed for their training. It thus became common to use available synthetic…

Computer Vision and Pattern Recognition · Computer Science 2018-10-10 Benjamin Planche , Sergey Zakharov , Ziyan Wu , Andreas Hutter , Harald Kosch , Slobodan Ilic

Generative Adversarial Networks (GANs) have been used widely to generate large volumes of synthetic data. This data is being utilized for augmenting with real examples in order to train deep Convolutional Neural Networks (CNNs). Studies…

Computer Vision and Pattern Recognition · Computer Science 2020-06-18 Binod Bhattarai , Seungryul Baek , Rumeysa Bodur , Tae-Kyun Kim

Robust object recognition systems usually rely on powerful feature extraction mechanisms from a large number of real images. However, in many realistic applications, collecting sufficient images for ever-growing new classes is unattainable.…

Computer Vision and Pattern Recognition · Computer Science 2017-05-05 Yang Long , Li Liu , Ling Shao , Fumin Shen , Guiguang Ding , Jungong Han

Multi-label zero-shot learning strives to classify images into multiple unseen categories for which no data is available during training. The test samples can additionally contain seen categories in the generalized variant. Existing…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Akshita Gupta , Sanath Narayan , Salman Khan , Fahad Shahbaz Khan , Ling Shao , Joost van de Weijer

Generative adversarial networks (GANs) have an enormous potential impact on digital content creation, e.g., photo-realistic digital avatars, semantic content editing, and quality enhancement of speech and images. However, the performance of…

Artificial Intelligence · Computer Science 2021-09-01 Pavel Andreev , Alexander Fritzler , Dmitry Vetrov

In this work we demonstrate that generative adversarial networks (GANs) can be used to generate realistic pervasive changes in remote sensing imagery, even in an unpaired training setting. We investigate some transformation quality metrics…

Image and Video Processing · Electrical Eng. & Systems 2020-05-19 Christopher X. Ren , Amanda Ziemann , James Theiler , Alice M. S. Durieux

Deep Convolutional Neural Networks (DCNNs) are hard and time-consuming to train. Normalization is one of the effective solutions. Among previous normalization methods, Batch Normalization (BN) performs well at medium and large batch sizes…

Machine Learning · Computer Science 2020-12-10 Xiao-Yun Zhou , Jiacheng Sun , Nanyang Ye , Xu Lan , Qijun Luo , Bo-Lin Lai , Pedro Esperanca , Guang-Zhong Yang , Zhenguo Li

As synthetic imagery is used more frequently in training deep models, it is important to understand how different synthesis techniques impact the performance of such models. In this work, we perform a thorough evaluation of the…

Computer Vision and Pattern Recognition · Computer Science 2019-09-05 Kristofer Schlachter , Connor DeFanti , Sebastian Herscher , Ken Perlin , Jonathan Tompson

In the realm of deep neural network deployment, low-bit quantization presents a promising avenue for enhancing computational efficiency. However, it often hinges on the availability of training data to mitigate quantization errors, a…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Yuhang Li , Youngeun Kim , Donghyun Lee , Souvik Kundu , Priyadarshini Panda

In generalized zero shot learning (GZSL), the set of classes are split into seen and unseen classes, where training relies on the semantic features of the seen and unseen classes and the visual representations of only the seen classes,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-03 Rafael Felix , B. G. Vijay Kumar , Ian Reid , Gustavo Carneiro

The increasingly photorealistic sample quality of generative image models suggests their feasibility in applications beyond image generation. We present the Neural Photo Editor, an interface that leverages the power of generative neural…

Machine Learning · Computer Science 2017-02-07 Andrew Brock , Theodore Lim , J. M. Ritchie , Nick Weston