English
Related papers

Related papers: A Loss Function for Generative Neural Networks Bas…

200 papers

We present an extension to masked autoencoders (MAE) which improves on the representations learnt by the model by explicitly encouraging the learning of higher scene-level features. We do this by: (i) the introduction of a perceptual…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Samyakh Tukra , Frederick Hoffman , Ken Chatfield

We present a coupled Variational Auto-Encoder (VAE) method that improves the accuracy and robustness of the probabilistic inferences on represented data. The new method models the dependency between input feature vectors (images) and weighs…

Machine Learning · Computer Science 2025-11-25 Shichen Cao , Jingjing Li , Kenric P. Nelson , Mark A. Kon

We introduce a version of a variational auto-encoder (VAE), which can generate good perturbations of images, when trained on a complex dataset (in our experiments, CIFAR-10). The net is using only two latent generative dimensions per class,…

Computer Vision and Pattern Recognition · Computer Science 2019-11-28 Galin Georgiev

We introduce a shape-sensitive loss function for catheter and guidewire segmentation and utilize it in a vision transformer network to establish a new state-of-the-art result on a large-scale X-ray images dataset. We transform…

Image and Video Processing · Electrical Eng. & Systems 2024-01-23 Chayun Kongtongvattana , Baoru Huang , Jingxuan Kang , Hoan Nguyen , Olajide Olufemi , Anh Nguyen

Learned image reconstruction techniques using deep neural networks have recently gained popularity, and have delivered promising empirical results. However, most approaches focus on one single recovery for each observation, and thus neglect…

Computer Vision and Pattern Recognition · Computer Science 2021-10-26 Chen Zhang , Riccardo Barbano , Bangti Jin

Deep metric learning has yielded impressive results in tasks such as clustering and image retrieval by leveraging neural networks to obtain highly discriminative feature embeddings, which can be used to group samples into different classes.…

Computer Vision and Pattern Recognition · Computer Science 2020-07-21 Ismail Elezi , Sebastiano Vascon , Alessandro Torcinovich , Marcello Pelillo , Laura Leal-Taixe

Recent success in the field of single image super-resolution (SISR) is achieved by optimizing deep convolutional neural networks (CNNs) in the image space with the L1 or L2 loss. However, when trained with these loss functions, models…

Image and Video Processing · Electrical Eng. & Systems 2022-02-03 Lusine Abrahamyan , Anh Minh Truong , Wilfried Philips , Nikos Deligiannis

In image anomaly detection, Autoencoders are the popular methods that reconstruct the input image that might contain anomalies and output a clean image with no abnormalities. These Autoencoder-based methods usually calculate the anomaly…

Image and Video Processing · Electrical Eng. & Systems 2021-05-24 Masaki Nakanishi , Kazuki Sato , Hideo Terada

Applications that involve supervised training require paired images. Researchers of single image super-resolution (SISR) create such images by artificially generating blurry input images from the corresponding ground truth. Similarly we can…

Image and Video Processing · Electrical Eng. & Systems 2020-05-15 Nao Takano , Gita Alaghband

Feed-forward CNNs trained for image transformation problems rely on loss functions that measure the similarity between the generated image and a target image. Most of the common loss functions assume that these images are spatially aligned…

Computer Vision and Pattern Recognition · Computer Science 2018-07-19 Roey Mechrez , Itamar Talmi , Lihi Zelnik-Manor

The adoption of neural network models in medical imaging has been constrained by strict privacy regulations, limited data availability, high acquisition costs, and demographic biases. Deep generative models offer a promising solution by…

Image and Video Processing · Electrical Eng. & Systems 2025-06-16 Zuzanna Skorniewska , Bartlomiej W. Papiez

Variational auto-encoders (VAEs) are a popular and powerful deep generative model. Previous works on VAEs have assumed a factorized likelihood model, whereby the output uncertainty of each pixel is assumed to be independent. This…

Machine Learning · Statistics 2026-05-14 Gara Dorta , Sara Vicente , Lourdes Agapito , Neill D. F. Campbell , Ivor Simpson

Loss functions are error metrics that quantify the difference between a prediction and its corresponding ground truth. Fundamentally, they define a functional landscape for traversal by gradient descent. Although numerous loss functions…

Image and Video Processing · Electrical Eng. & Systems 2021-04-09 Chaitanya Kaul , Nick Pears , Hang Dai , Roderick Murray-Smith , Suresh Manandhar

Objective functions that optimize deep neural networks play a vital role in creating an enhanced feature representation of the input data. Although cross-entropy-based loss formulations have been extensively used in a variety of supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Deen Dayal Mohan , Bhavin Jawade , Srirangaraj Setlur , Venu Govindaraj

Automatic building extraction from aerial imagery has several applications in urban planning, disaster management, and change detection. In recent years, several works have adopted deep convolutional neural networks (CNNs) for building…

Image and Video Processing · Electrical Eng. & Systems 2020-01-22 Clint Sebastian , Raffaele Imbriaco , Egor Bondarev , Peter H. N. de With

Depth estimation from 2D images is a common computer vision task that has applications in many fields including autonomous vehicles, scene understanding and robotics. The accuracy of a supervised depth estimation method mainly relies on the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Muhammad Adeel Hafeez , Michael G. Madden , Ganesh Sistu , Ihsan Ullah

Variational autoencoders (VAEs), that are built upon deep neural networks have emerged as popular generative models in computer vision. Most of the work towards improving variational autoencoders has focused mainly on making the…

Machine Learning · Statistics 2016-11-17 Siddharth Agrawal , Ambedkar Dukkipati

The weights of neural networks (NNs) have recently gained prominence as a new data modality in machine learning, with applications ranging from accuracy and hyperparameter prediction to representation learning or weight generation. One…

Machine Learning · Computer Science 2025-03-24 Léo Meynent , Ivan Melev , Konstantin Schürholt , Göran Kauermann , Damian Borth

Self-supervised learning has attracted increasing attention as it learns data-driven representation from data without annotations. Vision transformer-based autoencoder (ViT-AE) by He et al. (2021) is a recent self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Chinmay Prabhakar , Hongwei Bran Li , Jiancheng Yang , Suprosana Shit , Benedikt Wiestler , Bjoern Menze

We present a novel method for image anomaly detection, where algorithms that use samples drawn from some distribution of "normal" data, aim to detect out-of-distribution (abnormal) samples. Our approach includes a combination of encoder and…

Image and Video Processing · Electrical Eng. & Systems 2020-03-02 Nina Tuluptceva , Bart Bakker , Irina Fedulova , Anton Konushin