English
Related papers

Related papers: Evolving Loss Functions for Specific Image Augment…

200 papers

Nowadays, due to advanced digital imaging technologies and internet accessibility to the public, the number of generated digital images has increased dramatically. Thus, the need for automatic image enhancement techniques is quite apparent.…

Image and Video Processing · Electrical Eng. & Systems 2021-12-08 Saeedeh Rezaee , Nezam Mahdavi-Amiri

Image augmentation is a widely used technique to improve the performance of convolutional neural networks (CNNs). In common image shifting, cropping, flipping, shearing and rotating are used for augmentation. But there are more advanced…

Computer Vision and Pattern Recognition · Computer Science 2019-09-24 Philip May

For many years, it has been shown how much exploiting equivariances can be beneficial when solving image analysis tasks. For example, the superiority of convolutional neural networks (CNNs) compared to dense networks mainly comes from an…

Computer Vision and Pattern Recognition · Computer Science 2023-04-20 Valentin Delchevalerie , Alexandre Mayer , Adrien Bibal , Benoît Frénay

Despite the unprecedented improvement of face recognition, existing face recognition models still show considerably low performances in determining whether a pair of child and adult images belong to the same identity. Previous approaches…

Computer Vision and Pattern Recognition · Computer Science 2021-10-25 Jungsoo Lee , Jooyeol Yun , Sunghyun Park , Yonggyu Kim , Jaegul Choo

Designing an effective loss function plays an important role in visual analysis. Most existing loss function designs rely on hand-crafted heuristics that require domain experts to explore the large design space, which is usually sub-optimal…

Computer Vision and Pattern Recognition · Computer Science 2019-08-15 Chuming Li , Yuan Xin , Chen Lin , Minghao Guo , Wei Wu , Wanli Ouyang , Junjie Yan

The proposal of perceptual loss solves the problem that per-pixel difference loss function causes the reconstructed image to be overly-smooth, which acquires a significant progress in the field of single image super-resolution…

Image and Video Processing · Electrical Eng. & Systems 2022-01-19 Jie Song , Huawei Yi , Wenqian Xu , Xiaohui Li , Bo Li , Yuanyuan Liu

The field of medical image reconstruction has seen roughly four types of methods. The first type tended to be analytical methods, such as filtered back-projection (FBP) for X-ray computed tomography (CT) and the inverse Fourier transform…

Image and Video Processing · Electrical Eng. & Systems 2019-08-19 Saiprasad Ravishankar , Jong Chul Ye , Jeffrey A. Fessler

It has been challenging to identify ferrograph images with a small dataset and various scales of wear particle. A novel model is proposed in this study to cope with these challenging problems. For the problem of insufficient samples, we…

Computer Vision and Pattern Recognition · Computer Science 2020-10-15 Peng Peng , Jiugen Wang

In face recognition, designing margin-based (e.g., angular, additive, additive angular margins) softmax loss functions plays an important role in learning discriminative features. However, these hand-crafted heuristic methods are…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Xiaobo Wang , Shuo Wang , Cheng Chi , Shifeng Zhang , Tao Mei

Self-supervised contrastive learning frameworks have progressed rapidly over the last few years. In this paper, we propose a novel loss function for contrastive learning. We model our pre-training task as a binary classification problem to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Siladittya Manna , Umapada Pal , Saumik Bhattacharya

Unsupervised node representations learnt using contrastive learning-based methods have shown good performance on downstream tasks. However, these methods rely on augmentations that mimic low-pass filters, limiting their performance on tasks…

Machine Learning · Computer Science 2023-12-05 Chanakya Ekbote , Ajinkya Pankaj Deshpande , Arun Iyer , Ramakrishna Bairi , Sundararajan Sellamanickam

The loss functions of deep neural networks are complex and their geometric properties are not well understood. We show that the optima of these complex loss functions are in fact connected by simple curves over which training and test…

Machine Learning · Statistics 2018-10-31 Timur Garipov , Pavel Izmailov , Dmitrii Podoprikhin , Dmitry Vetrov , Andrew Gordon Wilson

We consider supervised learning problems in which set predictions provide explicit uncertainty estimates. Using Choquet integrals (a.k.a. Lov{\'a}sz extensions), we propose a convex loss function for nondecreasing subset-valued functions…

Machine Learning · Computer Science 2025-12-23 Francis Bach

Recent advances in deep learning have pushed the performances of visual saliency models way further than it has ever been. Numerous models in the literature present new ways to design neural networks, to arrange gaze pattern data, or to…

Computer Vision and Pattern Recognition · Computer Science 2019-07-05 Alexandre Bruckert , Hamed R. Tavakoli , Zhi Liu , Marc Christie , Olivier Le Meur

Deep Convolutional Neural Networks (DCNNs) and their variants have been widely used in large scale face recognition(FR) recently. Existing methods have achieved good performance on many FR benchmarks. However, most of them suffer from two…

Computer Vision and Pattern Recognition · Computer Science 2021-06-28 Jing Xu , Tszhang Guo , Yong Xu , Zenglin Xu , Kun Bai

The single image super-resolution(SISR) algorithms under deep learning currently have two main models, one based on convolutional neural networks and the other based on Transformer. The former uses the stacking of convolutional layers with…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Li Ke , Liu Yukai

Neural networks have proven effective at solving difficult problems but designing their architectures can be challenging, even for image classification problems alone. Our goal is to minimize human participation, so we employ evolutionary…

Neural and Evolutionary Computing · Computer Science 2017-06-13 Esteban Real , Sherry Moore , Andrew Selle , Saurabh Saxena , Yutaka Leon Suematsu , Jie Tan , Quoc Le , Alex Kurakin

We consider image transformation problems, where an input image is transformed into an output image. Recent methods for such problems typically train feed-forward convolutional neural networks using a \emph{per-pixel} loss between the…

Computer Vision and Pattern Recognition · Computer Science 2016-03-29 Justin Johnson , Alexandre Alahi , Li Fei-Fei

In this paper, orthogonal to the existing data and model studies, we instead resort our efforts to investigate the potential of loss function in a new perspective and present our belief ``Random Weights Networks can Be Acted as Loss Prior…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Man Zhou , Naishan Zheng , Jie Huang , Xiangyu Rui , Chunle Guo , Deyu Meng , Chongyi Li , Jinwei Gu

Contrastive learning is a powerful technique to learn representations that are semantically distinctive and geometrically invariant. While most of the earlier approaches have demonstrated its effectiveness on single-modality learning tasks…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Anurag Jain , Yashaswi Verma