English
Related papers

Related papers: Lossy Source Coding with Focal Loss

200 papers

The secrecy performance of a source-channel model is studied in the context of lossy source compression over a noisy broadcast channel. The source is causally revealed to the eavesdropper during decoding. The fidelity of the transmission to…

Information Theory · Computer Science 2015-06-24 Eva C. Song , Paul Cuff , H. Vincent Poor

Consider the set of source distributions within a fixed maximum relative entropy with respect to a given nominal distribution. Lossless source coding over this relative entropy ball can be approached in more than one way. A problem…

Information Theory · Computer Science 2011-05-03 Michael B. Baer , Farzad Rezaei , Charalambos D. Charalambous

Humans can easily perceive the direction of sound sources in a visual scene, termed sound source localization. Recent studies on learning-based sound source localization have mainly explored the problem from a localization perspective.…

Computer Vision and Pattern Recognition · Computer Science 2023-09-20 Arda Senocak , Hyeonggon Ryu , Junsik Kim , Tae-Hyun Oh , Hanspeter Pfister , Joon Son Chung

An encoder wishes to minimize the bit rate necessary to guarantee that a decoder is able to calculate a symbol-wise function of a sequence available only at the encoder and a sequence that can be measured only at the decoder. This classical…

Information Theory · Computer Science 2012-04-17 Behzad Ahmadi , Osvaldo Simeone

We prove the existence of codebooks for d-semifaithful lossy compression that are simultaneously universal with respect to both the class of finite-alphabet memoryless sources and the class of all bounded additive distortion measures. By…

Information Theory · Computer Science 2022-03-08 Neri Merhav

The choice of a loss function is an important factor when training neural networks for image restoration problems, such as single image super resolution. The loss function should encourage natural and perceptually pleasing results. A…

Image and Video Processing · Electrical Eng. & Systems 2021-10-19 Aamir Mustafa , Aliaksei Mikhailiuk , Dan Andrei Iliescu , Varun Babbar , Rafal K. Mantiuk

Ensembles of Convolutional neural networks have shown remarkable results in learning discriminative semantic features for image classification tasks. Though, the models in the ensemble often concentrate on similar regions in images. This…

Computer Vision and Pattern Recognition · Computer Science 2023-02-28 Tobias Schlagenhauf , Yiwen Lin , Benjamin Noack

Widely used loss functions for CNN segmentation, e.g., Dice or cross-entropy, are based on integrals over the segmentation regions. Unfortunately, for highly unbalanced segmentations, such regional summations have values that differ by…

Image and Video Processing · Electrical Eng. & Systems 2020-10-20 Hoel Kervadec , Jihene Bouchtiba , Christian Desrosiers , Eric Granger , Jose Dolz , Ismail Ben Ayed

We present a powerful new loss function and training scheme for learning binary hash codes with any differentiable model and similarity function. Our loss function improves over prior methods by using log likelihood loss on top of an…

Machine Learning · Computer Science 2018-10-03 Martin Loncaric , Bowei Liu , Ryan Weber

Cross-modal retrieval aims to learn discriminative and modal-invariant features for data from different modalities. Unlike the existing methods which usually learn from the features extracted by offline networks, in this paper, we propose…

Computer Vision and Pattern Recognition · Computer Science 2020-08-11 Longlong Jing , Elahe Vahdani , Jiaxing Tan , Yingli Tian

A conjectural expression of the asymptotic gap between the rate-distortion function of an arbitrary generalized Gaussian multiterminal source coding system and that of its centralized counterpart in the high-resolution regime is proposed.…

Information Theory · Computer Science 2019-08-19 Li Xie , Xiaolan Tu , Siyao Zhou , Jun Chen

Different from large-scale classification tasks, fine-grained visual classification is a challenging task due to two critical problems: 1) evident intra-class variances and subtle inter-class differences, and 2) overfitting owing to fewer…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Hang Yao , Qiguang Miao , Peipei Zhao , Chaoneng Li , Xin Li , Guanwen Feng , Ruyi Liu

We are interested in how to best communicate a (usually real valued) source to a number of destinations (sinks) over a network with capacity constraints in a collective fidelity metric over all the sinks, a problem which we call joint…

Information Theory · Computer Science 2007-07-13 Nima Sarshar , Xiaolin Wu

A lossy source code $\mathcal{C}$ with rate $R$ for a discrete memoryless source $S$ is called subset-universal if for every $0<R'< R$, almost every subset of $2^{nR'}$ of its codewords achieves average distortion close to the source's…

Information Theory · Computer Science 2015-03-13 Or Ordentlich , Ofer Shayevitz

Automatic segmentation methods are an important advancement in medical image analysis. Machine learning techniques, and deep neural networks in particular, are the state-of-the-art for most medical image segmentation tasks. Issues with…

Image and Video Processing · Electrical Eng. & Systems 2021-11-25 Michael Yeung , Evis Sala , Carola-Bibiane Schönlieb , Leonardo Rundo

Cross-entropy loss and focal loss are the most common choices when training deep neural networks for classification problems. Generally speaking, however, a good loss function can take on much more flexible forms, and should be tailored for…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Zhaoqi Leng , Mingxing Tan , Chenxi Liu , Ekin Dogus Cubuk , Xiaojie Shi , Shuyang Cheng , Dragomir Anguelov

Radio frequency sources are observed at a fusion center via sensor measurements made over slow flat-fading channels. The number of sources may be larger than the number of sensors, but their activity is sparse and intermittent with bursty…

Signal Processing · Electrical Eng. & Systems 2019-08-07 Annan Dong , Osvaldo Simeone , Alexander Haimovich , Jason Dabin

We consider a system in which two nodes take correlated measurements of a random source with time-varying and unknown statistics. The observations of the source at the first node are to be losslessly replicated with a given probability of…

Information Theory · Computer Science 2016-10-27 Fangzhou Chen , Bin Li , Can Emre Koksal

Convolutional neural networks have achieved great improvement on face recognition in recent years because of its extraordinary ability in learning discriminative features of people with different identities. To train such a well-designed…

Computer Vision and Pattern Recognition · Computer Science 2016-11-29 Xiao Zhang , Zhiyuan Fang , Yandong Wen , Zhifeng Li , Yu Qiao

Researchers illustrate improvements in contextual encoding strategies via resultant performance on a battery of shared Natural Language Understanding (NLU) tasks. Many of these tasks are of a categorical prediction variety: given a…

Computation and Language · Computer Science 2019-06-06 Zhongyang Li , Tongfei Chen , Benjamin Van Durme