English
Related papers

Related papers: Perceptual impact of the loss function on deep-lea…

200 papers

While it is nearly effortless for humans to quickly assess the perceptual similarity between two images, the underlying processes are thought to be quite complex. Despite this, the most widely used perceptual metrics today, such as PSNR and…

Computer Vision and Pattern Recognition · Computer Science 2018-04-12 Richard Zhang , Phillip Isola , Alexei A. Efros , Eli Shechtman , Oliver Wang

Image compression is one of the most fundamental techniques and commonly used applications in the image and video processing field. Earlier methods built a well-designed pipeline, and efforts were made to improve all modules of the pipeline…

Image and Video Processing · Electrical Eng. & Systems 2021-03-29 Yueyu Hu , Wenhan Yang , Zhan Ma , Jiaying Liu

Reducing the data footprint of visual content via image compression is essential to reduce storage requirements, but also to reduce the bandwidth and latency requirements for transmission. In particular, the use of compressed images allows…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 João Maria Janeiro , Stanislav Frolov , Alaaeldin El-Nouby , Jakob Verbeek

Deep learning based image segmentation methods have achieved great success, even having human-level accuracy in some applications. However, due to the black box nature of deep learning, the best method may fail in some situations. Thus…

Computer Vision and Pattern Recognition · Computer Science 2020-05-28 Leixin Zhou , Wenxiang Deng , Xiaodong Wu

Image and video restoration has achieved a remarkable leap with the advent of deep learning. The success of deep learning paradigm lies in three key components: data, model, and loss. Currently, many efforts have been devoted to the first…

Computer Vision and Pattern Recognition · Computer Science 2023-03-30 Man Zhou , Naishan Zheng , Jie Huang , Chunle Guo , Chongyi Li

Rate-distortion optimization (RDO) of codecs, where distortion is quantified by the mean-square error, has been a standard practice in image/video compression over the years. RDO serves well for optimization of codec performance for…

Image and Video Processing · Electrical Eng. & Systems 2021-05-03 Ogun Kirmemis , A. Murat Tekalp

We study causal, low-latency, sequential video compression when the output is subjected to both a mean squared-error (MSE) distortion loss as well as a perception loss to target realism. Motivated by prior approaches, we consider two…

Image and Video Processing · Electrical Eng. & Systems 2023-08-24 Sadaf Salehkalaibar , Buu Phan , Jun Chen , Wei Yu , Ashish Khisti

Over recent years, deep learning-based computer vision systems have been applied to images at an ever-increasing pace, oftentimes representing the only type of consumption for those images. Given the dramatic explosion in the number of…

Computer Vision and Pattern Recognition · Computer Science 2021-08-31 Nam Le , Honglei Zhang , Francesco Cricri , Ramin Ghaznavi-Youvalari , Esa Rahtu

Recent works have shown that learned models can achieve significant performance gains, especially in terms of perceptual quality measures, over traditional methods. Hence, the state of the art in image restoration and compression is getting…

Image and Video Processing · Electrical Eng. & Systems 2021-05-03 A. Murat Tekalp , Michele Covell , Radu Timofte , Chao Dong

The emerging Learned Compression (LC) replaces the traditional codec modules with Deep Neural Networks (DNN), which are trained end-to-end for rate-distortion performance. This approach is considered as the future of image/video…

Image and Video Processing · Electrical Eng. & Systems 2024-07-08 Farhad Pakdaman , Moncef Gabbouj

Recent methods for deep metric learning have been focusing on designing different contrastive loss functions between positive and negative pairs of samples so that the learned feature embedding is able to pull positive samples of the same…

Computer Vision and Pattern Recognition · Computer Science 2022-11-08 Shichao Kan , Zhiquan He , Yigang Cen , Yang Li , Vladimir Mladenovic , Zhihai He

In recent years, there has been rapid development in learned image compression techniques that prioritize ratedistortion-perceptual compression, preserving fine details even at lower bit-rates. However, current learning-based image…

Computer Vision and Pattern Recognition · Computer Science 2023-05-19 Peirong Ning , Wei Jiang , Ronggang Wang

The interest in analog computation has grown tremendously in recent years due to its fast computation speed and excellent energy efficiency, which is very important for edge and IoT devices in the sub-watt power envelope for deep learning…

Machine Learning · Computer Science 2022-05-18 Omobayode Fagbohungbe , Lijun Qian

This work investigates alternate pre-emphasis filters used as part of the loss function during neural network training for nonlinear audio processing. In our previous work, the error-to-signal ratio loss function was used during network…

Audio and Speech Processing · Electrical Eng. & Systems 2019-11-21 Alec Wright , Vesa Välimäki

As applications using immersive media gained increased attention from both academia and industry, research in the field of point cloud compression has greatly intensified in recent years, leading to the development of the MPEG compression…

Image and Video Processing · Electrical Eng. & Systems 2024-11-01 Davi Lazzarotto , Michela Testolina , Touradj Ebrahimi

Deep neural networks with multilevel connections process input data in complex ways to learn the information.A networks learning efficiency depends not only on the complex neural network architecture but also on the input training…

Image and Video Processing · Electrical Eng. & Systems 2021-11-02 Rajarajeswari Muthusivarajan , Adrian Celaya , Joshua P. Yung , Satish Viswanath , Daniel S. Marcus , Caroline Chung , David Fuentes

Simultaneous segmentation of multiple organs from different medical imaging modalities is a crucial task as it can be utilized for computer-aided diagnosis, computer-assisted surgery, and therapy planning. Thanks to the recent advances in…

Computer Vision and Pattern Recognition · Computer Science 2021-09-16 Saeid Asgari Taghanaki , Yefeng Zheng , S. Kevin Zhou , Bogdan Georgescu , Puneet Sharma , Daguang Xu , Dorin Comaniciu , Ghassan Hamarneh

Training-free perceptual image codec adopt pre-trained unconditional generative model during decoding to avoid training new conditional generative model. However, they heavily rely on diffusion inversion or sample communication, which take…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Ziran Zhu , Tongda Xu , Minye Huang , Dailan He , Xingtong Ge , Xinjie Zhang , Ling Li , Yan Wang

Learning-based lossless image compression employs pixel-based or subimage-based auto-regression for probability estimation, which achieves desirable performances. However, the existing works only consider context dependencies in one…

Image and Video Processing · Electrical Eng. & Systems 2025-03-17 Tiantian Li , Qunbing Xia , Yue Li , Ruixiao Guo , Gaobo Yang

Lossy image compression is often limited by the simplicity of the chosen loss measure. Recent research suggests that generative adversarial networks have the ability to overcome this limitation and serve as a multi-modal loss, especially…

Image and Video Processing · Electrical Eng. & Systems 2021-03-09 Jan P. Klopp , Keng-Chi Liu , Liang-Gee Chen , Shao-Yi Chien