English
Related papers

Related papers: Pretraining Image Encoders without Reconstruction …

200 papers

Recently, more and more images are compressed and sent to the back-end devices for the machine analysis tasks~(\textit{e.g.,} object detection) instead of being purely watched by humans. However, most traditional or learned image codecs are…

Image and Video Processing · Electrical Eng. & Systems 2022-06-14 Guo Lu , Xingtong Ge , Tianxiong Zhong , Jing Geng , Qiang Hu

In this paper, we propose a fully convolutional networks for iterative non-blind deconvolution We decompose the non-blind deconvolution problem into image denoising and image deconvolution. We train a FCNN to remove noises in the gradient…

Computer Vision and Pattern Recognition · Computer Science 2016-11-22 Jiawei Zhang , Jinshan Pan , Wei-Sheng Lai , Rynson Lau , Ming-Hsuan Yang

Implicit neural representations (INRs) have emerged as a powerful paradigm for medical imaging via physics-informed unsupervised learning. Classical INRs optimize an entire network from scratch for each subject, leading to inefficient…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Qing Wu , Xuanyu Tian , Chenhe Du , Haonan Zhang , Xiao Wang , Le Lu , Yuyao Zhang

Deep convolutional networks (CNNs) have exhibited their potential in image inpainting for producing plausible results. However, in most existing methods, e.g., context encoder, the missing parts are predicted by propagating the surrounding…

Computer Vision and Pattern Recognition · Computer Science 2018-04-16 Zhaoyi Yan , Xiaoming Li , Mu Li , Wangmeng Zuo , Shiguang Shan

Diffusion autoencoders (DAEs) are typically formulated as a noise prediction model and trained with a linear-$\beta$ noise schedule that spends much of its sampling steps at high noise levels. Because high noise levels are associated with…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Pramook Khungurn , Sukit Seripanitkarn , Phonphrm Thawatdamrongkit , Supasorn Suwajanakorn

Image compression and reconstruction are crucial for various digital applications. While contemporary neural compression methods achieve impressive compression rates, the adoption of such technology has been largely hindered by the…

Machine Learning · Computer Science 2025-10-06 Ethan G. Rogers , Cheng Wang

Terahertz (THz) sensing is a promising imaging technology for a wide variety of different applications. Extracting the interpretable and physically meaningful parameters for such applications, however, requires solving an inverse problem in…

Computer Vision and Pattern Recognition · Computer Science 2019-10-30 Tak Ming Wong , Matthias Kahl , Peter Haring Bolívar , Andreas Kolb , Michael Möller

Background: Building visual encoding models to accurately predict visual responses is a central challenge for current vision-based brain-machine interface techniques. To achieve high prediction accuracy on neural signals, visual encoding…

Computer Vision and Pattern Recognition · Computer Science 2019-02-26 Chi Zhang , Kai Qiao , Linyuan Wang , Li Tong , Guoen Hu , Ruyuan Zhang , Bin Yan

Self-supervised contrastive learning is an effective approach for addressing the challenge of limited labelled data. This study builds upon the previously established two-stage patch-level, multi-label classification method for…

Computer Vision and Pattern Recognition · Computer Science 2026-02-09 Salma Haidar , José Oramas

Learning compact binary codes for image retrieval task using deep neural networks has attracted increasing attention recently. However, training deep hashing networks for the task is challenging due to the binary constraints on the hash…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Thanh-Toan Do , Tuan Hoang , Dang-Khoa Le Tan , Trung Pham , Huu Le , Ngai-Man Cheung , Ian Reid

We focus on prediction problems with structured outputs that are subject to output validity constraints, e.g. pseudocode-to-code translation where the code must compile. While labeled input-output pairs are expensive to obtain, "unlabeled"…

Machine Learning · Computer Science 2023-10-26 Sang Michael Xie , Tengyu Ma , Percy Liang

Deep learning based image compression has recently witnessed exciting progress and in some cases even managed to surpass transform coding based approaches that have been established and refined over many decades. However, state-of-the-art…

Computer Vision and Pattern Recognition · Computer Science 2020-08-25 Leonhard Helminger , Abdelaziz Djelouah , Markus Gross , Christopher Schroers

The traditional SegNet architecture commonly encounters significant information loss during the sampling process, which detrimentally affects its accuracy in image semantic segmentation tasks. To counter this challenge, we introduce an…

Image and Video Processing · Electrical Eng. & Systems 2024-06-05 Zijun Gao , Qi Wang , Taiyuan Mei , Xiaohan Cheng , Yun Zi , Haowei Yang

Learned image compression methods generally optimize a rate-distortion loss, trading off improvements in visual distortion for added bitrate. Increasingly, however, compressed imagery is used as an input to deep learning networks for…

Image and Video Processing · Electrical Eng. & Systems 2022-02-02 Maxime Kawawa-Beaudan , Ryan Roggenkemper , Avideh Zakhor

Learned image compression research has achieved state-of-the-art compression performance with auto-encoder based neural network architectures, where the image is mapped via convolutional neural networks (CNN) into a latent representation…

Image and Video Processing · Electrical Eng. & Systems 2022-03-23 Fatih Kamisli

Recent research in the design of end to end communication system using deep learning has produced models which can outperform traditional communication schemes. Most of these architectures leveraged autoencoders to design the encoder at the…

Information Theory · Computer Science 2020-01-28 Vishnu Raj , Sheetal Kalyani

In this paper, it is shown that an auto-encoder using optimal reconstruction significantly outperforms a conventional auto-encoder. Optimal reconstruction uses the conditional mean of the input given the features, under a maximum entropy…

Machine Learning · Computer Science 2021-04-16 Paul M Baggenstoss

We suggest a loss for learning deep embeddings. The new loss does not introduce parameters that need to be tuned and results in very good embeddings across a range of datasets and problems. The loss is computed by estimating two…

Computer Vision and Pattern Recognition · Computer Science 2016-11-04 Evgeniya Ustinova , Victor Lempitsky

Depth estimation from 2D images is a common computer vision task that has applications in many fields including autonomous vehicles, scene understanding and robotics. The accuracy of a supervised depth estimation method mainly relies on the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-12 Muhammad Adeel Hafeez , Michael G. Madden , Ganesh Sistu , Ihsan Ullah

A feature learning task involves training models that are capable of inferring good representations (transformations of the original space) from input data alone. When working with limited or unlabelled data, and also when multiple visual…

Computer Vision and Pattern Recognition · Computer Science 2018-11-02 Gabriel B. Cavallari , Leonardo Sampaio Ferraz Ribeiro , Moacir Antonelli Ponti