English
Related papers

Related papers: Towards Backward-Compatible Continual Learning of …

200 papers

Image compression and reconstruction are crucial for various digital applications. While contemporary neural compression methods achieve impressive compression rates, the adoption of such technology has been largely hindered by the…

Machine Learning · Computer Science 2025-10-06 Ethan G. Rogers , Cheng Wang

We propose a new approach to the problem of optimizing autoencoders for lossy image compression. New media formats, changing hardware technology, as well as diverse requirements and content types create a need for compression algorithms…

Machine Learning · Statistics 2017-03-02 Lucas Theis , Wenzhe Shi , Andrew Cunningham , Ferenc Huszár

In visual retrieval systems, updating the embedding model requires recomputing features for every piece of data. This expensive process is referred to as backfilling. Recently, the idea of backward compatible training (BCT) was proposed. To…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Vivek Ramanujan , Pavan Kumar Anasosalu Vasu , Ali Farhadi , Oncel Tuzel , Hadi Pouransari

We address the challenge of applying existing convolutional neural network (CNN) architectures to compressed images. Existing CNN architectures represent images as a matrix of pixel intensities with a specified dimension; this desired…

Computer Vision and Pattern Recognition · Computer Science 2019-11-22 Christopher A. George , Bradley M. West

Neural network compression has recently received much attention due to the computational requirements of modern deep models. In this work, our objective is to transfer knowledge from a deep and accurate model to a smaller one. Our…

Computer Vision and Pattern Recognition · Computer Science 2018-11-15 Vasileios Belagiannis , Azade Farshad , Fabio Galasso

We propose Neural Image Compression (NIC), a two-step method to build convolutional neural networks for gigapixel image analysis solely using weak image-level labels. First, gigapixel images are compressed using a neural network trained in…

Computer Vision and Pattern Recognition · Computer Science 2020-04-16 David Tellez , Geert Litjens , Jeroen van der Laak , Francesco Ciompi

Deep neural networks give state-of-the-art accuracy for reconstructing images from few and noisy measurements, a problem arising for example in accelerated magnetic resonance imaging (MRI). However, recent works have raised concerns that…

Image and Video Processing · Electrical Eng. & Systems 2021-06-14 Mohammad Zalbagi Darestani , Akshay S. Chaudhari , Reinhard Heckel

We propose an end-to-end image compression and analysis model with Transformers, targeting to the cloud-based image classification application. Instead of placing an existing Transformer-based image classification model directly after an…

Computer Vision and Pattern Recognition · Computer Science 2021-12-20 Yuanchao Bai , Xu Yang , Xianming Liu , Junjun Jiang , Yaowei Wang , Xiangyang Ji , Wen Gao

With the proliferation of deep learning methods, many computer vision problems which were considered academic are now viable in the consumer setting. One drawback of consumer applications is lossy compression, which is necessary from an…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Max Ehrlich , Larry Davis , Ser-Nam Lim , Abhinav Shrivastava

IoT devices are increasingly the source of data for machine learning (ML) applications running on edge servers. Data transmissions from devices to servers are often over local wireless networks whose bandwidth is not just limited but, more…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-26 Ruiqi Wang , Hanyang Liu , Jiaming Qiu , Moran Xu , Roch Guerin , Chenyang Lu

Current artificial neural networks are trained with parameters encoded as floating point numbers that occupy lots of memory space at inference time. Due to the increase in the size of deep learning models, it is becoming very difficult to…

Machine Learning · Computer Science 2024-08-09 Ben Crulis , Barthelemy Serres , Cyril de Runz , Gilles Venturini

Successful Artificial Intelligence systems often require numerous labeled data to extract information from document images. In this paper, we investigate the problem of improving the performance of Artificial Intelligence systems in…

Information Retrieval · Computer Science 2022-09-27 Bao-Sinh Nguyen , Dung Tien Le , Hieu M. Vu , Tuan Anh D. Nguyen , Minh-Tien Nguyen , Hung Le

Camera sensors have been widely used in intelligent robotic systems. Developing camera sensors with high sensing efficiency has always been important to reduce the power, memory, and other related resources. Inspired by recent success on…

Image and Video Processing · Electrical Eng. & Systems 2023-10-11 Bowen Zhang , Zhijin Qin , Geoffrey Ye Li

This is an opinion paper. We hope to deliver a key message that current visual recognition systems are far from complete, i.e., recognizing everything that human can recognize, yet it is very unlikely that the gap can be bridged by…

Computer Vision and Pattern Recognition · Computer Science 2021-05-31 Lingxi Xie , Xiaopeng Zhang , Longhui Wei , Jianlong Chang , Qi Tian

Continual learning (CL) studies how models acquire tasks sequentially while retaining previously learned knowledge. Despite substantial progress in benchmarking CL methods, comparative evaluations typically keep the fine-tuning regime…

Machine Learning · Computer Science 2026-04-28 Paul-Tiberiu Iordache , Elena Burceanu

A novel algorithm for tunable compression to within the precision of reproduction targets, or storage, is proposed. The new algorithm is termed the `Perceptron Algorithm', which utilises simple existing concepts in a novel way, has multiple…

Computer Vision and Pattern Recognition · Computer Science 2007-05-23 Vassilios S. Vassiliadis

In this paper, we build autoencoder based pipelines for extreme end-to-end image compression based on Ball\'e's approach, which is the state-of-the-art open source implementation in image compression using deep learning. We deepened the…

Image and Video Processing · Electrical Eng. & Systems 2020-03-02 Licheng Xiao , Hairong Wang , Nam Ling

Sequential data is being generated at an unprecedented pace in various forms, including text and genomic data. This creates the need for efficient compression mechanisms to enable better storage, transmission and processing of such data. To…

Computation and Language · Computer Science 2018-11-21 Mohit Goyal , Kedar Tatwawadi , Shubham Chandak , Idoia Ochoa

Non-blind image deblurring is typically formulated as a linear least-squares problem regularized by natural priors on the corresponding sharp picture's gradients, which can be solved, for example, using a half-quadratic splitting method…

Computer Vision and Pattern Recognition · Computer Science 2020-09-16 Thomas Eboli , Jian Sun , Jean Ponce

Recently deep learning based image compression has made rapid advances with promising results based on objective quality metrics. However, a rigorous subjective quality evaluation on such compression schemes have rarely been reported. This…

Image and Video Processing · Electrical Eng. & Systems 2019-05-13 Zhengxue Cheng , Pinar Akyazi , Heming Sun , Jiro Katto , Touradj Ebrahimi