English
Related papers

Related papers: Information Compression in the AI Era: Recent Adva…

200 papers

This work presents a large-scale analysis of artificial intelligence (AI) and machine learning (ML) references within news articles and scientific publications between 2011 and 2019. We implement word association measurements that…

Computation and Language · Computer Science 2021-02-26 Autumn Toney

This paper explores the possibility of extending the capability of pre-trained neural image compressors (e.g., adapting to new data or target bitrates) without breaking backward compatibility, the ability to decode bitstreams encoded by the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-01 Zhihao Duan , Ming Lu , Justin Yang , Jiangpeng He , Zhan Ma , Fengqing Zhu

Three recent breakthroughs due to AI in arts and science serve as motivation: An award winning digital image, protein folding, fast matrix multiplication. Many recent developments in artificial neural networks, particularly deep learning…

Machine Learning · Computer Science 2026-05-21 Loc Vu-Quoc , Alexander Humer

Advancements in artificial intelligence, machine learning, and deep learning have catalyzed the transformation of big data analytics and management into pivotal domains for research and application. This work explores the theoretical…

Lossy compression introduces complex compression artifacts, particularly the blocking artifacts, ringing effects and blurring. Existing algorithms either focus on removing blocking artifacts and produce blurred output, or restores sharpened…

Computer Vision and Pattern Recognition · Computer Science 2015-04-28 Chao Dong , Yubin Deng , Chen Change Loy , Xiaoou Tang

Deep learning (DL) has achieved great success in signal processing and communications and has become a promising technology for future wireless communications. Existing works mainly focus on exploiting DL to improve the performance of…

Information Theory · Computer Science 2024-10-30 Jiajia Guo , Jinghe Wang , Chao-Kai Wen , Shi Jin , Geoffrey Ye Li

This paper considers the subject of information losses arising from the finite datasets used in the training of neural classifiers. It proves a relationship between such losses as the product of the expected total variation of the estimated…

Machine Learning · Computer Science 2020-01-09 Brandon Foggo , Nanpeng Yu , Jie Shi , Yuanqi Gao

Attempts from different disciplines to provide a fundamental understanding of deep learning have advanced rapidly in recent years, yet a unified framework remains relatively limited. In this article, we provide one possible way to align…

Machine Learning · Computer Science 2019-10-01 Guan-Horng Liu , Evangelos A. Theodorou

Artificial intelligence (AI) is rapidly becoming one of the key technologies of this century. The majority of results in AI thus far have been achieved using deep neural networks trained with a learning algorithm called error…

Artificial Intelligence · Computer Science 2025-10-30 Tommaso Salvatori , Ankur Mali , Christopher L. Buckley , Thomas Lukasiewicz , Rajesh P. N. Rao , Karl Friston , Alexander Ororbia

This article considers "compressive learning," an approach to large-scale machine learning where datasets are massively compressed before learning (e.g., clustering, classification, or regression) is performed. In particular, a "sketch" is…

In this paper, we explore and compare multiple solutions to the problem of data augmentation in image classification. Previous work has demonstrated the effectiveness of data augmentation through simple techniques, such as cropping,…

Computer Vision and Pattern Recognition · Computer Science 2017-12-14 Luis Perez , Jason Wang

In some rate-distortion-type problems, the required fidelity of information is affected by past actions. As a result, the distortion function depends not only on the instantaneous distortion between a source symbol and its representation…

Information Theory · Computer Science 2026-01-30 Hamidreza Abin , Amin Gohari , Andrew W. Eckford

This work deals with the use of emerging deep learning techniques in future wireless communication networks. It will be shown that data-driven approaches should not replace, but rather complement traditional design techniques based on…

Signal Processing · Electrical Eng. & Systems 2019-06-14 Alessio Zappone , Marco Di Renzo , Mérouane Debbah

The demand for artificial intelligence has grown significantly over the last decade and this growth has been fueled by advances in machine learning techniques and the ability to leverage hardware acceleration. However, in order to increase…

Machine Learning · Computer Science 2022-11-28 Joost Verbraeken , Matthijs Wolting , Jonathan Katzy , Jeroen Kloppenburg , Tim Verbelen , Jan S. Rellermeyer

The exponential growth of medical imaging has created significant challenges in data storage, transmission, and management for healthcare systems. In this vein, efficient compression becomes increasingly important. Unlike natural image…

Image and Video Processing · Electrical Eng. & Systems 2026-02-10 Guofeng Tong , Sixuan Liu , Yang Lv , Hanyu Pei , Feng-Lei Fan

Resource-constrained edge deployments demand AI solutions that balance high performance with stringent compute, memory, and energy limitations. In this survey, we present a comprehensive overview of the primary strategies for accelerating…

Machine Learning · Computer Science 2025-01-30 Jacob Sander , Achraf Cohen , Venkat R. Dasari , Brent Venable , Brian Jalaian

Two decades ago, a breakthrough in indexing string collections made it possible to represent them within their compressed space while at the same time offering indexed search functionalities. As this new technology permeated through…

Data Structures and Algorithms · Computer Science 2022-11-28 Gonzalo Navarro

Artificial Intelligence (AI) is a fast-growing research and development (R&D) discipline which is attracting increasing attention because of its promises to bring vast benefits for consumers and businesses, with considerable benefits…

Artificial Intelligence · Computer Science 2022-05-10 Zhenghua Chen , Min Wu , Alvin Chan , Xiaoli Li , Yew-Soon Ong

Despite rapid advancements, machine learning, particularly deep learning, is hindered by the need for large amounts of labeled data to learn meaningful patterns without overfitting and immense demands for computation and storage, which…

Machine Learning · Computer Science 2025-06-30 Xiaobo Zhao , Aaron Hurst , Panagiotis Karras , Daniel E. Lucani

Large-scale, high-quality data are considered an essential factor for the successful application of many deep learning techniques. Meanwhile, numerous real-world deep learning tasks still have to contend with the lack of sufficient amounts…

Machine Learning · Computer Science 2023-10-26 Ou Wu , Rujing Yao