中文
相关论文

相关论文: The First Principles of Deep Learning and Compress…

200 篇论文

Artificial intelligence in dynamic, real-world environments requires the capacity for continual learning. However, standard deep learning suffers from a fundamental issue: loss of plasticity, in which networks gradually lose their ability…

量子物理 · 物理学 2025-11-24 Yu-Qin Chen , Shi-Xin Zhang

Recent advancements in deep learning-based image compression are notable. However, prevalent schemes that employ a serial context-adaptive entropy model to enhance rate-distortion (R-D) performance are markedly slow. Furthermore, the…

应用统计 · 统计学 2024-03-25 Haisheng Fu , Feng Liang , Jie Liang , Zhenman Fang , Guohe Zhang , Jingning Han

Recent advancements in large language models (LLMs) have enabled their successful application to a broad range of tasks. However, in information-intensive tasks, the prompt length can grow fast, leading to increased computational…

计算与语言 · 计算机科学 2025-10-13 Weronika Łajewska , Momchil Hardalov , Laura Aina , Neha Anna John , Hang Su , Lluís Màrquez

A change of the prevalent supervised learning techniques is foreseeable in the near future: from the complex, computational expensive algorithms to more flexible and elementary training ones. The strong revitalization of randomized…

机器学习 · 计算机科学 2022-09-02 Antonello Rosato , Massimo Panella , Evgeny Osipov , Denis Kleyko

Deep neural networks excel in supervised learning tasks but are constrained by the need for extensive labeled data. Self-supervised learning emerges as a promising alternative, allowing models to learn without explicit labels. Information…

机器学习 · 计算机科学 2023-11-22 Ravid Shwartz-Ziv , Yann LeCun

Motivated by recent work on deep neural network (DNN)-based image compression methods showing potential improvements in image quality, savings in storage, and bandwidth reduction, we propose to perform image understanding tasks such as…

计算机视觉与模式识别 · 计算机科学 2018-03-19 Robert Torfason , Fabian Mentzer , Eirikur Agustsson , Michael Tschannen , Radu Timofte , Luc Van Gool

Deep learning models have achieved significant success in various image related tasks. However, they often encounter challenges related to computational complexity and overfitting. In this paper, we propose an efficient approach that…

计算机视觉与模式识别 · 计算机科学 2025-04-03 Salim Khazem , Jeremy Fix , Cédric Pradalier

Deep learning technology has developed unprecedentedly in the last decade and has become the primary choice in many application domains. This progress is mainly attributed to a systematic collaboration in which rapidly growing computing…

机器学习 · 计算机科学 2023-12-27 Shiye Lei , Dacheng Tao

We propose a new approach to the problem of optimizing autoencoders for lossy image compression. New media formats, changing hardware technology, as well as diverse requirements and content types create a need for compression algorithms…

机器学习 · 统计学 2017-03-02 Lucas Theis , Wenzhe Shi , Andrew Cunningham , Ferenc Huszár

Deep learning and convolutional neural networks (ConvNets) have been successfully applied to most relevant tasks in the computer vision community. However, these networks are computationally demanding and not suitable for embedded devices…

计算机视觉与模式识别 · 计算机科学 2016-06-20 Jose Alvarez , Lars Petersson

Conventional vision backbones, despite their success, often construct features through a largely uniform cascade of operations, offering limited explicit pathways for adaptive, iterative refinement. This raises a compelling question: can…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Bin Guo , John H. L. Hansen

Learned image compression has recently shown the potential to outperform the standard codecs. State-of-the-art rate-distortion (R-D) performance has been achieved by context-adaptive entropy coding approaches in which hyperprior and…

图像与视频处理 · 电气工程与系统科学 2021-01-01 Mohammad Akbari , Jie Liang , Jingning Han , Chengjie Tu

Deep learning models for image compression often face practical limitations in hardware-constrained applications. Although these models achieve high-quality reconstructions, they are typically complex, heavyweight, and require substantial…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Caroline Mazini Rodrigues , Nicolas Keriven , Thomas Maugey

Deep learning offers transformative potential in medical imaging, yet its clinical adoption is frequently hampered by challenges such as data scarcity, distribution shifts, and the need for robust task generalization. Prompt-based…

图像与视频处理 · 电气工程与系统科学 2025-07-03 Hao Yang , Xinlong Liang , Zhang Li , Yue Sun , Zheyu Hu , Xinghe Xie , Behdad Dashtbozorg , Jincheng Huang , Shiwei Zhu , Luyi Han , Jiong Zhang , Shanshan Wang , Ritse Mann , Qifeng Yu , Tao Tan

The ability to predict, anticipate and reason about future outcomes is a key component of intelligent decision-making systems. In light of the success of deep learning in computer vision, deep-learning-based video prediction emerged as a…

Learning-based image compression methods have emerged as state-of-the-art, showcasing higher performance compared to conventional compression solutions. These data-driven approaches aim to learn the parameters of a neural network model…

多媒体 · 计算机科学 2024-03-20 Shima Mohammadi , Yaojun Wu , João Ascenso

The information bottleneck principle (Shwartz-Ziv & Tishby, 2017) suggests that SGD-based training of deep neural networks results in optimally compressed hidden layers, from an information theoretic perspective. However, this claim was…

机器学习 · 计算机科学 2020-03-16 Luke Nicholas Darlow , Amos Storkey

The rapid growth of digital data has heightened the demand for efficient lossless compression methods. However, existing algorithms exhibit trade-offs: some achieve high compression ratios, others excel in encoding or decoding speed, and…

信息论 · 计算机科学 2025-10-01 Md. Atiqur Rahman , MM Fazle Rabbi

Machine learning is penetrating various domains virtually, thereby proliferating excellent results. It has also found an outlet in digital forensics, wherein it is becoming the prime driver of computational efficiency. A prominent feature…

计算机视觉与模式识别 · 计算机科学 2022-01-13 Shubham Bharadwaj

Recent advances in deep learning have markedly improved the quality of visual-attention modelling. In this work we apply these advances to video compression. We propose a compression method that uses a saliency model to adaptively compress…

计算机视觉与模式识别 · 计算机科学 2019-07-25 Vitaliy Lyudvichenko , Mikhail Erofeev , Alexander Ploshkin , Dmitriy Vatolin