中文
相关论文

相关论文: Elucidating Representation Degradation Problem in …

200 篇论文

Diffusion models generate data by removing noise gradually, which corresponds to the time-reversal of a noising process. However, access to only the denoising kernels is often insufficient. In many applications, we need the knowledge of the…

机器学习 · 计算机科学 2026-05-11 Jiajun He , José Miguel Hernández-Lobato , Yuanqi Du , Francisco Vargas

In recent years, deep learning-based image compression, particularly through generative models, has emerged as a pivotal area of research. Despite significant advancements, challenges such as diminished sharpness and quality in…

图像与视频处理 · 电气工程与系统科学 2024-09-18 Ryugo Morita , Hitoshi Nishimura , Ko Watanabe , Andreas Dengel , Jinjia Zhou

This paper proposes the Nerual Energy Descent (NED) via neural network evolution equations for a wide class of deep learning problems. We show that deep learning can be reformulated as the evolution of network parameters in an evolution…

数值分析 · 数学 2023-02-22 Wenrui Hao , Chunmei Wang , Xingjian Xu , Haizhao Yang

This paper presents a novel approach for denoising Electron Backscatter Diffraction (EBSD) patterns using diffusion models. We propose a two-stage training process with a UNet-based architecture, incorporating an auxiliary regression head…

图像与视频处理 · 电气工程与系统科学 2025-09-01 Nikolay Falaleev , Nikolai Orlov

The adaptation of foundation models has significantly advanced environmental audio deepfake detection (EADD), a rapidly growing area of research. These models are typically fine-tuned or utilized in their frozen states for downstream tasks.…

Reinforcement learning (RL) struggles to scale to large, combinatorial action spaces common in many real-world problems. This paper introduces a novel framework for training discrete diffusion models as highly effective policies in these…

机器学习 · 计算机科学 2026-05-21 Haitong Ma , Ofir Nabati , Aviv Rosenberg , Bo Dai , Oran Lang , Craig Boutilier , Na Li , Shie Mannor , Lior Shani , Guy Tenneholtz

The development of diffusion-based generative models over the past decade has largely proceeded independently of progress in representation learning. These diffusion models typically rely on regression-based objectives and generally lack…

计算机视觉与模式识别 · 计算机科学 2025-07-25 Runqian Wang , Kaiming He

The Evidential Regression Network (ERN) represents a novel approach that integrates deep learning with Dempster-Shafer's theory to predict a target and quantify the associated uncertainty. Guided by the underlying theory, specific…

机器学习 · 计算机科学 2024-01-04 Kai Ye , Tiejin Chen , Hua Wei , Liang Zhan

The quality of a fundus image can be compromised by numerous factors, many of which are challenging to be appropriately and mathematically modeled. In this paper, we introduce a novel diffusion model based framework, named Learning…

图像与视频处理 · 电气工程与系统科学 2023-03-09 Puijin Cheng , Li Lin , Yijin Huang , Huaqing He , Wenhan Luo , Xiaoying Tang

Diffusion model-based low-light image enhancement methods rely heavily on paired training data, leading to limited extensive application. Meanwhile, existing unsupervised methods lack effective bridging capabilities for unknown degradation.…

计算机视觉与模式识别 · 计算机科学 2025-02-18 Jinhong He , Minglong Xue , Aoxiang Ning , Chengyun Song

Image restoration is a long-standing problem in low-level computer vision with many interesting applications. We describe a flexible learning framework based on the concept of nonlinear reaction diffusion models for various image…

计算机视觉与模式识别 · 计算机科学 2016-08-23 Yunjin Chen , Thomas Pock

Speckle reduction is a prerequisite for many image processing tasks in synthetic aperture radar (SAR) images, as well as all coherent images. In recent years, predominant state-of-the-art approaches for despeckling are usually based on…

计算机视觉与模式识别 · 计算机科学 2017-02-27 Wensen Feng , Yunjin Chen

Diffusion models have emerged as powerful generative tools across various domains, yet tailoring pre-trained models to exhibit specific desirable properties remains challenging. While reinforcement learning (RL) offers a promising…

计算机视觉与模式识别 · 计算机科学 2025-06-03 Fengyuan Dai , Zifeng Zhuang , Yufei Huang , Siteng Huang , Bangyan Liao , Donglin Wang , Fajie Yuan

Experience replay is widely used to improve learning efficiency in reinforcement learning by leveraging past experiences. However, existing experience replay methods, whether based on uniform or prioritized sampling, often suffer from low…

机器学习 · 计算机科学 2025-05-20 Kaiyan Zhao , Yiming Wang , Yuyang Chen , Yan Li , Leong Hou U , Xiaoguang Niu

Implicit feedback is central to modern recommender systems but is inherently noisy, often impairing model training and degrading user experience. At scale, such noise can mislead learning processes, reducing both recommendation accuracy and…

信息检索 · 计算机科学 2025-10-13 Ze Liu , Xianquan Wang , Shuochen Liu , Jie Ma , Huibo Xu , Yupeng Han , Kai Zhang , Jun Zhou

Standard Latent Diffusion Models rely on a complex, three-part architecture consisting of a separate encoder, decoder, and diffusion network, which are trained in multiple stages. This modular design is computationally inefficient, leads to…

计算机视觉与模式识别 · 计算机科学 2025-11-19 Xiyuan Wang , Muhan Zhang

Diffusion models are a class of flexible generative models trained with an approximation to the log-likelihood objective. However, most use cases of diffusion models are not concerned with likelihoods, but instead with downstream objectives…

机器学习 · 计算机科学 2024-01-08 Kevin Black , Michael Janner , Yilun Du , Ilya Kostrikov , Sergey Levine

Decomposing a scene into its shape, reflectance, and illumination is a challenging but important problem in computer vision and graphics. This problem is inherently more challenging when the illumination is not a single light source under…

计算机视觉与模式识别 · 计算机科学 2021-08-27 Mark Boss , Raphael Braun , Varun Jampani , Jonathan T. Barron , Ce Liu , Hendrik P. A. Lensch

Autoregressive (AR) models remain the standard for natural language generation but still suffer from high latency due to strictly sequential decoding. Recent diffusion-inspired approaches, such as LlaDA and Dream, mitigate this by…

计算与语言 · 计算机科学 2025-10-16 Qinglin Zhu , Yizhen Yao , Runcong Zhao , Yanzheng Xiang , Amrutha Saseendran , Chen Jin , Philip Teare , Bin Liang , Yulan He , Lin Gui

In this paper, we focus on the often-overlooked issue of embedding collapse in existing diffusion-based sequential recommendation models and propose ADRec, an innovative framework designed to mitigate this problem. Diverging from previous…

信息检索 · 计算机科学 2025-05-27 Jialei Chen , Yuanbo Xu , Yiheng Jiang