English
Related papers

Related papers: SHARP: Spectrum-aware Highly-dynamic Adaptation fo…

200 papers

Robust fine-tuning aims to adapt large foundation models to downstream tasks while preserving their robustness to distribution shifts. Existing methods primarily focus on constraining and projecting current model towards the pre-trained…

Machine Learning · Computer Science 2025-06-24 Chengyue Huang , Junjiao Tian , Brisa Maneechotesuwan , Shivang Chopra , Zsolt Kira

Recent work in Deep Learning has re-imagined the representation of data as functions mapping from a coordinate space to an underlying continuous signal. When such functions are approximated by neural networks this introduces a compelling…

Machine Learning · Statistics 2022-08-09 Jonathan Richard Schwarz , Yee Whye Teh

We propose Diffusion-Sharpening, a fine-tuning approach that enhances downstream alignment by optimizing sampling trajectories. Existing RL-based fine-tuning methods focus on single training timesteps and neglect trajectory-level alignment,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Ye Tian , Ling Yang , Xinchen Zhang , Yunhai Tong , Mengdi Wang , Bin Cui

Large-scale text-to-image (T2I) diffusion models excel at open-domain synthesis but still struggle with precise text rendering, especially for multi-line layouts, dense typography, and long-tailed scripts such as Chinese. Prior solutions…

Computer Vision and Pattern Recognition · Computer Science 2026-01-05 Ruiqiang Zhang , Hengyi Wang , Chang Liu , Guanjie Wang , Zehua Ma , Weiming Zhang

Multilayer-perceptrons (MLP) are known to struggle with learning functions of high-frequencies, and in particular cases with wide frequency bands. We present a spatially adaptive progressive encoding (SAPE) scheme for input signals of MLP…

Machine Learning · Computer Science 2021-05-31 Amir Hertz , Or Perel , Raja Giryes , Olga Sorkine-Hornung , Daniel Cohen-Or

Deep image prior (DIP) is an unsupervised deep learning framework that has been successfully applied to a variety of inverse imaging problems. However, DIP-based methods are inherently prone to overfitting, which leads to performance…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Panagiotis Gkotsis , Athanasios A. Rontogiannis

Diffusion models have been shown to implicitly generate visual content autoregressively in the frequency domain, where low-frequency components are generated earlier in the denoising process while high-frequency details emerge only in later…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Howard Xiao , Brian Chao , Lior Yariv , Gordon Wetzstein

Synthesizing normal-light novel views from low-light multiview images is an important yet challenging task, given the low visibility and high ISO noise present in the input images. Existing low-light enhancement methods often struggle to…

Computer Vision and Pattern Recognition · Computer Science 2025-07-17 Ze Li , Feng Zhang , Xiatian Zhu , Meng Zhang , Yanghong Zhou , P. Y. Mok

Interactive segmentation models such as the Segment Anything Model (SAM) have demonstrated remarkable generalization on natural images, but they perform suboptimally on remote sensing imagery (RSI) due to severe domain shifts and the…

Computer Vision and Pattern Recognition · Computer Science 2026-03-31 M. Naseer Subhani

Three-dimensional (3D) medical image enhancement, including denoising and super-resolution, is critical for clinical diagnosis in CT, PET, and MRI. Although diffusion models have shown remarkable success in 2D medical imaging, scaling them…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Hongxu Jiang , Fei Li , Boxiao Yu , Ying Zhang , Kaleb Smith , Kuang Gong , Wei Shao

The steered response power (SRP) is a popular approach to compute a map of the acoustic scene, typically used for acoustic source localization. The SRP map is obtained as the frequency-weighted output power of a beamformer steered towards a…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-25 Thomas Dietzen , Enzo De Sena , Toon van Waterschoot

We argue that existing training-free segmentation methods rely on an implicit and limiting assumption, that segmentation is a spectral graph partitioning problem over diffusion-derived affinities. Such approaches, based on global graph…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Kunal Mahatha , Jose Dolz , Christian Desrosiers

Modern diffusion models encounter a fundamental trade-off between training efficiency and generation quality. While existing representation alignment methods, such as REPA, accelerate convergence through patch-wise alignment, they often…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Hesen Chen , Junyan Wang , Zhiyu Tan , Hao Li

The efficient Test-Time Scaling (TTS) paradigm offers a promising perspective for enhancing the generation performance of diffusion models. However, current solutions are limited to a static, pre-defined noise pool and suffer from…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Gang Dai , Yining Huang , Yiming Xia , Guohao Chen , Shuaicheng Niu

Hyperspectral images (HSIs) are inevitably degraded by a mixture of various types of noise, such as Gaussian noise, impulse noise, stripe noise, and dead pixels, which greatly limits the subsequent applications. Although various denoising…

Image and Video Processing · Electrical Eng. & Systems 2024-01-12 Dongyi Li , Dong Chu , Xiaobin Guan , Wei He , Huanfeng Shen

Automatic data augmentation (AutoDA) plays an important role in enhancing the generalization of neural networks. However, mainstream AutoDA methods often encounter two challenges: either the search process is excessively time-consuming,…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Anqi Xiao , Weichen Yu , Hongyuan Yu

Reconstructing high-dimensional spatiotemporal fields from sparse point-sensor measurements is a central challenge in learning parametric PDE dynamics. Existing approaches often struggle to generalize across trajectories and parameter…

Machine Learning · Computer Science 2026-02-05 Yanjie Tong , Peng Chen

We present a novel method for diffusion-guided frameworks for view-consistent super-resolution (SR) in neural rendering. Our approach leverages existing 2D SR models in conjunction with advanced techniques such as Variational Score…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Shrey Vishen , Jatin Sarabu , Saurav Kumar , Chinmay Bharathulwar , Rithwick Lakshmanan , Vishnu Srinivas

Deep learning has largely reshaped remote sensing (RS) research for aerial image understanding and made a great success. Nevertheless, most of the existing deep models are initialized with the ImageNet pretrained weights. Since natural…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Di Wang , Jing Zhang , Bo Du , Gui-Song Xia , Dacheng Tao

Autoregressive video diffusion models have emerged as a scalable paradigm for long video generation. However, they often suffer from severe extrapolation failure, where rapid error accumulation leads to significant temporal degradation when…

Computer Vision and Pattern Recognition · Computer Science 2026-03-16 Jia Li , Xiaomeng Fu , Xurui Peng , Weifeng Chen , Youwei Zheng , Tianyu Zhao , Jiexi Wang , Fangmin Chen , Xing Wang , Hayden Kwok-Hay So