English
Related papers

Related papers: VLM-Guided Group Preference Alignment for Diffusio…

200 papers

Diffusion-based generative models (DBGMs) perturb data to a target noise distribution and reverse this process to generate samples. The choice of noising process, or inference diffusion process, affects both likelihoods and sample quality.…

Machine Learning · Computer Science 2023-03-06 Raghav Singhal , Mark Goldstein , Rajesh Ranganath

Diffusion magnetic resonance imaging is a noninvasive imaging technique that can indirectly infer the microstructure of tissues and provide metrics which are subject to normal variability across subjects. Potentially abnormal values or…

Image and Video Processing · Electrical Eng. & Systems 2020-08-28 Samuel St-Jean , Max A. Viergever , Alexander Leemans

Ambiguity in medical image segmentation calls for models that capture full conditional distributions rather than a single point estimate. We present Prior-Guided Residual Diffusion (PGRD), a diffusion-based framework that learns voxel-wise…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Fuyou Mao , Beining Wu , Yanfeng Jiang , Han Xue , Yan Tang , Hao Zhang

Recently, regression-based methods have dominated the field of 3D human pose and shape estimation. Despite their promising results, a common issue is the misalignment between predictions and image observations, often caused by minor joint…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Tom Wehrbein , Bodo Rosenhahn , Iain Matthews , Carsten Stoll

Existing Human Motion Prediction (HMP) methods based on RGB-D cameras are sensitive to lighting conditions and raise privacy concerns, limiting their real-world applications such as firefighting and healthcare. Motivated by the robustness…

Computer Vision and Pattern Recognition · Computer Science 2025-12-02 Junqiao Fan , Haocong Rao , Jiarui Zhang , Jianfei Yang , Lihua Xie

Image restoration aims to recover high-quality images from degraded observations. When the degradation process is known, the recovery problem can be formulated as an inverse problem, and in a Bayesian context, the goal is to sample a clean…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Darshan Thaker , Abhishek Goyal , René Vidal

Can Visual Language Models (VLMs) effectively capture human visual preferences? This work addresses this question by training VLMs to think about preferences at test time, employing reinforcement learning methods inspired by DeepSeek R1 and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Alexander Gambashidze , Konstantin Sobolev , Andrey Kuznetsov , Ivan Oseledets

Most existing MRI reconstruction methods perform tar-geted reconstruction of the entire MR image without tak-ing specific tissue regions into consideration. This may fail to emphasize the reconstruction accuracy on im-portant tissues for…

Image and Video Processing · Electrical Eng. & Systems 2023-09-06 Yu Guan , Chuanming Yu , Shiyu Lu , Zhuoxu Cui , Dong Liang , Qiegen Liu

In recent years, the field of image generation has witnessed significant advancements, particularly in fine-tuning methods that align models with universal human preferences. This paper explores the critical role of preference data in the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Lingfan Zhang , Chen Liu , Chengming Xu , Kai Hu , Donghao Luo , Chengjie Wang , Yanwei Fu , Yuan Yao

Reinforcement learning from human feedback (RLHF) has emerged as the primary method for aligning large language models (LLMs) with human preferences. The RLHF process typically starts by training a reward model (RM) using human preference…

Machine Learning · Computer Science 2024-06-19 Haoxiang Wang , Wei Xiong , Tengyang Xie , Han Zhao , Tong Zhang

Predicting camera-space hand meshes from single RGB images is crucial for enabling realistic hand interactions in 3D virtual and augmented worlds. Previous work typically divided the task into two stages: given a cropped image of the hand,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Eugene Valassakis , Guillermo Garcia-Hernando

Estimating 3D hand meshes from single RGB images is challenging, due to intrinsic 2D-3D mapping ambiguities and limited training data. We adopt a compact parametric 3D hand model that represents deformable and articulated hand meshes. To…

Computer Vision and Pattern Recognition · Computer Science 2019-04-10 Seungryul Baek , Kwang In Kim , Tae-Kyun Kim

Heatmap regression (HR) has become one of the mainstream approaches for face alignment and has obtained promising results under constrained environments. However, when a face image suffers from large pose variations, heavy occlusions and…

Computer Vision and Pattern Recognition · Computer Science 2020-12-30 Jun Wan , Zhihui Lai , Jun Liu , Jie Zhou , Can Gao

Multi-person global human mesh recovery (HMR) is crucial for understanding crowd dynamics and interactions. Traditional vision-based HMR methods sometimes face limitations in real-world scenarios due to mutual occlusions, insufficient…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Jiayue Yuan , Fangting Xie , Guangwen Ouyang , Changhai Ma , Ziyu Wu , Heyu Ding , Quan Wan , Yi Ke , Yuchen Wu , Xiaohui Cai

Fine-tuning Diffusion Models remains an underexplored frontier in generative artificial intelligence (GenAI), especially when compared with the remarkable progress made in fine-tuning Large Language Models (LLMs). While cutting-edge…

Machine Learning · Computer Science 2024-02-16 Huizhuo Yuan , Zixiang Chen , Kaixuan Ji , Quanquan Gu

Diffusion models (DMs) have recently been introduced in image deblurring and exhibited promising performance, particularly in terms of details reconstruction. However, the diffusion model requires a large number of inference iterations to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Zheng Chen , Yulun Zhang , Ding Liu , Bin Xia , Jinjin Gu , Linghe Kong , Xin Yuan

Diffusion Probabilistic Models have recently shown remarkable performance in generative image modeling, attracting significant attention in the computer vision community. However, while a substantial amount of diffusion-based research has…

Computer Vision and Pattern Recognition · Computer Science 2023-07-12 Yijun Yang , Huazhu Fu , Angelica I. Aviles-Rivero , Carola-Bibiane Schönlieb , Lei Zhu

Augmentation for dense prediction typically relies on either sample mixing or generative synthesis. Mixing improves robustness but misaligned masks yield soft label ambiguity. Diffusion synthesis increases apparent diversity but, when…

Computer Vision and Pattern Recognition · Computer Science 2025-11-06 Pengyu Jie , Wanquan Liu , Rui He , Yihui Wen , Deyu Meng , Chenqiang Gao

Deep image restoration models aim to learn a mapping from degraded image space to natural image space. However, they face several critical challenges: removing degradation, generating realistic details, and ensuring pixel-level consistency.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Xinqi Lin , Fanghua Yu , Jinfan Hu , Zhiyuan You , Wu Shi , Jimmy S. Ren , Jinjin Gu , Chao Dong

3D human mesh recovery from point clouds is essential for various tasks, including AR/VR and human behavior understanding. Previous works in this field either require high-quality 3D human scans or sequential point clouds, which cannot be…

Computer Vision and Pattern Recognition · Computer Science 2021-10-19 Guanze Liu , Yu Rong , Lu Sheng