English
Related papers

Related papers: Human Preference Score v2: A Solid Benchmark for E…

200 papers

Human feedback has become the de facto standard for evaluating the performance of Large Language Models, and is increasingly being used as a training objective. However, it is not clear which properties of a generated output this single…

Computation and Language · Computer Science 2024-01-17 Tom Hosking , Phil Blunsom , Max Bartolo

Thanks to recent advancements in scalable deep architectures and large-scale pretraining, text-to-video generation has achieved unprecedented capabilities in producing high-fidelity, instruction-following content across a wide range of…

Computer Vision and Pattern Recognition · Computer Science 2025-05-09 Xuyang Guo , Jiayan Huo , Zhenmei Shi , Zhao Song , Jiahao Zhang , Jiale Zhao

With the rapid advancement of large multimodal models (LMMs), recent text-to-image (T2I) models can generate high-quality images and demonstrate great alignment to short prompts. However, they still struggle to effectively understand and…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Juntong Wang , Huiyu Duan , Jiarui Wang , Ziheng Jia , Guangtao Zhai , Xiongkuo Min

Text-to-video (T2V) generation has achieved remarkable progress in producing high-quality videos aligned with textual prompts. However, aligning synthesized videos with nuanced human preference remains challenging due to the subjective and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Qiushi Yang , Yingjie Chen , Yuan Yao , Yifang Men , Huaizhuo Liu , Miaomiao Cui

Recent advances in text-to-video (T2V) generative models have shown impressive capabilities. However, these models are still inadequate in aligning synthesized videos with human preferences (e.g., accurately reflecting text descriptions),…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Yibin Wang , Zhiyu Tan , Junyan Wang , Xiaomeng Yang , Cheng Jin , Hao Li

Diffusion models are the state of the art in text-to-image generation, but their perceptual variability remains understudied. In this paper, we examine how prompts affect image variability in black-box diffusion-based models. We propose…

Computer Vision and Pattern Recognition · Computer Science 2024-11-27 Raphael Tang , Xinyu Zhang , Lixinyu Xu , Yao Lu , Wenyan Li , Pontus Stenetorp , Jimmy Lin , Ferhan Ture

Alongside the prevalence of mobile videos, the general public leans towards consuming vertical videos on hand-held devices. To revitalize the exposure of horizontal contents, we hereby set forth the exploration of automated…

Computer Vision and Pattern Recognition · Computer Science 2021-06-24 Tun Zhu , Daoxin Zhang , Yao Hu , Tianran Wang , Xiaolong Jiang , Jianke Zhu , Jiawei Li

Human pose estimation - the process of recognizing human keypoints in a given image - is one of the most important tasks in computer vision and has a wide range of applications including movement diagnostics, surveillance, or self-driving…

Computer Vision and Pattern Recognition · Computer Science 2021-01-25 Trung Q. Tran , Giang V. Nguyen , Daeyoung Kim

Network visualization has traditionally relied on heuristic metrics, such as stress, under the assumption that optimizing them leads to aesthetic and informative layouts. However, no single metric consistently produces the most effective…

Machine Learning · Computer Science 2026-04-07 Peng Zhang , Xuefeng Li , Xiaoqi Wang , Han-Wei Shen , Yifan Hu

Large language models have been widely adopted in natural language processing, yet they face the challenge of generating unreliable content. Recent works aim to reduce misinformation and hallucinations by resorting to attribution as a means…

Computation and Language · Computer Science 2024-03-28 Dongfang Li , Zetian Sun , Baotian Hu , Zhenyu Liu , Xinshuo Hu , Xuebo Liu , Min Zhang

Despite advances in generation quality, current text-to-image (T2I) models often lack diversity, generating homogeneous outputs. This work introduces a framework to address the need for robust diversity evaluation in T2I models. Our…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Isabela Albuquerque , Ira Ktena , Olivia Wiles , Ivana Kajić , Amal Rannen-Triki , Cristina Vasconcelos , Aida Nematzadeh

Effective communication is central to achieving positive healthcare outcomes in mental health contexts, yet international students often face linguistic and cultural barriers that hinder their communication of mental distress. In this…

Neurons and Cognition · Quantitative Biology 2025-12-05 Sui He , Shenbin Qian

Preference learning is a widely adopted post-training technique that aligns large language models (LLMs) to human preferences and improves specific downstream task capabilities. In this work we systematically investigate how specific…

Computation and Language · Computer Science 2024-12-23 Joongwon Kim , Anirudh Goyal , Aston Zhang , Bo Xiong , Rui Hou , Melanie Kambadur , Dhruv Mahajan , Hannaneh Hajishirzi , Liang Tan

Evaluating text-to-image generative models remains a challenge, despite the remarkable progress being made in their overall performances. While existing metrics like CLIPScore work for coarse evaluations, they lack the sensitivity to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Georgia Gabriela Sampaio , Ruixiang Zhang , Shuangfei Zhai , Jiatao Gu , Josh Susskind , Navdeep Jaitly , Yizhe Zhang

Aligning text-to-image (T2I) diffusion models with human preferences has emerged as a critical research challenge. While recent advances in this area have extended preference optimization techniques from large language models (LLMs) to the…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Junyong Kang , Seohyun Lim , Kyungjune Baek , Hyunjung Shim

Text-to-image generative models have recently attracted considerable interest, enabling the synthesis of high-quality images from textual prompts. However, these models often lack the capability to generate specific subjects from given…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Yanting Miao , William Loh , Suraj Kothawade , Pascal Poupart , Abdullah Rashwan , Yeqing Li

High-quality preference datasets are essential for training reward models that can effectively guide large language models (LLMs) in generating high-quality responses aligned with human preferences. As LLMs become stronger and better…

Computation and Language · Computer Science 2024-06-14 Zhilin Wang , Yi Dong , Olivier Delalleau , Jiaqi Zeng , Gerald Shen , Daniel Egert , Jimmy J. Zhang , Makesh Narsimhan Sreedhar , Oleksii Kuchaiev

Dataset replication is a useful tool for assessing whether improvements in test accuracy on a specific benchmark correspond to improvements in models' ability to generalize reliably. In this work, we present unintuitive yet significant ways…

Recent advancements in human preference optimization, originally developed for Large Language Models (LLMs), have shown significant potential in improving text-to-image diffusion models. These methods aim to learn the distribution of…

Computer Vision and Pattern Recognition · Computer Science 2025-10-21 Amir Saeidi , Yiran Luo , Agneet Chatterjee , Shamanthak Hegde , Bimsara Pathiraja , Yezhou Yang , Chitta Baral

AI systems rely on extensive training on large datasets to address various tasks. However, image-based systems, particularly those used for demographic attribute prediction, face significant challenges. Many current face image datasets…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Georgia Baltsou , Ioannis Sarridis , Christos Koutlis , Symeon Papadopoulos