English
Related papers

Related papers: GenArena: How Can We Achieve Human-Aligned Evaluat…

200 papers

Recent years have witnessed remarkable progress in 3D content generation. However, corresponding evaluation methods struggle to keep pace. Automatic approaches have proven challenging to align with human preferences, and the mixed…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Weitao Wang , Haoran Xu , Yuxiao Yang , Zhifang Liu , Jun Meng , Haoqian Wang

The synergy between generative and discriminative models receives growing attention. While discriminative Contrastive Language-Image Pre-Training (CLIP) excels in high-level semantics, it struggles with perceiving fine-grained visual…

Computer Vision and Pattern Recognition · Computer Science 2025-08-01 Shijie Ma , Yuying Ge , Teng Wang , Yuxin Guo , Yixiao Ge , Ying Shan

Face recognition and verification are two computer vision tasks whose performance has progressed with the introduction of deep representations. However, ethical, legal, and technical challenges due to the sensitive character of face data…

Computer Vision and Pattern Recognition · Computer Science 2024-10-24 Alexandre Fournier-Montgieux , Michael Soumm , Adrian Popescu , Bertrand Luvison , Hervé Le Borgne

Recent studies show that sentence-level extractive QA, i.e., based on Answer Sentence Selection (AS2), is outperformed by Generation-based QA (GenQA) models, which generate answers using the top-k answer sentences ranked by AS2 models (a la…

Computation and Language · Computer Science 2023-05-25 Matteo Gabburo , Siddhant Garg , Rik Koncel-Kedziorski , Alessandro Moschitti

Generative Adversarial Networks (GANs) advance face synthesis through learning the underlying distribution of observed data. Despite the high-quality generated faces, some minority groups can be rarely generated from the trained models due…

Computer Vision and Pattern Recognition · Computer Science 2021-03-30 Shuhan Tan , Yujun Shen , Bolei Zhou

Recently, we have witnessed great progress in image editing with natural language instructions. Several closed-source models like GPT-Image-1, Seedream, and Google-Nano-Banana have shown highly promising progress. However, the open-source…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Keming Wu , Sicong Jiang , Max Ku , Ping Nie , Minghao Liu , Wenhu Chen

AI arenas, which rank generative models from pairwise preferences of users, are a popular method for measuring the relative performance of models in the course of their organic use. Because rankings are computed from noisy preferences,…

Machine Learning · Computer Science 2026-03-31 Chris Hays , Rachel Li , Bailey Flanigan , Manish Raghavan

Human evaluation is critical for validating the performance of text-to-image generative models, as this highly cognitive process requires deep comprehension of text and images. However, our survey of 37 recent papers reveals that many works…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Mayu Otani , Riku Togashi , Yu Sawai , Ryosuke Ishigami , Yuta Nakashima , Esa Rahtu , Janne Heikkilä , Shin'ichi Satoh

This work addresses the lack of multimodal generative models capable of producing high-quality videos with spatially aligned audio. While recent advancements in generative models have been successful in video generation, they often overlook…

Sound · Computer Science 2026-02-05 Kazuki Shimada , Christian Simon , Takashi Shibuya , Shusuke Takahashi , Yuki Mitsufuji

Recent generative models based on score matching and flow matching have significantly advanced generation tasks, but their potential in discriminative tasks remains underexplored. Previous approaches, such as generative classifiers, have…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Rongkun Xue , Jinouwen Zhang , Yazhe Niu , Dazhong Shen , Bingqi Ma , Yu Liu , Jing Yang

Reinforcement learning has substantially improved the performance of LLM agents on tasks with verifiable outcomes, but it still struggles on open-ended agent tasks with vast solution spaces (e.g., complex travel planning). Due to the…

Despite the significant advancements in keyphrase extraction and keyphrase generation methods, the predominant approach for evaluation mainly relies on exact matching with human references. This scheme fails to recognize systems that…

Computation and Language · Computer Science 2024-06-05 Di Wu , Da Yin , Kai-Wei Chang

In image-based camera localization systems, information about the environment is usually stored in some representation, which can be referred to as a map. Conventionally, most maps are built upon hand-crafted features. Recently, neural…

Computer Vision and Pattern Recognition · Computer Science 2019-04-17 Mingpan Guo , Stefan Matthes , Jiaojiao Ye , Hao Shen

This work addresses the problems of semantic segmentation and image super-resolution by jointly considering the performance of both in training a Generative Adversarial Network (GAN). We propose a novel architecture and domain-specific…

Computer Vision and Pattern Recognition · Computer Science 2022-05-19 Tristan Frizza , Donald G. Dansereau , Nagita Mehr Seresht , Michael Bewley

The rapid advancement of generative AI has revolutionized image creation, enabling high-quality synthesis from text prompts while raising critical challenges for media authenticity. We present Ai-GenBench, a novel benchmark designed to…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Lorenzo Pellegrini , Davide Cozzolino , Serafino Pandolfini , Davide Maltoni , Matteo Ferrara , Luisa Verdoliva , Marco Prati , Marco Ramilli

This paper reports on the second GENEA Challenge to benchmark data-driven automatic co-speech gesture generation. Participating teams used the same speech and motion dataset to build gesture-generation systems. Motion generated by all these…

Human-Computer Interaction · Computer Science 2022-08-23 Youngwoo Yoon , Pieter Wolfert , Taras Kucherenko , Carla Viegas , Teodor Nikolov , Mihail Tsakov , Gustav Eje Henter

Training multi-modal large language models (MLLMs) that align with human intentions is a long-term challenge. Traditional score-only reward models for alignment suffer from low accuracy, weak generalization, and poor interpretability,…

Artificial Intelligence · Computer Science 2025-05-27 Jiayi Zhou , Jiaming Ji , Boyuan Chen , Jiapeng Sun , Wenqi Chen , Donghai Hong , Sirui Han , Yike Guo , Yaodong Yang

As agents based on large language models are increasingly deployed to long-horizon tasks, maintaining their alignment with stakeholder preferences becomes critical. Effective alignment in such settings requires reward models that are…

Artificial Intelligence · Computer Science 2025-12-09 Charlie Masters , Marta Grześkiewicz , Stefano V. Albrecht

Unified multimodal models integrate the reasoning capacity of large language models with both image understanding and generation, showing great promise for advanced multimodal intelligence. However, the community still lacks a rigorous…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Hongxiang Li , Yaowei Li , Bin Lin , Yuwei Niu , Yuhang Yang , Xiaoshuang Huang , Jiayin Cai , Xiaolong Jiang , Yao Hu , Long Chen

The rapid advancement of AIGC-based video generation has underscored the critical need for comprehensive evaluation frameworks that go beyond traditional generation quality metrics to encompass aesthetic appeal. However, existing benchmarks…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Longteng Jiang , DanDan Zheng , Qianqian Qiao , Heng Huang , Huaye Wang , Yihang Bo , Bao Peng , Jingdong Chen , Jun Zhou , Xin Jin