English
Related papers

Related papers: LMME3DHF: Benchmarking and Evaluating Multimodal 3…

200 papers

Quality assessment of AI-generated content is crucial for evaluating model capability and guiding model optimization. However, most existing quality assessment datasets and models provide only a single quality score, which is too coarse to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-02 Shushi Wang , Zicheng Zhang , Chunyi Li , Wei Wang , Liya Ma , Fengjiao Chen , Xiaoyu Li , Xuezhi Cao , Guangtao Zhai , Xiaohong Liu

Reconstructing 3D visuals from functional Magnetic Resonance Imaging (fMRI) data, introduced as Recon3DMind, is of significant interest to both cognitive neuroscience and computer vision. To advance this task, we present the fMRI-3D…

Computer Vision and Pattern Recognition · Computer Science 2025-08-15 Jianxiong Gao , Yanwei Fu , Yuqian Fu , Yun Wang , Xuelin Qian , Jianfeng Feng

Reading and evaluating product reviews is central to how most people decide what to buy and consume online. However, the recent emergence of Large Language Models and Generative Artificial Intelligence now means writing fraudulent or fake…

We present MeshLLM, a novel framework that leverages large language models (LLMs) to understand and generate text-serialized 3D meshes. Our approach addresses key limitations in existing methods, including the limited dataset scale when…

Multimodal Large Language Models (MLLMs) have recently demonstrated impressive capabilities in multimodal understanding, reasoning, and interaction. However, existing MLLMs prevalently suffer from serious hallucination problems, generating…

Computation and Language · Computer Science 2024-03-11 Tianyu Yu , Yuan Yao , Haoye Zhang , Taiwen He , Yifeng Han , Ganqu Cui , Jinyi Hu , Zhiyuan Liu , Hai-Tao Zheng , Maosong Sun , Tat-Seng Chua

Although multimodal large language models (MLLMs) have achieved promising results on a wide range of vision-language tasks, their ability to perceive and understand human faces is rarely explored. In this work, we comprehensively evaluate…

Computer Vision and Pattern Recognition · Computer Science 2024-10-29 Haomiao Sun , Mingjie He , Tianheng Lian , Hu Han , Shiguang Shan

Social interactions incorporate nonverbal signals to convey emotions alongside speech, including facial expressions and body gestures. Generative models have demonstrated promising results in creating full-body nonverbal animations…

Human-Computer Interaction · Computer Science 2026-04-01 Kiran Chhatre , Renan Guarese , Andrii Matviienko , Christopher Peters

Recent advancements in Artificial Intelligence have led to remarkable improvements in generating realistic human faces. While these advancements demonstrate significant progress in generative models, they also raise concerns about the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-25 Jin Huang , Subhadra Gopalakrishnan , Trisha Mittal , Jake Zuena , Jaclyn Pytlarz

Most of the existing video face super-resolution (VFSR) methods are trained and evaluated on VoxCeleb1, which is designed specifically for speaker identification and the frames in this dataset are of low quality. As a consequence, the VFSR…

Image and Video Processing · Electrical Eng. & Systems 2022-05-10 Liangbin Xie. Xintao Wang , Honglun Zhang , Chao Dong , Ying Shan

The impressive achievements of generative models in creating high-quality videos have raised concerns about digital integrity and privacy vulnerabilities. Recent works of AI-generated content detection have been widely studied in the image…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Qingyuan Liu , Yun-Yun Tsai , Ruijian Zha , Victoria Li , Pengyuan Shi , Chengzhi Mao , Junfeng Yang

Advances in face synthesis have raised alarms about the deceptive use of synthetic faces. Can synthetic identities be effectively used to fool human observers? In this paper, we introduce a study of the human perception of synthetic faces…

Computer Vision and Pattern Recognition · Computer Science 2021-11-09 Bingyu Shen , Brandon RichardWebster , Alice O'Toole , Kevin Bowyer , Walter J. Scheirer

Reliable face forgery detection algorithms are crucial for countering the growing threat of deepfake-driven disinformation. Previous research has demonstrated the potential of Multimodal Large Language Models (MLLMs) in identifying…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Siran Peng , Zipei Wang , Li Gao , Xiangyu Zhu , Tianshuo Zhang , Ajian Liu , Haoyuan Zhang , Zhen Lei

Consumer 3D scanners and depth cameras are increasingly being used to generate content and avatars for Virtual Reality (VR) environments and avoid the inconveniences of hand modeling; however, it is sometimes difficult to evaluate…

Human-Computer Interaction · Computer Science 2017-02-01 Jacob Thorn , Rodrigo Pizarro , Bernhard Spanlang , Pablo Bermell-Garcia , Mar Gonzalez-Franco

In this work, we contribute to video saliency research in two ways. First, we introduce a new benchmark for predicting human eye movements during dynamic scene free-viewing, which is long-time urged in this field. Our dataset, named DHF1K…

Computer Vision and Pattern Recognition · Computer Science 2018-05-29 Wenguan Wang , Jianbing Shen , Fang Guo , Ming-Ming Cheng , Ali Borji

Multimodal large language models (MLLMs) have demonstrated remarkable capabilities in various tasks. However, effectively evaluating these MLLMs on face perception remains largely unexplored. To address this gap, we introduce FaceBench, a…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Xiaoqin Wang , Xusen Ma , Xianxu Hou , Meidan Ding , Yudong Li , Junliang Chen , Wenting Chen , Xiaoyang Peng , Linlin Shen

Speech-driven 3D facial animation has gained significant attention for its ability to create realistic and expressive facial animations in 3D space based on speech. Learning-based methods have shown promising progress in achieving accurate…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Se Jin Park , Joanna Hong , Minsu Kim , Yong Man Ro

Recent advancements in autonomous driving, augmented reality, robotics, and embodied intelligence have necessitated 3D perception algorithms. However, current 3D perception methods, especially specialized small models, exhibit poor…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Fan Yang , Sicheng Zhao , Yanhao Zhang , Hui Chen , Haonan Lu , Jungong Han , Guiguang Ding

The rapidly developing field of large multimodal models (LMMs) has led to the emergence of diverse models with remarkable capabilities. However, existing benchmarks fail to comprehensively, objectively and accurately evaluate whether LMMs…

The rapid advancement of talking-head deepfake generation fueled by advanced generative models has elevated the realism of synthetic videos to a level that poses substantial risks in domains such as media, politics, and finance. However,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Xinqi Xiong , Prakrut Patel , Qingyuan Fan , Amisha Wadhwa , Sarathy Selvam , Xiao Guo , Luchao Qi , Xiaoming Liu , Roni Sengupta

We present two major contributions in this work: 1) we create a full HD resolution stereoscopic (S3D) video dataset comprised of 12 reference and 360 distorted videos. The test stimuli are produced by simulating the five levels of fog and…

Multimedia · Computer Science 2024-12-02 Sria Biswas , Balasubramanyam Appina , Priyanka Kokil , Sumohana S Channappayya