English
Related papers

Related papers: The Truth and Nothing but the Truth: Multimodal An…

200 papers

Fact verification based on structured data is challenging as it requires models to understand both natural language and symbolic operations performed over tables. Although pre-trained language models have demonstrated a strong capability in…

Computation and Language · Computer Science 2021-09-24 Xiaoyu Yang , Xiaodan Zhu

Multimodal learning involves integrating information from various modalities to enhance learning and comprehension. We compare three modality fusion strategies in person identification and verification by processing two modalities: voice…

Audio and Speech Processing · Electrical Eng. & Systems 2024-11-05 Aref Farhadipour , Masoumeh Chapariniya , Teodora Vukovic , Volker Dellwo

Face verification systems have seen substantial advancements; however, they often lack transparency in their decision-making processes. In this paper, we introduce an innovative Vision-Language Model (VLM) for Face Verification, which not…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Syed Abdul Hannan , Hazim Bukhari , Thomas Cantalapiedra , Eman Ansar , Massa Baali , Rita Singh , Bhiksha Raj

In settings from fact-checking to question answering, we frequently want to know whether a collection of evidence (premises) entails a hypothesis. Existing methods primarily focus on the end-to-end discriminative version of this task, but…

Computation and Language · Computer Science 2022-10-31 Kaj Bostrom , Zayne Sprague , Swarat Chaudhuri , Greg Durrett

The success of automatic speaker verification shows that discriminative speaker representations can be extracted from neutral speech. However, as a kind of non-verbal voice, laughter should also carry speaker information intuitively. Thus,…

Audio and Speech Processing · Electrical Eng. & Systems 2023-11-21 Yuke Lin , Xiaoyi Qin , Huahua Cui , Zhenyi Zhu , Ming Li

This paper discusses a novel method for Facial Expression Recognition System which performs facial expression analysis in a near real time from a live web cam feed. Primary objectives were to get results in a near real time with light…

Computer Vision and Pattern Recognition · Computer Science 2012-06-18 Saumil Srivastava

Language use reveals information about who we are and how we feel1-3. One of the pioneers in text analysis, Walter Weintraub, manually counted which types of words people used in medical interviews and showed that the frequency of…

Computation and Language · Computer Science 2018-11-07 Sophie van der Zee , Ronald Poppe , Alice Havrileck , Aurelien Baillon

The goal of this work is to recognise phrases and sentences being spoken by a talking face, with or without the audio. Unlike previous works that have focussed on recognising a limited number of words or phrases, we tackle lip reading as an…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Triantafyllos Afouras , Joon Son Chung , Andrew Senior , Oriol Vinyals , Andrew Zisserman

Smile is an irrefutable expression that shows the physical state of the mind in both true and deceptive ways. Generally, it shows happy state of the mind, however, `smiles' can be deceptive, for example people can give a smile when they…

Computer Vision and Pattern Recognition · Computer Science 2016-05-24 Bappaditya Mandal , Nizar Ouarti

Are frontier AI systems becoming more capable? Certainly. Yet such progress is not an unalloyed blessing but rather a Trojan horse: behind their performance leaps lie more insidious and destructive safety risks, namely deception. Unlike…

Artificial Intelligence · Computer Science 2026-05-28 Sitong Fang , Shiyi Hou , Kaile Wang , Boyuan Chen , Donghai Hong , Jiayi Zhou , Josef Dai , Yaodong Yang , Jiaming Ji

Business communication digitisation has reorganised the process of persuasive discourse, which allows not only greater transparency but also advanced deception. This inquiry synthesises classical rhetoric and communication psychology with…

Computation and Language · Computer Science 2025-08-14 Sayem Hossen , Monalisa Moon Joti , Md. Golam Rashed

Veracity is an essential key in research and development of innovative products. Live Emotion analysis and verification nullify deceit made to complainers on live chat, corroborate messages of both ends in messaging apps and promote an…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Falguni Patel , NirmalKumar Patel , Santosh Kumar Bharti

Facial expressions of emotion play an important role in human social interactions. However, posed acting is not always the same as genuine feeling. Therefore, the credibility assessment of facial expressions, namely, the discrimination of…

Computer Vision and Pattern Recognition · Computer Science 2020-08-27 Shan Jia , Shuo Wang , Chuanbo Hu , Paula Webster , Xin Li

Text data are being used as a lens through which human cognition can be studied at a large scale. Methods like emotion analysis are now in the standard toolkit of computational social scientists but typically rely on third-person annotation…

Computation and Language · Computer Science 2020-06-17 Bennett Kleinberg

The rise of manipulated media has made deepfakes a particularly insidious threat, involving various generative manipulations such as lip-sync modifications, face-swaps, and avatar-driven facial synthesis. Conventional detection methods,…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Soumyya Kanti Datta , Tanvi Ranga , Chengzhe Sun , Siwei Lyu

Self-consistency-based approaches, which involve repeatedly sampling multiple outputs and selecting the most consistent one as the final response, prove to be remarkably effective in improving the factual accuracy of large language models.…

Computation and Language · Computer Science 2025-01-24 Yi Cheng , Xiao Liang , Yeyun Gong , Wen Xiao , Song Wang , Yuji Zhang , Wenjun Hou , Kaishuai Xu , Wenge Liu , Wenjie Li , Jian Jiao , Qi Chen , Peng Cheng , Wayne Xiong

A major challenge in DeepFake forgery detection is that state-of-the-art algorithms are mostly trained to detect a specific fake method. As a result, these approaches show poor generalization across different types of facial manipulations,…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Davide Cozzolino , Andreas Rössler , Justus Thies , Matthias Nießner , Luisa Verdoliva

As synthetic media, including video, audio, and text, become increasingly indistinguishable from real content, the risks of misinformation, identity fraud, and social manipulation escalate. This survey traces the evolution of deepfake…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Ping Liu , Qiqi Tao , Joey Tianyi Zhou

Emotion recognition and sentiment analysis are pivotal tasks in speech and language processing, particularly in real-world scenarios involving multi-party, conversational data. This paper presents a multimodal approach to tackle these…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Aref Farhadipour , Hossein Ranjbar , Masoumeh Chapariniya , Teodora Vukovic , Sarah Ebling , Volker Dellwo

Misinformation can be countered with fact-checking, but the process is costly and slow. Identifying checkworthy claims is the first step, where automation can help scale fact-checkers' efforts. However, detection methods struggle with…

Artificial Intelligence · Computer Science 2025-06-05 Michiel van der Meer , Pavel Korshunov , Sébastien Marcel , Lonneke van der Plas