Detecting speaking persons in video
Computer Vision and Pattern Recognition
2021-10-27 v1
Authors:
Hannes Fassold
Abstract
We present a novel method for detecting speaking persons in video, by extracting facial landmarks with a neural network and analysing these landmarks statistically over time
Cite
@article{arxiv.2110.13806,
title = {Detecting speaking persons in video},
author = {Hannes Fassold},
journal= {arXiv preprint arXiv:2110.13806},
year = {2021}
}
Comments
Accepted for MMSP 2021
Related papers
View all related →
Computer Vision and Pattern Recognition · Computer Science
Identity-Preserving Talking Face Generation with Landmark and Appearance Priors
Weizhi Zhong, Chaowei Fang, Yinqi Cai, Pengxu Wei +3
2023-05-16
Computer Vision and Pattern Recognition · Computer Science
Generating Talking Face Landmarks from Speech
Sefik Emre Eskimez, Ross K Maddox, Chenliang Xu, Zhiyao Duan
2018-04-24
Computer Vision and Pattern Recognition · Computer Science
Facial Expression Recognition using Facial Landmark Detection and Feature Extraction via Neural Networks
Fuzail Khan
2020-07-17
Computer Vision and Pattern Recognition · Computer Science
Landmark Guided Visual Feature Extractor for Visual Speech Recognition with Limited Resource
Lei Yang, Junshan Jin, Mingyuan Zhang, Yi He +2
2025-08-12
Computer Vision and Pattern Recognition · Computer Science
Speech2Face: Learning the Face Behind a Voice
Tae-Hyun Oh, Tali Dekel, Changil Kim, Inbar Mosseri +3
2019-05-24
Computer Vision and Pattern Recognition · Computer Science
Context-aware Talking Face Video Generation
Meidai Xuanyuan, Yuwang Wang, Honglei Guo, Qionghai Dai
2024-02-29
Computer Vision and Pattern Recognition · Computer Science
You said that?
Joon Son Chung, Amir Jamaludin, Andrew Zisserman
2017-07-19
Computer Vision and Pattern Recognition · Computer Science
The Conversation: Deep Audio-Visual Speech Enhancement
Triantafyllos Afouras, Joon Son Chung, Andrew Zisserman
2018-06-20
Multimedia · Computer Science
Putting a Face to the Voice: Fusing Audio and Visual Signals Across a Video to Determine Speakers
Ken Hoover, Sourish Chaudhuri, Caroline Pantofaru, Malcolm Slaney +1
2017-06-02
Computer Vision and Pattern Recognition · Computer Science
Real-Time Facial Expression Recognition using Facial Landmarks and Neural Networks
Mohammad Amin Haghpanah, Ehsan Saeedizade, Mehdi Tale Masouleh, Ahmad Kalhor
2022-02-02
Computer Vision and Pattern Recognition · Computer Science
Learning Landmarks Motion from Speech for Speaker-Agnostic 3D Talking Heads Generation
Federico Nocentini, Claudio Ferrari, Stefano Berretti
2023-07-27
Computer Vision and Pattern Recognition · Computer Science
Deep Learning for Automatic Tracking of Tongue Surface in Real-time Ultrasound Videos, Landmarks instead of Contours
M. Hamed Mozaffari, Won-Sook Lee
2020-03-20
Computer Vision and Pattern Recognition · Computer Science
Seeing Through Noise: Visually Driven Speaker Separation and Enhancement
Aviv Gabbay, Ariel Ephrat, Tavi Halperin, Shmuel Peleg
2018-02-13
Image and Video Processing · Electrical Eng. & Systems
Unsupervised active speaker detection in media content using cross-modal information
Rahul Sharma, Shrikanth Narayanan
2022-09-27
Computer Vision and Pattern Recognition · Computer Science
MakeItTalk: Speaker-Aware Talking-Head Animation
Yang Zhou, Xintong Han, Eli Shechtman, Jose Echevarria +2
2021-02-26
Audio and Speech Processing · Electrical Eng. & Systems
Speaker disentanglement in video-to-speech conversion
Dan Oneata, Adriana Stan, Horia Cucu
2021-05-21
Computer Vision and Pattern Recognition · Computer Science
Deepfake Detection Via Facial Feature Extraction and Modeling
Benjamin Carter, Nathan Dilla, Micheal Callahan, Atuhaire Ambala
2025-07-28
Computation and Language · Computer Science
Face Landmark-based Speaker-Independent Audio-Visual Speech Enhancement in Multi-Talker Environments
Giovanni Morrone, Luca Pasa, Vadim Tikhanoff, Sonia Bergamaschi +2
2021-02-04
Audio and Speech Processing · Electrical Eng. & Systems
Audio-Visual Target Speaker Enhancement on Multi-Talker Environment using Event-Driven Cameras
Ander Arriandiaga, Giovanni Morrone, Luca Pasa, Leonardo Badino +1
2021-02-23
Audio and Speech Processing · Electrical Eng. & Systems
A Closer Look at Audio-Visual Multi-Person Speech Recognition and Active Speaker Selection
Otavio Braga, Olivier Siohan
2022-05-13
Computer Vision and Pattern Recognition · Computer Science
Dynamic Neural Textures: Generating Talking-Face Videos with Continuously Controllable Expressions
Zipeng Ye, Zhiyao Sun, Yu-Hui Wen, Yanan Sun +3
2022-04-14
Computer Vision and Pattern Recognition · Computer Science
Talking Detection In Collaborative Learning Environments
Wenjing Shi, Marios S. Pattichis, Sylvia Celedón-Pattichis, Carlos LópezLeiva
2021-10-18
Computer Vision and Pattern Recognition · Computer Science
High-fidelity and Lip-synced Talking Face Synthesis via Landmark-based Diffusion Model
Weizhi Zhong, Junfan Lin, Peixin Chen, Liang Lin +1
2024-08-13
Computer Vision and Pattern Recognition · Computer Science
Leveraging Real Talking Faces via Self-Supervision for Robust Forgery Detection
Alexandros Haliassos, Rodrigo Mira, Stavros Petridis, Maja Pantic
2022-10-24
Computer Vision and Pattern Recognition · Computer Science
Identity-Preserving Realistic Talking Face Generation
Sanjana Sinha, Sandika Biswas, Brojeshwar Bhowmick
2020-05-27