English
Related papers

Related papers: Advances and Challenges in Deep Lip Reading

200 papers

Lip reading is used to understand or interpret speech without hearing it, a technique especially mastered by people with hearing difficulties. The ability to lip read enables a person with a hearing impairment to communicate with others and…

Computer Vision and Pattern Recognition · Computer Science 2014-09-05 Ahmad B. A. Hassanat

Visual speech recognition (VSR), commonly known as lip reading, has garnered significant attention due to its wide-ranging practical applications. The advent of deep learning techniques and advancements in hardware capabilities have…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Bowen Hao , Dongliang Zhou , Xiaojie Li , Xingyu Zhang , Liang Xie , Jianlong Wu , Erwei Yin

Recent advances in deep learning have heightened interest among researchers in the field of visual speech recognition (VSR). Currently, most existing methods equate VSR with automatic lip reading, which attempts to recognise speech by…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Yuanhang Zhang , Shuang Yang , Jingyun Xiao , Shiguang Shan , Xilin Chen

The goal of this paper is to learn strong lip reading models that can recognise speech in silent videos. Most prior works deal with the open-set visual speech recognition problem by adapting existing automatic speech recognition techniques…

Computer Vision and Pattern Recognition · Computer Science 2021-12-06 K R Prajwal , Triantafyllos Afouras , Andrew Zisserman

Lip reading, also known as visual speech recognition, aims to recognize the speech content from videos by analyzing the lip dynamics. There have been several appealing progress in recent years, benefiting much from the rapidly developed…

Computer Vision and Pattern Recognition · Computer Science 2020-11-17 Dalu Feng , Shuang Yang , Shiguang Shan , Xilin Chen

Lip reading is used to understand or interpret speech without hearing it, a technique especially mastered by people with hearing difficulties. The ability to lip read enables a person with a hearing impairment to communicate with others and…

Computer Vision and Pattern Recognition · Computer Science 2014-09-24 Ahmad Basheer Hassanat

Visual speech recognition (VSR) aims to recognize the content of speech based on lip movements, without relying on the audio stream. Advances in deep learning and the availability of large audio-visual datasets have led to the development…

Computer Vision and Pattern Recognition · Computer Science 2022-11-01 Pingchuan Ma , Stavros Petridis , Maja Pantic

Lip Reading, or Visual Automatic Speech Recognition (V-ASR), is a complex task requiring the interpretation of spoken language exclusively from visual cues, primarily lip movements and facial expressions. This task is especially challenging…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Marshall Thomas , Edward Fish , Richard Bowden

Audio-visual (AV) lip biometrics is a promising authentication technique that leverages the benefits of both the audio and visual modalities in speech communication. Previous works have demonstrated the usefulness of AV lip biometrics.…

Multimedia · Computer Science 2021-04-27 Meng Liu , Longbiao Wang , Kong Aik Lee , Hanyi Zhang , Chang Zeng , Jianwu Dang

Speaker-independent VSR is a complex task that involves identifying spoken words or phrases from video recordings of a speaker's facial movements. Over the years, there has been a considerable amount of research in the field of VSR…

Computer Vision and Pattern Recognition · Computer Science 2023-12-13 Praneeth Nemani , G. Sai Krishna , Supriya Kundrapu

Visual speech, referring to the visual domain of speech, has attracted increasing attention due to its wide applications, such as public security, medical treatment, military defense, and film entertainment. As a powerful AI strategy, deep…

Computer Vision and Pattern Recognition · Computer Science 2024-03-15 Changchong Sheng , Gangyao Kuang , Liang Bai , Chenping Hou , Yulan Guo , Xin Xu , Matti Pietikäinen , Li Liu

The goal of this work is to recognise phrases and sentences being spoken by a talking face, with or without the audio. Unlike previous works that have focussed on recognising a limited number of words or phrases, we tackle lip reading as an…

Computer Vision and Pattern Recognition · Computer Science 2018-12-27 Triantafyllos Afouras , Joon Son Chung , Andrew Senior , Oriol Vinyals , Andrew Zisserman

In this work, we propose a technique to transfer speech recognition capabilities from audio speech recognition systems to visual speech recognizers, where our goal is to utilize audio data during lipreading model training. Impressive…

Multimedia · Computer Science 2022-07-13 Hadeel Mabrouk , Omar Abugabal , Nourhan Sakr , Hesham M. Eraqi

Visual speech recognition (VSR), also known as lip reading, is the task of recognizing speech from silent video. Despite significant advancements in VSR over recent decades, most existing methods pay limited attention to real-world visual…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Tianyue Wang , Shuang Yang , Shiguang Shan , Xilin Chen

Visual Speech Recognition (VSR) differs from the common perception tasks as it requires deeper reasoning over the video sequence, even by human experts. Despite the recent advances in VSR, current approaches rely on labeled data to fully…

Human lip-reading is a challenging task. It requires not only knowledge of underlying language but also visual clues to predict spoken words. Experts need certain level of experience and understanding of visual expressions learning to…

Computer Vision and Pattern Recognition · Computer Science 2018-02-16 M Faisal , Sanaullah Manzoor

The need for an automatic lip-reading system is ever increasing. Infact, today, extraction and reliable analysis of facial movements make up an important part in many multimedia systems such as videoconference, low communication systems,…

Computer Vision and Pattern Recognition · Computer Science 2013-02-19 Salah Werda , Walid Mahdi , Abdelmajid Ben Hamadou

Visual speech recognition (VSR) is the task of recognizing spoken language from video input only, without any audio. VSR has many applications as an assistive technology, especially if it could be deployed in mobile devices and embedded…

Computation and Language · Computer Science 2019-06-06 Nilay Shrivastava , Astitwa Saxena , Yaman Kumar , Rajiv Ratn Shah , Debanjan Mahata , Amanda Stent

Deep learning is an emerging technology that is considered one of the most promising directions for reaching higher levels of artificial intelligence. Among the other achievements, building computers that understand speech represents a…

Computation and Language · Computer Science 2017-12-19 Mirco Ravanelli

Recent adoption of deep learning methods to the field of machine lipreading research gives us two options to pursue to improve system performance. Either, we develop end-to-end systems holistically or, we experiment to further our…

Computer Vision and Pattern Recognition · Computer Science 2018-04-26 Helen L Bear
‹ Prev 1 2 3 10 Next ›