English
Related papers

Related papers: Deep Learning for Visual Speech Analysis: A Survey

200 papers

With the burgeoning amount of data of image-text pairs and diversity of Vision-and-Language (V\&L) tasks, scholars have introduced an abundance of deep learning models in this research domain. Furthermore, in recent years, transfer learning…

Computation and Language · Computer Science 2024-12-12 Thong Nguyen , Cong-Duy Nguyen , Xiaobao Wu , See-Kiong Ng , Anh Tuan Luu

Deep Learning has implemented a wide range of applications and has become increasingly popular in recent years. The goal of multimodal deep learning is to create models that can process and link information using various modalities. Despite…

Computer Vision and Pattern Recognition · Computer Science 2021-05-25 Jabeen Summaira , Xi Li , Amin Muhammad Shoib , Songyuan Li , Jabbar Abdul

We introduce a new approach for audio-visual speech separation. Given a video, the goal is to extract the speech associated with a face in spite of simultaneous background sounds and/or other human speakers. Whereas existing methods focus…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Ruohan Gao , Kristen Grauman

Speech summarization has become an essential tool for efficiently managing and accessing the growing volume of spoken and audiovisual content. However, despite its increasing importance, speech summarization remains loosely defined. The…

Computation and Language · Computer Science 2025-10-20 Fabian Retkowski , Maike Züfle , Andreas Sudmann , Dinah Pfau , Shinji Watanabe , Jan Niehues , Alexander Waibel

Deep learning has allowed a paradigm shift in pattern recognition, from using hand-crafted features together with statistical classifiers to using general-purpose learning procedures for learning data-driven representations, features, and…

Computer Vision and Pattern Recognition · Computer Science 2018-03-30 Javier Ruiz-del-Solar , Patricio Loncomilla , Naiomi Soto

Deep learning is an emerging research field that has proven its effectiveness towards deploying more efficient intelligent systems. Security, on the other hand, is one of the most essential issues in modern communication systems. Recently…

Cryptography and Security · Computer Science 2018-07-13 Majd Latah

Deep learning models have been used widely for various purposes in recent years in object recognition, self-driving cars, face recognition, speech recognition, sentiment analysis, and many others. However, in recent years it has been shown…

Computation and Language · Computer Science 2020-06-16 Aminul Huq , Mst. Tasnim Pervin

Over the last decade, there has been a remarkable surge in interest in automated crowd monitoring within the computer vision community. Modern deep-learning approaches have made it possible to develop fully-automated vision-based…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Muhammad Asif Khan , Hamid Menouar , Ridha Hamila

Dialogue systems are a popular natural language processing (NLP) task as it is promising in real-life applications. It is also a complicated task since many NLP tasks deserving study are involved. As a result, a multitude of novel works on…

Computation and Language · Computer Science 2022-03-31 Jinjie Ni , Tom Young , Vlad Pandelea , Fuzhao Xue , Erik Cambria

The availability of smart devices leads to an exponential increase in multimedia content. However, advancements in deep learning have also enabled the creation of highly sophisticated Deepfake content, including speech Deepfakes, which pose…

Sound · Computer Science 2025-07-16 Menglu Li , Yasaman Ahmadiadli , Xiao-Ping Zhang

Speaker diarization is a task to label audio or video recordings with classes that correspond to speaker identity, or in short, a task to identify "who spoke when". In the early years, speaker diarization algorithms were developed for…

Audio and Speech Processing · Electrical Eng. & Systems 2021-11-29 Tae Jin Park , Naoyuki Kanda , Dimitrios Dimitriadis , Kyu J. Han , Shinji Watanabe , Shrikanth Narayanan

The exploration of various vision-language tasks, such as visual captioning, visual question answering, and visual commonsense reasoning, is an important area in artificial intelligence and continuously attracts the research community's…

Computer Vision and Pattern Recognition · Computer Science 2024-12-12 Yayun Qi , Hongxi Li , Yiqi Song , Xinxiao Wu , Jiebo Luo

Singing voice synthesis (SVS) is a task that aims to generate audio signals according to musical scores and lyrics. With its multifaceted nature concerning music and language, producing singing voices indistinguishable from that of human…

Audio and Speech Processing · Electrical Eng. & Systems 2021-10-07 Yin-Ping Cho , Fu-Rong Yang , Yung-Chuan Chang , Ching-Ting Cheng , Xiao-Han Wang , Yi-Wen Liu

Object detection is a fundamental visual recognition problem in computer vision and has been widely studied in the past decades. Visual object detection aims to find objects of certain target classes with precise localization in a given…

Computer Vision and Pattern Recognition · Computer Science 2019-08-13 Xiongwei Wu , Doyen Sahoo , Steven C. H. Hoi

This paper presents a comprehensive survey of vision-language (VL) intelligence from the perspective of time. This survey is inspired by the remarkable progress in both computer vision and natural language processing, and recent trends…

Computer Vision and Pattern Recognition · Computer Science 2022-03-04 Feng Li , Hao Zhang , Yi-Fan Zhang , Shilong Liu , Jian Guo , Lionel M. Ni , PengChuan Zhang , Lei Zhang

Domain adaptation (DA) aims at improving the performance of a model on target domains by transferring the knowledge contained in different but related source domains. With recent advances in deep learning models which are extremely data…

Computer Vision and Pattern Recognition · Computer Science 2020-12-29 Gabriela Csurka

Most visual recognition studies rely heavily on crowd-labelled data in deep neural networks (DNNs) training, and they usually train a DNN for each single visual recognition task, leading to a laborious and time-consuming visual recognition…

Computer Vision and Pattern Recognition · Computer Science 2024-02-19 Jingyi Zhang , Jiaxing Huang , Sheng Jin , Shijian Lu

Most state-of-the-art speech systems are using Deep Neural Networks (DNNs). Those systems require a large amount of data to be learned. Hence, learning state-of-the-art frameworks on under-resourced speech languages/problems is a difficult…

Audio and Speech Processing · Electrical Eng. & Systems 2020-03-10 Vincent Roger , Jérôme Farinas , Julien Pinquier

Visual question answering (or VQA) is a new and exciting problem that combines natural language processing and computer vision techniques. We present a survey of the various datasets and models that have been used to tackle this task. The…

Computation and Language · Computer Science 2017-05-12 Akshay Kumar Gupta

The practical impact of deep learning on complex supervised learning problems has been significant, so much so that almost every Artificial Intelligence problem, or at least a portion thereof, has been somehow recast as a deep learning…

Machine Learning · Statistics 2018-03-19 Housam Khalifa Bashier Babiker , Randy Goebel