English
Related papers

Related papers: Imagined Speech and Visual Imagery as Intuitive Pa…

200 papers

We present an introspection of an audiovisual speech enhancement model. In particular, we focus on interpreting how a neural audiovisual speech enhancement model uses visual cues to improve the quality of the target speech signal. We show…

A major objective of Brain-Computer interfaces (BCI) is to restore communication and control in patients with severe motor impairments, like people with Locked-in syndrome. These patients are left only with limited eye and eyelid movements.…

Human-Computer Interaction · Computer Science 2023-02-14 P Séguin , E Maby , J Mattout

The recent successes of Vision-Language models raise the question of how to equivalently imbue a pretrained speech model with vision understanding, an important milestone towards building a multimodal speech model able to freely converse…

Computer Vision and Pattern Recognition · Computer Science 2025-03-21 Amélie Royer , Moritz Böhle , Gabriel de Marmiesse , Laurent Mazaré , Neil Zeghidour , Alexandre Défossez , Patrick Pérez

Steady-state visual-evoked potential (SSVEP)-based brain-computer interfaces (BCIs) offer a non-invasive means of communication through high-speed speller systems. However, their efficiency heavily relies on individual training data…

Machine Learning · Computer Science 2023-11-22 Sung-Yu Chen , Chi-Min Chang , Kuan-Jung Chiang , Chun-Shu Wei

This software project based paper is for a vision of the near future in which computer interaction is characterized by natural face-to-face conversations with lifelike characters that speak, emote, and gesture. The first step is speech. The…

Human-Computer Interaction · Computer Science 2013-05-10 Urmila Shrawankar , Anjali Mahajan

This work focuses on inner speech recognition starting from EEG signals. Inner speech recognition is defined as the internalized process in which the person thinks in pure meanings, generally associated with an auditory imagery of own inner…

Human-Computer Interaction · Computer Science 2023-10-26 Francesca Gasparini , Elisa Cazzaniga , Aurora Saibene

Generating human language through non-invasive brain-computer interfaces (BCIs) has the potential to unlock many applications, such as serving disabled patients and improving communication. Currently, however, generating language via BCIs…

Computation and Language · Computer Science 2025-11-04 Ziyi Ye , Qingyao Ai , Yiqun Liu , Maarten de Rijke , Min Zhang , Christina Lioma , Tuukka Ruotsalo

A brain-computer interface (BCI) enables a user to communicate with a computer directly using brain signals. The most common non-invasive BCI modality, electroencephalogram (EEG), is sensitive to noise/artifact and suffers…

Human-Computer Interaction · Computer Science 2022-11-15 Dongrui Wu , Yifan Xu , Bao-Liang Lu

The paper presents a study of two novel visual motion onset stimulus-based brain-computer interfaces (vmoBCI). Two settings are compared with afferent and efferent to a computer screen center motion patterns. Online vmoBCI experiments are…

Neurons and Cognition · Quantitative Biology 2016-10-03 Jair Pereira Junior , Caio Teixeira , Tomasz M. Rutkowski

A brain-computer interface (BCI) is a system that allows a person to communicate or control the surroundings without depending on the brain's normal output pathways of peripheral nerves and muscles. A lot of successful applications have…

Human-Computer Interaction · Computer Science 2023-07-18 Ce Zhou

Brain-computer interface (BCI) is used for communication between humans and devices by recognizing status and intention of humans. Communication between humans and a drone using electroencephalogram (EEG) signals is one of the most…

Computer Vision and Pattern Recognition · Computer Science 2021-08-17 Dae-Hyeok Lee , Dong-Kyun Han , Sung-Jin Kim , Ji-Hoon Jeong , Seong-Whan Lee

In recent times, there have been significant advancements in utilizing the sensing capabilities of mobile devices for developing applications. The primary objective has been to enhance the way a user interacts with the application by making…

Human-Computer Interaction · Computer Science 2015-09-07 Sumit Soman , Siddharth Srivastava , Saurabh Srivastava , Nitendra Rajput

In this paper we will describe all necessary parts of Brain-Computer Interface (BCI), such as source of signals, hardware, software, analysis, architectures of complete system. We also will go along various applications of BCI, view some…

Human-Computer Interaction · Computer Science 2010-03-16 Kirill A. Sorudeykin

Open-domain dialogue generation in natural language processing (NLP) is by default a pure-language task, which aims to satisfy human need for daily communication on open-ended topics by producing related and informative responses. In this…

Computation and Language · Computer Science 2021-09-21 Lei Shen , Haolan Zhan , Xin Shen , Yonghao Song , Xiaofang Zhao

Brain-Computer Interface (BCI) uses brain signals in order to provide a new method for communication between human and outside world. Feature extraction, selection and classification are among the main matters of concerns in signal…

Human-Computer Interaction · Computer Science 2017-09-13 Ehsan Arbabi , Mohammad Bagher Shamsollahi

Visual decoding of neurophysiological signals is a critical challenge for brain-computer interfaces (BCIs) and computational neuroscience. However, current approaches are often constrained by the systematic and stochastic gaps between…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Feixue Shao , Guangze Shi , Xueyu Liu , Yongfei Wu , Mingqiang Wei , Jianan Zhang , Jianbo Lu , Guiying Yan , Weihua Yang

Brain decoding has emerged as a rapidly advancing and extensively utilized technique within neuroscience. This paper centers on the application of raw electroencephalogram (EEG) signals for decoding human brain activity, offering a more…

Machine Learning · Computer Science 2025-02-04 Zenon Lamprou , Yashar Moshfeghi

Brain-Computer Interfaces (BCIs) are used in various application scenarios allowing direct communication between the brain and computers. Specifically, electroencephalography (EEG) is one of the most common techniques for obtaining evoked…

Human-Computer Interaction · Computer Science 2023-11-10 Eduardo López Bernal , Sergio López Bernal , Gregorio Martínez Pérez , Alberto Huertas Celdrán

Humans can effortlessly describe what they see, yet establishing a shared representational format between vision and language remains a significant challenge. Emerging evidence suggests that human brain representations in both vision and…

Neurons and Cognition · Quantitative Biology 2025-07-30 Katerina Marie Simkova , Adrien Doerig , Clayton Hickey , Ian Charest

Human thinking requires the brain to understand the meaning of language expression and to properly organize the thoughts flow using the language. However, current natural language processing models are primarily limited in the word…

Computation and Language · Computer Science 2019-06-04 Feng Qi , Wenchuan Wu