English
Related papers

Related papers: Fine-Tuning Large Language Models Using EEG Micros…

200 papers

The human brain remains continuously active, whether an individual is working or at rest. Mental activity is a daily process, and if the brain becomes excessively active, known as overload, it can adversely affect human health. Recently,…

Signal Processing · Electrical Eng. & Systems 2024-03-13 Hong-Hai Nguyen , Ngumimi Karen Iyortsuun , Seungwon Kim , Hyung-Jeong Yang , Soo-Hyung Kim

This project proposes an attention-aware LLM that integrates EEG and eye tracking to monitor and measure user attention dynamically. To realize this, the project will integrate real-time EEG and eye-tracking data into an LLM-based…

Human-Computer Interaction · Computer Science 2025-11-11 Dan Zhang

The pretrained large language models (LLMs) are finetuned with labeled data for better instruction following ability and alignment with human values. In this paper, we study the learning dynamics of LLM finetuning on reasoning tasks and…

Computation and Language · Computer Science 2025-09-30 Zhiwen Ruan , Yun Chen , Yutao Hou , Peng Li , Yang Liu , Guanhua Chen

Cognitive load, the amount of mental effort required for task completion, plays an important role in performance and decision-making outcomes, making its classification and analysis essential in various sensitive domains. In this paper, we…

Machine Learning · Computer Science 2023-08-02 Dustin Pulver , Prithila Angkan , Paul Hungler , Ali Etemad

Machine learning (ML) and deep learning (DL) techniques have been widely applied to analyze electroencephalography (EEG) signals for disease diagnosis and brain-computer interfaces (BCI). The integration of multimodal data has been shown to…

Signal Processing · Electrical Eng. & Systems 2025-01-16 Siqi Zhao , Wangyang Li , Xiru Wang , Stevie Foglia , Hongzhao Tan , Bohan Zhang , Ameer Hamoodi , Aimee Nelson , Zhen Gao

Large Language Models (LLMs) have demonstrated remarkable capabilities in complex tasks. Recent advancements in Large Reasoning Models (LRMs), such as OpenAI o1 and DeepSeek-R1, have further improved performance in System-2 reasoning…

Computation and Language · Computer Science 2025-08-25 Yang Sui , Yu-Neng Chuang , Guanchu Wang , Jiamu Zhang , Tianyi Zhang , Jiayi Yuan , Hongyi Liu , Andrew Wen , Shaochen Zhong , Na Zou , Hanjie Chen , Xia Hu

In this paper, we explore prior research and introduce a new methodology for classifying mental state levels based on EEG signals utilizing machine learning (ML). Our method proposes an optimized training method by introducing a validation…

Signal Processing · Electrical Eng. & Systems 2023-12-18 Maxime Girard , Rémi Nahon , Enzo Tartaglione , Van-Tam Nguyen

The detection of pilots' mental states is important due to the potential for their abnormal mental states to result in catastrophic accidents. This study introduces the feasibility of employing deep learning techniques to classify different…

Signal Processing · Electrical Eng. & Systems 2023-12-18 Dae-Hyeok Lee , Sung-Jin Kim , Si-Hyun Kim , Seong-Whan Lee

Electroencephalography (EEG) offers non-invasive, real-time mental workload assessment, which is crucial in high-stakes domains like aviation and medicine and for advancing brain-computer interface (BCI) technologies. This study introduces…

Human-Computer Interaction · Computer Science 2025-06-11 Gourav Siddhad , Partha Pratim Roy , Byung-Gyu Kim

The paper introduces ExKG-LLM, a framework designed to automate the expansion of cognitive neuroscience knowledge graphs (CNKG) using large language models (LLMs). It addresses limitations in existing tools by enhancing accuracy,…

Artificial Intelligence · Computer Science 2025-07-09 Ali Sarabadani , Kheirolah Rahsepar Fard , Hamid Dalvand

Electroencephalography provides a non-invasive window into brain activity, offering valuable insights for neurological research, brain-computer interfaces, and clinical diagnostics. However, the development of robust machine learning models…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Chi-Sheng Chen , Ying-Jung Chen , Aidan Hung-Wen Tsai

Large Language Models (LLMs) have the unique capability to understand and generate human-like text from input queries. When fine-tuned, these models show enhanced performance on domain-specific queries. OpenAI highlights the process of…

Computation and Language · Computer Science 2024-07-02 Scott Barnett , Zac Brannelly , Stefanus Kurniawan , Sheng Wong

Electroencephalography (EEG) interpretation using multimodal large language models (MLLMs) offers a novel approach for analyzing brain signals. However, the complex nature of brain activity introduces critical challenges: EEG signals…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Ziyi Zeng , Zhenyang Cai , Yixi Cai , Xidong Wang , Junying Chen , Rongsheng Wang , Yipeng Liu , Siqi Cai , Benyou Wang , Zhiguo Zhang , Haizhou Li

Accurately monitoring cognitive load in real time is critical for Brain-Computer Interfaces (BCIs) that adapt to user engagement and support personalized learning. Electroencephalography (EEG) offers a non-invasive, cost-effective modality…

Human-Computer Interaction · Computer Science 2026-05-04 Deeksha M. Shama , Dimitra Emmanouilidou , Ivan J. Tashev

Understanding the correlation between EEG features and cognitive tasks is crucial for elucidating brain function. Brain activity synchronizes during speaking and listening tasks. However, it is challenging to estimate task-dependent brain…

Neurons and Cognition · Quantitative Biology 2024-10-01 Dai Shimizu , Ko Watanabe , Andreas Dengel

Multimodal language modeling has enabled breakthroughs for representation learning, yet remains unexplored in the realm of functional brain data for clinical phenotyping. This paper pioneers EEG-language models (ELMs) trained on clinical…

Signal Processing · Electrical Eng. & Systems 2025-08-12 Sam Gijsen , Kerstin Ritter

The increasing quality and affordability of consumer electroencephalogram (EEG) headsets make them attractive for situations where medical grade devices are impractical. Predicting and tracking cognitive states is possible for tasks that…

Computer Vision and Pattern Recognition · Computer Science 2016-06-07 Pouya Bashivan , Irina Rish , Steve Heisig

Conventional augmentative and alternative communication (AAC) systems and language-learning platforms often fail to adapt in real time to the user's cognitive and linguistic needs, especially in neurological conditions such as post-stroke…

Human-Computer Interaction · Computer Science 2025-08-01 Ismail Hossain , Mridul Banik

Reinforcement learning (RL) has become a key technique for enhancing the reasoning abilities of large language models (LLMs), with policy-gradient algorithms dominating the post-training stage because of their efficiency and effectiveness.…

Artificial Intelligence · Computer Science 2025-08-08 Chang Tian , Matthew B. Blaschko , Mingzhe Xing , Xiuxing Li , Yinliang Yue , Marie-Francine Moens

Mental fatigue increases the risk of operator error in language comprehension tasks. In order to prevent operator performance degradation, we used EEG signals to assess the mental fatigue of operators in human-computer systems. This study…

Artificial Intelligence · Computer Science 2021-04-20 Chunhua Ye , Zhong Yin , Chenxi Wu , Xiayidai Abulaiti , Yixing Zhang , Zhenqi Sun , Jianhua Zhang