中文
相关论文

相关论文: EEG-DLite: Dataset Distillation for Efficient Larg…

200 篇论文

Deep learning has grown tremendously over recent years, yielding state-of-the-art results in various fields. However, training such models requires huge amounts of data, increasing the computational time and cost. To address this, dataset…

机器学习 · 计算机科学 2023-07-18 Murad Tukan , Alaa Maalouf , Margarita Osadchy

A significant challenge in the electroencephalogram EEG lies in the fact that current data representations involve multiple electrode signals, resulting in data redundancy and dominant lead information. However extensive research conducted…

信号处理 · 电气工程与系统科学 2024-07-31 Huyen Ngo , Khoi Do , Duong Nguyen , Viet Dung Nguyen , Lan Dang

Foundation models have transformed AI by reducing reliance on task-specific data through large-scale pretraining. While successful in language and vision, their adoption in EEG has lagged due to the heterogeneity of public datasets, which…

Dataset distillation, a training-aware data compression technique, has recently attracted increasing attention as an effective tool for mitigating costs of optimization and data storage. However, progress remains largely empirical.…

机器学习 · 计算机科学 2026-03-31 Yuri Kinoshita , Naoki Nishikawa , Taro Toyoizumi

EEG foundation models aim to learn reusable representations across heterogeneous paradigms, yet existing approaches often use uniform adaptation mechanisms and are typically reported under separate downstream fine-tuning protocols. In this…

信号处理 · 电气工程与系统科学 2026-05-19 Wei Xiong , Jiangtong Li , Kun Zhu , Jie Li

Model distillation aims to distill the knowledge of a complex model into a simpler one. In this paper, we consider an alternative formulation called dataset distillation: we keep the model fixed and instead attempt to distill the knowledge…

机器学习 · 计算机科学 2020-02-26 Tongzhou Wang , Jun-Yan Zhu , Antonio Torralba , Alexei A. Efros

In this article, we explore the potential of using latent diffusion models, a family of powerful generative models, for the task of reconstructing naturalistic music from electroencephalogram (EEG) recordings. Unlike simpler music with…

Dataset distillation aims to synthesize a small dataset from a large dataset, enabling the model trained on it to perform well on the original dataset. With the blooming of large language models and multimodal large language models, the…

计算机视觉与模式识别 · 计算机科学 2025-09-29 Zhenghao Zhao , Haoxuan Wang , Junyi Wu , Yuzhang Shang , Gaowen Liu , Yan Yan

Electroencephalography (EEG) reflects the brain's functional state, making it a crucial tool for diverse detection applications like seizure detection and sleep stage classification. While deep learning-based approaches have recently shown…

机器学习 · 计算机科学 2025-10-07 Kerui Wu , Ziyue Zhao , Bülent Yener

Training machine learning models on massive datasets is expensive and time-consuming. Dataset distillation addresses this by creating a small synthetic dataset that achieves the same performance as the full dataset. Recent methods use…

计算机视觉与模式识别 · 计算机科学 2026-04-02 Jeffrey A. Chan-Santiago , Mubarak Shah

Deep Learning has revolutionized various fields, including Computer Vision, Natural Language Processing, as well as Biomedical research. Within the field of neuroscience, specifically in electrophysiological neuroimaging, researchers are…

机器学习 · 计算机科学 2022-04-14 Dung Truong , Manisha Sinha , Kannan Umadevi Venkataraju , Michael Milham , Arnaud Delorme

Although large language models (LLMs) have recently achieved remarkable performance on various complex reasoning benchmarks, the academic community still lacks an in-depth understanding of base model training processes and data quality. To…

计算与语言 · 计算机科学 2025-05-14 Xiaoyu Tian , Sitong Zhao , Haotian Wang , Shuaiting Chen , Yiping Peng , Yunjie Ji , Han Zhao , Xiangang Li

Electroencephalografic (EEG) data are complex multi-dimensional time-series that are very useful in many applications, from diagnostics to driving brain-computer interface systems. Their classification is still a challenging task, due to…

信号处理 · 电气工程与系统科学 2024-07-30 Alberto Zancanaro , Giulia Cisotto , Italo Zoppis , Sara Lucia Manzoni

The adoption of deep learning-based healthcare decision support systems such as the detection of irregular cardiac rhythm is hindered by challenges such as lack of access to quality data and the high costs associated with the collection and…

机器学习 · 计算机科学 2022-05-31 Sagnik Dakshit , Barbara Mukami Maweu , Sristi Dakshit , Balakrishnan Prabhakaran

Foundation models pre-trained through masked reconstruction on large-scale EEG data have emerged as a promising paradigm for learning generalizable neural representations across diverse brain-computer interface applications. However, a…

人工智能 · 计算机科学 2026-05-19 Yang Shao , Peiliang Gong , Qun Dai , Daoqiang Zhang

While electroencephalogram (EEG) has been a crucial tool for monitoring the brain and diagnosing neurological disorders (e.g., epilepsy), learning meaningful representations from raw EEG signals remains challenging due to limited…

Dataset distillation aims to distill the knowledge of a large-scale real dataset into small yet informative synthetic data such that a model trained on it performs as well as a model trained on the full dataset. Despite recent progress,…

计算机视觉与模式识别 · 计算机科学 2024-11-21 Ahmad Sajedi , Samir Khaki , Lucy Z. Liu , Ehsan Amjadian , Yuri A. Lawryshyn , Konstantinos N. Plataniotis

High-fidelity ECG interpretation is increasingly reliant on massive foundation models, yet their deployment in clinical edge-care remains hindered by extreme computational demands. While knowledge distillation (KD) is a promising solution,…

计算机视觉与模式识别 · 计算机科学 2026-05-29 Dang Hong Nguyen , Nhi Ngoc-Yen Nguyen , Huy-Hieu Pham

Deep learning networks are increasingly attracting attention in various fields, including electroencephalography (EEG) signal processing. These models provided comparable performance with that of traditional techniques. At present, however,…

信号处理 · 电气工程与系统科学 2021-07-29 Haoming Zhang , Mingqi Zhao , Chen Wei , Dante Mantini , Zherui Li , Quanying Liu

Electroencephalogram (EEG) signals play a crucial role in understanding brain activity and diagnosing neurological diseases. Because supervised EEG encoders are unable to learn robust EEG patterns and rely too heavily on expensive signal…

机器学习 · 计算机科学 2025-09-23 Junhong Lai , Jiyu Wei , Lin Yao , Yueming Wang