English
Related papers

Related papers: ManifoldFormer: Geometric Deep Learning for Neural…

200 papers

Rapid growth of high-dimensional datasets in fields such as single-cell RNA sequencing and spatial genomics has led to unprecedented opportunities for scientific discovery, but it also presents unique computational and statistical…

Grassmannian manifold offers a powerful carrier for geometric representation learning by modelling high-dimensional data as low-dimensional subspaces. However, existing approaches predominantly rely on static single-subspace…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Xuan Yu , Tianyang Xu

The application of Riemannian geometry in the decoding of brain-computer interfaces (BCIs) has swiftly garnered attention because of its straightforwardness, precision, and resilience, along with its aptitude for transfer learning, which…

Signal Processing · Electrical Eng. & Systems 2024-07-31 Imad Eddine Tibermacine , Samuele Russo , Ahmed Tibermacine , Abdelaziz Rabehi , Bachir Nail , Kamel Kadri , Christian Napoli

Electroencephalography (EEG) foundation models hold significant promise for universal Brain-Computer Interfaces (BCIs). However, existing approaches often rely on end-to-end fine-tuning and exhibit limited efficacy under frozen-probing…

Machine Learning · Computer Science 2026-03-20 Jiquan Wang , Sha Zhao , Yangxuan Zhou , Yiming Kang , Shijian Li , Gang Pan

The development of EEG decoding algorithms confronts challenges such as data sparsity, subject variability, and the need for precise annotations, all of which are vital for advancing brain-computer interfaces and enhancing the diagnosis of…

Signal Processing · Electrical Eng. & Systems 2025-01-15 Zirui Wang , Zhenxi Song , Yi Guo , Yuxin Liu , Guoyang Xu , Min Zhang , Zhiguo Zhang

We propose a model for time series taking values on a Riemannian manifold and fit it to time series of covariance matrices derived from EEG data for patients suffering from epilepsy. The aim of the study is two-fold: to develop a model with…

Methodology · Statistics 2024-02-13 Tao Ding , Tom M. W. Nye , Yujiang Wang

Deep generative models have demonstrated successful applications in learning non-linear data distributions through a number of latent variables and these models use a nonlinear function (generator) to map latent samples into the data space.…

Computer Vision and Pattern Recognition · Computer Science 2023-04-04 Pourya Shamsolmoali , Masoumeh Zareapoor , Huiyu Zhou , Dacheng Tao , Xuelong Li

Deep learning has achieved a remarkable performance breakthrough in several fields, most notably in speech recognition, natural language processing, and computer vision. In particular, convolutional neural network (CNN) architectures…

Computer Vision and Pattern Recognition · Computer Science 2016-12-08 Federico Monti , Davide Boscaini , Jonathan Masci , Emanuele Rodolà , Jan Svoboda , Michael M. Bronstein

We develop Riemannian approaches to variational autoencoders (VAEs) for PDE-type ambient data with regularizing geometric latent dynamics, which we refer to as VAE-DLM, or VAEs with dynamical latent manifolds. We redevelop the VAE framework…

Machine Learning · Computer Science 2026-01-21 Andrew Gracyk

We propose Lie group embedded dynamical neural networks (LieEDNN) and the corresponding learning algorithms based on gradient descent and metric projection on smooth manifold, where we treat Lie group as an intrinsic representation for…

Machine Learning · Computer Science 2026-05-27 Tianwei Wang , Bryan Chen , Qian Zuo , Qiyue Xia , Xin Li , Wei Pang

This work presents a novel method of exploring human brain-visual representations, with a view towards replicating these processes in machines. The core idea is to learn plausible computational and biological representations by correlating…

Computer Vision and Pattern Recognition · Computer Science 2020-04-21 Simone Palazzo , Concetto Spampinato , Isaak Kavasidis , Daniela Giordano , Joseph Schmidt , Mubarak Shah

We propose extrinsic and intrinsic deep neural network architectures as general frameworks for deep learning on manifolds. Specifically, extrinsic deep neural networks (eDNNs) preserve geometric features on manifolds by utilizing an…

Machine Learning · Statistics 2023-02-20 Yihao Fang , Ilsang Ohn , Vijay Gupta , Lizhen Lin

We develop data-driven methods incorporating geometric and topological information to learn parsimonious representations of nonlinear dynamics from observations. The approaches learn nonlinear state-space models of the dynamics for general…

Machine Learning · Computer Science 2025-03-28 Ryan Lopez , Paul J. Atzberger

Deep learning (DL) has been widely investigated in a vast majority of applications in electroencephalography (EEG)-based brain-computer interfaces (BCIs), especially for motor imagery (MI) classification in the past five years. The…

Signal Processing · Electrical Eng. & Systems 2022-09-26 Ce Ju , Cuntai Guan

Recent methods in geometric deep learning have introduced various neural networks to operate over data that lie on Riemannian manifolds. Such networks are often necessary to learn well over graphs with a hierarchical structure or to learn…

Machine Learning · Statistics 2023-10-17 Isay Katsman , Eric Ming Chen , Sidhanth Holalkere , Anna Asch , Aaron Lou , Ser-Nam Lim , Christopher De Sa

Multi-domain graph pre-training integrates knowledge from diverse domains to enhance performance in the target domains, which is crucial for building graph foundation models. Despite initial success, existing solutions often fall short of…

Machine Learning · Computer Science 2026-03-03 Li Sun , Zhenhao Huang , Silei Chen , Lanxu Yang , Junda Ye , Sen Su , Philip S. Yu

Despite significant advances in the field of deep learning in ap-plications to various areas, an explanation of the learning pro-cess of neural network models remains an important open ques-tion. The purpose of this paper is a comprehensive…

Machine Learning · Computer Science 2023-06-07 German Magai

In recent years, manifold learning has become increasingly popular as a tool for performing non-linear dimensionality reduction. This has led to the development of numerous algorithms of varying degrees of complexity that aim to recover man…

Machine Learning · Statistics 2013-06-03 Dominique Perraul-Joncas , Marina Meila

Despite significant advances in the field of deep learning in applications to various fields, explaining the inner processes of deep learning models remains an important and open question. The purpose of this article is to describe and…

Machine Learning · Computer Science 2022-04-20 German Magai , Anton Ayzenberg

Synthesizing geometrical shapes from human brain activities is an interesting and meaningful but very challenging topic. Recently, the advancements of deep generative models like Generative Adversarial Networks (GANs) have supported the…

Signal Processing · Electrical Eng. & Systems 2020-03-02 Xiang Zhang , Xiaocong Chen , Manqing Dong , Huan Liu , Chang Ge , Lina Yao