English
Related papers

Related papers: A Discussion On the Validity of Manifold Learning

200 papers

Reinforcement learning (RL) algorithms have been around for decades and employed to solve various sequential decision-making problems. These algorithms however have faced great challenges when dealing with high-dimensional environments. The…

Machine Learning · Computer Science 2020-04-01 Thanh Thi Nguyen , Ngoc Duy Nguyen , Saeid Nahavandi

Massive multi-input multi-output (MIMO) in Frequency Division Duplex (FDD) mode suffers from heavy feedback overhead for Channel State Information (CSI). In this paper, a novel manifold learning-based CSI feedback framework (MLCF) is…

Information Theory · Computer Science 2024-08-27 Yandi Cao , Haifan Yin , Ziao Qin , Weidong Li , Weimin Wu , Mérouane Debbah

Continual learning is an emerging paradigm in machine learning, wherein a model is exposed in an online fashion to data from multiple different distributions (i.e. environments), and is expected to adapt to the distribution change.…

Machine Learning · Computer Science 2022-03-29 Binghui Peng , Andrej Risteski

Learning meaningful representations using deep neural networks involves designing efficient training schemes and well-structured networks. Currently, the method of stochastic gradient descent that has a momentum with dropout is one of the…

Machine Learning · Computer Science 2016-01-15 Taehoon Lee , Minsuk Choi , Sungroh Yoon

Manifold learning and dimensionality reduction techniques are ubiquitous in science and engineering, but can be computationally expensive procedures when applied to large data sets or when similarities are expensive to compute. To date,…

Machine Learning · Statistics 2017-04-05 Keith Levin , Vince Lyzinski

Reinforcement learning (RL) has gained increasing attraction in the academia and tech industry with launches to a variety of impactful applications and products. Although research is being actively conducted on many fronts (e.g., offline…

Machine Learning · Computer Science 2021-12-13 Ruiyang Xu , Zhengxing Chen

Current popular methods for Magnetic Resonance Fingerprint (MRF) recovery are bottlenecked by the heavy storage and computation requirements of a dictionary-matching (DM) step due to the growing size and complexity of the fingerprint…

Machine Learning · Computer Science 2018-11-06 Mohammad Golbabaee , Dongdong Chen , Pedro A. Gómez , Marion I. Menzel , Mike E. Davies

This paper puts forth a novel bi-linear modeling framework for data recovery via manifold-learning and sparse-approximation arguments and considers its application to dynamic magnetic-resonance imaging (dMRI). Each temporal-domain MR image…

Image and Video Processing · Electrical Eng. & Systems 2020-02-28 Gaurav N. Shetty , Konstantinos Slavakis , Abhishek Bose , Ukash Nakarmi , Gesualdo Scutari , Leslie Ying

We explore unique considerations involved in fitting ML models to data with very high precision, as is often required for science applications. We empirically compare various function approximation methods and study how they scale with…

Machine Learning · Computer Science 2023-02-01 Eric J. Michaud , Ziming Liu , Max Tegmark

Deep learning models are favored in many research and industry areas and have reached the accuracy of approximating or even surpassing human level. However they've long been considered by researchers as black-box models for their…

Machine Learning · Computer Science 2020-10-16 Xiaojian Wang , Jingyuan Wang , Ke Tang

We study the multiple manifold problem, a binary classification task modeled on applications in machine vision, in which a deep fully-connected neural network is trained to separate two low-dimensional submanifolds of the unit sphere. We…

Machine Learning · Statistics 2021-05-07 Sam Buchanan , Dar Gilboa , John Wright

Despite the popularity of the manifold hypothesis, current manifold-learning methods do not support machine learning directly on the latent $d$-dimensional data manifold, as they primarily aim to perform dimensionality reduction into…

Machine Learning · Computer Science 2025-10-21 Ryan A. Robinett , Sophia A. Madejski , Kyle Ruark , Samantha J. Riesenfeld , Lorenzo Orecchia

With the rapid advancements in autonomous driving and robot navigation, there is a growing demand for lifelong learning models capable of estimating metric (absolute) depth. Lifelong learning approaches potentially offer significant cost…

Computer Vision and Pattern Recognition · Computer Science 2023-10-16 Junjie Hu , Chenyou Fan , Liguang Zhou , Qing Gao , Honghai Liu , Tin Lun Lam

The state-of-the-art online learning approaches are only capable of learning the metric for predefined tasks. In this paper, we consider lifelong learning problem to mimic "human learning", i.e., endowing a new capability to the learned…

Machine Learning · Computer Science 2017-06-13 Gan Sun , Yang Cong , Ji Liu , Xiaowei Xu

Function approximation based on data drawn randomly from an unknown distribution is an important problem in machine learning. The manifold hypothesis assumes that the data is sampled from an unknown submanifold of a high dimensional…

Machine Learning · Computer Science 2024-08-20 H. N. Mhaskar , Ryan O'Dowd

Manifold Learning is a class of algorithms seeking a low-dimensional non-linear representation of high-dimensional data. Thus manifold learning algorithms are, at least in theory, most applicable to high-dimensional data and sample sizes to…

Machine Learning · Computer Science 2016-03-10 James McQueen , Marina Meila , Jacob VanderPlas , Zhongyue Zhang

Machine learning (ML) methods have become popular for parameter inference in cosmology, although their reliance on specific training data can cause difficulties when applied across different data sets. By reproducing and testing networks…

Cosmology and Nongalactic Astrophysics · Physics 2024-12-23 Kimeel Sooknunan , Emma Chapman , Luke Conaboy , Daniel Mortlock , Jonathan Pritchard

The current trend in developing machine learning models for reading comprehension and logical reasoning tasks is focused on improving the models' abilities to understand and utilize logical rules. This work focuses on providing a novel loss…

Computation and Language · Computer Science 2023-12-27 Jeffrey Lu , Ivan Rodriguez

Among many unsolved puzzles in theories of Deep Neural Networks (DNNs), there are three most fundamental challenges that highly demand solutions, namely, expressibility, optimisability, and generalisability. Although there have been…

Machine Learning · Computer Science 2018-11-27 Hao Shen

Large Language Models (LLMs) frequently prioritize conflicting in-context information over pre-existing parametric memory, a phenomenon often termed sycophancy or compliance. However, the mechanistic realization of this behavior remains…

Machine Learning · Computer Science 2026-02-09 Long Zhang , Fangwei Lin