English
Related papers

Related papers: Self-organized manifold learning and heuristic cha…

200 papers

The linear representation hypothesis states that language models (LMs) encode concepts as directions in their latent space, forming organized, multidimensional manifolds. Prior work has largely focused on identifying specific geometries for…

Artificial Intelligence · Computer Science 2026-04-08 Federico Tiblias , Irina Bigoulaeva , Jingcheng Niu , Simone Balloccu , Iryna Gurevych

Conventional machine learning (ML) relies heavily on manual design from machine learning experts to decide learning tasks, data, models, optimization algorithms, and evaluation metrics, which is labor-intensive, time-consuming, and cannot…

Machine Learning · Computer Science 2022-01-11 Wenwu Zhu , Xin Wang , Pengtao Xie

Multidimensional scaling is an important dimension reduction tool in statistics and machine learning. Yet few theoretical results characterizing its statistical performance exist, not to mention any in high dimensions. By considering a…

Methodology · Statistics 2022-03-30 Xiucai Ding , Qiang Sun

Recently, transfer subspace learning based approaches have shown to be a valid alternative to unsupervised subspace clustering and temporal data clustering for human motion segmentation (HMS). These approaches leverage prior knowledge from…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Mariella Dimiccoli , Lluís Garrido , Guillem Rodriguez-Corominas , Herwig Wendt

Multidimensional scaling (MDS) is the act of embedding proximity information about a set of $n$ objects in $d$-dimensional Euclidean space. As originally conceived by the psychometric community, MDS was concerned with embedding a fixed set…

Machine Learning · Statistics 2024-12-12 Michael W. Trosset , Carey E. Priebe

Most modern supervised statistical/machine learning (ML) methods are explicitly designed to solve prediction problems very well. Achieving this goal does not imply that these methods automatically deliver good estimators of causal…

Algorithms proposed for solving high-dimensional optimization problems with no derivative information frequently encounter the "curse of dimensionality," becoming ineffective as the dimension of the parameter space grows. One feature of a…

Optimization and Control · Mathematics 2020-04-28 Dmitry Pozharskiy , Noah J. Wichrowski , Andrew B. Duncan , Grigorios A. Pavliotis , Ioannis G. Kevrekidis

Modern information processing relies on the axiom that high-dimensional data lie near low-dimensional geometric structures. This paper revisits the problem of data-driven learning of these geometric structures and puts forth two new…

Machine Learning · Statistics 2018-03-06 Tong Wu , Waheed U. Bajwa

Dynamical Systems (DS) are an effective and powerful means of shaping high-level policies for robotics control. They provide robust and reactive control while ensuring the stability of the driving vector field. The increasing complexity of…

Robotics · Computer Science 2024-03-19 Bernardo Fichera , Aude Billard

Manifolds discovered by machine learning models provide a compact representation of the underlying data. Geodesics on these manifolds define locally length-minimising curves and provide a notion of distance, which are key for reduced-order…

Machine Learning · Computer Science 2023-05-25 Daniel Kelshaw , Luca Magri

There are a variety of choices to be made in both computer algebra systems (CASs) and satisfiability modulo theory (SMT) solvers which can impact performance without affecting mathematical correctness. Such choices are candidates for…

Symbolic Computation · Computer Science 2021-06-17 Dorian Florescu , Matthew England

Multidimensional Scaling (MDS) is a classic technique that seeks vectorial representations for data points, given the pairwise distances between them. However, in recent years, data are usually collected from diverse sources or have…

Computer Vision and Pattern Recognition · Computer Science 2017-08-29 Song Bai , Xiang Bai , Longin Jan Latecki , Qi Tian

Machine learning has recently been widely adopted to address the managerial decision making problems, in which the decision maker needs to be able to interpret the contributions of individual attributes in an explicit form. However, there…

Machine Learning · Computer Science 2019-10-28 Mengzhuo Guo , Qingpeng Zhang , Xiuwu Liao , Frank Youhua Chen , Daniel Dajun Zeng

Automata learning has been successfully applied in the verification of hardware and software. The size of the automaton model learned is a bottleneck for scalability, and hence optimizations that enable learning of compact representations…

Formal Languages and Automata Theory · Computer Science 2019-11-04 Gerco van Heerdt , Matteo Sammartino , Alexandra Silva

Subspace segmentation or subspace learning is a challenging and complicated task in machine learning. This paper builds a primary frame and solid theoretical bases for the minimal subspace segmentation (MSS) of finite samples. Existence and…

Machine Learning · Computer Science 2019-09-10 Zhenyue Zhang , Yuqing Xia

The matching of 3D shapes has been extensively studied for shapes represented as surface meshes, as well as for shapes represented as point clouds. While point clouds are a common representation of raw real-world 3D data (e.g. from laser…

Computer Vision and Pattern Recognition · Computer Science 2026-05-05 Dongliang Cao , Florian Bernard

Metric Multidimensional scaling (MDS) is a classical method for generating meaningful (non-linear) low-dimensional embeddings of high-dimensional data. MDS has a long history in the statistics, machine learning, and graph drawing…

Machine Learning · Computer Science 2021-09-24 Erik Demaine , Adam Hesterberg , Frederic Koehler , Jayson Lynch , John Urschel

A common belief in high-dimensional data analysis is that data are concentrated on a low-dimensional manifold. This motivates simultaneous dimension reduction and regression on manifolds. We provide an algorithm for learning gradients on…

Statistics Theory · Mathematics 2010-02-24 Sayan Mukherjee , Qiang Wu , Ding-Xuan Zhou

In order to learn quickly with few samples, meta-learning utilizes prior knowledge learned from previous tasks. However, a critical challenge in meta-learning is task uncertainty and heterogeneity, which can not be handled via globally…

Machine Learning · Computer Science 2019-11-19 Huaxiu Yao , Ying Wei , Junzhou Huang , Zhenhui Li

The lack of proper class discrimination among the Hyperspectral (HS) data points poses a potential challenge in HS classification. To address this issue, this paper proposes an optimal geometry-aware transformation for enhancing the…

Machine Learning · Computer Science 2018-07-10 Ramanarayan Mohanty , S L Happy , Aurobinda Routray