English
Related papers

Related papers: Position: Beyond Euclidean -- Foundation Models Sh…

200 papers

Autoformalization involves automatically translating informal math into formal theorems and proofs that are machine-verifiable. Euclidean geometry provides an interesting and controllable domain for studying autoformalization. In this…

Machine Learning · Computer Science 2024-05-28 Logan Murphy , Kaiyu Yang , Jialiang Sun , Zhaoyu Li , Anima Anandkumar , Xujie Si

Understanding the representations of different languages in multilingual language models is essential for comprehending their cross-lingual properties, predicting their performance on downstream tasks, and identifying any biases across…

Computation and Language · Computer Science 2023-05-16 Cheril Shah , Yashashree Chandak , Manan Suri

Spatial models of preference, in the form of vector embeddings, are learned by many deep learning and multiagent systems, including recommender systems. Often these models are assumed to approximate a Euclidean structure, where an…

Artificial Intelligence · Computer Science 2023-05-16 Luke Thorburn , Maria Polukarov , Carmine Ventre

We develop a rigorous theoretical framework for principal manifold estimation that recovers a latent low-dimensional manifold from a point cloud observed in a high-dimensional ambient space. Our framework accommodates manifolds with…

Statistics Theory · Mathematics 2026-04-07 Kun Meng , Christopher Perez

The recently proposed Broximal Point Method (BPM) [Gruntkowska et al., 2025] offers an idealized optimization framework based on iteratively minimizing the objective function over norm balls centered at the current iterate. It enjoys…

Optimization and Control · Mathematics 2025-10-02 Kaja Gruntkowska , Peter Richtárik

While the exploration for embodied AI has spanned multiple decades, it remains a persistent challenge to endow agents with human-level intelligence, including perception, learning, reasoning, decision-making, control, and generalization…

Robotics · Computer Science 2024-02-07 Zhiyuan Xu , Kun Wu , Junjie Wen , Jinming Li , Ning Liu , Zhengping Che , Jian Tang

In this paper, we consider the problem of fast and efficient indexing techniques for sequences evolving in non-Euclidean spaces. This problem has several applications in the areas of human activity analysis, where there is a need to perform…

Computer Vision and Pattern Recognition · Computer Science 2015-02-17 Rushil Anirudh , Pavan Turaga

This position paper proposes a systematic approach towards developing a framework to help select the most effective embedding models for natural language processing (NLP) tasks, addressing the challenge posed by the proliferation of both…

Computation and Language · Computer Science 2024-09-02 Vivek Khetan

Various topological techniques and tools have been applied to neural networks in terms of network complexity, explainability, and performance. One fundamental assumption of this line of research is the existence of a global (Euclidean)…

Machine Learning · Computer Science 2022-01-02 Dongfang Zhao

Geometric analyses of large language model (LLM) representations reveal structured variation across depth but remain fundamentally correlational with respect to token prediction formation. Meanwhile, causal interventions expose…

Machine Learning · Computer Science 2026-05-27 Shahar Haim , Daniel C McNamee

Large language models (LLMs) have achieved remarkable success and demonstrated superior performance across various tasks, including natural language processing (NLP), weather forecasting, biological protein folding, text generation, and…

Artificial Intelligence · Computer Science 2025-12-09 Sarang Patil , Zeyong Zhang , Yiran Huang , Tengfei Ma , Mengjia Xu

Euclidean deep learning is often inadequate for addressing real-world signals where the representation space is irregular and curved with complex topologies. Interpreting the geometric properties of such feature spaces has become paramount…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Ramzan Basheer , Deepak Mishra

Graphs are ubiquitous, and learning on graphs has become a cornerstone in artificial intelligence and data mining communities. Unlike pixel grids in images or sequential structures in language, graphs exhibit a typical non-Euclidean…

Machine Learning · Computer Science 2026-02-12 Li Sun , Qiqi Wan , Suyang Zhou , Zhenhao Huang , Philip S. Yu

In machine learning, data is usually represented in a (flat) Euclidean space where distances between points are along straight lines. Researchers have recently considered more exotic (non-Euclidean) Riemannian manifolds such as hyperbolic…

Machine Learning · Computer Science 2021-01-12 Marc T. Law , Jos Stam

Backward compatible representation learning enables updated models to integrate seamlessly with existing ones, avoiding to reprocess stored data. Despite recent advances, existing compatibility approaches in Euclidean space neglect the…

Machine Learning · Computer Science 2025-06-09 Ngoc Bui , Menglin Yang , Runjin Chen , Leonardo Neves , Mingxuan Ju , Rex Ying , Neil Shah , Tong Zhao

Protein engineering is experiencing a paradigmatic shift through the integration of geometric deep learning into computational design workflows. While traditional strategies, such as rational design and directed evolution, have enabled…

In robotic tasks, changes in reference frames typically do not influence the underlying physical properties of the system, which has been known as invariance of physical laws.These changes, which preserve distance, encompass isometric…

Machine Learning · Computer Science 2023-07-18 Linfeng Zhao , Owen Howell , Jung Yeon Park , Xupeng Zhu , Robin Walters , Lawson L. S. Wong

The proliferation of Large Language Models (LLMs) has s fueled a shift in robot learning from automation towards general embodied Artificial Intelligence (AI). Adopting foundation models together with traditional learning methods to robot…

Robotics · Computer Science 2023-11-27 Xuan Xiao , Jiahang Liu , Zhipeng Wang , Yanmin Zhou , Yong Qi , Qian Cheng , Bin He , Shuo Jiang

Various non-trivial spaces are becoming popular for embedding structured data such as graphs, texts, or images. Following spherical and hyperbolic spaces, more general product spaces have been proposed. However, searching for the best…

Machine Learning · Computer Science 2022-04-11 Kirill Shevkunov , Liudmila Prokhorenkova

Recent studies have experimentally shown that we can achieve in non-Euclidean metric space effective and efficient graph embedding, which aims to obtain the vertices' representations reflecting the graph's structure in the metric space.…

Machine Learning · Statistics 2023-05-16 Atsushi Suzuki , Atsushi Nitanda , Taiji Suzuki , Jing Wang , Feng Tian , Kenji Yamanishi