中文
相关论文

相关论文: Position: Beyond Euclidean -- Foundation Models Sh…

200 篇论文

Autoformalization involves automatically translating informal math into formal theorems and proofs that are machine-verifiable. Euclidean geometry provides an interesting and controllable domain for studying autoformalization. In this…

机器学习 · 计算机科学 2024-05-28 Logan Murphy , Kaiyu Yang , Jialiang Sun , Zhaoyu Li , Anima Anandkumar , Xujie Si

Understanding the representations of different languages in multilingual language models is essential for comprehending their cross-lingual properties, predicting their performance on downstream tasks, and identifying any biases across…

计算与语言 · 计算机科学 2023-05-16 Cheril Shah , Yashashree Chandak , Manan Suri

Spatial models of preference, in the form of vector embeddings, are learned by many deep learning and multiagent systems, including recommender systems. Often these models are assumed to approximate a Euclidean structure, where an…

人工智能 · 计算机科学 2023-05-16 Luke Thorburn , Maria Polukarov , Carmine Ventre

We develop a rigorous theoretical framework for principal manifold estimation that recovers a latent low-dimensional manifold from a point cloud observed in a high-dimensional ambient space. Our framework accommodates manifolds with…

统计理论 · 数学 2026-04-07 Kun Meng , Christopher Perez

The recently proposed Broximal Point Method (BPM) [Gruntkowska et al., 2025] offers an idealized optimization framework based on iteratively minimizing the objective function over norm balls centered at the current iterate. It enjoys…

最优化与控制 · 数学 2025-10-02 Kaja Gruntkowska , Peter Richtárik

While the exploration for embodied AI has spanned multiple decades, it remains a persistent challenge to endow agents with human-level intelligence, including perception, learning, reasoning, decision-making, control, and generalization…

机器人学 · 计算机科学 2024-02-07 Zhiyuan Xu , Kun Wu , Junjie Wen , Jinming Li , Ning Liu , Zhengping Che , Jian Tang

In this paper, we consider the problem of fast and efficient indexing techniques for sequences evolving in non-Euclidean spaces. This problem has several applications in the areas of human activity analysis, where there is a need to perform…

计算机视觉与模式识别 · 计算机科学 2015-02-17 Rushil Anirudh , Pavan Turaga

This position paper proposes a systematic approach towards developing a framework to help select the most effective embedding models for natural language processing (NLP) tasks, addressing the challenge posed by the proliferation of both…

计算与语言 · 计算机科学 2024-09-02 Vivek Khetan

Various topological techniques and tools have been applied to neural networks in terms of network complexity, explainability, and performance. One fundamental assumption of this line of research is the existence of a global (Euclidean)…

机器学习 · 计算机科学 2022-01-02 Dongfang Zhao

Geometric analyses of large language model (LLM) representations reveal structured variation across depth but remain fundamentally correlational with respect to token prediction formation. Meanwhile, causal interventions expose…

机器学习 · 计算机科学 2026-05-27 Shahar Haim , Daniel C McNamee

Large language models (LLMs) have achieved remarkable success and demonstrated superior performance across various tasks, including natural language processing (NLP), weather forecasting, biological protein folding, text generation, and…

人工智能 · 计算机科学 2025-12-09 Sarang Patil , Zeyong Zhang , Yiran Huang , Tengfei Ma , Mengjia Xu

Euclidean deep learning is often inadequate for addressing real-world signals where the representation space is irregular and curved with complex topologies. Interpreting the geometric properties of such feature spaces has become paramount…

计算机视觉与模式识别 · 计算机科学 2024-09-12 Ramzan Basheer , Deepak Mishra

Graphs are ubiquitous, and learning on graphs has become a cornerstone in artificial intelligence and data mining communities. Unlike pixel grids in images or sequential structures in language, graphs exhibit a typical non-Euclidean…

机器学习 · 计算机科学 2026-02-12 Li Sun , Qiqi Wan , Suyang Zhou , Zhenhao Huang , Philip S. Yu

In machine learning, data is usually represented in a (flat) Euclidean space where distances between points are along straight lines. Researchers have recently considered more exotic (non-Euclidean) Riemannian manifolds such as hyperbolic…

机器学习 · 计算机科学 2021-01-12 Marc T. Law , Jos Stam

Backward compatible representation learning enables updated models to integrate seamlessly with existing ones, avoiding to reprocess stored data. Despite recent advances, existing compatibility approaches in Euclidean space neglect the…

机器学习 · 计算机科学 2025-06-09 Ngoc Bui , Menglin Yang , Runjin Chen , Leonardo Neves , Mingxuan Ju , Rex Ying , Neil Shah , Tong Zhao

Protein engineering is experiencing a paradigmatic shift through the integration of geometric deep learning into computational design workflows. While traditional strategies, such as rational design and directed evolution, have enabled…

In robotic tasks, changes in reference frames typically do not influence the underlying physical properties of the system, which has been known as invariance of physical laws.These changes, which preserve distance, encompass isometric…

机器学习 · 计算机科学 2023-07-18 Linfeng Zhao , Owen Howell , Jung Yeon Park , Xupeng Zhu , Robin Walters , Lawson L. S. Wong

The proliferation of Large Language Models (LLMs) has s fueled a shift in robot learning from automation towards general embodied Artificial Intelligence (AI). Adopting foundation models together with traditional learning methods to robot…

机器人学 · 计算机科学 2023-11-27 Xuan Xiao , Jiahang Liu , Zhipeng Wang , Yanmin Zhou , Yong Qi , Qian Cheng , Bin He , Shuo Jiang

Various non-trivial spaces are becoming popular for embedding structured data such as graphs, texts, or images. Following spherical and hyperbolic spaces, more general product spaces have been proposed. However, searching for the best…

机器学习 · 计算机科学 2022-04-11 Kirill Shevkunov , Liudmila Prokhorenkova

Recent studies have experimentally shown that we can achieve in non-Euclidean metric space effective and efficient graph embedding, which aims to obtain the vertices' representations reflecting the graph's structure in the metric space.…

机器学习 · 统计学 2023-05-16 Atsushi Suzuki , Atsushi Nitanda , Taiji Suzuki , Jing Wang , Feng Tian , Kenji Yamanishi