English
Related papers

Related papers: Manifold Metric: A Loss Landscape Approach for Pre…

200 papers

Manifolds discovered by machine learning models provide a compact representation of the underlying data. Geodesics on these manifolds define locally length-minimising curves and provide a notion of distance, which are key for reduced-order…

Machine Learning · Computer Science 2023-05-25 Daniel Kelshaw , Luca Magri

Equivariant neural networks have proven to be effective for tasks with known underlying symmetries. However, optimizing equivariant networks can be tricky and best training practices are less established than for standard networks. In…

Machine Learning · Computer Science 2025-11-04 YuQing Xie , Tess Smidt

Manifold learning techniques have become increasingly valuable as data continues to grow in size. By discovering a lower-dimensional representation (embedding) of the structure of a dataset, manifold learning algorithms can substantially…

Neural and Evolutionary Computing · Computer Science 2020-01-31 Andrew Lensen , Mengjie Zhang , Bing Xue

The escalating parameter counts in modern deep learning models pose a fundamental challenge to efficient training and resolution of overfitting. We address this by introducing the \emph{Mapping Networks} which replace the high dimensional…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Lord Sen , Shyamapada Mukherjee

One of the ultimate goals of Manifold Learning (ML) is to reconstruct an unknown nonlinear low-dimensional manifold embedded in a high-dimensional observation space by a given set of data points from the manifold. We derive a local lower…

Machine Learning · Computer Science 2012-12-27 Alexander V. Bernstein , Alexander P. Kuleshov

Is there a way for a designer to evaluate the performance of a given hood frame geometry without spending significant time on simulation setup? This paper seeks to address this challenge by developing a multimodal machine-learning (MMML)…

Machine Learning · Computer Science 2025-09-16 Abhishek Indupally , Satchit Ramnath

We address the problem of merging graph and feature-space information while learning a metric from structured data. Existing algorithms tackle the problem in an asymmetric way, by either extracting vectorized summaries of the graph…

Machine Learning · Computer Science 2020-02-17 Nicolo Colombo

Landslides are a recurring, widespread hazard. Preparation and mitigation efforts can be aided by a high-quality, large-scale dataset that covers global at-risk areas. Such a dataset currently does not exist and is impossible to construct…

Computer Vision and Pattern Recognition · Computer Science 2024-03-26 Savinay Nagendra , Chaopeng Shen , Daniel Kifer

Likelihood based-learning of graphical models faces challenges of computational-complexity and robustness to model mis-specification. This paper studies methods that fit parameters directly to maximize a measure of the accuracy of predicted…

Machine Learning · Computer Science 2014-07-04 Justin Domke

Machine learning (ML) models have been quite successful in predicting outcomes in many applications. However, in some cases, domain experts might have a judgment about the expected outcome that might conflict with the prediction of ML…

Machine Learning · Computer Science 2023-05-02 Hogun Park , Aly Megahed , Peifeng Yin , Yuya Ong , Pravar Mahajan , Pei Guo

In this paper, we study linear regression applied to data structured on a manifold. We assume that the data manifold is smooth and is embedded in a Euclidean space, and our objective is to reveal the impact of the data manifold's extrinsic…

Machine Learning · Computer Science 2023-07-25 Liangchen Liu , Juncai He , Richard Tsai

This paper introduces a physics-informed machine learning approach for pathloss prediction. This is achieved by including in the training phase simultaneously (i) physical dependencies between spatial loss field and (ii) measured pathloss…

Machine Learning · Statistics 2023-12-15 Steffen Limmer , Alberto Martinez Alba , Nicola Michailow

Fitness landscape analysis aims to understand the geometry of a given optimization problem in order to design more efficient search algorithms. However, there is a very little knowledge on the landscape of multiobjective problems. In this…

Neural and Evolutionary Computing · Computer Science 2012-07-19 Sébastien Verel , Arnaud Liefooghe , Clarisse Dhaenens

Diffusion models have achieved remarkable success in generative modeling. Despite more stable training, the loss of diffusion models is not indicative of absolute data-fitting quality, since its optimal value is typically not zero but…

Machine Learning · Computer Science 2026-04-17 Yixian Xu , Shengjie Luo , Liwei Wang , Di He , Chang Liu

We explore unique considerations involved in fitting ML models to data with very high precision, as is often required for science applications. We empirically compare various function approximation methods and study how they scale with…

Machine Learning · Computer Science 2023-02-01 Eric J. Michaud , Ziming Liu , Max Tegmark

The modern image search system requires semantic understanding of image, and a key yet under-addressed problem is to learn a good metric for measuring the similarity between images. While deep metric learning has yielded impressive…

Computer Vision and Pattern Recognition · Computer Science 2017-08-08 Jian Wang , Feng Zhou , Shilei Wen , Xiao Liu , Yuanqing Lin

How can one meaningfully make a measurement, if the meter does not conform to any standard and its scale expands or shrinks depending on what is measured? In the present work it is argued that current evaluation practices for…

Machine Learning · Computer Science 2023-02-24 K. Dyrland , A. S. Lundervold , P. G. L. Porta Mana

In most machine learning applications, classification accuracy is not the primary metric of interest. Binary classifiers which face class imbalance are often evaluated by the $F_\beta$ score, area under the precision-recall curve, Precision…

Machine Learning · Computer Science 2018-03-02 Alan Mackey , Xiyang Luo , Elad Eban

Reinforcement learning has proven its power on various occasions. However, its performance is not always guaranteed when system dynamics change. Instead, it largely relies on users' empirical experience. For reinforcement learning…

Machine Learning · Computer Science 2026-05-05 Jingyi Liu , Jian Guo , Eberhard Gill

Predicting the future motion of vehicles has been studied using various techniques, including stochastic policies, generative models, and regression. Recent work has shown that classification over a trajectory set, which approximates…

Machine Learning · Computer Science 2021-01-15 Freddy A. Boulton , Elena Corina Grigore , Eric M. Wolff