English
Related papers

Related papers: Towards Modeling and Resolving Singular Parameter …

200 papers

Multiple time scale stochastic dynamical systems are ubiquitous in science and engineering, and the reduction of such systems and their models to only their slow components is often essential for scientific computation and further analysis.…

Dynamical Systems · Mathematics 2015-01-22 Carmeline J. Dsilva , Ronen Talmon , C. William Gear , Ronald R. Coifman , Ioannis G. Kevrekidis

Many generative models attempt to replicate the density of their input data. However, this approach is often undesirable, since data density is highly affected by sampling biases, noise, and artifacts. We propose a method called SUGAR…

Machine Learning · Computer Science 2018-09-10 Ofir Lindenbaum , Jay S. Stanley , Guy Wolf , Smita Krishnaswamy

The folded node is a singularity associated with loss of normal hyperbolicity in systems where mixtures of slow and fast timescales arise due to singular perturbations. Canards are special solutions that reveal a counteractive feature of…

Dynamical Systems · Mathematics 2015-06-03 Mathieu Desroches , Mike R. Jeffrey

Anomalies are samples that significantly deviate from the rest of the data and their detection plays a major role in building machine learning models that can be reliably used in applications such as data-driven design and novelty…

Machine Learning · Statistics 2023-06-19 Amin Yousefpour , Mehdi Shishehbor , Zahra Zanjani Foumani , Ramin Bostanabad

With the increase in complexity of robotic systems and the rise in non-expert users, it can be assumed that task constraints are not explicitly known. In tasks where avoiding singularity is critical to its success, this paper provides an…

Robotics · Computer Science 2019-03-27 Jeevan Manavalan , Matthew Howard

Parametrizations of data manifolds in shape spaces can be computed using the rich toolbox of Riemannian geometry. This, however, often comes with high computational costs, which raises the question if one can learn an efficient neural…

Machine Learning · Computer Science 2023-09-04 Josua Sassen , Klaus Hildebrandt , Martin Rumpf , Benedikt Wirth

Model merging has emerged as a practical paradigm for integrating multiple independently trained models into a single model without joint retraining. Previous studies have demonstrated the effectiveness of combining parameters through…

Machine Learning · Computer Science 2025-12-02 Zhikang Chen , Sen Cui , Deheng Ye , Min Zhang , Gang Niu , Yu Zhang , Masashi Sugiyama , Tingting Zhu

In the realm of robotics, numerous downstream robotics tasks leverage machine learning methods for processing, modeling, or synthesizing data. Often, this data comprises variables that inherently carry geometric constraints, such as the…

Robotics · Computer Science 2024-04-30 Noémie Jaquier , Leonel Rozo , Tamim Asfour

Learning shared structure across environments facilitates rapid learning and adaptive behavior in neural systems. This has been widely demonstrated and applied in machine learning to train models that are capable of generalizing to novel…

Machine Learning · Statistics 2025-04-09 Ayesha Vermani , Josue Nassar , Hyungju Jeon , Matthew Dowling , Il Memming Park

In order to avoid the curse of dimensionality, frequently encountered in Big Data analysis, there was a vast development in the field of linear and nonlinear dimension reduction techniques in recent years. These techniques (sometimes…

Graphics · Computer Science 2020-02-27 Barak Sober , David Levin

Data-driven modeling of human motions is ubiquitous in computer graphics and computer vision applications, such as synthesizing realistic motions or recognizing actions. Recent research has shown that such problems can be approached by…

Graphics · Computer Science 2019-08-21 He Wang , Edmond S. L. Ho , Hubert P. H. Shum , Zhanxing Zhu

This paper proposes a novel analysis for the Scaffold algorithm, a popular method for dealing with data heterogeneity in federated learning. While its convergence in deterministic settings--where local control variates mitigate client…

Machine Learning · Statistics 2025-03-11 Paul Mangold , Alain Durmus , Aymeric Dieuleveut , Eric Moulines

This paper discusses a general framework for smoothing parameter estimation for models with regular likelihoods constructed in terms of unknown smooth functions of covariates. Gaussian random effects and parametric terms may also be…

Methodology · Statistics 2016-05-10 Simon N. Wood , Natalya Pya , Benjamin Säfken

The problem of identifying geometric structure in data is a cornerstone of (unsupervised) learning. As a result, Geometric Representation Learning has been widely applied across scientific and engineering domains. In this work, we…

Machine Learning · Computer Science 2025-06-03 Imran Nasim , Melanie Weber

If the dynamics of an evolutionary differential equation system possess a low-dimensional, attracting, slow manifold, there are many advantages to using this manifold to perform computations for long term dynamics, locating features such as…

Computational Physics · Physics 2007-05-23 C. W. Gear , I. G. Kevrekidis

Commonly used optimization algorithms often show a trade-off between good generalization and fast training times. For instance, stochastic gradient descent (SGD) tends to have good generalization; however, adaptive gradient methods have…

Machine Learning · Computer Science 2023-06-14 Aditya Cowsik , Tankut Can , Paolo Glorioso

To address the challenges of long-tailed classification, researchers have proposed several approaches to reduce model bias, most of which assume that classes with few samples are weak classes. However, recent studies have shown that tail…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Yanbiao Ma , Licheng Jiao , Fang Liu , Maoji Wen , Lingling Li , Wenping Ma , Shuyuan Yang , Xu Liu , Puhua Chen

Deep learning models are known to often learn features that spuriously correlate with the class label during training but are irrelevant to the prediction task. Existing methods typically address this issue by annotating potential spurious…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Weiwei Li , Junzhuo Liu , Yuanyuan Ren , Yuchen Zheng , Yahao Liu , Wen Li

Testing procedures for assessing specific parametric model forms, or for checking the plausibility of simplifying assumptions, play a central role in the mathematical treatment of the uncertain. No certain answers are obtained by testing…

Modern neural networks have shown promise for solving partial differential equations over surfaces, often by discretizing the surface as a mesh and learning with a mesh-aware graph neural network. However, graph neural networks suffer from…

Machine Learning · Computer Science 2026-05-13 Edward Berman , Luisa Li , Jung Yeon Park , Robin Walters