English
Related papers

Related papers: Automatic and Structure-Aware Sparsification of Hy…

200 papers

In this thesis we discuss machine learning methods performing automated variable selection for learning sparse predictive models. There are multiple reasons for promoting sparsity in the predictive models. By relying on a limited set of…

Machine Learning · Computer Science 2019-03-27 Magda Gregorova

Advances in machine learning methods for computer vision tasks have led to their consideration for safety-critical applications like autonomous driving. However, effectively integrating these methods into the automotive development…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Youssef Shoeb , Azarm Nowzad , Hanno Gottschalk

Causal inference in continuous-time sequential decision problems is challenged by hidden confounders. We show that, in latent state-space models with time-varying interventions, observability of the latent dynamics from observed data is…

Machine Learning · Computer Science 2026-05-14 Jennifer Wendland , Nicolas Freitag , Maik Kschischo

A central goal of neuroscience is to understand how activity in the nervous system is related to features of the external world, or to features of the nervous system itself. A common approach is to model neural responses as a weighted…

Machine Learning · Statistics 2015-05-14 Kristofer E. Bouchard

Foundation models have transformed language, vision, and time series data analysis, yet progress on dynamic predictions for physical systems remains limited. Given the complexity of physical constraints, two challenges stand out. $(i)$…

Machine Learning · Computer Science 2026-02-05 Haoran Li , Chenhan Xiao , Lihao Mai , Yang Weng , Erik Blasch

Neural differential equations are a promising new member in the neural network family. They show the potential of differential equations for time series data analysis. In this paper, the strength of the ordinary differential equation (ODE)…

Machine Learning · Computer Science 2020-05-21 Mansura Habiba , Barak A. Pearlmutter

We propose a novel machine learning framework for solving optimization problems governed by large-scale partial differential equations (PDEs) with high-dimensional random parameters. Such optimization under uncertainty (OUU) problems may be…

Optimization and Control · Mathematics 2023-06-01 Dingcheng Luo , Thomas O'Leary-Roseberry , Peng Chen , Omar Ghattas

Reinsurance optimization is a cornerstone of solvency and capital management, yet traditional approaches often rely on restrictive distributional assumptions and static program designs. We propose a hybrid framework that combines…

Econometrics · Economics 2026-03-24 Stella C. Dong

Ordinary differential equations (ODEs) are the primary means to modelling dynamical systems in many natural and engineering sciences. The number of equations required to describe a system with high heterogeneity limits our capability of…

Mathematical Software · Computer Science 2017-07-17 Andrea Vandin

Entropic Outlier Sparsification (EOS) is proposed as a robust computational strategy for the detection of data anomalies in a broad class of learning methods, including the unsupervised problems (like detection of non-Gaussian outliers in…

Methodology · Statistics 2022-06-08 Illia Horenko

Neural ordinary differential equations (neural ODEs) can effectively learn dynamical systems from time series data, but their behavior on graph-structured data remains poorly understood, especially when applied to graphs with different size…

Physics and Society · Physics 2026-02-10 Moritz Laber , Tina Eliassi-Rad , Brennan Klein

We propose a neural control method to provide guaranteed stabilization for mechanical systems using a novel negative imaginary neural ordinary differential equation (NINODE) controller. Specifically, we employ neural networks with desired…

Systems and Control · Electrical Eng. & Systems 2025-04-29 Kanghong Shi , Ruigang Wang , Ian R. Manchester

Neural networks continue to struggle with compositional generalization, and this issue is exacerbated by a lack of massive pre-training. One successful approach for developing neural systems which exhibit human-like compositional…

Artificial Intelligence · Computer Science 2024-12-19 Paul Soulos , Henry Conklin , Mattia Opper , Paul Smolensky , Jianfeng Gao , Roland Fernandez

Recent advances in convolutional neural networks(CNNs) usually come with the expense of excessive computational overhead and memory footprint. Network compression aims to alleviate this issue by training compact models with comparable…

Computer Vision and Pattern Recognition · Computer Science 2021-05-17 Xin-Yu Zhang , Kai Zhao , Taihong Xiao , Ming-Ming Cheng , Ming-Hsuan Yang

Fractional Differential Equations (FDEs) are essential tools for modelling complex systems in science and engineering. They extend the traditional concepts of differentiation and integration to non-integer orders, enabling a more precise…

Machine Learning · Computer Science 2025-03-27 C. Coelho , M. Fernanda P. Costa , L. L. Ferrás

We propose Sparse Neural Network architectures that are based on random or structured bipartite graph topologies. Sparse architectures provide compression of the models learned and speed-ups of computations, they can also surpass their…

Machine Learning · Computer Science 2017-06-20 Alfred Bourely , John Patrick Boueri , Krzysztof Choromonski

We propose a machine learning framework to accelerate numerical computations of time-dependent ODEs and PDEs. Our method is based on recasting (generalizations of) existing numerical methods as artificial neural networks, with a set of…

Numerical Analysis · Mathematics 2019-03-08 Siddhartha Mishra

Learning dynamical systems is a promising avenue for scientific discoveries. However, capturing the governing dynamics in multiple environments still remains a challenge: model-based approaches rely on the fidelity of assumptions made for a…

Machine Learning · Computer Science 2023-03-09 MoonJeong Park , Youngbin Choi , Namhoon Lee , Dongwoo Kim

Continuing advances in neural interfaces have enabled simultaneous monitoring of spiking activity from hundreds to thousands of neurons. To interpret these large-scale data, several methods have been proposed to infer latent dynamic…

Machine Learning · Computer Science 2019-08-23 Mohammad Reza Keshtkaran , Chethan Pandarinath

We introduce a flexible, scalable Bayesian inference framework for nonlinear dynamical systems characterised by distinct and hierarchical variability at the individual, group, and population levels. Our model class is a generalisation of…

Machine Learning · Statistics 2019-10-03 Geoffrey Roeder , Paul K. Grant , Andrew Phillips , Neil Dalchau , Edward Meeds