English
Related papers

Related papers: Invariant multiscale neural networks for data-scar…

200 papers

There is a growing consensus that solutions to complex science and engineering problems require novel methodologies that are able to integrate traditional physics-based modeling approaches with state-of-the-art machine learning (ML)…

Computational Physics · Physics 2022-03-15 Jared Willard , Xiaowei Jia , Shaoming Xu , Michael Steinbach , Vipin Kumar

This paper demonstrates spherical convolutional neural networks (S-CNN) offer distinct advantages over conventional fully-connected networks (FCN) at estimating scalar parameters of tissue microstructure from diffusion MRI (dMRI). Such…

Image and Video Processing · Electrical Eng. & Systems 2022-08-17 Tobias Goodwin-Allcock , Jason McEwen , Robert Gray , Parashkev Nachev , Hui Zhang

We present a sparse representation of model uncertainty for Deep Neural Networks (DNNs) where the parameter posterior is approximated with an inverse formulation of the Multivariate Normal Distribution (MND), also known as the information…

Machine Learning · Computer Science 2020-06-23 Jongseok Lee , Matthias Humt , Jianxiang Feng , Rudolph Triebel

Machine learning (ML) is emerging as a transformative tool for the design of architected materials, offering properties that far surpass those achievable through lab-based trial-and-error methods. However, a major challenge in current…

Composite materials with different microstructural material symmetries are common in engineering applications where grain structure, alloying and particle/fiber packing are optimized via controlled manufacturing. In fact these…

Materials Science · Physics 2024-04-30 Ravi Patel , Cosmin Safta , Reese E. Jones

Despite the successes of deep learning in computer vision, difficulties persist in recognizing objects that have undergone group-symmetric transformations rarely seen during training$\unicode{x2013}$for example objects seen in unusual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-11 Minh Dinh , Stéphane Deny

This paper presents Mechanistic Neural Networks, a neural network design for machine learning applications in the sciences. It incorporates a new Mechanistic Block in standard architectures to explicitly learn governing differential…

Machine Learning · Computer Science 2024-02-21 Adeel Pervez , Francesco Locatello , Efstratios Gavves

Machine learning techniques are used to predict theoretical constraints such as unitarity and boundedness from below in extensions of the Standard Model. This approach has proven effective for models incorporating additional SU(2) scalar…

High Energy Physics - Phenomenology · Physics 2025-12-19 Darius Jurčiukonis

Achieving invariance to nuisance transformations is a fundamental challenge in the construction of robust and reliable vision systems. Existing approaches to invariance scale exponentially with the dimension of the family of…

Computer Vision and Pattern Recognition · Computer Science 2022-03-11 Sam Buchanan , Jingkai Yan , Ellie Haber , John Wright

In this survey, we discuss the challenges of executing scientific workflows as well as existing Machine Learning (ML) techniques to alleviate those challenges. We provide the context and motivation for applying ML to each step of the…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-10-28 Azita Nouri , Philip E. Davis , Pradeep Subedi , Manish Parashar

From early image processing to modern computational imaging, successful models and algorithms have relied on a fundamental property of natural signals: symmetry. Here symmetry refers to the invariance property of signal sets to…

Signal Processing · Electrical Eng. & Systems 2022-09-07 Dongdong Chen , Mike Davies , Matthias J. Ehrhardt , Carola-Bibiane Schönlieb , Ferdia Sherry , Julián Tachella

Machine Learning (ML) applications on healthcare can have a great impact on people's lives helping deliver better and timely treatment to those in need. At the same time, medical data is usually big and sparse requiring important…

Machine Learning · Computer Science 2018-12-27 Dianbo Liu , Nestor Sepulveda , Ming Zheng

We explore unique considerations involved in fitting ML models to data with very high precision, as is often required for science applications. We empirically compare various function approximation methods and study how they scale with…

Machine Learning · Computer Science 2023-02-01 Eric J. Michaud , Ziming Liu , Max Tegmark

The problem of high-dimensional and large-scale representation of visual data is addressed from an unsupervised learning perspective. The emphasis is put on discrete representations, where the description length can be measured in bits and…

Machine Learning · Computer Science 2019-01-25 Sohrab Ferdowsi

In this paper, we present a survey on the utility of machine learning (ML) algorithms for applications in cognitive radio networks (CRN). We start with a high-level overview of some of the major challenges in CRNs, and mention the ML…

Signal Processing · Electrical Eng. & Systems 2021-06-22 Akshay Upadhye , Purushothaman Saravanan , Shreeram Suresh Chandra , Sanjeev Gurugopinath

In recent years, the use of machine learning has become increasingly popular in the context of lattice field theories. An essential element of such theories is represented by symmetries, whose inclusion in the neural network properties can…

High Energy Physics - Lattice · Physics 2021-12-24 Srinath Bulusu , Matteo Favoni , Andreas Ipp , David I. Müller , Daniel Schuh

Invariant coordinate selection is an unsupervised multivariate data transformation useful in many contexts such as outlier detection or clustering. It is based on the simultaneous diagonalization of two affine equivariant and positive…

Methodology · Statistics 2025-03-12 Aurore Archimbaud

Recognizing symmetries in data allows for significant boosts in neural network training, which is especially important where training data are limited. In many cases, however, the exact underlying symmetry is present only in an idealized…

High Energy Physics - Phenomenology · Physics 2025-04-07 Seth Nabat , Aishik Ghosh , Edmund Witkowski , Gregor Kasieczka , Daniel Whiteson

Learning representations that capture the underlying data generating process is a key problem for data efficient and robust use of neural networks. One key property for robustness which the learned representation should capture and which…

Machine Learning · Computer Science 2022-06-24 Mathieu Chevalley , Charlotte Bunne , Andreas Krause , Stefan Bauer

Recently, with the significant developments in deep learning techniques, solving underdetermined inverse problems has become one of the major concerns in the medical imaging domain. Typical examples include undersampled magnetic resonance…

Image and Video Processing · Electrical Eng. & Systems 2020-06-29 Chang Min Hyun , Seong Hyeon Baek , Mingyu Lee , Sung Min Lee , Jin Keun Seo