English
Related papers

Related papers: Partially Exchangeable Networks and Architectures …

200 papers

Thanks to their universal approximation properties and new efficient training strategies, Deep Neural Networks are becoming a valuable tool for the approximation of mathematical operators. In the present work, we introduce Mesh-Informed…

Numerical Analysis · Mathematics 2023-05-08 Nicola Rares Franco , Andrea Manzoni , Paolo Zunino

Ensemble learning has proven effective in improving predictive performance and estimating uncertainty in neural networks. However, conventional ensemble methods often suffer from redundant parameter usage and computational inefficiencies…

Machine Learning · Computer Science 2024-12-23 Arnav Kharbanda , Advait Chandorkar

This paper introduces a new Convolutional Neural Network (ConvNet) architecture inspired by a class of partial differential equations (PDEs) called quasi-linear hyperbolic systems. With comparable performance on the image classification…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Yao Liu , Hang Shao , Bing Bai

Neural networks (NN) have achieved state-of-the-art performance in various applications. Unfortunately in applications where training data is insufficient, they are often prone to overfitting. One effective way to alleviate this problem is…

Machine Learning · Computer Science 2016-11-03 Hao Wang , Xingjian Shi , Dit-Yan Yeung

We propose a novel statistical model for sparse networks with overlapping community structure. The model is based on representing the graph as an exchangeable point process, and naturally generalizes existing probabilistic models with…

Methodology · Statistics 2025-02-06 Adrien Todeschini , Xenia Miscouridou , François Caron

Conventional machine learning algorithms have traditionally been designed under the assumption that input data follows a vector-based format, with an emphasis on vector-centric paradigms. However, as the demand for tasks involving set-based…

Machine Learning · Computer Science 2024-04-01 Masanari Kimura , Ryotaro Shimizu , Yuki Hirakawa , Ryosuke Goto , Yuki Saito

Motivation: Several different threads of research have been proposed for modeling and mining temporal data. On the one hand, approaches such as dynamic Bayesian networks (DBNs) provide a formal probabilistic basis to model relationships…

Machine Learning · Computer Science 2009-04-15 Debprakash Patnaik , Srivatsan Laxman , Naren Ramakrishnan

Mechanistic models of single-neuron dynamics have been extensively studied in computational neuroscience. However, identifying which models can quantitatively reproduce empirically measured data has been challenging. We propose to overcome…

In inference problems involving a multi-dimensional parameter $\theta$, it is often natural to consider decision rules that have a risk which is invariant under some group $G$ of permutations of $\theta$. We show that this implies that the…

Methodology · Statistics 2014-07-01 Erik van Zwet

Active learning optimizes the exploration of large parameter spaces by strategically selecting which experiments or simulations to conduct, thus reducing resource consumption and potentially accelerating scientific discovery. A key…

Machine Learning · Computer Science 2024-05-20 Maxim Ziatdinov

Bayesian networks are probabilistic graphical models widely employed to understand dependencies in high dimensional data, and even to facilitate causal discovery. Learning the underlying network structure, which is encoded as a directed…

Machine Learning · Statistics 2022-02-03 Jack Kuipers , Polina Suter , Giusi Moffa

The Exponential-family Random Graph Model (ERGM) is a powerful model to fit networks with complex structures. However, for dynamic valued networks whose observations are matrices of counts that evolve over time, the development of the ERGM…

Methodology · Statistics 2023-06-21 Yik Lun Kei , Yanzhen Chen , Oscar Hernan Madrid Padilla

This paper introduces Progressively Diffused Networks (PDNs) for unifying multi-scale context modeling with deep feature learning, by taking semantic image segmentation as an exemplar application. Prior neural networks, such as ResNet, tend…

Computer Vision and Pattern Recognition · Computer Science 2017-02-21 Ruimao Zhang , Wei Yang , Zhanglin Peng , Xiaogang Wang , Liang Lin

Bayesian neural networks (BNNs) allow rigorous uncertainty quantification in deep learning, but often come at a prohibitive computational cost. We propose three different innovative architectures of partial trace-class Bayesian neural…

Machine Learning · Statistics 2025-11-04 Arran Carter , Torben Sell

Deep Ensembles (DE) are a prominent approach for achieving excellent performance on key metrics such as accuracy, calibration, uncertainty estimation, and out-of-distribution detection. However, hardware limitations of real-world systems…

In the context of inferring a Bayesian network structure (directed acyclic graph, DAG for short), we devise a non-reversible continuous time Markov chain, the ``Causal Zig-Zag sampler'', that targets a probability distribution over classes…

Machine Learning · Statistics 2024-09-12 Moritz Schauer , Marcel Wienöbst

The construction of decision-theoretic Bayesian designs for realistically-complex nonlinear models is computationally challenging, as it requires the optimization of analytically intractable expected utility functions over high-dimensional…

Methodology · Statistics 2016-07-01 Antony Overstall , David Woods

Bayesian networks (BNs) are a widely used class of probabilistic graphical models employed in numerous application domains. However, inferring the network's graphical structure from data remains challenging. Bayesian structure learners…

Machine Learning · Computer Science 2025-11-19 William Zhao , Guy Van den Broeck , Benjie Wang

We consider the simulation of Bayesian statistical inverse problems governed by large-scale linear and nonlinear partial differential equations (PDEs). Markov chain Monte Carlo (MCMC) algorithms are standard techniques to solve such…

Numerical Analysis · Mathematics 2021-02-09 Harbir Antil , Howard C Elman , Akwum Onwunta , Deepanshu Verma

Bayesian neural networks (BNNs) have recently regained a significant amount of attention in the deep learning community due to the development of scalable approximate Bayesian inference techniques. There are several advantages of using a…

Machine Learning · Statistics 2023-05-02 Aliaksandr Hubin , Geir Storvik