English
Related papers

Related papers: A Spike-and-Slab Prior for Dimension Selection in …

200 papers

Generative Flow Networks (GFlowNets), a class of generative models over discrete and structured sample spaces, have been previously applied to the problem of inferring the marginal posterior distribution over the directed acyclic graph…

Despite the abundance of methods for variable selection and accommodating spatial structure in regression models, there is little precedent for incorporating spatial dependence in covariate inclusion probabilities for regionally varying…

Methodology · Statistics 2012-09-05 Kristian Lum

The increased quantity of data has led to a soaring use of networks to model relationships between different objects, represented as nodes. Since the number of nodes can be particularly large, the network information must be summarised…

Methodology · Statistics 2024-12-03 Rémi Boutin , Pierre Latouche , Charles Bouveyron

Large language models (LLMs) are advanced AI systems applied across various domains, including NLP, information retrieval, and recommendation systems. Despite their adaptability and efficiency, LLMs have not been extensively explored for…

Artificial Intelligence · Computer Science 2025-07-08 Harshith Manjunath , Lucas Heublein , Tobias Feigl , Felix Ott

State Space Models (SSMs) are powerful tools for modeling sequential data in computer vision and time series analysis domains. However, traditional SSMs are limited by fixed, one-dimensional sequential processing, which restricts their…

Machine Learning · Computer Science 2025-04-08 Nikola Zubić , Davide Scaramuzza

We introduce a Gaussian Prototype Layer for gradient-based prototype learning and demonstrate two novel network architectures for explainable segmentation one of which relies on region proposals. Both models are evaluated on agricultural…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Michael Gerstenberger , Steffen Maaß , Peter Eisert , Sebastian Bosse

The stochastic block model (SBM) provides a popular framework for modeling community structures in networks. However, more attention has been devoted to problems concerning estimating the latent node labels and the model parameters than the…

Statistics Theory · Mathematics 2016-03-02 Y. X. Rachel Wang , Peter J. Bickel

Both linear mixed models (LMMs) and sparse regression models are widely used in genetics applications, including, recently, polygenic modeling in genome-wide association studies. These two approaches make very different assumptions, so are…

Quantitative Methods · Quantitative Biology 2012-11-16 Xiang Zhou , Peter Carbonetto , Matthew Stephens

The paper addresses joint sparsity selection in the regression coefficient matrix and the error precision (inverse covariance) matrix for high-dimensional multivariate regression models in the Bayesian paradigm. The selected sparsity…

Methodology · Statistics 2022-01-19 Srijata Samanta , Kshitij Khare , George Michailidis

We address the problem of compressed sensing using a deep generative prior model and consider both linear and learned nonlinear sensing mechanisms, where the nonlinear one involves either a fully connected neural network or a convolutional…

Machine Learning · Computer Science 2021-05-26 Vinayak Killedar , Praveen Kumar Pokala , Chandra Sekhar Seelamantula

Layer pruning has emerged as a potent approach to remove redundant layers in the pre-trained network on the purpose of reducing network size and improve computational efficiency. However, existing layer pruning methods mostly overlook the…

Machine Learning · Computer Science 2025-11-17 Yuqi Li , Yao Lu , Junhao Dong , Zeyu Dong , Chuanguang Yang , Xin Yin , Yihao Chen , Jianping Gou , Yingli Tian , Tingwen Huang

Spiking neural networks (SNNs) take inspiration from the brain to enable energy-efficient computations. Since the advent of Transformers, SNNs have struggled to compete with artificial networks on modern sequential tasks, as they inherit…

Neural and Evolutionary Computing · Computer Science 2024-01-03 Matei Ioan Stan , Oliver Rhodes

Bayesian neural networks (BNNs) require scalable sampling algorithms to approximate posterior distributions over parameters. Existing stochastic gradient Markov Chain Monte Carlo (SGMCMC) methods are highly sensitive to the choice of…

Machine Learning · Computer Science 2026-04-10 Rajit Rajpal , Benedict Leimkuhler , Yuanhao Jiang

In this work we provide an analysis of the distribution of the post-adaptation parameters of Gradient-Based Meta-Learning (GBML) methods. Previous work has noticed how, for the case of image-classification, this adaptation only takes place…

Machine Learning · Computer Science 2022-10-03 Gustaf Tegnér , Alfredo Reichlin , Hang Yin , Mårten Björkman , Danica Kragic

Training of neural networks can be reformulated in spectral space, by allowing eigenvalues and eigenvectors of the network to act as target of the optimization instead of the individual weights. Working in this setting, we show that the…

Disordered Systems and Neural Networks · Physics 2022-10-13 Lorenzo Buffoni , Enrico Civitelli , Lorenzo Giambagli , Lorenzo Chicchi , Duccio Fanelli

Nonlinear regression problem is one of the most popular and important statistical tasks. The first methods like least squares estimation go back to Gauss and Legendre. Recent models and developments in statistics and machine learning like…

Statistics Theory · Mathematics 2025-02-20 Vladimir Spokoiny

Structured pruning is widely used to compress large language models (LLMs), yet its effectiveness depends heavily on neuron importance estimation. Most existing methods estimate neuron importance from activation statistics on a single…

Machine Learning · Computer Science 2026-03-17 Xiaoyun Liu , Divya Saxena , Jiannong Cao , Yuqing Zhao , Yiying Dong , Penghui Ruan

Bayesian shrinkage methods have generated a lot of recent interest as tools for high-dimensional regression and model selection. These methods naturally facilitate tractable uncertainty quantification and incorporation of prior information.…

Methodology · Statistics 2017-04-21 Bala Rajaratnam , Doug Sparks , Kshitij Khare , Liyuan Zhang

Spiking neural networks (SNNs) have shown clear advantages over traditional artificial neural networks (ANNs) for low latency and high computational efficiency, due to their event-driven nature and sparse communication. However, the…

Neural and Evolutionary Computing · Computer Science 2020-07-03 Jibin Wu , Chenglin Xu , Daquan Zhou , Haizhou Li , Kay Chen Tan

Generalized linear models (GLMs) are popular for data-analysis in almost all quantitative sciences, but the choice of likelihood family and link function is often difficult. This motivates the search for likelihoods and links that minimize…

Methodology · Statistics 2024-03-19 Maximilian Scholz , Paul-Christian Bürkner