English
Related papers

Related papers: Truncated proposals for scalable and hassle-free s…

200 papers

Spiking Neural Networks (SNNs) hold great potential to realize brain-inspired, energy-efficient computational systems. However, current SNNs still fall short in terms of multi-scale temporal processing compared to their biological…

Neural and Evolutionary Computing · Computer Science 2024-08-28 Xinyi Chen , Jibin Wu , Chenxiang Ma , Yinsong Yan , Yujie Wu , Kay Chen Tan

For high dimensional sparse linear regression problems, we propose a sequential convex relaxation algorithm (iSCRA-TL1) by solving inexactly a sequence of truncated $\ell_1$-norm regularized minimization problems, in which the working index…

Statistics Theory · Mathematics 2024-11-05 Shujun Bi , Yonghua Yang , Shaohua Pan

Simulation-based inference with neural posterior estimation (NPE) often yields overconfident and unreliable posteriors under limited simulation budgets. To address this, we propose DRO-NPE, a distributionally robust approach that replaces…

Machine Learning · Statistics 2026-05-28 William Laplante , Yuga Hikida , Charita Dellaporta , François-Xavier Briol , Ayush Bharti

Simulation-based inference has been popular for amortized Bayesian computation. It is typical to have more than one posterior approximation, from different inference algorithms, different architectures, or simply the randomness of…

Methodology · Statistics 2024-03-04 Yuling Yao , Bruno Régaldo-Saint Blancard , Justin Domke

Accurately estimating parameters of physiological models is essential to achieving reliable digital twins. For Type 1 Diabetes, this is particularly challenging due to the complexity of glucose-insulin interactions. Traditional methods…

This study presents a pipeline leveraging t-Distributed Stochastic Neighbor Embedding (t-SNE) for interpretable visualizations of chirp features across diverse outcome scenarios. The dataset, comprising chirp-based temporal, spectral, and…

Machine Learning · Computer Science 2025-08-20 Nooshin Bahador , Milad Lankarany

This paper discusses a class of thresholding-based iterative selection procedures (TISP) for model selection and shrinkage. People have long before noticed the weakness of the convex $l_1$-constraint (or the soft-thresholding) in wavelets…

Statistics Theory · Mathematics 2009-11-29 Yiyuan She

Recent deep neural networks (DNNs), such as diffusion models [1], have faced high computational demands. Thus, spiking neural networks (SNNs) have attracted lots of attention as energy-efficient neural networks. However, conventional…

Neural and Evolutionary Computing · Computer Science 2024-09-04 Dayena Jeong , Jaewoo Park , Jeonghee Jo , Jongkil Park , Jaewook Kim , Hyun Jae Jang , Suyoun Lee , Seongsik Park

Automated machine learning aims to automate the whole process of machine learning, including model configuration. In this paper, we focus on automated hyperparameter optimization (HPO) based on sequential model-based optimization (SMBO).…

Machine Learning · Computer Science 2019-09-11 Ying Wei , Peilin Zhao , Huaxiu Yao , Junzhou Huang

One of the most exciting advancements in AI over the last decade is the wide adoption of ANNs, such as DNN and CNN, in many real-world applications. However, the underlying massive amounts of computation and storage requirement greatly…

Neural and Evolutionary Computing · Computer Science 2018-03-15 Tao Liu , Lei Jiang , Yier Jin , Gang Quan , Wujie Wen

Probabilistic evaluation improves the trade-off between target coverage and OAR sparing in IMPT but remains computationally demanding. This study proposes sparse probabilistic evaluation (SPE), a computationally efficient approach…

Statistical inference of population parameters of astrophysical sources is challenging. It requires accounting for selection effects, which stem from the artificial separation between bright detected and dim undetected sources that is…

Instrumentation and Methods for Astrophysics · Physics 2022-11-10 Noemi Anau Montel , Christoph Weniger

Bayesian neural networks offer better estimates of model uncertainty compared to frequentist networks. However, inference involving Bayesian models requires multiple instantiations or sampling of the network parameters, requiring…

Neural and Evolutionary Computing · Computer Science 2024-01-30 Prabodh Katti , Anagha Nimbekar , Chen Li , Amit Acharyya , Bashir M. Al-Hashimi , Bipin Rajendran

We introduce the \textsc{Tailed-Uniform} proposal distribution for generating training simulations in simulation-based inference. Instead of sampling parameters uniformly within bounded regions, we extend the distribution beyond prior…

Instrumentation and Methods for Astrophysics · Physics 2026-01-27 Chaipat Tirapongprasert , Matthew Ho

In this paper we propose a new kind of high order numerical scheme for backward stochastic differential equations(BSDEs). Unlike the traditional $\theta$-scheme, we reduce truncation errors by taking $\theta$ carefully for every subinterval…

Numerical Analysis · Mathematics 2018-08-08 Chol-Kyu Pak , Mun-Chol Kim , Chang-Ho Rim

Many statistical problems include model parameters that are defined as the solutions to optimization sub-problems. These include classical approaches such as profile likelihood as well as modern applications involving flow networks or…

Methodology · Statistics 2025-03-17 Cheng Zeng , Yaozhi Yang , Jason Xu , Leo L Duan

Neural Processes (NPs) are a popular class of approaches for meta-learning. Similar to Gaussian Processes (GPs), NPs define distributions over functions and can estimate uncertainty in their predictions. However, unlike GPs, NPs and their…

Machine Learning · Computer Science 2023-02-09 Tung Nguyen , Aditya Grover

A wide range of problems in computational science and engineering require estimation of sparse eigenvectors for high dimensional systems. Here, we propose two variants of the Truncated Orthogonal Iteration to compute multiple leading…

Numerical Analysis · Mathematics 2021-03-26 Hexuan Liu , Aleksandr Aravkin

There are a large number of methods for solving under-determined linear inverse problem. Many of them have very high time complexity for large datasets. We propose a new method called Two-Stage Sparse Representation (TSSR) to tackle this…

Computer Vision and Pattern Recognition · Computer Science 2015-12-09 Chengyu Peng , Hong Cheng , Manchor Ko

The t-distributed Stochastic Neighbor Embedding (t-SNE) algorithm is a ubiquitously employed dimensionality reduction (DR) method. Its non-parametric nature and impressive efficacy motivated its parametric extension. It is however bounded…

Machine Learning · Computer Science 2020-10-06 Francesco Crecchi , Cyril de Bodt , Michel Verleysen , John A. Lee , Davide Bacciu