English
Related papers

Related papers: A Novel Method of Marginalisation using Low Discre…

200 papers

We propose a deep neural network (DNN) based least distance (LD) estimator (DNN-LD) for a multivariate regression problem, addressing the limitations of the conventional methods. Due to the flexibility of a DNN structure, both linear and…

Methodology · Statistics 2024-01-09 Jungmin Shin , Seung Jun Shin , Sungwan Bang

Advection-dominated dynamical systems, characterized by partial differential equations, are found in applications ranging from weather forecasting to engineering design where accuracy and robustness are crucial. There has been significant…

Computational Physics · Physics 2020-06-29 Romit Maulik , Bethany Lusch , Prasanna Balaprakash

In this study, we combine two novel methods, the conformable double Laplace-Sumudu transform (CDLST) and the modified decomposition technique. We use the new approach called conformable double Laplace-Sumudu modified decomposition (CDLSMD)…

General Mathematics · Mathematics 2023-06-07 S. A. Ahmed , R. Saadeh , A. Qazza , T. M. Elzaki

The Laplace approximation has been one of the workhorses of Bayesian inference. It often delivers good approximations in practice despite the fact that it does not strictly take into account where the volume of posterior density lies.…

Machine Learning · Statistics 2022-03-02 Nikolaos Gianniotis

Large language models (LLMs) can memorize and reproduce training sequences verbatim -- a tendency that undermines both generalization and privacy. Existing mitigation methods apply interventions uniformly, degrading performance on the…

Machine Learning · Computer Science 2026-02-10 Xuanqi Zhang , Haoyang Shang , Xiaoxiao Li

This paper introduces the Adaptive Gradient Least Squares Progressive iterative Approximation (AdagradLSPIA), an accelerated version of the Least Squares Progressive Iterative Approximation (LSPIA) method, enhanced with adaptive…

Numerical Analysis · Mathematics 2025-05-08 Svajūnas Sajavičius

Laplace approximation (LA) and its linearized variant (LLA) enable effortless adaptation of pretrained deep neural networks to Bayesian neural networks. The generalized Gauss-Newton (GGN) approximation is typically introduced to improve…

Machine Learning · Computer Science 2022-10-25 Zhijie Deng , Feng Zhou , Jun Zhu

Stochastic gradient methods are dominant in nonconvex optimization especially for deep models but have low asymptotical convergence due to the fixed smoothness. To address this problem, we propose a simple yet effective method for improving…

Machine Learning · Computer Science 2018-05-25 Jun Li , Hongfu Liu , Bineng Zhong , Yue Wu , Yun Fu

We present a non-conforming least squares method for approximating solutions of second order elliptic problems with discontinuous coefficients. The method is based on a general Saddle Point Least Squares (SPLS) method introduced in previous…

Numerical Analysis · Mathematics 2019-04-01 Constantin Bacuta , Jacob Jacavage

In this paper, we introduce proximal gradient temporal difference learning, which provides a principled way of designing and analyzing true stochastic gradient temporal difference learning algorithms. We show how gradient TD (GTD)…

Machine Learning · Computer Science 2020-06-09 Bo Liu , Ian Gemp , Mohammad Ghavamzadeh , Ji Liu , Sridhar Mahadevan , Marek Petrik

This paper introduces a Laplace approximation to Bayesian inference in Dirichlet regression models, which can be used to analyze a set of variables on a simplex exhibiting skewness and heteroscedasticity, without having to transform the…

This paper develops methodology that provides a toolbox for routinely fitting complex models to realistic spatial point pattern data. We consider models that are based on log-Gaussian Cox processes and include local interaction in these by…

Applications · Statistics 2013-01-10 Janine B. Illian , Sigrunn H. Sørbye , Håvard Rue

Sparse Identification of Nonlinear Dynamical Systems (SINDy) is a powerful tool for the data-driven discovery of governing equations. However, it encounters challenges when modeling complex dynamical systems involving high-order derivatives…

Dynamical Systems · Mathematics 2024-11-05 Haoyang Zheng , Guang Lin

We present a convergence rate analysis for biased stochastic gradient descent (SGD), where individual gradient updates are corrupted by computation errors. We develop stochastic quadratic constraints to formulate a small linear matrix…

Optimization and Control · Mathematics 2020-03-31 Bin Hu , Peter Seiler , Laurent Lessard

Distributed lag non-linear models (DLNM) have gained popularity for modeling nonlinear lagged relationships between exposures and outcomes. When applied to spatially referenced data, these models must account for spatial dependence, a…

Generative recommendation models employing Semantic IDs (SIDs) exhibit strong potential, yet their practical deployment is bottlenecked by the high inference latency of beam-expanded autoregressive decoding. In this work, we identify that…

Information Retrieval · Computer Science 2026-05-14 Zitian Guo , Yupeng Hou , Clark Mingxuan Ju , Neil Shah , Julian McAuley

In this paper, we study the problem of multipath channel estimation for direct sequence spread spectrum signals. To resolve multipath components arriving within a short interval, we propose a new algorithm called the least-squares based…

Information Theory · Computer Science 2015-03-19 Wooseok Nam , Seung-Hyun Kong

Laplacian-P-splines (LPS) associate the P-splines smoother and the Laplace approximation in a unifying framework for fast and flexible inference under the Bayesian paradigm. Gaussian Markov field priors imposed on penalized latent variables…

Methodology · Statistics 2023-09-18 Philippe Lambert , Oswaldo Gressani

A grid-overlay finite difference method is proposed for the numerical approximation of the fractional Laplacian on arbitrary bounded domains. The method uses an unstructured simplicial mesh and an overlay uniform grid for the underlying…

Numerical Analysis · Mathematics 2024-04-08 Weizhang Huang , Jinye Shen

As one of the recently proposed algorithms for sparse system identification, $l_0$ norm constraint Least Mean Square ($l_0$-LMS) algorithm modifies the cost function of the traditional method with a penalty of tap-weight sparsity. The…

Information Theory · Computer Science 2015-06-04 Guolong Su , Jian Jin , Yuantao Gu , Jian Wang