English
Related papers

Related papers: Towards Flexible Sparsity-Aware Modeling: Automati…

200 papers

Substantial research on structured sparsity has contributed to analysis of many different applications. However, there have been few Bayesian procedures among this work. Here, we develop a Bayesian model for structured sparsity that uses a…

Methodology · Statistics 2014-07-09 Barbara E. Engelhardt , Ryan P. Adams

Many machine learning applications use latent variable models to explain structure in data, whereby visible variables (= coordinates of the given datapoint) are explained as a probabilistic function of some hidden variables. Finding…

Machine Learning · Computer Science 2016-12-30 Sanjeev Arora , Rong Ge , Tengyu Ma , Andrej Risteski

Neural network compression has been an increasingly important subject, not only due to its practical relevance, but also due to its theoretical implications, as there is an explicit connection between compressibility and generalization…

Machine Learning · Statistics 2024-02-13 Yijun Wan , Melih Barsbey , Abdellatif Zaidi , Umut Simsekli

Gaussian graphical regression is a powerful means that regresses the precision matrix of a Gaussian graphical model on covariates, permitting the numbers of the response variables and covariates to far exceed the sample size. Model fitting…

Methodology · Statistics 2022-05-24 Jingfei Zhang , Yi Li

Learning-based model predictive control (MPC) can enhance control performance by correcting for model inaccuracies, enabling more precise state trajectory predictions than traditional MPC. A common approach is to model unknown residual…

Systems and Control · Electrical Eng. & Systems 2026-03-19 Lars Bartels , Amon Lahr , Andrea Carron , Melanie N. Zeilinger

Computational models providing accurate estimates of their uncertainty are crucial for risk management associated with decision making in healthcare contexts. This is especially true since many state-of-the-art systems are trained using the…

Machine Learning · Computer Science 2022-06-09 Hongshu Liu , Nabeel Seedat , Julia Ive

Data-driven Model Predictive Control (MPC), where the system model is learned from data with machine learning, has recently gained increasing interests in the control community. Gaussian Processes (GP), as a type of statistical models, are…

Systems and Control · Computer Science 2019-10-03 Truong X. Nghiem

Learning representations for graphs plays a critical role in a wide spectrum of downstream applications. In this paper, we summarize the limitations of the prior works in three folds: representation space, modeling dynamics and modeling…

Machine Learning · Computer Science 2021-04-07 Li Sun , Zhongbao Zhang , Jiawei Zhang , Feiyang Wang , Hao Peng , Sen Su , Philip S. Yu

The existing randomized algorithms need an initial estimation of the tubal rank to compute a tensor singular value decomposition. This paper proposes a new randomized fixedprecision algorithm which for a given third-order tensor and a…

Numerical Analysis · Mathematics 2024-04-09 Salman Ahmadi-Asl

This paper presents a probabilistic framework to obtain both reliable and fast uncertainty estimates for predictions with Deep Neural Networks (DNNs). Our main contribution is a practical and principled combination of DNNs with sparse…

Robotics · Computer Science 2021-09-22 Jongseok Lee , Jianxiang Feng , Matthias Humt , Marcus G. Müller , Rudolph Triebel

Current causal discovery approaches require restrictive model assumptions in the absence of interventional data to ensure structure identifiability. These assumptions often do not hold in real-world applications leading to a loss of…

Machine Learning · Statistics 2025-06-25 Anish Dhir , Ruby Sedgwick , Avinash Kori , Ben Glocker , Mark van der Wilk

Power amplifiers (PAs) are essential components in wireless communication systems, and the design of their behavioral models has been an important research topic for many years. The widely used generalized memory polynomial (GMP) model…

Signal Processing · Electrical Eng. & Systems 2025-03-04 Yuchao Wang , Yimin Wei

CANDECOMP/PARAFAC (CP) tensor factorization of incomplete data is a powerful technique for tensor completion through explicitly capturing the multilinear latent factors. The existing CP algorithms require the tensor rank to be manually…

Machine Learning · Computer Science 2015-01-22 Qibin Zhao , Liqing Zhang , Andrzej Cichocki

We develop an automated variational method for inference in models with Gaussian process (GP) priors and general likelihoods. The method supports multiple outputs and multiple latent functions and does not require detailed knowledge of the…

Machine Learning · Statistics 2018-11-06 Edwin V. Bonilla , Karl Krauth , Amir Dezfouli

Despite their high accuracy, complex neural networks demand significant computational resources, posing challenges for deployment on resource constrained devices such as mobile phones and embedded systems. Compression algorithms have been…

Machine Learning · Computer Science 2025-09-23 Ali Aghababaei-Harandi , Massih-Reza Amini

Tensor decomposition is a well-known tool for multiway data analysis. This work proposes using stochastic gradients for efficient generalized canonical polyadic (GCP) tensor decomposition of large-scale tensors. GCP tensor decomposition is…

Numerical Analysis · Mathematics 2020-11-25 Tamara G. Kolda , David Hong

Deep neural networks generalize well on unseen data though the number of parameters often far exceeds the number of training examples. Recently proposed complexity measures have provided insights to understanding the generalizability in…

Machine Learning · Computer Science 2020-05-12 Jingling Li , Yanchao Sun , Jiahao Su , Taiji Suzuki , Furong Huang

Fabrication process variations can significantly influence the performance and yield of nano-scale electronic and photonic circuits. Stochastic spectral methods have achieved great success in quantifying the impact of process variations,…

Machine Learning · Statistics 2021-06-29 Zichang He , Zheng Zhang

This paper proposes a novel method for learning highly nonlinear, multivariate functions from examples. Our method takes advantage of the property that continuous functions can be approximated by polynomials, which in turn are representable…

Machine Learning · Computer Science 2020-05-05 Sandor Szedmak , Anna Cichonska , Heli Julkunen , Tapio Pahikkala , Juho Rousu

Structured sparsity has recently emerged in statistics, machine learning and signal processing as a promising paradigm for learning in high-dimensional settings. All existing methods for learning under the assumption of structured sparsity…

Machine Learning · Statistics 2015-09-16 Nino Shervashidze , Francis Bach