English
Related papers

Related papers: Gaussian-Mixture-Model Q-Functions for Policy Iter…

200 papers

Gaussian mixture models are universal approximators in the sense that any smooth density can be approximated arbitrarily well with a Gaussian mixture model with enough components. Due to their broad expressive power, Gaussian mixture models…

Computation · Statistics 2025-02-12 Haley Colgate Kottler , Julia Lindberg , Jose Israel Rodriguez

One of the key challenges that Reinforcement Learning (RL) faces is its limited capability to adapt to a change of data distribution caused by uncertainties. This challenge arises especially in RL systems using deep neural networks as…

Machine Learning · Computer Science 2025-06-17 Amornyos Horprasert , Esa Apriaskar , Xingyu Liu , Lanlan Su , Lyudmila S. Mihaylova

The softmax cross-entropy loss function has been widely used to train deep models for various tasks. In this work, we propose a Gaussian mixture (GM) loss function for deep neural networks for visual classification. Unlike the softmax…

Computer Vision and Pattern Recognition · Computer Science 2020-11-19 Weitao Wan , Jiansheng Chen , Cheng Yu , Tong Wu , Yuanyi Zhong , Ming-Hsuan Yang

The assumption of Gaussian or Gaussian mixture data has been extensively exploited in a long series of precise performance analyses of machine learning (ML) methods, on large datasets having comparably numerous samples and features. To…

Machine Learning · Statistics 2025-03-14 Xiaoyi Mai , Zhenyu Liao

The recent trend towards Personalized Federated Learning (PFL) has garnered significant attention as it allows for the training of models that are tailored to each client while maintaining data privacy. However, current PFL techniques…

Machine Learning · Computer Science 2023-05-03 Yue Wu , Shuaicheng Zhang , Wenchao Yu , Yanchi Liu , Quanquan Gu , Dawei Zhou , Haifeng Chen , Wei Cheng

We consider the problem of estimating the conditional probability distribution of missing values given the observed ones. We propose an approach, which combines the flexibility of deep neural networks with the simplicity of Gaussian mixture…

Machine Learning · Computer Science 2020-11-20 Marcin Przewięźlikowski , Marek Śmieja , Łukasz Struski

A comparative study of the application of Gaussian Mixture Model (GMM) and Radial Basis Function (RBF) in biometric recognition of voice has been carried out and presented. The application of machine learning techniques to biometric…

Machine Learning · Computer Science 2012-11-13 Fatai Adesina Anifowose

A common way to learn and analyze statistical models is to consider operations in the model parameter space. But what happens if we optimize in the parameter space and there is no one-to-one mapping between the parameter space and the…

Machine Learning · Computer Science 2022-06-20 Pascal Mattia Esser , Frank Nielsen

We consider maximum likelihood estimation for Gaussian Mixture Models (Gmms). This task is almost invariably solved (in theory and practice) via the Expectation Maximization (EM) algorithm. EM owes its success to various factors, of which…

Machine Learning · Statistics 2018-06-04 Reshad Hosseini , Suvrit Sra

Feature selection in reinforcement learning (RL), i.e. choosing basis functions such that useful approximations of the unkown value function can be obtained, is one of the main challenges in scaling RL to real-world applications. Here we…

Artificial Intelligence · Computer Science 2012-02-01 Tobias Jung , Peter Stone

Gaussian Mixture Models (GMMs) are one of the most potent parametric density models used extensively in many applications. Flexibly-tied factorization of the covariance matrices in GMMs is a powerful approach for coping with the challenges…

Machine Learning · Computer Science 2023-11-14 Mohammad Pasande , Reshad Hosseini , Babak Nadjar Araabi

Neural networks in general, from MLPs and CNNs to attention-based Transformers, are constructed from layers of linear combinations followed by nonlinear operations such as ReLU, Sigmoid, or Softmax. Despite their strength, these…

Machine Learning · Computer Science 2025-10-09 Weiguo Lu , Gangnan Yuan , Hong-kun Zhang , Shangyang Li

Full-sampling (e.g., Q-learning) and pure-expectation (e.g., Expected Sarsa) algorithms are efficient and frequently used techniques in reinforcement learning. Q$(\sigma,\lambda)$ is the first approach unifies them with eligibility trace…

Machine Learning · Computer Science 2019-09-09 Long Yang , Yu Zhang , Qian Zheng , Pengfei Li , Gang Pan

Gaussian mixture models form a flexible and expressive parametric family of distributions that has found applications in a wide variety of applications. Unfortunately, fitting these models to data is a notoriously hard problem from a…

Statistics Theory · Mathematics 2023-01-05 Yuling Yan , Kaizheng Wang , Philippe Rigollet

We introduce inferential methods for prediction based on functional random effects in generalized functional mixed effects models. This is similar to the inference for random effects in generalized linear mixed effects models (GLMMs), but…

Methodology · Statistics 2025-01-15 Xinkai Zhou , Erjia Cui , Joseph Sartini , Ciprian Crainiceanu

Affordances are fundamental descriptors of relationships between actions, objects and effects. They provide the means whereby a robot can predict effects, recognize actions, select objects and plan its behavior according to desired goals.…

Robotics · Computer Science 2024-02-12 Pedro Osório , Alexandre Bernardino , Ruben Martinez-Cantin , José Santos-Victor

Recent state-of-the-art artificial agents lack the ability to adapt rapidly to new tasks, as they are trained exclusively for specific objectives and require massive amounts of interaction to learn new skills. Meta-reinforcement learning…

Machine Learning · Computer Science 2022-03-23 Zhenshan Bing , Lukas Knak , Fabrice Oliver Robin , Kai Huang , Alois Knoll

Successor Features (SF) combined with Generalized Policy Improvement (GPI) provide a robust framework for transfer learning in Reinforcement Learning (RL) by decoupling environment dynamics from reward functions. However, standard SF…

Machine Learning · Computer Science 2026-04-02 Ritish Shrirao , Aditya Priyadarshi , Raghuram Bharadwaj Diddigi

State-action value functions (i.e., Q-values) are ubiquitous in reinforcement learning (RL), giving rise to popular algorithms such as SARSA and Q-learning. We propose a new notion of action value defined by a Gaussian smoothed version of…

Machine Learning · Computer Science 2018-07-26 Ofir Nachum , Mohammad Norouzi , George Tucker , Dale Schuurmans

Unsupervised learning has been widely used in many real-world applications. One of the simplest and most important unsupervised learning models is the Gaussian mixture model (GMM). In this work, we study the multi-task learning problem on…

Machine Learning · Statistics 2025-12-29 Ye Tian , Haolei Weng , Lucy Xia , Yang Feng