English
Related papers

Related papers: Extending CDCL-based Model Enumeration with Weight…

200 papers

Reinforcement learning algorithms are typically designed for discrete-time dynamics, even though the underlying real-world control systems are often continuous in time. In this paper, we study the problem of continuous-time reinforcement…

Machine Learning · Computer Science 2026-03-03 Klemens Iten , Lenart Treven , Bhavya Sukhija , Florian Dörfler , Andreas Krause

Classification and clustering algorithms have been proved to be successful individually in different contexts. Both of them have their own advantages and limitations. For instance, although classification algorithms are more powerful than…

Machine Learning · Computer Science 2017-08-30 Tanmoy Chakraborty

Clustering methods seek to partition data such that elements are more similar to elements in the same cluster than to elements in different clusters. The main challenge in this task is the lack of a unified definition of a cluster,…

Statistics Theory · Mathematics 2022-07-06 Franz Besold , Vladimir Spokoiny

The large memory requirements of deep neural networks limit their deployment and adoption on many devices. Model compression methods effectively reduce the memory requirements of these models, usually through applying transformations such…

Machine Learning · Computer Science 2017-11-15 Brandon Reagen , Udit Gupta , Robert Adolf , Michael M. Mitzenmacher , Alexander M. Rush , Gu-Yeon Wei , David Brooks

Cognitive workload is a topic of increasing interest across various fields such as health, psychology, and defense applications. In this research, we focus on classifying cognitive workload using the COLET dataset, employing a window-based…

Machine Learning · Computer Science 2025-11-04 Andrew Hallam , R G Gayathri , Glory Lee , Atul Sajjanhar

We propose Posterior Bootstrap, a set of algorithms extending Weighted Likelihood Bootstrap, to properly incorporate prior information and address the problem of model misspecification in Bayesian inference. We consider two approaches to…

Methodology · Statistics 2021-04-19 Emilia Pompe

We propose the Lasso Weighted $k$-means ($LW$-$k$-means) algorithm as a simple yet efficient sparse clustering procedure for high-dimensional data where the number of features ($p$) can be much larger compared to the number of observations…

Machine Learning · Statistics 2019-03-26 Saptarshi Chakraborty , Swagatam Das

The prohibitive sizes of Large Language Models (LLMs) today make it difficult to deploy them on memory-constrained edge devices. This work introduces $\rm CALDERA$ -- a new post-training LLM compression algorithm that harnesses the inherent…

Machine Learning · Computer Science 2024-11-05 Rajarshi Saha , Naomi Sagan , Varun Srivastava , Andrea J. Goldsmith , Mert Pilanci

Modern deep neural networks can easily overfit to biased training data containing corrupted labels or class imbalance. Sample re-weighting methods are popularly used to alleviate this data bias issue. Most current methods, however, require…

Machine Learning · Computer Science 2023-05-02 Jun Shu , Xiang Yuan , Deyu Meng , Zongben Xu

As large language models (LLMs) scale, model compression is crucial for edge deployment and accessibility. Weight-only quantization reduces model size but suffers from performance degradation at lower bit widths. Moreover, standard…

Computation and Language · Computer Science 2025-06-03 Baohao Liao , Christian Herold , Seyyed Hadi Hashemi , Stefan Vasilev , Shahram Khadivi , Christof Monz

Many model compression techniques of Deep Neural Networks (DNNs) have been investigated, including weight pruning, weight clustering and quantization, etc. Weight pruning leverages the redundancy in the number of weights in DNNs, while…

Neural and Evolutionary Computing · Computer Science 2018-11-06 Shaokai Ye , Tianyun Zhang , Kaiqi Zhang , Jiayu Li , Jiaming Xie , Yun Liang , Sijia Liu , Xue Lin , Yanzhi Wang

Recently, a number of works have studied clustering strategies that combine classical clustering algorithms and deep learning methods. These approaches follow either a sequential way, where a deep representation is learned using a deep…

Machine Learning · Computer Science 2019-06-13 Severine Affeldt , Lazhar Labiod , Mohamed Nadif

We introduce a new training paradigm that enforces interval constraints on neural network parameter space to control forgetting. Contemporary Continual Learning (CL) methods focus on training neural networks efficiently from a stream of…

Cluster-weighted factor analyzers (CWFA) are a versatile class of mixture models designed to estimate the joint distribution of a random vector that includes a response variable along with a set of explanatory variables. They are…

Methodology · Statistics 2024-11-07 Xiaoke Qin , Francesca Martella , Sanjeena Subedi

Finite mixtures of regressions with fixed covariates are a commonly used model-based clustering methodology to deal with regression data. However, they assume assignment independence, i.e. the allocation of data points to the clusters is…

Methodology · Statistics 2021-04-27 Salvatore D. Tomarchio , Paul D. McNicholas , Antonio Punzo

Weighted model counting (WMC) consists of computing the weighted sum of all satisfying assignments of a propositional formula. WMC is well-known to be #P-hard for exact solving, but admits a fully polynomial randomized approximation scheme…

Artificial Intelligence · Computer Science 2020-07-14 Ralph Abboud , İsmail İlkan Ceylan , Radoslav Dimitrov

We study weighted basic parallel processes (WBPP), a nonlinear recursive generalisation of weighted finite automata inspired from process algebra and Petri net theory. Our main result is an algorithm of 2-EXPSPACE complexity for the WBPP…

Formal Languages and Automata Theory · Computer Science 2024-07-08 Lorenzo Clemente

Speculative techniques in microarchitectures relax various dependencies in programs, which contributes to the complexity of (weak) memory models. We show using WMM, a new weak memory model, that the model becomes simpler if it includes…

Programming Languages · Computer Science 2016-06-20 Sizhuo Zhang , Arvind , Muralidaran Vijayaraghavan

We present a subset selection algorithm designed to work with arbitrary model families in a practical batch setting. In such a setting, an algorithm can sample examples one at a time but, in order to limit overhead costs, is only able to…

Machine Learning · Computer Science 2023-01-31 Gui Citovsky , Giulia DeSalvo , Sanjiv Kumar , Srikumar Ramalingam , Afshin Rostamizadeh , Yunjuan Wang

Continual learning (CL) aims to train models that can learn a sequence of tasks without forgetting previously acquired knowledge. A core challenge in CL is balancing stability -- preserving performance on old tasks -- and plasticity --…

Machine Learning · Computer Science 2025-05-14 Zhenrong Liu , Janne M. J. Huttunen , Mikko Honkala