English
Related papers

Related papers: DisARM: An Antithetic Gradient Estimator for Binar…

200 papers

Computation methods for solving entropy-regularized reward optimization -- a class of problems widely used for fine-tuning generative models -- have advanced rapidly. Among those, Adjoint Matching (AM, Domingo-Enrich et al., 2025) has…

Machine Learning · Statistics 2026-02-17 Oswin So , Brian Karrer , Chuchu Fan , Ricky T. Q. Chen , Guan-Horng Liu

Hyperspectral imagery collected from airborne or satellite sources inevitably suffers from spectral variability, making it difficult for spectral unmixing to accurately estimate abundance maps. The classical unmixing model, the linear…

Computer Vision and Pattern Recognition · Computer Science 2019-06-25 Danfeng Hong , Naoto Yokoya , Jocelyn Chanussot , Xiao Xiang Zhu

Autoregressive models (ARMs) currently hold state-of-the-art performance in likelihood-based modeling of image and audio data. Generally, neural network based ARMs are designed to allow fast inference, but sampling from these models is…

Machine Learning · Computer Science 2020-07-09 Auke Wiggers , Emiel Hoogeboom

In contrast to the popular Cox model which presents a multiplicative covariate effect specification on the time to event hazards, the semiparametric additive risks model (ARM) offers an attractive additive specification, allowing for direct…

Methodology · Statistics 2022-03-21 Tong Wang , Dipankar Bandyopadhyay , Samiran Sinha

We address the problem of solving mixed random linear equations. We have unlabeled observations coming from multiple linear regressions, and each observation corresponds to exactly one of the regression models. The goal is to learn the…

Machine Learning · Statistics 2020-08-13 Avishek Ghosh , Kannan Ramchandran

Data augmentation is popular in the training of large neural networks; currently, however, there is no clear theoretical comparison between different algorithmic choices on how to use augmented data. In this paper, we take a step in this…

Machine Learning · Computer Science 2022-06-17 Shuo Yang , Yijun Dong , Rachel Ward , Inderjit S. Dhillon , Sujay Sanghavi , Qi Lei

While deep learning has contributed to the advancement of sensor-based Human Activity Recognition (HAR), it is usually a costly and challenging supervised task with the needs of a large amount of labeled data. To alleviate this issue,…

Human-Computer Interaction · Computer Science 2022-03-24 Jinqiang Wang , Tao Zhu , Jingyuan Gan , Liming Chen , Huansheng Ning , Yaping Wan

Although data augmentation is a powerful technique for improving the performance of image classification tasks, it is difficult to identify the best augmentation policy. The optimal augmentation policy, which is the latent variable, cannot…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Koichi Kuriyama

In this paper, we propose a novel variable selection approach in the framework of sparse high-dimensional GLARMA models. It consists in combining the estimation of the autoregressive moving average (ARMA) coefficients of these models with…

Statistics Theory · Mathematics 2019-10-14 Céline Lévy-Leduc , Sarah Ouadah , Laure Sansonnet

Entropy is ubiquitous in machine learning, but it is in general intractable to compute the entropy of the distribution of an arbitrary continuous random variable. In this paper, we propose the amortized residual denoising autoencoder…

Machine Learning · Computer Science 2020-06-11 Jae Hyun Lim , Aaron Courville , Christopher Pal , Chin-Wei Huang

We introduce \emph{Adaptive RAG Memory} (ARM), a retrieval-augmented generation (RAG) framework that replaces a static vector index with a \emph{dynamic} memory substrate governed by selective remembrance and decay. Frequently retrieved…

Information Retrieval · Computer Science 2026-01-07 Okan Bursa

We propose and analyze an Accelerated Rearrangement Method (ARM) for solving a class of nonconvex optimization problems involving two-phase composites. These problems include maximizing the (work) energy of a membrane governed by the…

Optimization and Control · Mathematics 2026-02-26 Chiu-Yen Kao , Seyyed Abbas Mohammadi , Braxton Osting

Reward modeling is central to alignment pipelines such as RLHF, RLAIF, and PPO-based policy optimization, yet its reliability is constrained by limited and heterogeneous human preference data that are expensive to collect at scale. While…

Machine Learning · Computer Science 2026-05-26 Payel Bhattacharjee , Osvaldo Simeone , Ravi Tandon

Due to the limited availability of medical data, deep learning approaches for medical image analysis tend to generalise poorly to unseen data. Augmenting data during training with random transformations has been shown to help and became a…

Image and Video Processing · Electrical Eng. & Systems 2022-10-04 Tian Xia , Pedro Sanchez , Chen Qin , Sotirios A. Tsaftaris

We derive an unbiased estimator for expectations over discrete random variables based on sampling without replacement, which reduces variance as it avoids duplicate samples. We show that our estimator can be derived as the…

Machine Learning · Computer Science 2020-02-17 Wouter Kool , Herke van Hoof , Max Welling

Deep learning has achieved remarkable success in medical image classification. However, its clinical application is often hindered by data heterogeneity caused by variations in scanner vendors, imaging protocols, and operators. Approaches…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Yaoyao Zhu , Xiuding Cai , Yingkai Wang , Yu Yao , Xu Luo , Zhongliang Fu

Standard reward models typically predict scalar scores that fail to capture the multifaceted nature of response quality in non-verifiable domains, such as creative writing or open-ended instruction following. To address this limitation, we…

Computation and Language · Computer Science 2026-02-13 Ran Xu , Tianci Liu , Zihan Dong , Tony Yu , Ilgee Hong , Carl Yang , Linjun Zhang , Tao Zhao , Haoyu Wang

Stochastic optimization algorithms using exponential moving averages of the past gradients, such as ADAM, RMSProp and AdaGrad, have been having great successes in many applications, especially in training deep neural networks. ADAM in…

Machine Learning · Computer Science 2026-01-30 Ruiqi Wang , Diego Klabjan

Automatic speech recognition systems based on deep learning are mainly trained under empirical risk minimization (ERM). Since ERM utilizes the averaged performance on the data samples regardless of a group such as healthy or dysarthric…

Audio and Speech Processing · Electrical Eng. & Systems 2023-06-28 Eungbeom Kim , Yunkee Chae , Jaeheon Sim , Kyogu Lee

With the rapid development of deep learning, automatic modulation recognition (AMR), as an important task in cognitive radio, has gradually transformed from traditional feature extraction and classification to automatic classification by…

Signal Processing · Electrical Eng. & Systems 2024-10-30 Xinjie Xu , Zhuangzhi Chen , Dongwei Xu , Huaji Zhou , Shanqing Yu , Shilian Zheng , Qi Xuan , Xiaoniu Yang