English
Related papers

Related papers: Entropy-Guided Multiplicative Updates: KL Projecti…

200 papers

Reinforcement Learning with Verifiable Rewards (RLVR) has become the standard paradigm for LLM mathematical reasoning, with Group Relative Policy Optimization (GRPO) serving as the dominant algorithm. We identify two overlooked…

Machine Learning · Computer Science 2026-05-13 Mingxiong Lin , Zhangquan Gong , Maowen Tang , Qian Li , Chuangchuang Wang , Jian Ma , Sutian Huang , Kai Tang , Haonan Lu

Large Language Models (LLMs) as interactive agents show significant promise in Knowledge Graph Question Answering (KGQA) but often struggle with the semantic gap between natural language queries and structured knowledge graph (KG)…

Computation and Language · Computer Science 2025-10-20 Jingao Xu , Shuoyoucheng Ma , Xin Song , Rong Jiang , Hongkui Tu , Bin Zhou

We study a benchmarked risk-sensitive portfolio problem in a factor-based setting to bring together three strands of the literature: benchmarked risk-sensitive investment management, the Kuroda-Nagai change-of-measure method, and the free…

Portfolio Management · Quantitative Finance 2026-04-28 Sebastien Lleo , Wolfgang Runggaldier

Positive linear programs (LPs) model many graph and operations research problems. One can solve for a $(1+\epsilon)$-approximation for positive LPs, for any selected $\epsilon$, in polylogarithmic depth and near-linear work via variations…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-02-14 Caleb Ju , Serif Yesil , Mengyuan Sun , Chandra Chekuri , Edgar Solomonik

We propose a new constrained EM algorithm that is applicable to general constrained estimation problems. The proposed method is based on a novel framework, the `dual-homotopy framework,' which combines deterministic annealing EM with a…

Methodology · Statistics 2026-05-13 Jisoo Choi , Hee-Seok Oh

The Expectation--Maximization Maximum Likelihood (EMML) algorithm belongs to the Expectation--Maximization family and is widely used for image reconstruction problems under Poisson noise.In this paper, we reinterpret EMML as a mirror…

Optimization and Control · Mathematics 2026-04-20 Antonin Clerc , Ségolène Martin , Nicolas Papadakis , Gabriele Steidl

We propose a new regularisation strategy for the classical ensemble Kalman inversion (EKI) framework. The strategy consists of: (i) an adaptive choice for the regularisation parameter in the update formula in EKI, and (ii) criteria for the…

Numerical Analysis · Mathematics 2020-09-24 Marco Iglesias , Yuchen Yang

This work proposes a novel Alternating Direction Method of Multipliers (ADMM)-based Ensemble Kalman Inversion (EKI) algorithm for solving constrained nonlinear model predictive control (NMPC) problems. First, stage-wise nonlinear inequality…

Optimization and Control · Mathematics 2026-03-26 Ahmed Khalil , Mohamed Safwat , Efstathios Bakolas

Accelerated algorithms for maximum likelihood image reconstruction are essential for emerging applications such as 3D tomography, dynamic tomographic imaging, and other high dimensional inverse problems. In this paper, we introduce and…

Computation · Statistics 2012-01-31 Stéphane Chrétien , Alfred O. Hero

Reliable estimation of neuromuscular activation is a key enabler for adaptive and personalized control in wearable robotics. However, surface electromyography (EMG) remains difficult to deploy robustly outside laboratory settings due to…

Robotics · Computer Science 2026-04-29 Miroljub Mihailovic , Luca Tonin , Stefano Tortora , Emanuele Menegatti

Predictive inference requires balancing statistical accuracy against informational complexity, yet the choice of complexity measure is usually imposed rather than derived. We treat econometric objects as predictive rules, mappings from…

Statistics Theory · Mathematics 2026-02-16 Nicholas G. Polson , Daniel Zantedeschi

We present an update of the General-relativistic multigrid numerical (Gmunu) code, a parallelized, multi-dimensional curvilinear, general relativistic magnetohydrodynamics code with an efficient non-linear cell-centred multigrid (CCMG)…

Instrumentation and Methods for Astrophysics · Physics 2021-09-20 Patrick Chi-Kit Cheong , Alan Tsz-Lok Lam , Harry Ho-Yin Ng , Tjonnie Guang Feng Li

We introduce a practical method for incorporating equality and inequality constraints in global optimization methods based on stochastic interacting particle systems, specifically consensus-based optimization (CBO) and ensemble Kalman…

Optimization and Control · Mathematics 2021-11-05 J. A. Carrillo , C. Totzeck , U. Vaes

Entropic regularization provides a simple way to approximate linear programs whose constraints split into two or more tractable blocks. The resulting objectives are amenable to cyclic Kullback-Leibler (KL) Bregman projections, with…

Optimization and Control · Mathematics 2026-05-11 Gabriel Peyré

Data representation techniques have made a substantial contribution to advancing data processing and machine learning (ML). Improving predictive power was the focus of previous representation techniques, which unfortunately perform rather…

Machine Learning · Computer Science 2022-05-24 Qiyou Duan , Hadi Ghauch , Taejoon Kim

In this paper, we consider a prototypical convex optimization problem with multi-block variables and separable structures. By adding the Logarithmic Quadratic Proximal (LQP) regularizer with suitable proximal parameter to each of the first…

Numerical Analysis · Mathematics 2021-04-01 Jianchao Bai , Yuxue Ma , Hao Sun , Miao Zhang

Motivated by robotic trajectory optimization problems we consider the Augmented Lagrangian approach to constrained optimization. We first propose an alternative augmentation of the Lagrangian to handle the inequality case (not based on…

Optimization and Control · Mathematics 2014-12-16 Marc Toussaint

Multimodal Knowledge Graphs (MKGs) extend traditional knowledge graphs by incorporating visual and textual modalities, enabling richer and more expressive entity representations. However, existing MKGs often suffer from incompleteness,…

Artificial Intelligence · Computer Science 2026-01-07 Wei Huang , Peining Li , Meiyu Liang , Xu Hou , Junping Du , Yingxia Shao , Guanhua Ye , Wu Liu , Kangkang Lu , Yang Yu

Policy optimization methods like Group Relative Policy Optimization (GRPO) and its variants have achieved strong results on mathematical reasoning and code generation tasks. Despite extensive exploration of reward processing strategies and…

Machine Learning · Computer Science 2026-02-05 Rui Yuan , Mykola Khandoga , Vinay Kumar Sankarapu

We propose a randomized multiplicative weight update (MWU) algorithm for $\ell_{\infty}$ regression that runs in $\widetilde{O}\left(n^{2+1/22.5} \text{poly}(1/\epsilon)\right)$ time when $\omega = 2+o(1)$, improving upon the previous best…

Data Structures and Algorithms · Computer Science 2025-04-29 Deeksha Adil , Shunhua Jiang , Rasmus Kyng