English
Related papers

Related papers: Solving OSCAR regularization problems by proximal …

200 papers

We analyzed the performance of a biologically inspired algorithm called the Corrected Projections Algorithm (CPA) when a sparseness constraint is required to unambiguously reconstruct an observed signal using atoms from an overcomplete…

Numerical Analysis · Computer Science 2017-03-24 Gonzalo H Otazu

In this paper, we investigate a group sparse optimization problem via $\ell_{p,q}$ regularization in three aspects: theory, algorithm and application. In the theoretical aspect, by introducing a notion of group restricted eigenvalue…

Optimization and Control · Mathematics 2016-01-29 Yaohua Hu , Chong Li , Kaiwen Meng , Jing Qin , Xiaoqi Yang

In this note, we examine the aggregation of preferences achieved by the Group Policy Optimisation (GRPO) algorithm, a reinforcement learning method used to train advanced artificial intelligence models such as DeepSeek-R1-Zero and…

Machine Learning · Computer Science 2025-03-14 Milan Vojnovic , Se-Young Yun

In text classification, the problem of overfitting arises due to the high dimensionality, making regularization essential. Although classic regularizers provide sparsity, they fail to return highly accurate models. On the contrary,…

Machine Learning · Computer Science 2018-10-10 Konstantinos Skianis , Nikolaos Tziortziotis , Michalis Vazirgiannis

In this work, we explore the use of operator splitting algorithms for solving regularized structural topology optimization problems. The context is the classical structural design problems (e.g., compliance minimization and compliant…

Optimization and Control · Mathematics 2013-07-22 Cameron Talischi , Glaucio H. Paulino

This paper presents the Distributed Primal Outer Approximation (DiPOA) algorithm for solving Sparse Convex Programming (SCP) problems with separable structures, efficiently, and in a decentralized manner. The DiPOA algorithm development…

Optimization and Control · Mathematics 2022-10-14 Alireza Olama , Eduardo Camponogara , Paulo R. C. Mendes

For the inclusion problem involving two maximal monotone operators, under the metric subregularity of the composite operator, we derive the linear convergence of the generalized proximal point algorithm and several splitting algorithms,…

Optimization and Control · Mathematics 2016-09-28 Li Shen , Shaohua Pan

The Lasso has attracted the attention of many authors these last years. While many efforts have been made to prove that the Lasso behaves like a variable selection procedure at the price of strong (though unavoidable) assumptions on the…

Statistics Theory · Mathematics 2010-08-31 Pascal Massart , Caroline Meynet

We focus on solving the clustered lasso problem, which is a least squares problem with the $\ell_1$-type penalties imposed on both the coefficients and their pairwise differences to learn the group structure of the regression parameters.…

Optimization and Control · Mathematics 2019-05-02 Meixia Lin , Yong-Jin Liu , Defeng Sun , Kim-Chuan Toh

Model selection and sparse recovery are two important problems for which many regularization methods have been proposed. We study the properties of regularization methods in both problems under the unified framework of regularized least…

Statistics Theory · Mathematics 2009-09-03 Jinchi Lv , Yingying Fan

We consider the problem of minimizing an objective function that is the sum of a convex function and a group sparsity-inducing regularizer. Problems that integrate such regularizers arise in modern machine learning applications, often for…

Optimization and Control · Mathematics 2020-07-30 Frank E. Curtis , Yutong Dai , Daniel P. Robinson

The optimal statistic (OS) is a frequentist estimator for the amplitude and significance of a spatially-correlated signal in pulsar timing array (PTA) data, and it is widely used to search for the gravitational wave background (GWB).…

Instrumentation and Methods for Astrophysics · Physics 2024-01-18 Shashwat C. Sardesai , Sarah J. Vigeland , Kyle A. Gersbach , Stephen R. Taylor

Since DeepSeek-R1 popularized, Group Relative Policy Optimization (GRPO) has become the core part of training Reasoning LLMs. However, we find some deficiency that influences RL stability and inference efficiency, like zero-variance in…

Computation and Language · Computer Science 2025-09-30 Chen Li , Nazhou Liu , Kai Yang

Group Relative Policy Optimization (GRPO) is highly effective for post-training autoregressive (AR) language models, yet its direct application to diffusion large language models (dLLMs) often triggers reward collapse. We identify two…

Machine Learning · Computer Science 2026-03-10 Jianyuan Zhong , Kaibo Wang , Ding Ding , Zijin Feng , Haoli Bai , Yang Xiang , Jiacheng Sun , Qiang Xu

Assigning jobs onto identical machines with the objective to minimize the maximal load is one of the most basic problems in combinatorial optimization. Motivated by product planing and data placement, we study a natural extension called…

Data Structures and Algorithms · Computer Science 2019-09-27 Klaus Jansen , Alexandra Lassota , Marten Maack

We propose the Particle Swarm Optimization (PSO) as an alternative method for locating periodic orbits in a three--dimensional (3D) model of barred galaxies. We develop an appropriate scheme that transforms the problem of finding periodic…

Astrophysics · Physics 2009-11-10 Ch. Skokos , K. E. Parsopoulos , P. A. Patsis , M. N. Vrahatis

Reinforcement Learning with Verifiable Rewards (RLVR) has emerged as a promising approach to improve the reasoning abilities of Large Language Models (LLMs). Among RLVR algorithms, Group Relative Policy Optimization (GRPO) and its variants…

Artificial Intelligence · Computer Science 2026-04-21 Zhaokang Liao , Yingguo Gao , Yi Yang , Yongheng Hu , Jingting Ding

Model-free reinforcement learning algorithms have seen remarkable progress, but key challenges remain. Trust Region Policy Optimization (TRPO) is known for ensuring monotonic policy improvement through conservative updates within a trust…

Machine Learning · Computer Science 2025-07-29 Zhengpeng Xie , Qiang Zhang , Fan Yang , Marco Hutter , Renjing Xu

Recently, much progress has been made on particle swarm optimization (PSO). A number of works have been devoted to analyzing the convergence of the underlying algorithms. Nevertheless, in most cases, rather simplified hypotheses are used.…

Optimization and Control · Mathematics 2016-11-15 Quan Yuan , George Yin

Inverse problems and regularization theory is a central theme in contemporary signal processing, where the goal is to reconstruct an unknown signal from partial indirect, and possibly noisy, measurements of it. A now standard method for…

Optimization and Control · Mathematics 2014-12-09 Samuel Vaiter , Gabriel Peyré , Jalal M. Fadili