English
Related papers

Related papers: An ADMM approach for multi-response regression wit…

200 papers

Interactive assessments generate sequential process data that are not well handled by conventional item response models. Existing MDP-based measurement approaches, such as the Markov decision process measurement model (MDP-MM, LaMar, 2018),…

Methodology · Statistics 2026-05-12 Wenqian Xu , Feng Ji

In this paper, we present a novel approach to reconstruct a unique image of an observed scene with widely distributed radar sensors. The problem is posed as a constrained optimization problem in which the global image which represents the…

Signal Processing · Electrical Eng. & Systems 2023-06-28 Ahmed Murtada , Ruizhi Hu , Bhavani Shankar Mysore Rama Rao , Udo Schroeder

This paper considers the problem of distributed model fitting using the alternating directions method of multipliers (ADMM). ADMM splits the learning problem into several smaller subproblems, usually by partitioning the data samples. The…

Optimization and Control · Mathematics 2022-03-04 Dinesh Krishnamoorthy , Vyacheslav Kungurtsev

We consider a randomized controlled trial between two groups. The objective is to identify a population with characteristics such that the test therapy is more effective than the control therapy. Such a population is called a subgroup. This…

Methodology · Statistics 2021-12-06 Shintaro Yuki , Kensuke Tanioka , Hiroshi Yadohisa

The alternating direction method of multipliers (ADMM) proposed by Glowinski and Marrocco is a benchmark algorithm for two-block separable convex optimization problems with linear equality constraints. It has been modified, specified, and…

Optimization and Control · Mathematics 2021-07-15 Bingsheng He , Shengjie Xu , Xiaoming Yuan

Heterogeneous panel data models that allow the coefficients to vary across individuals and/or change over time have received increasingly more attention in statistics and econometrics. This paper proposes a two-dimensional heterogeneous…

Econometrics · Economics 2021-10-22 Wei Wang , Xiaodong Yan , Yanyan Ren , Zhijie Xiao

In this paper, we propose an algorithmic framework, dubbed inertial alternating direction methods of multipliers (iADMM), for solving a class of nonconvex nonsmooth multiblock composite optimization problems with linear constraints. Our…

Optimization and Control · Mathematics 2023-01-26 Le Thi Khanh Hien , Duy Nhat Phan , Nicolas Gillis

We introduce Adversarial Policy Optimization (AdvPO), a novel solution to the pervasive issue of reward over-optimization in Reinforcement Learning from Human Feedback (RLHF) for Large Language Models (LLMs). Over-optimization occurs when a…

Machine Learning · Computer Science 2024-07-10 Xiaoying Zhang , Jean-Francois Ton , Wei Shen , Hongning Wang , Yang Liu

We propose a generalization of the linear panel quantile regression model to accommodate both \textit{sparse} and \textit{dense} parts: sparse means while the number of covariates available is large, potentially only a much smaller number…

Econometrics · Economics 2022-08-24 Alexandre Belloni , Mingli Chen , Oscar Hernan Madrid Padilla , Zixuan , Wang

The generalized alternating direction method of multipliers (ADMM) of Xiao et al. [{\tt Math. Prog. Comput., 2018}] aims at the two-block linearly constrained composite convex programming problem, in which each block is in the form of…

Optimization and Control · Mathematics 2022-04-05 Hongwu Li , Haibin Zhang , Yunhai Xiao

The alternating direction method of multipliers (ADMM) is a powerful optimization solver in machine learning. Recently, stochastic ADMM has been integrated with variance reduction methods for stochastic gradient, leading to SAG-ADMM and…

Machine Learning · Computer Science 2016-10-18 Shuai Zheng , James T. Kwok

We address the problem of solving mixed random linear equations. We have unlabeled observations coming from multiple linear regressions, and each observation corresponds to exactly one of the regression models. The goal is to learn the…

Machine Learning · Statistics 2020-08-13 Avishek Ghosh , Kannan Ramchandran

Heavy computational load for solving nonconvex problems for large-scale systems or systems with real-time demands at each sample step has been recognized as one of the reasons for preventing a wider application of nonlinear model predictive…

Optimization and Control · Mathematics 2022-04-19 Yaling Ma , Runze Gao , Li Dai , Jinxian Wu , Yuanqing Xia

In this paper, we develop a symmetric accelerated stochastic Alternating Direction Method of Multipliers (SAS-ADMM) for solving separable convex optimization problems with linear constraints. The objective function is the sum of a possibly…

Optimization and Control · Mathematics 2021-12-21 Jianchao Bai , Deren Han , Hao Sun , Hongchao Zhang

A novel functional additive model is proposed which is uniquely modified and constrained to model nonlinear interactions between a treatment indicator and a potentially large number of functional and/or scalar pretreatment covariates. The…

Methodology · Statistics 2021-01-26 Hyung Park , Eva Petkova , Thaddeus Tarpey , R. Todd Ogden

Reinforcement Learning from Human Feedback has emerged as a standard for aligning diffusion models. However, we identify a fundamental limitation in the standard DPO formulation because it relies on the Bradley-Terry model to aggregate…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Jiho Jang , Jinyoung Kim , Kyungjune Baek , Nojun Kwak

A mixed data frame (MDF) is a table collecting categorical, numerical and count observations. The use of MDF is widespread in statistics and the applications are numerous from abundance data in ecology to recommender systems. In many cases,…

Methodology · Statistics 2019-03-27 Geneviève Robin , Olga Klopp , Julie Josse , Éric Moulines , Robert Tibshirani

Statistical approaches that successfully combine multiple datasets are more powerful, efficient, and scientifically informative than separate analyses. To address variation architectures correctly and comprehensively for high-dimensional…

Methodology · Statistics 2023-09-01 Jiuzhou Wang , Eric F. Lock

Analyzing multi-way measurements with variations across one mode of the dataset is a challenge in various fields including data mining, neuroscience and chemometrics. For example, measurements may evolve over time or have unaligned time…

Machine Learning · Computer Science 2022-09-07 Marie Roald , Carla Schenker , Vince D. Calhoun , Tülay Adalı , Rasmus Bro , Jeremy E. Cohen , Evrim Acar

The multivariate regression model basically offers the analysis of a single dataset with multiple responses. However, such a single-dataset analysis often leads to unsatisfactory results. Integrative analysis is an effective method to pool…

Methodology · Statistics 2023-04-18 Shuichi Kawano , Toshikazu Fukushima , Junichi Nakagawa , Mamoru Oshiki