English
Related papers

Related papers: Scalable Kernel Quantile Regression: A Preconditio…

200 papers

This paper provides a local convergence analysis of the proximal augmented Lagrangian method (PALM) applied to a class of non-convex conic programming problems. Previous convergence results for PALM typically imposed assumptions such as…

Optimization and Control · Mathematics 2025-09-16 Ning Zhang , Yi Zhang

The augmented Lagrangian method (ALM) has gained tremendous popularity for its elegant theory and impressive numerical performance since it was proposed by Hestenes and Powell in 1969. It has been widely used in numerous efficient solvers…

Optimization and Control · Mathematics 2022-08-09 Shiwei Wang , Chao Ding

The development of edge computing places critical demands on energy-efficient model deployment for multiple-input multiple-output (MIMO) detection tasks. Deploying deep unfolding models such as PGD-Nets and ADMM-Nets into…

Machine Learning · Computer Science 2025-05-20 Zeyi Ren , Jingreng Lei , Yichen Jin , Ermo Hua , Qingfeng Lin , Chen Zhang , Bowen Zhou , Yik-Chung Wu

Kernel logistic regression (KLR) is a powerful classification method widely applied across diverse domains. In many real-world scenarios, indefinite kernels capture more domain-specific structural information than positive definite kernels.…

Machine Learning · Statistics 2025-10-31 Shaoxin Wang , Hanjing Yao

Parameter quantization for Large Language Models (LLMs) has attracted increasing attentions recently in reducing memory costs and improving computational efficiency. Early approaches have been widely adopted. However, the existing methods…

Machine Learning · Computer Science 2024-06-04 Haoyu Wang , Bei Liu , Hang Shao , Bo Xiao , Ke Zeng , Guanglu Wan , Yanmin Qian

Kernel ridge regression (KRR) is widely used for nonparametric regression over reproducing kernel Hilbert spaces. It offers powerful modeling capabilities at the cost of significant computational costs, which typically require $O(n^3)$…

Methodology · Statistics 2024-03-18 Xiaowu Dai , Huiying Zhong

Symmetric cone programming covers a broad class of convex optimization problems, including linear programming, second-order cone programming, and semidefinite programming. Although the augmented Lagrangian method (ALM) is well-suited for…

Optimization and Control · Mathematics 2026-03-03 Rui-Jin Zhang , Ruoyu Diao , Xin-Wei Liu , Yu-Hong Dai

This paper proposes QPALM, a proximal augmented Lagrangian method based on quadratic approximations, for solving nonlinear programming problems with weakly convex objective and constraint functions. The algorithm is constructed by…

Optimization and Control · Mathematics 2026-05-06 Yule Zhang , Benqi Liu , Xiantao Xiao , Liwei Zhang

Functional quantile regression (FQR) is a useful alternative to mean regression for functional data as it provides a comprehensive understanding of how scalar predictors influence the conditional distribution of functional responses. In…

Methodology · Statistics 2023-11-08 Yusha Liu , Meng Li , Jeffrey S. Morris

Standard conformal prediction methods guarantee marginal coverage but often produce inefficient intervals that fail to adapt to local heteroscedasticity, while recent localized approaches often struggle to maintain validity across distinct…

Methodology · Statistics 2025-12-02 Yuan Lu

Due to the possible lack of primal-dual-type error bounds, the superlinear convergence for the Karush-Kuhn-Tucker (KKT) residues of the sequence generated by augmented Lagrangian method (ALM) for solving convex composite conic programming…

Optimization and Control · Mathematics 2017-06-28 Ying Cui , Defeng Sun , Kim-Chuan Toh

The random feature (RF) approach is a well-established and efficient tool for scalable kernel methods, but existing literature has primarily focused on kernel ridge regression with random features (KRR-RF), which has limitations in handling…

Machine Learning · Statistics 2025-03-18 Caixing Wang , Xingdong Feng

The Augmented Lagragian Method (ALM) and Alternating Direction Method of Multiplier (ADMM) have been powerful optimization methods for general convex programming subject to linear constraint. We consider the convex problem whose objective…

Optimization and Control · Mathematics 2015-11-18 Canyi Lu , Huan Li , Zhouchen Lin , Shuicheng Yan

Quantum Machine Learning (QML) presents as a revolutionary approach to weather forecasting by using quantum computing to improve predictive modeling capabilities. In this study, we apply QML models, including Quantum Gated Recurrent Units…

Quantum Physics · Physics 2025-09-15 Saiyam Sakhuja , Shivanshu Siyanwal , Abhishek Tiwari , Britant , Savita Kashyap

Kernel logistic regression (KLR) is a conventional nonlinear classifier in machine learning. With the explosive growth of data size, the storage and computation of large dense kernel matrices is a major challenge in scaling KLR. Even the…

Machine Learning · Computer Science 2022-07-29 Junna Zhang , Shuisheng Zhou , Cui Fu , Feng Ye

Kernel methods, particularly kernel ridge regression (KRR), are time-proven, powerful nonparametric regression techniques known for their rich capacity, analytical simplicity, and computational tractability. The analysis of their predictive…

Statistics Theory · Mathematics 2025-09-23 Xin Bing , Xin He , Chao Wang

We present several key advances to the Physics and Equality Constrained Artificial Neural Networks (PECANN) framework, substantially improving its capacity to solve challenging partial differential equations (PDEs). Our enhancements broaden…

Machine Learning · Computer Science 2025-12-09 Qifeng Hu , Shamsulhaq Basir , Inanc Senocak

Quantum reinforcement learning (QRL) models augment classical reinforcement learning schemes with quantum-enhanced kernels. Different proposals on how to construct such models empirically show a promising performance. In particular, these…

Kernel ridge regression (KRR) is a widely used nonparametric method due to its strong theoretical guarantees and computational convenience. However, standard KRR does not distinguish between linear and nonlinear components in the signal,…

Statistics Theory · Mathematics 2026-05-13 Xin Bing , Chao Wang

The kernel trick is a widely applicable technique in machine learning domains that maps datasets that are difficult to classify into a computationally friendly feature space. As the dimension of the dataset scales, these kernel calculations…

Quantum Physics · Physics 2025-12-15 Collin C. D. Frink , Chaoyang Ti , Stephen K. Gray , Xu Han , Matthew Otten