English
Related papers

Related papers: Exponentially Weighted l_2 Regularization Strategy…

200 papers

Continuous neural representations have recently emerged as a powerful and flexible alternative to classical discretized representations of signals. However, training them to capture fine details in multi-scale signals is difficult and…

Machine Learning · Computer Science 2022-10-06 Sifan Wang , Hanwen Wang , Jacob H. Seidman , Paris Perdikaris

P-splines are penalized B-splines, in which finite order differences in coefficients are typically penalized with an $\ell_2$ norm. P-splines can be used for semiparametric regression and can include random effects to account for…

Methodology · Statistics 2018-11-01 Brian D. Segal , Michael R. Elliott , Thomas Braun , Hui Jiang

This paper studies continuous-time risk-sensitive reinforcement learning (RL) under the entropy-regularized, exploratory diffusion process formulation with the exponential-form objective. The risk-sensitive objective arises either as the…

Machine Learning · Computer Science 2026-03-17 Yanwei Jia

For some special data in reality, such as the genetic data, adjacent genes may have the similar function. Thus ensuring the smoothness between adjacent genes is highly necessary. But, in this case, the standard lasso penalty just doesn't…

Methodology · Statistics 2022-09-29 Xin Xin , Boyi Xie , Yunhai Xiao

In this paper, we tackle the task of generating Prediction Intervals (PIs) in high-risk scenarios by proposing enhancements for learning Interval Type-2 (IT2) Fuzzy Logic Systems (FLSs) to address their learning challenges. In this context,…

Machine Learning · Computer Science 2024-04-22 Ata Koklu , Yusuf Guven , Tufan Kumbasar

Reinforcement Learning (RL) is an emerging approach to control many dynamical systems for which classical control approaches are not applicable or insufficient. However, the resultant policies may not generalize to variations in the…

Robotics · Computer Science 2023-11-13 Abdel Gafoor Haddad , Mohammed B. Mohiuddin , Igor Boiko , Yahya Zweiri

Rough set theory is a well-known mathematical framework that can deal with inconsistent data by providing lower and upper approximations of concepts. A prominent property of these approximations is their granular representation: that is,…

Artificial Intelligence · Computer Science 2024-03-19 Adnan Theerens , Chris Cornelis

The rapid growth in complexity and size of modern deep neural networks (DNNs) has increased challenges related to computational costs and memory usage, spurring a growing interest in efficient model compression techniques. Previous…

Computer Vision and Pattern Recognition · Computer Science 2025-07-04 Sarthak Ketanbhai Modi , Zi Pong Lim , Shourya Kuchhal , Yushi Cao , Yupeng Cheng , Yon Shin Teo , Shang-Wei Lin , Zhiming Li

In regression problems, the use of TSK fuzzy systems is widely extended due to the precision of the obtained models. Moreover, the use of simple linear TSK models is a good choice in many real problems due to the easy understanding of the…

Machine Learning · Computer Science 2015-07-20 I. Rodríguez-Fdez , M. Mucientes , A. Bugarín

Model-free approaches for reinforcement learning (RL) and continuous control find policies based only on past states and rewards, without fitting a model of the system dynamics. They are appealing as they are general purpose and easy to…

Machine Learning · Computer Science 2018-10-09 Yasin Abbasi-Yadkori , Nevena Lazic , Csaba Szepesvari

Two-time-scale optimization is a framework introduced in Zeng et al. (2024) that abstracts a range of policy evaluation and policy optimization problems in reinforcement learning (RL). Akin to bi-level optimization under a particular type…

Optimization and Control · Mathematics 2026-01-21 Sihan Zeng , Thinh T. Doan

This note proposes a new type of Parallel Distributed Controller (PDC) for Takagi-Sugeno (TS) fuzzy models. Our idea consists of using two control terms based on state feedback, one composed of a convex combination of linear gains weighted…

Systems and Control · Electrical Eng. & Systems 2025-06-17 Leonardo Amaral Mozelli , Victor Costa da Silva Campos

The function-on-function regression model is fundamental for analyzing relationships between functional covariates and responses. However, most existing function-on-function regression methodologies assume independence between observations,…

Methodology · Statistics 2025-12-02 Ufuk Beyaztas , Han Lin Shang , Gizel Bakicierler Sezer

In genetical genomics studies, it is important to jointly analyze gene expression data and genetic variants in exploring their associations with complex traits, where the dimensionality of gene expressions and genetic variants can both be…

Methodology · Statistics 2014-04-15 Wei Lin , Rui Feng , Hongzhe Li

Expressive policies based on flow-matching have been successfully applied in reinforcement learning (RL) more recently due to their ability to model complex action distributions from offline data. These algorithms build on standard policy…

Machine Learning · Computer Science 2026-02-04 Mingxuan Li , Junzhe Zhang , Elias Bareinboim

In this work a method to regularize Cox frailty models is proposed that accommodates time-varying covariates and time-varying coefficients and is based on the full instead of the partial likelihood. A particular advantage in this framework…

Methodology · Statistics 2020-04-01 Maike Hohberg , Andreas Groll

Exponential time differencing methods is a power tool for high-performance numerical simulation of computationally challenging problems in condensed matter physics, fluid dynamics, chemical and biological physics, where mathematical models…

Numerical Analysis · Mathematics 2024-10-15 Evelina V. Permyakova , Denis S. Goldobin

Data augmentation is one of the most popular techniques for improving the robustness of neural networks. In addition to directly training the model with original samples and augmented samples, a torrent of methods regularizing the distance…

Machine Learning · Computer Science 2020-11-30 Haohan Wang , Zeyi Huang , Xindi Wu , Eric P. Xing

The most commonly used form of regularization typically involves defining the penalty function as a L1 or L2 norm. However, numerous alternative approaches remain untested in practical applications. In this study, we apply ten different…

Applications · Statistics 2024-11-20 Bartosz Uniejewski

Regularization has long been utilized to learn sparsity in deep neural network pruning. However, its role is mainly explored in the small penalty strength regime. In this work, we extend its application to a new scenario where the…

Computer Vision and Pattern Recognition · Computer Science 2021-04-07 Huan Wang , Can Qin , Yulun Zhang , Yun Fu