English
Related papers

Related papers: Integrating Random Effects in Deep Neural Networks

200 papers

Tabular datasets play a crucial role in various applications. Thus, developing efficient, effective, and widely compatible prediction algorithms for tabular data is important. Currently, two prominent model types, Gradient Boosted Decision…

Machine Learning · Computer Science 2024-07-16 Jiahuan Yan , Jintai Chen , Qianxing Wang , Danny Z. Chen , Jian Wu

Deep neural network (DNN) models have demonstrated impressive performance in various domains, yet their application in cognitive neuroscience is limited due to their lack of interpretability. In this study we employ two structurally…

Signal Processing · Electrical Eng. & Systems 2024-09-04 Murat Kucukosmanoglu , Javier O. Garcia , Justin Brooks , Kanika Bansal

This paper proposes a deep neural network (DNN)-driven framework to address the longstanding generalization challenge in adaptive filtering (AF). In contrast to traditional AF frameworks that emphasize explicit cost function design, the…

Machine Learning · Statistics 2025-08-07 Qizhen Wang , Gang Wang , Ying-Chang Liang

This paper develops a general approach for deep learning for a setting that includes nonparametric regression and classification. We perform a framework from data that fulfills a generalized Bernstein-type inequality, including independent,…

Statistics Theory · Mathematics 2025-12-30 William Kengne , Modou Wade

Machine Learning (ML) applications are proliferating in the enterprise. Relational data which are prevalent in enterprise applications are typically normalized; as a result, data has to be denormalized via primary/foreign-key joins to be…

Machine Learning · Computer Science 2021-03-22 Zhaoyue Chen , Nick Koudas , Zhe Zhang , Xiaohui Yu

Graph neural networks (GNNs) have emerged as a powerful tool for effectively mining and learning from graph-structured data, with applications spanning numerous domains. However, most research focuses on static graphs, neglecting the…

Machine Learning · Computer Science 2024-04-30 Yanping Zheng , Lu Yi , Zhewei Wei

Deep neural networks are currently among the most commonly used classifiers. Despite easily achieving very good performance, one of the best selling points of these models is their modular design - one can conveniently adapt their…

Machine Learning · Computer Science 2017-02-21 Katarzyna Janocha , Wojciech Marian Czarnecki

In natural language processing (NLP), deep neural networks (DNNs) could model complex interactions between context and have achieved impressive results on a range of NLP tasks. Prior works on feature interaction attribution mainly focus on…

Computation and Language · Computer Science 2023-10-27 Xiaolei Lu , Jianghong Ma , Haode Zhang

Deep learning has been successfully adopted in mobile edge computing (MEC) to optimize task offloading and resource allocation. However, the dynamics of edge networks raise two challenges in neural network (NN)-based optimization methods:…

Systems and Control · Electrical Eng. & Systems 2023-06-21 Xiucheng Wang , Nan Cheng , Lianhao Fu , Wei Quan , Ruijin Sun , Yilong Hui , Tom Luan , Xuemin Shen

In this study, we prove that an intrinsic low dimensionality of covariates is the main factor that determines the performance of deep neural networks (DNNs). DNNs generally provide outstanding empirical performance. Hence, numerous studies…

Machine Learning · Statistics 2020-09-18 Ryumei Nakada , Masaaki Imaizumi

This study evaluates deep neural networks for forecasting probability distributions of financial returns. 1D convolutional neural networks (CNN) and Long Short-Term Memory (LSTM) architectures are used to forecast parameters of three…

Risk Management · Quantitative Finance 2025-09-03 Jakub Michańków

Learning the optimized solution as a function of environmental parameters is effective in solving numerical optimization in real time for time-sensitive applications. Existing works of learning to optimize train deep neural networks (DNN)…

Machine Learning · Computer Science 2019-05-28 Chengjian Sun , Chenyang Yang

Nonlinear regression problem is one of the most popular and important statistical tasks. The first methods like least squares estimation go back to Gauss and Legendre. Recent models and developments in statistics and machine learning like…

Statistics Theory · Mathematics 2025-02-20 Vladimir Spokoiny

The training phases of Deep neural network~(DNN) consumes enormous processing time and energy. Compression techniques utilizing the sparsity of DNNs can effectively accelerate the inference phase of DNNs. However, it can be hardly used in…

Machine Learning · Computer Science 2018-12-17 Zhuoran Song , Ru Wang , Dongyu Ru , Hongru Huang , Zhenghao Peng , Jing Ke , Xiaoyao Liang , Li Jiang

Deep neural networks (DNNs) enable innovative applications of machine learning like image recognition, machine translation, or malware detection. However, deep learning is often criticized for its lack of robustness in adversarial settings…

Machine Learning · Computer Science 2018-03-14 Nicolas Papernot , Patrick McDaniel

Auxiliary information can be exploited in machine learning models using the paradigm of evidence based conditional inference. Multi-modal techniques in Deep Neural Networks (DNNs) can be seen as perturbing the latent feature representation…

Computer Vision and Pattern Recognition · Computer Science 2019-12-09 Dinesh Khandelwal , Suyash Agrawal , Parag Singla , Chetan Arora

Traditional neural networks (multi-layer perceptrons) have become an important tool in data science due to their success across a wide range of tasks. However, their performance is sometimes unsatisfactory, and they often require a large…

Machine Learning · Statistics 2024-12-09 Gyu Min Kim , Jeong Min Jeon

This paper investigates how various randomization techniques impact Deep Neural Networks (DNNs). Randomization, like weight noise and dropout, aids in reducing overfitting and enhancing generalization, but their interactions are poorly…

Large training datasets almost always contain examples with inaccurate or incorrect labels. Deep Neural Networks (DNNs) tend to overfit training label noise, resulting in poorer model performance in practice. To address this problem, we…

Computer Vision and Pattern Recognition · Computer Science 2022-03-01 Chen Gong , Kong Bin , Eric J. Seibel , Xin Wang , Youbing Yin , Qi Song

Real-time lightweight time series anomaly detection has become increasingly crucial in cybersecurity and many other domains. Its ability to adapt to unforeseen pattern changes and swiftly identify anomalies enables prompt responses and…

Machine Learning · Computer Science 2024-07-29 Ming-Chang Lee , Jia-Chun Lin , Sokratis Katsikas