English
Related papers

Related papers: An interpretable neural network-based non-proporti…

200 papers

We develop a nonparametric Bayesian modeling approach to ordinal regression based on priors placed directly on the discrete distribution of the ordinal responses. The prior probability models are built from a structured mixture of…

Methodology · Statistics 2024-03-25 Jizhou Kang , Athanasios Kottas

Random reshuffling techniques are prevalent in large-scale applications, such as training neural networks. While the convergence and acceleration effects of random reshuffling-type methods are fairly well understood in the smooth setting,…

Optimization and Control · Mathematics 2025-07-29 Junwen Qiu , Xiao Li , Andre Milzarek

We propose neural network operator inference (NN-OpInf): a structure-preserving, composable, and minimally restrictive operator inference framework for the non-intrusive reduced-order modeling of dynamical systems. The approach learns…

Machine Learning · Computer Science 2026-03-10 Eric Parish , Anthony Gruber , Patrick Blonigan , Irina Tezaur

Control of nonlinear distributed parameter systems (DPS) under uncertainty is a meaningful task for many industrial processes. However, both intrinsic uncertainty and high dimensionality of DPS require intensive computations, while…

Optimization and Control · Mathematics 2024-10-17 Min Tao , Ioannis Zacharopoulos , Constantinos Theodoropoulos

We introduce a novel interpretable tree based algorithm for prediction in a regression setting. Our motivation is to estimate the unknown regression function from a functional decomposition perspective in which the functional components…

Machine Learning · Statistics 2023-08-04 Munir Hiabu , Enno Mammen , Joseph T. Meyer

We present a novel implementation of conditional Long Short-Term Memory Recurrent Neural Networks that successfully predict the spectral evolution of a pulse in nonlinear periodically-poled waveguides. The developed networks offer large…

Optics · Physics 2024-02-05 Simone Lauria , Mohammed F. Saleh

Robust Ordinal Regression (ROR) is a way of dealing with Multiple Criteria Decision Aiding (MCDA), by considering all sets of parameters of an assumed preference model, that are compatible with preference information given by the Decision…

Optimization and Control · Mathematics 2012-06-28 Salvatore Corrente , Salvatore Greco , Roman Slowinski

Recent developments in diagnostic and computing technologies offer to leverage numerous forms of nonintrusive modeling approaches from data where machine learning can be used to build computationally cheap and accurate surrogate models. To…

Computational Physics · Physics 2023-02-22 Saeed Akbari , Suraj Pawar , Omer San

In the context of regressing a response $Y$ on a predictor $X$, we consider estimating the local modes of the distribution of $Y$ given $X=x$ when $X$ is prone to measurement error. We propose two nonparametric estimation methods, with one…

Methodology · Statistics 2016-10-28 Haiming Zhou , Xianzheng Huang

This paper describes three methods for carrying out non-asymptotic inference on partially identified parameters that are solutions to a class of optimization problems. Applications in which the optimization problems arise include estimation…

Methodology · Statistics 2022-12-02 Joel L. Horowitz , Sokbae Lee

Neural networks are becoming a popular tool for solving many real-world problems such as object recognition and machine translation, thanks to its exceptional performance as an end-to-end solution. However, neural networks are complex…

Machine Learning · Computer Science 2020-09-29 Guoliang Dong , Jingyi Wang , Jun Sun , Yang Zhang , Xinyu Wang , Ting Dai , Jin Song Dong , Xingen Wang

Conditional inference on arbitrary subsets of variables is a core problem in probabilistic inference with important applications such as masked language modeling and image inpainting. In recent years, the family of Any-Order Autoregressive…

Machine Learning · Computer Science 2022-10-25 Andy Shih , Dorsa Sadigh , Stefano Ermon

We present a method of parameter estimation for large class of nonlinear systems, namely those in which the state consists of output derivatives and the flow is linear in the parameter. The method, which solves for the unknown parameter by…

Systems and Control · Electrical Eng. & Systems 2024-07-16 Simon Kuang , Xinfan Lin

We consider the problem of predictive monitoring (PM), i.e., predicting at runtime future violations of a system from the current state. We work under the most realistic settings where only partial and noisy observations of the state are…

Machine Learning · Computer Science 2021-08-18 Francesca Cairoli , Luca Bortolussi , Nicola Paoletti

We reassess the use of linear models to approximate response probabilities of binary outcomes, focusing on average partial effects (APE). We confirm that linear projection parameters coincide with APEs in certain scenarios. Through…

Econometrics · Economics 2023-10-19 Kaicheng Chen , Robert S. Martin , Jeffrey M. Wooldridge

Neural Ordinary Differential Equations (NODEs) have proven to be a powerful modeling tool for approximating (interpolation) and forecasting (extrapolation) irregularly sampled time series data. However, their performance degrades…

Machine Learning · Computer Science 2020-04-29 Hammad A. Ayyubi , Yi Yao , Ajay Divakaran

A biologically plausible low-order model (LOM) of biological neural networks is a recurrent hierarchical network of dendritic nodes/trees, spiking/nonspiking neurons, unsupervised/ supervised covariance/accumulative learning mechanisms,…

Optimization and Control · Mathematics 2020-12-15 Huachuan Wang , James Ting-Ho Lo

Unlike standard linear regression, quantile regression captures the relationship between covariates and the conditional response distribution as a whole, rather than only the relationship between covariates and the expected value of the…

Methodology · Statistics 2019-11-19 Isabella N Grabski , Roberta De Vito , Barbara E Engelhardt

We investigate the sensitivity of reduced order models (ROMs) to training data resolution as well as sampling rate. In particular, we consider proper orthogonal decomposition (POD), coupled with Galerkin projection (POD-GP), as an intrusive…

Fluid Dynamics · Physics 2020-07-15 Shady E. Ahmed , Omer San , Diana A. Bistrian , Ionel M. Navon

We introduce Post-Optimization Model Edit (POME), a new algorithm that enhances the performance of fine-tuned large language models using only their pretrained and fine-tuned checkpoints, without requiring extra data or further…

Machine Learning · Computer Science 2025-10-09 Yong Liu , Di Fu , Yang Luo , Zirui Zhu , Minhao Cheng , Cho-Jui Hsieh , Yang You