English
Related papers

Related papers: A gradient-enhanced univariate dimension reduction…

200 papers

We evaluate uncertainty quantification (UQ) methods for deep learning applied to liquid argon time projection chamber (LArTPC) physics analysis tasks. As deep learning applications enter widespread usage among physics data analysis, neural…

High Energy Physics - Experiment · Physics 2023-11-02 Dae Heun Koh , Aashwin Mishra , Kazuhiro Terao

The presence of uncertainty in material properties and geometry of a structure is ubiquitous. The design of robust engineering structures, therefore, needs to incorporate uncertainty in the optimization process. Stochastic gradient descent…

Optimization and Control · Mathematics 2019-11-26 Subhayan De , Kurt Maute , Alireza Doostan

Uniform Discrete Diffusion Model (UDM) has recently emerged as a promising paradigm for discrete generative modeling; however, its integration with reinforcement learning remains largely unexplored. We observe that naively applying GRPO to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Jiaqi Wang , Haoge Deng , Ting Pan , Yang Liu , Chengyuan Wang , Fan Zhang , Yonggang Qi , Xinlong Wang

Assessing the quality of aleatoric uncertainty estimates from uncertainty quantification (UQ) deep learning methods is important in scientific contexts, where uncertainty is physically meaningful and important to characterize and interpret…

Machine Learning · Computer Science 2024-11-14 Rebecca Nevin , Aleksandra Ćiprijanović , Brian D. Nord

Uncertainty estimation is a crucial aspect of deploying dependable deep learning models in safety-critical systems. In this study, we introduce a novel and efficient method for deterministic uncertainty estimation called Discriminant…

Machine Learning · Computer Science 2024-02-21 Jiaxin Zhang , Kamalika Das , Sricharan Kumar

Diffusion-based image super-resolution methods have demonstrated significant advantages over GAN-based approaches, particularly in terms of perceptual quality. Building upon a lengthy Markov chain, diffusion-based methods possess remarkable…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Leheng Zhang , Weiyi You , Kexuan Shi , Shuhang Gu

Uncertainty quantification (UQ) techniques are frequently used to ascertain output variability in systems with parametric uncertainty. Traditional algorithms for UQ are either system-agnostic and slow (such as Monte Carlo) or fast with…

Computation · Statistics 2015-03-19 Tuhin Sahai , Jose Miguel Pasini

Dimensional reduction~(DR) maps high-dimensional data into a lower dimensions latent space with minimized defined optimization objectives. The DR method usually falls into feature selection~(FS) and feature projection~(FP). FS focuses on…

Machine Learning · Computer Science 2022-11-24 Zelin Zang , Yongjie Xu , Linyan Lu , Yulan Geng , Senqiao Yang , Stan Z. Li

Topology optimization under uncertainty (TOuU) often defines objectives and constraints by statistical moments of geometric and physical quantities of interest. Most traditional TOuU methods use gradient-based optimization algorithms and…

Optimization and Control · Mathematics 2019-11-05 Subhayan De , Jerrad Hampton , Kurt Maute , Alireza Doostan

Uncertainty quantification (UQ) plays a pivotal role in reduction of uncertainties during both optimization and decision making processes. It can be applied to solve a variety of real-world applications in science and engineering. Bayesian…

Uncertainty quantification (UQ) is crucial for deploying machine learning models in high-stakes applications, where overconfident predictions can lead to serious consequences. An effective UQ method must balance computational efficiency…

Machine Learning · Computer Science 2026-02-23 Taeseong Yoon , Heeyoung Kim

While neural networks have demonstrated impressive performance across various tasks, accurately quantifying uncertainty in their predictions is essential to ensure their trustworthiness and enable widespread adoption in critical systems.…

Machine Learning · Statistics 2025-11-11 Joseph Wilson , Chris van der Heide , Liam Hodgkinson , Fred Roosta

High dimensional unconstrained quadratic programs (UQPs) involving massive datasets are now common in application areas such as web, social networks, etc. Unless computational resources that match up to these datasets are available, solving…

Optimization and Control · Mathematics 2014-07-15 Gugan Thoppe , Vivek S. Borkar , Dinesh Garg

There are essentially three kinds of approaches to Uncertainty Quantification (UQ): (A) robust optimization, (B) Bayesian, (C) decision theory. Although (A) is robust, it is unfavorable with respect to accuracy and data assimilation. (B)…

In this work, we propose a stochastic gradient descent (SGD) framework to design data-driven policy gradient descent algorithms for the linear quadratic regulator problem. Two alternative schemes are considered to estimate the policy…

Systems and Control · Electrical Eng. & Systems 2026-02-24 Bowen Song , Simon Weissmann , Mathias Staudigl , Andrea Iannelli

Uncertainty estimation aims to evaluate the confidence of a trained deep neural network. However, existing uncertainty estimation approaches rely on low-dimensional distributional assumptions and thus suffer from the high dimensionality of…

Machine Learning · Computer Science 2023-10-26 Tsai Hor Chan , Kin Wai Lau , Jiajun Shen , Guosheng Yin , Lequan Yu

Stochastic gradient descent (SGD), which dates back to the 1950s, is one of the most popular and effective approaches for performing stochastic optimization. Research on SGD resurged recently in machine learning for optimizing convex loss…

Machine Learning · Computer Science 2019-12-24 Jie Chen , Ronny Luss

Unsupervised out-of-distribution (U-OOD) detection is to identify OOD data samples with a detector trained solely on unlabeled in-distribution (ID) data. The likelihood function estimated by a deep generative model (DGM) could be a natural…

Machine Learning · Statistics 2024-09-09 Yewen Li , Chaojie Wang , Xiaobo Xia , Xu He , Ruyi An , Dong Li , Tongliang Liu , Bo An , Xinrun Wang

Uncertain fractional differential equation (UFDE) is a kind of differential equation about uncertain process. As an significant mathematical tool to describe the evolution process of dynamic system, UFDE is better than the ordinary…

Numerical Analysis · Mathematics 2023-02-27 Chenlei Tian , Jing Cao , Yifu Song , Ting Jin

Accelerating the convergence of second-order optimization, particularly Newton-type methods, remains a pivotal challenge in algorithmic research. In this paper, we extend previous work on the \textbf{Quadratic Gradient (QG)} and rigorously…

Optimization and Control · Mathematics 2026-04-01 John Chiang