English
Related papers

Related papers: Robust Model Selection for Discovery of Latent Mec…

200 papers

Although the Bayesian paradigm offers a formal framework for estimating the entire probability distribution over uncertain parameters, its online implementation can be challenging due to high computational costs. We suggest the Adaptive…

Machine Learning · Computer Science 2023-10-23 Pedram Agand , Mo Chen , Hamid D. Taghirad

The Lasso method is known to exhibit instability in the presence of highly correlated features, often leading to an arbitrary selection of predictors. This issue manifests itself in two primary error types: the erroneous omission of…

Methodology · Statistics 2025-08-07 Yanxin Liu , Yunqi Zhang

Safety is essential for reinforcement learning (RL) applied in real-world situations. Chance constraints are suitable to represent the safety requirements in stochastic systems. Previous chance-constrained RL methods usually have a low…

Machine Learning · Computer Science 2021-03-17 Baiyu Peng , Yao Mu , Yang Guan , Shengbo Eben Li , Yuming Yin , Jianyu Chen

Identifying meaningful and independent factors of variation in a dataset is a challenging learning task frequently addressed by means of deep latent variable models. This task can be viewed as learning symmetry transformations preserving…

Machine Learning · Computer Science 2022-11-01 Maxim Samarin , Vitali Nesterov , Mario Wieser , Aleksander Wieczorek , Sonali Parbhoo , Volker Roth

Computational mechanics is a method for discovering, describing and quantifying patterns, using tools from statistical physics. It constructs optimal, minimal models of stochastic processes and their underlying causal structures. These…

Machine Learning · Computer Science 2007-05-23 Cosma Rohilla Shalizi , James P. Crutchfield

In learning theory, a standard assumption is that the data is generated from a finite mixture model. But what happens when the number of components is not known in advance? The problem of estimating the number of components, also called…

Data Structures and Algorithms · Computer Science 2023-04-25 Jerry Li , Allen Liu , Ankur Moitra

Integrated solutions for analytics over relational databases are of great practical importance as they avoid the costly repeated loop data scientists have to deal with on a daily basis: select features from data residing in relational…

Databases · Computer Science 2020-02-10 Mahmoud Abo Khamis , Hung Q. Ngo , XuanLong Nguyen , Dan Olteanu , Maximilian Schleich

For many scientific questions, understanding the underlying mechanism is the goal. To help investigators better understand the underlying mechanism, variable selection is a crucial step that permits the identification of the most associated…

Methodology · Statistics 2025-10-06 Shuangshuang Xu , Marco A. R. Ferreira , Allison N. Tegge

The adversarial subproblem in two-stage adaptive robust optimization (ARO), which identifies the worst-case uncertainty realization, is a major computational bottleneck. This difficulty is exacerbated when the recourse value function is…

Systems and Control · Electrical Eng. & Systems 2026-03-25 Zhiyi Zhou , Ján Drgoňa , Yury Dvorkin

Causal learning has long concerned itself with the accurate recovery of underlying causal mechanisms. Such causal modelling enables better explanations of out-of-distribution data. Prior works on causal learning assume that the high-level…

The linear layer is one of the most pervasive modules in deep learning representations. However, it requires $O(N^2)$ parameters and $O(N^2)$ operations. These costs can be prohibitive in mobile applications or prevent scaling in many…

Machine Learning · Computer Science 2016-03-22 Marcin Moczulski , Misha Denil , Jeremy Appleyard , Nando de Freitas

Discovering causal structures with latent variables from observational data is a fundamental challenge in causal discovery. Existing methods often rely on constraint-based, iterative discrete searches, limiting their scalability to large…

Machine Learning · Computer Science 2024-12-02 Parjanya Prashant , Ignavier Ng , Kun Zhang , Biwei Huang

Prevalent Fault Localization (FL) techniques rely on tests to localize buggy program elements. Tests could be treated as fuel to further boost FL by providing more debugging information. Therefore, it is highly valuable to measure the Fault…

Software Engineering · Computer Science 2025-01-07 Yifan Zhao , Zeyu Sun , Guoqing Wang , Qingyuan Liang , Yakun Zhang , Yiling Lou , Dan Hao , Lu Zhang

Continual Learning (CL) methods usually learn from all available data. However, this is not the case in human cognition which efficiently focuses on key experiences while disregarding the redundant information. Similarly, not all data…

Machine Learning · Computer Science 2024-10-24 Elif Ceren Gok Yildirim , Murat Onur Yildirim , Joaquin Vanschoren

Deployed machine learning models should be updated to take advantage of a larger sample size to improve performance, as more data is gathered over time. Unfortunately, even when model updates improve aggregate metrics such as accuracy, they…

Machine Learning · Computer Science 2023-05-09 George Adam , Benjamin Haibe-Kains , Anna Goldenberg

Most of previous machine learning algorithms are proposed based on the i.i.d. hypothesis. However, this ideal assumption is often violated in real applications, where selection bias may arise between training and testing process. Moreover,…

Computer Vision and Pattern Recognition · Computer Science 2018-08-24 Zheyan Shen , Peng Cui , Kun Kuang , Bo Li , Peixuan Chen

Model selection is difficult to analyse yet theoretically and empirically important, especially for high-dimensional data analysis. Recently the least absolute shrinkage and selection operator (Lasso) has been applied in the statistical and…

Machine Learning · Statistics 2016-06-02 Ning Xu , Jian Hong , Timothy C. G. Fisher

We propose a computationally tractable, tube-based robust nonlinear model predictive control (MPC) framework using difference-of-convex (DC) functions and sequential convex programming. For systems with differentiable discrete time…

Optimization and Control · Mathematics 2026-02-03 Martin Doff-Sotta , Zaheen A-Rahman , Mark Cannon

Causal representation learning has emerged as the center of action in causal machine learning research. In particular, multi-domain datasets present a natural opportunity for showcasing the advantages of causal representation learning over…

Machine Learning · Computer Science 2023-12-12 Kartik Ahuja , Amin Mansouri , Yixin Wang

Discovering the underlying dynamics of complex systems from data is an important practical topic. Constrained optimization algorithms are widely utilized and lead to many successes. Yet, such purely data-driven methods may bring about…

Dynamical Systems · Mathematics 2023-05-17 Nan Chen , Yinling Zhang