中文
相关论文

相关论文: Conditional entropy minimization principle for lea…

200 篇论文

Domain Generalization (DG) aims to learn a generalizable model on the unseen target domain by only training on the multiple observed source domains. Although a variety of DG methods have focused on extracting domain-invariant features, the…

计算机视觉与模式识别 · 计算机科学 2023-09-11 Xi Yu , Huan-Hsin Tseng , Shinjae Yoo , Haibin Ling , Yuewei Lin

Machine learning algorithms with empirical risk minimization usually suffer from poor generalization performance due to the greedy exploitation of correlations among the training data, which are not stable under distributional shifts.…

机器学习 · 计算机科学 2021-06-18 Jiashuo Liu , Zheyuan Hu , Peng Cui , Bo Li , Zheyan Shen

Rerandomization utilizes modern computing ability to improve covariate balance while adhering to the randomization principle originally advocated by RA Fisher. Affinely invariant rerandomization has the ``Equal Percent Variance Reducing''…

统计方法学 · 统计学 2025-04-03 Zhen Zhong , Donald B. Rubin

Domain Generalization (DG) aims to develop classifiers that can generalize to new, unseen data distributions, a critical capability when collecting new domain-specific data is impractical. A common DG baseline minimizes the empirical risk…

机器学习 · 计算机科学 2024-12-11 Piotr Teterwak , Kuniaki Saito , Theodoros Tsiligkaridis , Kate Saenko , Bryan A. Plummer

Invariance learning methods aim to learn invariant features in the hope that they generalize under distributional shifts. Although many tasks are naturally characterized by continuous domains, current invariance learning techniques…

机器学习 · 计算机科学 2024-04-24 Yong Lin , Fan Zhou , Lu Tan , Lintao Ma , Jiameng Liu , Yansu He , Yuan Yuan , Yu Liu , James Zhang , Yujiu Yang , Hao Wang

Inferring causal individual treatment effect (ITE) from observational data is a challenging problem whose difficulty is exacerbated by the presence of treatment assignment bias. In this work, we propose a new way to estimate the ITE using…

机器学习 · 计算机科学 2021-03-16 Abhin Shah , Kartik Ahuja , Karthikeyan Shanmugam , Dennis Wei , Kush Varshney , Amit Dhurandhar

The Invariant Risk Minimization (IRM) approach aims to address the challenge of domain generalization by training a feature representation that remains invariant across multiple environments. However, in noisy environments, IRM-related…

机器学习 · 计算机科学 2025-02-11 Gaojie Jin , Ronghui Mu , Xinping Yi , Xiaowei Huang , Lijun Zhang

Machine learning can benefit from causal discovery for interpretation and from causal inference for generalization. In this line of research, a few invariant learning algorithms for out-of-distribution (OOD) generalization have been…

机器学习 · 计算机科学 2023-04-06 Borja Guerrero Santillan

In this paper, a safe and learning-based control framework for model predictive control (MPC) is proposed to optimize nonlinear systems with a non-differentiable objective function under uncertain environmental disturbances. The control…

机器人学 · 计算机科学 2022-02-22 Lei Zheng , Rui Yang , Zhixuan Wu , Jiesen Pan , Hui Cheng

The application of standard sufficient dimension reduction methods for reducing the dimension space of predictors without losing regression information requires inverting the covariance matrix of the predictors. This has posed a number of…

统计方法学 · 统计学 2019-10-01 Kabir Opeyemi Olorede , Waheed Babatunde Yahya

Invariant representation learning (IRL) encourages the prediction from invariant causal features to labels de-confounded from the environments, advancing the technical roadmap of out-of-distribution (OOD) generalization. Despite spotlights…

机器学习 · 计算机科学 2023-12-18 Ziliang Chen , Yongsen Zheng , Zhao-Rong Lai , Quanlong Guan , Liang Lin

In this paper, we develop the constraint energy minimizing generalized multiscale finite element method (CEM-GMsFEM) for convection-diffusion equations with inhomogeneous Dirichlet, Neumann and Robin boundary conditions, along with…

数值分析 · 数学 2024-08-02 Po Chai Wong , Eric T. Chung , Changqing Ye , Lina Zhao

In the past decades, machine learning with Empirical Risk Minimization (ERM) has demonstrated great capability in learning and exploiting the statistical patterns from data, or even surpassing humans. Despite the success, ERM avoids the…

机器学习 · 计算机科学 2025-06-17 Yongqiang Chen

In this paper, we propose a general framework to learn a robust large-margin binary classifier when corrupt measurements, called anomalies, caused by sensor failure might be present in the training set. The goal is to minimize the…

机器学习 · 计算机科学 2016-10-24 Tianpei Xie , Nasser. M. Narabadi , Alfred O. Hero

Learning models that can handle distribution shifts is a key challenge in domain generalization. Invariance learning, an approach that focuses on identifying features invariant across environments, improves model generalization by capturing…

机器学习 · 统计学 2026-05-11 Yiran Jia , Jelena Bradic

Exponential models of distributions are widely used in machine learning for classiffication and modelling. It is well known that they can be interpreted as maximum entropy models under empirical expectation constraints. In this work, we…

机器学习 · 计算机科学 2012-07-19 Amir Globerson , Naftali Tishby

In this work we investigate to which extent one can recover class probabilities within the empirical risk minimization (ERM) paradigm. The main aim of our paper is to extend existing results and emphasize the tight relations between…

机器学习 · 计算机科学 2020-07-22 Alexander Mey , Marco Loog

Learning models that gracefully handle distribution shifts is central to research on domain generalization, robust optimization, and fairness. A promising formulation is domain-invariant learning, which identifies the key issue of learning…

机器学习 · 计算机科学 2021-07-16 Elliot Creager , Jörn-Henrik Jacobsen , Richard Zemel

This paper investigates domain generalization: How to take knowledge acquired from an arbitrary number of related domains and apply it to previously unseen domains? We propose Domain-Invariant Component Analysis (DICA), a kernel-based…

机器学习 · 统计学 2013-01-11 Krikamol Muandet , David Balduzzi , Bernhard Schölkopf

Max-value entropy search (MES) is one of the state-of-the-art approaches in Bayesian optimization (BO). In this paper, we propose a novel variant of MES for constrained problems, called Constrained MES via Information lower BOund…

机器学习 · 计算机科学 2023-02-21 Shion Takeno , Tomoyuki Tamura , Kazuki Shitara , Masayuki Karasuyama