中文
相关论文

相关论文: Conditional entropy minimization principle for lea…

200 篇论文

Many biochemical applications such as molecular property prediction require models to generalize beyond their training domains (environments). Moreover, natural environments in these tasks are structured, defined by complex descriptors such…

机器学习 · 计算机科学 2020-10-08 Wengong Jin , Regina Barzilay , Tommi Jaakkola

The principle of maximum entropy is a broadly applicable technique for computing a distribution with the least amount of information possible constrained to match empirical data, for instance, feature expectations. We seek to generalize…

信息论 · 计算机科学 2022-05-30 Kenneth Bogert

Traditional empirical risk minimization (ERM) for semantic segmentation can disproportionately advantage or disadvantage certain target classes in favor of an (unfair but) improved overall performance. Inspired by the recently introduced…

计算机视觉与模式识别 · 计算机科学 2021-03-29 Attila Szabo , Hadi Jamali-Rad , Siva-Datta Mannava

In fluid flow simulation, the multi-continuum model is a useful strategy. When the heterogeneity and contrast of coefficients are high, the system becomes multiscale, and some kinds of reduced-order methods are demanded. Combining these…

数值分析 · 数学 2023-02-08 Tina Mai , Siu Wun Cheung , Jun Sur Richard Park

A prominent family of methods for learning data distributions relies on density ratio estimation (DRE), where a model is trained to $\textit{classify}$ between data samples and samples from some reference distribution. DRE-based models can…

机器学习 · 计算机科学 2024-11-01 Shahar Yadin , Noam Elata , Tomer Michaeli

Invariant risk minimization (IRM) has received increasing attention as a way to acquire environment-agnostic data representations and predictions, and as a principled solution for preventing spurious correlations from being learned and for…

机器学习 · 计算机科学 2023-03-07 Yihua Zhang , Pranay Sharma , Parikshit Ram , Mingyi Hong , Kush Varshney , Sijia Liu

Domain generalization (DG) aims to enhance the ability of models trained on source domains to generalize effectively to unseen domains. Recently, Sharpness-Aware Minimization (SAM) has shown promise in this area by reducing the sharpness of…

计算机视觉与模式识别 · 计算机科学 2025-03-10 Ziyang Chen , Yiwen Ye , Feilong Tang , Yongsheng Pan , Yong Xia

Understanding interaction effects among variables is important for regression modeling in various applications. The conventional approach of quantifying interactions as the product of variables often lacks clear interpretability, especially…

统计方法学 · 统计学 2026-05-21 Kexin Xie , Xinwei Deng

Inference of gene regulatory networks (GRNs) based on experimental data is a challenging task in bioinformatics. In this paper, we present a bi-objective minimization model (BoMM) for inference of GRNs, where one objective is the fitting…

计算工程、金融与科学 · 计算机科学 2015-12-17 Yu Chen , Xiufen Zou

It is well known that open dynamical systems can admit an uncountable number of (absolutely continuous) conditionally invariant measures (ACCIMs) for each prescribed escape rate. We propose and illustrate a convex optimisation based…

动力系统 · 数学 2013-02-22 Christopher Bose , Rua Murray

In this paper, we develop the constrained energy minimizing generalized multiscale finite element method (CEM-GMsFEM) with mixed boundary conditions (Dirichlet and Neumann) for the elasticity equations in high contrast media. By a special…

数值分析 · 数学 2022-10-21 Zhongqian Wang , Changqing Ye , Eric T. Chung

Inertial measurement units (IMUs) are fundamental sensing components in multi-source integrated navigation systems, and their performance directly determines the accuracy and reliability of solutions. However, the precision of low-cost IMUs…

信号处理 · 电气工程与系统科学 2026-05-19 Jiarui Lv , Feng Zhu , Xiaohong Zhang

The theoretical and empirical performance of Empirical Risk Minimization (ERM) often suffers when loss functions are poorly behaved with large Lipschitz moduli and spurious sharp minimizers. We propose and analyze a counterpart to ERM…

最优化与控制 · 数学 2021-07-08 Matthew Norton , Johannes O. Royset

This paper studies cross-domain lossy compression through the lens of minimum entropy coupling (MEC) with rate and classification constraints. In this setting, an encoder observes samples from a degraded source domain, while the decoder is…

信息论 · 计算机科学 2026-05-12 Nam Nguyen , Hassan Tavakoli , An Vuong , Thinh Nguyen , Bella Bose

Adversarial Training (AT) is known as an effective approach to enhance the robustness of deep neural networks. Recently researchers notice that robust models with AT have good generative ability and can synthesize realistic images, while…

机器学习 · 计算机科学 2022-03-28 Yifei Wang , Yisen Wang , Jiansheng Yang , Zhouchen Lin

A new method for estimating structural equation models (SEM) is proposed and evaluated. In contrast to most other methods, it is based directly on the data, not on the covariance matrix of the data. The new approach is flexible enough to…

统计方法学 · 统计学 2021-10-22 Reinhard Oldenburg

Entropy minimization has been widely used in unsupervised domain adaptation (UDA). However, existing works reveal that entropy minimization only may result into collapsed trivial solutions. In this paper, we propose to avoid trivial…

机器学习 · 计算机科学 2020-02-06 Xiaofu Wu , Suofei hang , Quan Zhou , Zhen Yang , Chunming Zhao , Longin Jan Latecki

Mixture model-based clustering has become an increasingly popular data analysis technique since its introduction over fifty years ago, and is now commonly utilized within a family setting. Families of mixture models arise when the component…

统计方法学 · 统计学 2019-11-11 Sanjeena Subedi , Paul D. McNicholas

How to effectively learn from unlabeled data from the target domain is crucial for domain adaptation, as it helps reduce the large performance gap due to domain shift or distribution change. In this paper, we propose an easy-to-implement…

计算机视觉与模式识别 · 计算机科学 2024-06-11 Chaofan Tao , Fengmao Lv , Lixin Duan , Min Wu

Domain Generalization (DG) aims to learn a model that can generalize well to unseen target domains from a set of source domains. With the idea of invariant causal mechanism, a lot of efforts have been put into learning robust causal effects…

计算机视觉与模式识别 · 计算机科学 2022-10-07 Qiaowei Miao , Junkun Yuan , Kun Kuang