English
Related papers

Related papers: Central Moment Discrepancy (CMD) for Domain-Invari…

200 papers

An adaptive bandwidth selection procedure for the mixture kernel in the maximum mean discrepancy (MMD) for fitting generative moment matching networks (GMMNs) is introduced, and its ability to improve the learning of copula random number…

Machine Learning · Statistics 2025-09-01 Marius Hofert , Gan Yao

We investigate the optimization target of Contrast-Consistent Search (CCS), which aims to recover the internal representations of truth of a large language model. We present a new loss function that we call the Midpoint-Displacement (MD)…

Machine Learning · Computer Science 2023-11-02 Hugo Fry , Seamus Fallows , Ian Fan , Jamie Wright , Nandi Schoots

The maximum mean discrepancy (MMD) is a recently proposed test statistic for two-sample test. Its quadratic time complexity, however, greatly hampers its availability to large-scale applications. To accelerate the MMD calculation, in this…

Artificial Intelligence · Computer Science 2015-06-19 Ji Zhao , Deyu Meng

The Diffusion Probabilistic Model (DPM) has emerged as a highly effective generative model in the field of computer vision. Its intermediate latent vectors offer rich semantic information, making it an attractive option for various…

Computer Vision and Pattern Recognition · Computer Science 2023-03-29 Haipeng Zhou , Lei Zhu , Yuyin Zhou

Learning high-dimensional distributions is often done with explicit likelihood modeling or implicit modeling via minimizing integral probability metrics (IPMs). In this paper, we expand this learning paradigm to stochastic orders, namely,…

Machine Learning · Statistics 2022-11-11 Carles Domingo-Enrich , Yair Schiff , Youssef Mroueh

In the enterprise email search setting, the same search engine often powers multiple enterprises from various industries: technology, education, manufacturing, etc. However, using the same global ranking model across different enterprises…

Information Retrieval · Computer Science 2019-06-20 Brandon Tran , Maryam Karimzadehgan , Rama Kumar Pasumarthi , Michael Bendersky , Donald Metzler

We provide a new estimation method for conditional moment models via the martingale difference divergence (MDD).Our MDD-based estimation method is formed in the framework of a continuum of unconditional moment restrictions. Unlike the…

Econometrics · Economics 2024-04-18 Kunyang Song , Feiyu Jiang , Ke Zhu

Bias evaluation is fundamental to trustworthy AI, both in terms of checking data quality and in terms of checking the outputs of AI systems. In testing data quality, for example, one may study the distance of a given dataset, viewed as a…

Machine Learning · Computer Science 2025-06-12 Jiří Němeček , Mark Kozdoba , Illia Kryvoviaz , Tomáš Pevný , Jakub Mareček

In this paper, we propose a novel domain generalization (DG) framework based on a new upper bound to the risk on the unseen domain. Particularly, our framework proposes to jointly minimize both the covariate-shift as well as the…

Machine Learning · Computer Science 2022-08-02 Thuan Nguyen , Boyang Lyu , Prakash Ishwar , Matthias Scheutz , Shuchin Aeron

Approximation of a target probability distribution using a finite set of points is a problem of fundamental importance in numerical integration. Several authors have proposed to select points by minimising a maximum mean discrepancy (MMD),…

Machine Learning · Statistics 2026-05-13 Zonghao Chen , Toni Karvonen , Heishiro Kanagawa , François-Xavier Briol , Chris. J. Oates

We present Manifold Alignment Determination (MAD), an algorithm for learning alignments between data points from multiple views or modalities. The approach is capable of learning correspondences between views as well as correspondences…

Machine Learning · Statistics 2017-01-13 Andreas Damianou , Neil D. Lawrence , Carl Henrik Ek

Recently, transfer subspace learning based approaches have shown to be a valid alternative to unsupervised subspace clustering and temporal data clustering for human motion segmentation (HMS). These approaches leverage prior knowledge from…

Computer Vision and Pattern Recognition · Computer Science 2021-08-30 Mariella Dimiccoli , Lluís Garrido , Guillem Rodriguez-Corominas , Herwig Wendt

We propose a new sufficient dimension reduction approach designed deliberately for high-dimensional classification. This novel method is named maximal mean variance (MMV), inspired by the mean variance index first proposed by Cui, Li and…

Methodology · Statistics 2018-12-11 Xin Chen , Jingjing Wu , Zhigang Yao , Jia Zhang

In domain adaptation, covariate shift and label shift problems are two distinct and complementary tasks. In covariate shift adaptation where the differences in data distribution arise from variations in feature probabilities, existing…

Machine Learning · Statistics 2023-12-13 Hongwei Wen , Annika Betken , Hanyuan Hang

Collaborative Metric Learning (CML) has recently emerged as a popular method in recommendation systems (RS), closing the gap between metric learning and Collaborative Filtering. Following the convention of RS, existing methods exploit…

Information Retrieval · Computer Science 2022-10-03 Shilong Bao , Qianqian Xu , Zhiyong Yang , Yuan He , Xiaochun Cao , Qingming Huang

Domain generalization methods aim to learn models robust to domain shift with data from a limited number of source domains and without access to target domain samples during training. Popular domain alignment methods for domain…

Machine Learning · Computer Science 2022-06-17 Wenyu Zhang , Mohamed Ragab , Chuan-Sheng Foo

Normalized compression distance (NCD) is a parameter-free, feature-free, alignment-free, similarity measure between a pair of finite objects based on compression. However, it is not sufficient for all applications. We propose an NCD of…

Computer Vision and Pattern Recognition · Computer Science 2016-01-28 Andrew R. Cohen , Paul M. B. Vitanyi

Moment-based distributionally robust optimization (DRO) provides an optimization framework to integrate statistical information with traditional optimization approaches. Under this framework, one assumes that the underlying joint…

Optimization and Control · Mathematics 2023-11-01 Shiyi Jiang , Jianqiang Cheng , Kai Pan , Zuo-Jun Max Shen

The maximum mean discrepancy (MMD) is a kernel-based nonparametric statistic for two-sample testing, whose inferential accuracy depends critically on variance characterization. Existing work provides various finite-sample estimators of the…

Machine Learning · Statistics 2026-02-05 Shijie Zhong , Yikun Yang , Da Gong , Jiangfeng Fu

Deep superpixel algorithms have made remarkable strides by substituting hand-crafted features with learnable ones. Nevertheless, we observe that existing deep superpixel methods, serving as mid-level representation operations, remain…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Sen Xu , Shikui Wei , Tao Ruan , Lixin Liao