English
Related papers

Related papers: Generalizable Embeddings with Cross-batch Metric L…

200 papers

A generative Bayesian model is developed for deep (multi-layer) convolutional dictionary learning. A novel probabilistic pooling operation is integrated into the deep model, yielding efficient bottom-up and top-down probabilistic learning.…

Machine Learning · Statistics 2015-02-24 Yunchen Pu , Xin Yuan , Lawrence Carin

For many applications, an ensemble of base classifiers is an effective solution. The tuning of its parameters(number of classes, amount of data on which each classifier is to be trained on, etc.) requires G, the generalization error of a…

Graph neural networks, which generalize deep neural network models to graph structured data, have attracted increasing attention in recent years. They usually learn node representations by transforming, propagating and aggregating node…

Machine Learning · Computer Science 2019-05-21 Yao Ma , Suhang Wang , Charu C. Aggarwal , Jiliang Tang

Deep neural networks obtained by standard training have been constantly plagued by adversarial examples. Although adversarial training demonstrates its capability to defend against adversarial examples, unfortunately, it leads to an…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Hongjun Wang , Yisen Wang

We present a swift walk-through of our recent work that uses machine learning to fit interatomic potentials based on quantum mechanical data. We describe our Gaussian Approximation Potentials (GAP) framework, discussing a variety of…

Materials Science · Physics 2020-02-06 Albert P. Bartók , Gábor Csányi

Heralded by the initial success in speech recognition and image classification, learning-based approaches with neural networks, commonly referred to as deep learning, have spread across various fields. A primitive form of a neural network…

Robotics · Computer Science 2024-09-02 Takuma Yoneda

The pursuit of a universal AI-generated image (AIGI) detector often relies on aggregating data from numerous generators to improve generalization. However, this paper identifies a paradoxical phenomenon we term the Benefit then Conflict…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Ziheng Qin , Yuheng Ji , Renshuai Tao , Yuxuan Tian , Yuyang Liu , Yipu Wang , Xiaolong Zheng

Federated learning is a decentralized and privacy-preserving technique that enables multiple clients to collaborate with a server to learn a global model without exposing their private data. However, the presence of statistical…

Machine Learning · Computer Science 2023-07-06 Shiyu Liu , Shaogao Lv , Dun Zeng , Zenglin Xu , Hui Wang , Yue Yu

Generalized zero-shot learning(GZSL) aims to classify samples from seen and unseen labels, assuming unseen labels are not accessible during training. Recent advancements in GZSL have been expedited by incorporating…

Computer Vision and Pattern Recognition · Computer Science 2023-09-15 Riti Paul , Sahil Vora , Baoxin Li

Recently, generative graph models have shown promising results in learning graph representations through self-supervised methods. However, most existing generative graph representation learning (GRL) approaches rely on random masking across…

Machine Learning · Computer Science 2026-05-08 Xinyue Hu , Zhibin Duan , Xinyang Liu , Yuxin Li , Bo Chen , Chaojie Wang , Yilin He , Hongwei Liu , Mingyuan Zhou

In Generalized Linear Estimation (GLE) problems, we seek to estimate a signal that is observed through a linear transform followed by a component-wise, possibly nonlinear and noisy, channel. In the Bayesian optimal setting, Generalized…

Disordered Systems and Neural Networks · Physics 2021-02-03 Luca Saglietti , Yue M. Lu , Carlo Lucibello

Deep metric learning is often used to learn an embedding function that captures the semantic differences within a dataset. A key factor in many problem domains is how this embedding generalizes to new classes of data. In observing many…

Machine Learning · Computer Science 2019-09-18 Xiaotong Liu , Hong Xuan , Zeyu Zhang , Abby Stylianou , Robert Pless

Network representation learning (NRL) is a powerful technique for learning low-dimensional vector representation of high-dimensional and sparse graphs. Most studies explore the structure and metadata associated with the graph using random…

Machine Learning · Computer Science 2020-01-30 Zekarias T. Kefato , Sarunas Girdzijauskas

The problem of distance metric learning is mostly considered from the perspective of learning an embedding space, where the distances between pairs of examples are in correspondence with a similarity metric. With the rise and success of…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Yehao Li , Ting Yao , Yingwei Pan , Hongyang Chao , Tao Mei

Multiple generalized additive models (GAMs) are a type of distributional regression wherein parameters of probability distributions depend on predictors through smooth functions, with selection of the degree of smoothness via $L_2$…

Machine Learning · Statistics 2018-09-26 Yousra El-Bachir , Anthony C. Davison

Graph-level representation learning is the pivotal step for downstream tasks that operate on the whole graph. The most common approach to this problem heretofore is graph pooling, where node features are typically averaged or summed to…

Machine Learning · Computer Science 2022-09-20 Kaixuan Chen , Jie Song , Shunyu Liu , Na Yu , Zunlei Feng , Gengshi Han , Mingli Song

A generally intelligent learner should generalize to more complex tasks than it has previously encountered, but the two common paradigms in machine learning -- either training a separate learner per task or training a single learner for all…

Machine Learning · Computer Science 2019-05-09 Michael B. Chang , Abhishek Gupta , Sergey Levine , Thomas L. Griffiths

We propose a general class of sample based explanations of machine learning models, which we term generalized representers. To measure the effect of a training sample on a model's test prediction, generalized representers use two…

Machine Learning · Computer Science 2023-10-31 Che-Ping Tsai , Chih-Kuan Yeh , Pradeep Ravikumar

Behavior cloning methods for robot learning suffer from poor generalization due to limited data support beyond expert demonstrations. Recent approaches leveraging video prediction models have shown promising results by learning rich…

Deep metric learning aims to construct an embedding space where samples of the same class are close to each other, while samples of different classes are far away from each other. Most existing deep metric learning methods attempt to…

Computer Vision and Pattern Recognition · Computer Science 2023-04-24 Liu Pingping , Liu Zetong , Lang Yijun , Zhou Qiuzhan , Li Qingliang