English
Related papers

Related papers: Informative Sample-Aware Proxy for Deep Metric Lea…

200 papers

Deep metric learning (DML) aims to minimize empirical expected loss of the pairwise intra-/inter- class proximity violations in the embedding space. We relate DML to feasibility problem of finite chance constraints. We show that minimizer…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Yeti Z. Gurbuz , Ogul Can , A. Aydin Alatan

The task of infomin learning aims to learn a representation with high utility while being uninformative about a specified target, with the latter achieved by minimising the mutual information between the representation and the target. It…

Machine Learning · Computer Science 2023-02-22 Yanzhi Chen , Weihao Sun , Yingzhen Li , Adrian Weller

Learning deep representations for visual place recognition is commonly performed using pairwise or triple loss functions that highly depend on the hardness of the examples sampled at each training iteration. Existing techniques address this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Amar Ali-bey , Brahim Chaib-draa , Philippe Giguère

Deep metric learning aims to learn a deep embedding that can capture the semantic similarity of data points. Given the availability of massive training samples, deep metric learning is known to suffer from slow convergence due to a large…

Machine Learning · Computer Science 2019-12-05 Xinshao Wang , Yang Hua , Elyor Kodirov , Guosheng Hu , Neil M. Robertson

Unsupervised domain adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Owing to privacy concerns and heavy data transmission, source-free UDA, exploiting the pre-trained source models…

Computer Vision and Pattern Recognition · Computer Science 2022-05-31 Yuhe Ding , Lijun Sheng , Jian Liang , Aihua Zheng , Ran He

We present an algorithm for minimizing an objective with hard-to-compute gradients by using a related, easier-to-access function as a proxy. Our algorithm is based on approximate proximal point iterations on the proxy combined with…

Machine Learning · Computer Science 2023-06-08 Blake Woodworth , Konstantin Mishchenko , Francis Bach

Content-based medical image retrieval is an important diagnostic tool that improves the explainability of computer-aided diagnosis systems and provides decision making support to healthcare professionals. Medical imaging data, such as…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Yunyan Xing , Benjamin J. Meyer , Mehrtash Harandi , Tom Drummond , Zongyuan Ge

In this paper, we propose a new method called ProfWeight for transferring information from a pre-trained deep neural network that has a high test accuracy to a simpler interpretable model or a very shallow network of low complexity and a…

Machine Learning · Computer Science 2018-11-20 Amit Dhurandhar , Karthikeyan Shanmugam , Ronny Luss , Peder Olsen

A common method to study deep learning systems is to use simplified model representations--for example, using singular value decomposition to visualize the model's hidden states in a lower dimensional space. This approach assumes that the…

Machine Learning · Computer Science 2024-06-06 Dan Friedman , Andrew Lampinen , Lucas Dixon , Danqi Chen , Asma Ghandeharioun

Incremental learning aims to enable machine learning models to continuously acquire new knowledge given new classes, while maintaining the knowledge already learned for old classes. Saving a subset of training samples of previously seen…

Computer Vision and Pattern Recognition · Computer Science 2021-04-22 Jian Jiang , Edoardo Cetin , Oya Celiktutan

Addressing bias in the trained machine learning system often requires access to sensitive attributes. In practice, these attributes are not available either due to legal and policy regulations or data unavailability for a given demographic.…

Machine Learning · Computer Science 2023-12-27 Bhushan Chaudhary , Anubha Pandey , Deepak Bhatt , Darshika Tiwari

Humans are able to accelerate their learning by selecting training materials that are the most informative and at the appropriate level of difficulty. We propose a framework for distributing deep learning in which one set of workers search…

Machine Learning · Statistics 2016-04-19 Guillaume Alain , Alex Lamb , Chinnadhurai Sankar , Aaron Courville , Yoshua Bengio

Intelligent reflecting surfaces (IRSs) have become a vital technology for improving the spectrum and energy efficiency of forthcoming wireless networks. Nevertheless, practical implementation is obstructed by the excessive overhead…

Signal Processing · Electrical Eng. & Systems 2025-11-07 Xianhua Yu , Dong Li , Bowen Gu , Liuqing Yang , Sumei Sun , George K. Karagiannidis

Recent advances in deep learning have significantly improved the performance of various computer vision applications. However, discovering novel categories in an incremental learning scenario remains a challenging problem due to the lack of…

Computer Vision and Pattern Recognition · Computer Science 2023-11-03 Hyungmin Kim , Sungho Suh , Daehwan Kim , Daun Jeong , Hansang Cho , Junmo Kim

The generalization with respect to domain shifts, as they frequently appear in applications such as autonomous driving, is one of the remaining big challenges for deep learning models. Therefore, we propose an exemplar-based style synthesis…

Computer Vision and Pattern Recognition · Computer Science 2023-07-04 Yumeng Li , Dan Zhang , Margret Keuper , Anna Khoreva

Deep metric learning algorithms have been utilized to learn discriminative and generalizable models which are effective for classifying unseen classes. In this paper, a novel noise tolerant deep metric learning algorithm is proposed. The…

Machine Learning · Computer Science 2019-04-09 Soumyadeep Ghosh , Richa Singh , Mayank Vatsa

We present prompt distribution learning for effectively adapting a pre-trained vision-language model to address downstream recognition tasks. Our method not only learns low-bias prompts from a few samples but also captures the distribution…

Computer Vision and Pattern Recognition · Computer Science 2022-05-09 Yuning Lu , Jianzhuang Liu , Yonggang Zhang , Yajing Liu , Xinmei Tian

Diffusion models have achieved remarkable progress in image and audio generation, largely due to Classifier-Free Guidance. However, the choice of guidance scale remains underexplored: a fixed scale often fails to generalize across prompts…

Sound · Computer Science 2025-10-07 Xuanhao Zhang , Chang Li

In this paper, we propose a stochastic optimization method that adaptively controls the sample size used in the computation of gradient approximations. Unlike other variance reduction techniques that either require additional storage or the…

Optimization and Control · Mathematics 2017-11-01 Raghu Bollapragada , Richard Byrd , Jorge Nocedal

Large language models (LLMs) have demonstrated impressive capabilities across various tasks, but their performance is highly sensitive to the prompts utilized. This variability poses challenges for accurate assessment and user satisfaction.…

Computation and Language · Computer Science 2024-10-17 Jingming Zhuo , Songyang Zhang , Xinyu Fang , Haodong Duan , Dahua Lin , Kai Chen