English
Related papers

Related papers: Revisiting Distance Metric Learning for Few-Shot N…

200 papers

Existing metric learning losses can be categorized into two classes: pair-based and proxy-based losses. The former class can leverage fine-grained semantic relations between data points, but slows convergence in general due to its high…

Computer Vision and Pattern Recognition · Computer Science 2020-04-01 Sungyeon Kim , Dongwon Kim , Minsu Cho , Suha Kwak

Proxy-based Deep Metric Learning (DML) learns deep representations by embedding images close to their class representatives (proxies), commonly with respect to the angle between them. However, this disregards the embedding norm, which can…

Machine Learning · Computer Science 2022-07-11 Michael Kirchhof , Karsten Roth , Zeynep Akata , Enkelejda Kasneci

Cross-domain few-shot learning (CDFSL) aims to acquire knowledge from limited training data in the target domain by leveraging prior knowledge transferred from source domains with abundant training samples. CDFSL faces challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yixiong Zou , Yicong Liu , Yiman Hu , Yuhua Li , Ruixuan Li

Large language models (LLMs) demonstrate remarkable machine translation (MT) abilities via prompting, even though they were not explicitly trained for this task. However, even given the incredible quantities of data they are trained on,…

Computation and Language · Computer Science 2023-02-16 Marjan Ghazvininejad , Hila Gonen , Luke Zettlemoyer

Cross-Domain Few-Shot Learning (CDFSL) aims to adapt large-scale pretrained models to specialized target domains with limited samples, yet the few-shot fine-tuning of vision-language models like CLIP remains underexplored. By establishing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Yaze Zhao , Yicong Liu , Yixiong Zou , Yuhua Li , Ruixuan Li

Representation learning has been widely studied in the context of meta-learning, enabling rapid learning of new tasks through shared representations. Recent works such as MAML have explored using fine-tuning-based metrics, which measure the…

Machine Learning · Computer Science 2021-05-06 Kurtland Chua , Qi Lei , Jason D. Lee

Source-Free Cross-Domain Few-Shot Learning (SF-CDFSL) focuses on fine-tuning with limited training data from target domains (e.g., medical or satellite images), where Vision-Language Models (VLMs) such as CLIP and SigLIP have shown…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Zhenyu Zhang , Yixiong Zou , Yuhua Li , Ruixuan Li , Guangyao Chen

We introduce Similarity-Distance-Magnitude (SDM) language models (LMs), which are sequence prediction models fine-tuned to maximize the proportion of generations in the well-calibrated, high-probability region partitioned by a final-layer…

Computation and Language · Computer Science 2025-10-31 Allen Schmaltz

The advent of deep learning has led to a significant gain in machine translation. However, most of the studies required a large parallel dataset which is scarce and expensive to construct and even unavailable for some languages. This paper…

Computation and Language · Computer Science 2023-04-04 Viet H. Pham , Thang M. Pham , Giang Nguyen , Long Nguyen , Dien Dinh

Recent studies have highlighted that deep neural networks (DNNs) are vulnerable to adversarial examples. In this paper, we improve the robustness of DNNs by utilizing techniques of Distance Metric Learning. Specifically, we incorporate…

Machine Learning · Computer Science 2019-05-29 Pengcheng Li , Jinfeng Yi , Bowen Zhou , Lijun Zhang

LLMs are typically trained in high-resource languages, and tasks in lower-resourced languages tend to underperform the higher-resource language counterparts for in-context learning. Despite the large body of work on prompting settings, it…

Computation and Language · Computer Science 2025-06-25 Christopher Toukmaji , Jeffrey Flanigan

Deep Metric Learning (DML) is arguably one of the most influential lines of research for learning visual similarities with many proposed approaches every year. Although the field benefits from the rapid progress, the divergence in training…

Computer Vision and Pattern Recognition · Computer Science 2020-08-04 Karsten Roth , Timo Milbich , Samarth Sinha , Prateek Gupta , Björn Ommer , Joseph Paul Cohen

Distance metric learning (DML) has been studied extensively in the past decades for its superior performance with distance-based algorithms. Most of the existing methods propose to learn a distance metric with pairwise or triplet…

Machine Learning · Computer Science 2019-05-23 Qi Qian , Jiasheng Tang , Hao Li , Shenghuo Zhu , Rong Jin

Metric learning aims to build a distance metric typically by learning an effective embedding function that maps similar objects into nearby points in its embedding space. Despite recent advances in deep metric learning, it remains…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Deunsol Jung , Dahyun Kang , Suha Kwak , Minsu Cho

Pre-trained Language Models (PLMs) can be accurately fine-tuned for downstream text processing tasks. Recently, researchers have introduced several parameter-efficient fine-tuning methods that optimize input prompts or adjust a small number…

Computation and Language · Computer Science 2024-06-07 Saeed Najafi , Alona Fyshe

Speech-based machine learning (ML) has been heralded as a promising solution for tracking prosodic and spectrotemporal patterns in real-life that are indicative of emotional changes, providing a valuable window into one's cognitive and…

Machine Learning · Computer Science 2021-09-08 Kexin Feng , Theodora Chaspari

With the remarkable success achieved by the Convolutional Neural Networks (CNNs) in object recognition recently, deep learning is being widely used in the computer vision community. Deep Metric Learning (DML), integrating deep learning with…

Computer Vision and Pattern Recognition · Computer Science 2018-03-08 Bowen Wu , Zhangling Chen , Jun Wang , Huaming Wu

Deep neural networks can yield good performance on various tasks but often require large amounts of data to train them. Meta-learning received considerable attention as one approach to improve the generalization of these networks from a…

Machine Learning · Computer Science 2023-10-11 Mike Huisman , Aske Plaat , Jan N. van Rijn

Recent advances in Large Language Models (LLMs) have significantly reshaped the landscape of Natural Language Processing (NLP). Among the various prompting techniques, few-shot prompting has gained considerable attention for its…

Computation and Language · Computer Science 2025-10-07 Deshan Sumanathilaka , Nicholas Micallef , Julian Hough

Deep distance metric learning (DDML), which is proposed to learn image similarity metrics in an end-to-end manner based on the convolution neural network, has achieved encouraging results in many computer vision tasks.$L2$-normalization in…

Computer Vision and Pattern Recognition · Computer Science 2018-03-29 Xuefei Zhe , Shifeng Chen , Hong Yan