English
Related papers

Related papers: Deep Metric Learning with Soft Orthogonal Proxies

200 papers

Physical symmetries provide a strong inductive bias for constructing functions to analyze data. In particular, this bias may improve robustness, data efficiency, and interpretability of machine learning models. However, building machine…

High Energy Physics - Phenomenology · Physics 2025-11-05 Pradyun Hebbar , Thandikire Madula , Vinicius Mikuni , Benjamin Nachman , Nadav Outmezguine , Inbar Savoray

Estimating causal treatment effects in observational settings is frequently compromised by selection bias arising from unobserved confounders. While traditional econometric methods struggle when these confounders are orthogonal to…

Artificial Intelligence · Computer Science 2026-01-06 Ahmed Dawoud , Osama El-Shamy

Given the voluminous nature of the multimedia sensed data, the Multimedia Internet of Things (MIoT) devices and networks will present several limitations in terms of power and communication overhead. One traditional solution to cope with…

Multimedia · Computer Science 2021-05-20 Hassan N. Noura , Ola Salman , Raphaël Couturier

Discrete optimization problems often arise in deep learning tasks, despite the fact that neural networks typically operate on continuous data. One class of these problems involve objective functions which depend on neural networks, but…

Machine Learning · Computer Science 2023-10-17 Eric Lei , Arman Adibi , Hamed Hassani

Is a deep learning model capable of understanding systems governed by certain first principle laws by only observing the system's output? Can deep learning learn the underlying physics and honor the physics when making predictions? The…

Computational Physics · Physics 2020-06-11 Rohan Thavarajah , Xiang Zhai , Zheren Ma , David Castineira

Classical approaches for one-class problems such as one-class SVM and isolation forest require careful feature engineering when applied to structured domains like images. State-of-the-art methods aim to leverage deep learning to learn…

Machine Learning · Computer Science 2020-08-18 Sachin Goyal , Aditi Raghunathan , Moksh Jain , Harsha Vardhan Simhadri , Prateek Jain

Robust estimation of the essential matrix, which encodes the relative position and orientation of two cameras, is a fundamental step in structure from motion pipelines. Recent deep-based methods achieved accurate estimation by using complex…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Dror Moran , Yuval Margalit , Guy Trostianetsky , Fadi Khatib , Meirav Galun , Ronen Basri

The ambiguous appearance, tiny scale, and fine-grained classes of objects in remote sensing imagery inevitably lead to the noisy annotations in category labels of detection dataset. However, the effects and treatments of the label noises…

Computer Vision and Pattern Recognition · Computer Science 2024-05-16 Guozhang Liu , Ting Liu , Mengke Yuan , Tao Pang , Guangxing Yang , Hao Fu , Tao Wang , Tongkui Liao

Representational similarity metrics typically force all units to be matched, making them susceptible to noise and outliers common in neural representations. We extend the soft-matching distance to a partial optimal transport setting that…

Machine Learning · Computer Science 2026-02-24 Chaitanya Kapoor , Alex H. Williams , Meenakshi Khosla

Decentralized machine learning (DML) supports collaborative training in large-scale networks with no central server. It is sensitive to the quality and reliability of inter-device communications that result in time-varying and stochastic…

Signal Processing · Electrical Eng. & Systems 2025-11-06 Zhiyuan Zhai , Shuyan Hu , Wei Ni , Xiaojun Yuan , Xin Wang

In recent years, we have witnessed a surge of interests in learning a suitable distance metric from weakly supervised data. Most existing methods aim to pull all the similar samples closer while push the dissimilar ones as far as possible.…

Machine Learning · Computer Science 2021-02-05 Huiyuan Deng , Xiangzhu Meng , Lin Feng

Deep embeddings answer one simple question: How similar are two images? Learning these embeddings is the bedrock of verification, zero-shot learning, and visual search. The most prominent approaches optimize a deep convolutional network…

Computer Vision and Pattern Recognition · Computer Science 2018-01-17 Chao-Yuan Wu , R. Manmatha , Alexander J. Smola , Philipp Krähenbühl

Recent advancements in human preference optimization, initially developed for Language Models (LMs), have shown promise for text-to-image Diffusion Models, enhancing prompt alignment, visual appeal, and user preference. Unlike LMs,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Alexander Gambashidze , Anton Kulikov , Yuriy Sosnin , Ilya Makarov

With the proliferation of mobile devices and the Internet of Things, deep learning models are increasingly deployed on devices with limited computing resources and memory, and are exposed to the threat of adversarial noise. Learning deep…

Computer Vision and Pattern Recognition · Computer Science 2021-12-30 Xian Wei , Yanhui Huang , Yangyu Xu , Mingsong Chen , Hai Lan , Yuanxiang Li , Zhongfeng Wang , Xuan Tang

This proposes a novel ensemble deep learning-based model to accurately classify, detect and localize different defect categories for aggressive pitches and thin resists (High NA applications).In particular, we train RetinaNet models using…

Image and Video Processing · Electrical Eng. & Systems 2022-06-29 Bappaditya Deya , Dipam Goswamif , Sandip Haldera , Kasem Khalilb , Philippe Leraya , Magdy A. Bayoumi

Deep Metric Learning (DML) is a prominent field in machine learning with extensive practical applications that concentrate on learning visual similarities. It is known that inputs such as Adversarial Examples (AXs), which follow a…

Machine Learning · Computer Science 2022-12-07 Inderjeet Singh , Kazuya Kakizaki , Toshinori Araki

Domain generalization (DG) aims to learn a model on one or more different but related source domains that could be generalized into an unseen target domain. Existing DG methods try to prompt the diversity of source domains for the model's…

Machine Learning · Computer Science 2022-09-14 Mengzhu Wang , Jianlong Yuan , Qi Qian , Zhibin Wang , Hao Li

Empirical researchers increasingly use upstream machine-learning (ML) methods to construct proxies for latent target variables from complex, unstructured data. A naive plug-in use of such proxies in downstream econometric models, however,…

Econometrics · Economics 2026-04-14 Lixiong Li

Most image segmentation algorithms are trained on binary masks formulated as a classification task per pixel. However, in applications such as medical imaging, this "black-and-white" approach is too constraining because the contrast between…

Image and Video Processing · Electrical Eng. & Systems 2020-11-19 Charley Gros , Andreanne Lemay , Julien Cohen-Adad

Metric learning aims to embed one metric space into another to benefit tasks like classification and clustering. Although a greatly distorted metric space has a high degree of freedom to fit training data, it is prone to overfitting and…

Machine Learning · Computer Science 2015-05-12 Renjie Liao , Jianping Shi , Ziyang Ma , Jun Zhu , Jiaya Jia