English
Related papers

Related papers: Keep your distance: learning dispersed embeddings …

200 papers

Metric learning algorithms aim to learn a distance function that brings the semantically similar data items together and keeps dissimilar ones at a distance. The traditional Mahalanobis distance learning is equivalent to find a linear…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Karrar Al-Kaabi , Reza Monsefi , Davood Zabihzadeh

Deep networks are successfully used as classification models yielding state-of-the-art results when trained on a large number of labeled samples. These models, however, are usually much less suited for semi-supervised problems because of…

Machine Learning · Computer Science 2018-12-05 Elad Hoffer , Nir Ailon

Diffusion models generate images with an unprecedented level of quality, but how can we freely rearrange image layouts? Recent works generate controllable scenes via learning spatially disentangled latent codes, but these methods do not…

Computer Vision and Pattern Recognition · Computer Science 2024-04-11 Jiawei Ren , Mengmeng Xu , Jui-Chieh Wu , Ziwei Liu , Tao Xiang , Antoine Toisoul

In distributed statistical learning, $N$ samples are split across $m$ machines and a learner wishes to use minimal communication to learn as well as if the examples were on a single machine. This model has received substantial interest in…

Machine Learning · Computer Science 2019-03-19 Jayadev Acharya , Christopher De Sa , Dylan J. Foster , Karthik Sridharan

Modern successes of diffusion models in learning complex, high-dimensional data distributions are attributed, in part, to their capability to construct diffusion processes with analytic transition kernels and score functions. The…

Machine Learning · Statistics 2024-03-01 Guan-Horng Liu , Tianrong Chen , Evangelos A. Theodorou , Molei Tao

We present the MDS feature learning framework, in which multidimensional scaling (MDS) is applied on high-level pairwise image distances to learn fixed-length vector representations of images. The aspects of the images that are captured by…

Computer Vision and Pattern Recognition · Computer Science 2013-06-17 Quan Wang , Kim L. Boyer

Many of the existing methods for learning joint embedding of images and text use only supervised information from paired images and its textual attributes. Taking advantage of the recent success of unsupervised learning in deep neural…

Computer Vision and Pattern Recognition · Computer Science 2017-03-21 Yao-Hung Hubert Tsai , Liang-Kang Huang , Ruslan Salakhutdinov

Existing deep embedding methods in vision tasks are capable of learning a compact Euclidean space from images, where Euclidean distances correspond to a similarity metric. To make learning more effective and efficient, hard sample mining is…

Computer Vision and Pattern Recognition · Computer Science 2016-10-28 Chen Huang , Chen Change Loy , Xiaoou Tang

Modern realities and trends in learning require more and more generalization ability of models, which leads to an increase in both models and training sample size. It is already difficult to solve such tasks in a single device mode. This is…

Optimization and Control · Mathematics 2024-12-03 Dmitry Bylinkin , Kirill Degtyarev , Aleksandr Beznosikov

Euclidean embeddings of data are fundamentally limited in their ability to capture latent semantic structures, which need not conform to Euclidean spatial assumptions. Here we consider an alternative, which embeds data as discrete…

Machine Learning · Computer Science 2019-05-10 Charlie Frogner , Farzaneh Mirzazadeh , Justin Solomon

Semi-supervised clustering is an very important topic in machine learning and computer vision. The key challenge of this problem is how to learn a metric, such that the instances sharing the same label are more likely close to each other on…

Machine Learning · Computer Science 2015-01-27 Gang Chen

In this work, we study distributed sketching methods for large scale regression problems. We leverage multiple randomized sketches for reducing the problem dimensions as well as preserving privacy and improving straggler resilience in…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-06-23 Burak Bartan , Mert Pilanci

Diffusion models, such as Stable Diffusion, have shown incredible performance on text-to-image generation. Since text-to-image generation often requires models to generate visual concepts with fine-grained details and attributes specified…

Computer Vision and Pattern Recognition · Computer Science 2024-04-26 Xuehai He , Weixi Feng , Tsu-Jui Fu , Varun Jampani , Arjun Akula , Pradyumna Narayana , Sugato Basu , William Yang Wang , Xin Eric Wang

Detecting uncertainty in large language models (LLMs) is essential for building reliable systems, yet many existing approaches are overly complex and depend on brittle semantic clustering or access to model internals. We introduce Radial…

Machine Learning · Computer Science 2026-04-08 Manh Nguyen , Sunil Gupta , Hung Le

Machine learning for differential equations paves the way for computationally efficient alternatives to numerical solvers, with potentially broad impacts in science and engineering. Though current algorithms typically require simulated…

Machine Learning · Computer Science 2024-02-15 Grégoire Mialon , Quentin Garrido , Hannah Lawrence , Danyal Rehman , Yann LeCun , Bobak T. Kiani

We demonstrate that frequently appearing objects can be discovered by training randomly sampled patches from a small number of images (100 to 200) by self-supervision. Key to this approach is the pattern space, a latent space of patterns…

Computer Vision and Pattern Recognition · Computer Science 2021-06-17 Hankyu Moon , Heng Hao , Sima Didari , Jae Oh Woo , Patrick Bangert

Neural networks use their hidden layers to transform input data into linearly separable data clusters, with a linear or a perceptron type output layer making the final projection on the line perpendicular to the discriminating hyperplane.…

Machine Learning · Computer Science 2018-07-10 Wlodzislaw Duch

Deep image embedding provides a way to measure the semantic similarity of two images. It plays a central role in many applications such as image search, face verification, and zero-shot learning. It is desirable to have a universal deep…

Computer Vision and Pattern Recognition · Computer Science 2020-03-10 Yang Feng , Futang Peng , Xu Zhang , Wei Zhu , Shanfeng Zhang , Howard Zhou , Zhen Li , Tom Duerig , Shih-Fu Chang , Jiebo Luo

Data clustering, the task of grouping observations according to their similarity, is a key component of unsupervised learning -- with real world applications in diverse fields such as biology, medicine, and social science. Often in these…

Machine Learning · Computer Science 2023-09-20 Anne Sophie Riis Damstrup , Sofie Tosti Madsen , Michele Coscia

We present a novel view of nonlinear manifold learning using derivative-free optimization techniques. Specifically, we propose an extension of the classical multi-dimensional scaling (MDS) method, where instead of performing gradient…