English
Related papers

Related papers: Online Learning of Combinatorial Objects via Exten…

200 papers

In recent years, binary code learning, a.k.a hashing, has received extensive attention in large-scale multimedia retrieval. It aims to encode high-dimensional data points to binary codes, hence the original high-dimensional metric space can…

Computer Vision and Pattern Recognition · Computer Science 2019-05-28 Mingbao Lin , Rongrong Ji , Hong Liu , Yongjian Liu

On-line and batch learning of a perceptron in a discrete weight space, where each weight can take $2 L+1$ different values, are examined analytically and numerically. The learning algorithm is based on the training of the continuous…

Statistical Mechanics · Physics 2009-11-07 Michal Rosen-Zvi , Ido Kanter

This paper revisits the online learning approach to inverse linear optimization studied by B\"armann et al. (2017), where the goal is to infer an unknown linear objective function of an agent from sequential observations of the agent's…

Machine Learning · Computer Science 2025-02-11 Shinsaku Sakaue , Han Bao , Taira Tsuchiya

Federated learning is an emerging technique used to prevent the leakage of private information. Unlike centralized learning that needs to collect data from users and store them collectively on a cloud server, federated learning makes it…

Machine Learning · Computer Science 2019-06-11 Hangyu Zhu , Yaochu Jin

Many vision-related tasks benefit from reasoning over multiple modalities to leverage complementary views of data in an attempt to learn robust embedding spaces. Most deep learning-based methods rely on a late fusion technique whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Austin Reiter , Menglin Jia , Pu Yang , Ser-Nam Lim

This paper proposes a generic method to learn interpretable convolutional filters in a deep convolutional neural network (CNN) for object classification, where each interpretable filter encodes features of a specific object part. Our method…

Machine Learning · Computer Science 2020-03-13 Quanshi Zhang , Xin Wang , Ying Nian Wu , Huilin Zhou , Song-Chun Zhu

The Transformer architecture is shown to provide a powerful framework as an end-to-end model for building expression trees from online handwritten gestures corresponding to glyph strokes. In particular, the attention mechanism was…

Computation and Language · Computer Science 2022-11-07 Mirco Ramo , Guénolé C. M. Silvestre

We study decentralized online Riemannian optimization over manifolds with possibly positive curvature, going beyond the Hadamard manifold setting. Decentralized optimization techniques rely on a consensus step that is well understood in…

Optimization and Control · Mathematics 2025-09-10 Emre Sahinoglu , Shahin Shahrampour

We consider the problem of multi-task learning in the high dimensional setting. In particular, we introduce an estimator and investigate its statistical and computational properties for the problem of multiple connected linear regressions…

Machine Learning · Statistics 2023-07-03 Amir Asiaee , Samet Oymak , Kevin R. Coombes , Arindam Banerjee

Federated learning allows edge devices to collaboratively learn a shared model while keeping the training data on device, decoupling the ability to do model training from the need to store the data in the cloud. We propose Federated matched…

Machine Learning · Computer Science 2020-02-18 Hongyi Wang , Mikhail Yurochkin , Yuekai Sun , Dimitris Papailiopoulos , Yasaman Khazaeni

Generalization to out-of-distribution (OOD) circumstances after training remains a challenge for artificial agents. To improve the robustness displayed by plastic Hebbian neural networks, we evolve a set of Hebbian learning rules, where…

Neural and Evolutionary Computing · Computer Science 2021-04-19 Joachim Winther Pedersen , Sebastian Risi

Machine learning has emerged as a powerful approach in materials discovery. Its major challenge is selecting features that create interpretable representations of materials, useful across multiple prediction tasks. We introduce an…

This paper presents a deep relational metric learning (DRML) framework for image clustering and retrieval. Most existing deep metric learning methods learn an embedding space with a general objective of increasing interclass distances and…

Computer Vision and Pattern Recognition · Computer Science 2021-08-24 Wenzhao Zheng , Borui Zhang , Jiwen Lu , Jie Zhou

Recent research has proposed neural architectures for solving combinatorial problems in structured output spaces. In many such problems, there may exist multiple solutions for a given input, e.g. a partially filled Sudoku puzzle may have…

Machine Learning · Computer Science 2021-04-06 Yatin Nandwani , Deepanshu Jindal , Mausam , Parag Singla

Estimating the pose and shape of hands and objects under interaction finds numerous applications including augmented and virtual reality. Existing approaches for hand and object reconstruction require explicitly defined physical constraints…

Computer Vision and Pattern Recognition · Computer Science 2022-04-28 Tze Ho Elden Tse , Kwang In Kim , Ales Leonardis , Hyung Jin Chang

Many real-world problems can be reduced to combinatorial optimization on a graph, where the subset or ordering of vertices that maximize some objective function must be found. With such tasks often NP-hard and analytically intractable,…

Machine Learning · Computer Science 2021-03-22 Thomas D. Barrett , William R. Clements , Jakob N. Foerster , A. I. Lvovsky

It is known that the complex Grassmannian of $k$-dimensional subspaces can be identified with the set of projection matrices of rank $k$. It is also classically known that the convex hull of this set is the set of Hermitian matrices with…

Combinatorics · Mathematics 2024-03-19 Kazumasa Narita

Learning in Riemannian orbifolds is motivated by existing machine learning algorithms that directly operate on finite combinatorial structures such as point patterns, trees, and graphs. These methods, however, lack statistical…

Machine Learning · Computer Science 2012-04-20 Brijnesh J. Jain , Klaus Obermayer

We build a theoretical framework for designing and understanding practical meta-learning methods that integrates sophisticated formalizations of task-similarity with the extensive literature on online convex optimization and sequential…

Machine Learning · Computer Science 2019-12-10 Mikhail Khodak , Maria-Florina Balcan , Ameet Talwalkar

We study online prediction where regret of the algorithm is measured against a benchmark defined via evolving constraints. This framework captures online prediction on graphs, as well as other prediction problems with combinatorial…

Machine Learning · Computer Science 2015-06-15 Alexander Rakhlin , Karthik Sridharan