中文
相关论文

相关论文: K-Deep Simplex: Deep Manifold Learning via Local D…

200 篇论文

We introduce the localized Lasso, which is suited for learning models that are both interpretable and have a high predictive power in problems with high dimensionality $d$ and small sample size $n$. More specifically, we consider a function…

机器学习 · 统计学 2016-10-17 Makoto Yamada , Koh Takeuchi , Tomoharu Iwata , John Shawe-Taylor , Samuel Kaski

The idea that many important classes of signals can be well-represented by linear combinations of a small set of atoms selected from a given dictionary has had dramatic impact on the theory and practice of signal processing. For practical…

信息论 · 计算机科学 2015-03-18 Quan Geng , Huan Wang , John Wright

We consider the task of aligning two sets of points in high dimension, which has many applications in natural language processing and computer vision. As an example, it was recently shown that it is possible to infer a bilingual lexicon,…

机器学习 · 计算机科学 2018-05-30 Edouard Grave , Armand Joulin , Quentin Berthet

This paper introduces a general multi-class approach to weakly supervised classification. Inferring the labels and learning the parameters of the model is usually done jointly through a block-coordinate descent algorithm such as…

机器学习 · 计算机科学 2012-07-03 Armand Joulin , Francis Bach

The volume of image repositories continues to grow. Despite the availability of content-based addressing, we still lack a lightweight tool that allows us to discover images of distinct characteristics from a large collection. In this paper,…

计算机视觉与模式识别 · 计算机科学 2024-02-15 Shanfeng Hu

The sparsity of signals in a transform domain or dictionary has been exploited in applications such as compression, denoising and inverse problems. More recently, data-driven adaptation of synthesis dictionaries has shown promise compared…

机器学习 · 计算机科学 2019-06-14 Saiprasad Ravishankar , Raj Rao Nadakuditi , Jeffrey A. Fessler

Speculative Decoding (SD) has emerged as a widely used paradigm to accelerate the inference of large language models (LLMs) without compromising generation quality. It works by efficiently drafting multiple tokens using a compact model and…

计算与语言 · 计算机科学 2026-01-21 Mingbo Song , Heming Xia , Jun Zhang , Chak Tou Leong , Qiancheng Xu , Wenjie Li , Sujian Li

Motivated by the growing interest in representation learning approaches that uncover the latent structure of high-dimensional data, this work proposes new algorithms for reconstruction-based manifold learning within Reproducing-Kernel…

机器学习 · 计算机科学 2026-05-07 Enrique Feito-Casares , Francisco M. Melgarejo-Meseguer , José-Luis Rojo-Álvarez

We present in this paper a novel approach for training deterministic auto-encoders. We show that by adding a well chosen penalty term to the classical reconstruction cost function, we can achieve results that equal or surpass those attained…

人工智能 · 计算机科学 2011-04-22 Salah Rifai , Xavier Muller , Xavier Glorot , Gregoire Mesnil , Yoshua Bengio , Pascal Vincent

Clustering is a fundamental unsupervised learning approach. Many clustering algorithms -- such as $k$-means -- rely on the euclidean distance as a similarity measure, which is often not the most relevant metric for high dimensional data…

机器学习 · 计算机科学 2019-10-22 Aude Genevay , Gabriel Dulac-Arnold , Jean-Philippe Vert

This paper demonstrates a self-supervised framework for learning voxel-wise coarse-to-fine representations tailored for dense downstream tasks. Our approach stems from the observation that existing methods for hierarchical representation…

计算机视觉与模式识别 · 计算机科学 2024-05-28 Eytan Kats , Jochen G. Hirsch , Mattias P. Heinrich

We consider the problem of learning a dictionary matrix from a number of observed signals, which are assumed to be generated via a linear model with a common underlying dictionary. In particular, we derive lower bounds on the minimum…

机器学习 · 统计学 2015-07-21 Alexander Jung , Yonina C. Eldar , Norbert Görtz

Sparse clustering, which aims to find a proper partition of an extremely high-dimensional data set with redundant noise features, has been attracted more and more interests in recent years. The existing studies commonly solve the problem in…

机器学习 · 统计学 2019-02-25 Xiangyu Chang , Yu Wang , Rongjian Li , Zongben Xu

We address the problem of vehicle self-localization from multi-modal sensor information and a reference map. The map is generated off-line by extracting landmarks from the vehicle's field of view, while the measurements are collected…

机器人学 · 计算机科学 2019-07-22 Nico Engel , Stefan Hoermann , Markus Horn , Vasileios Belagiannis , Klaus Dietmayer

Manifold learning builds on the "manifold hypothesis," which posits that data in high-dimensional datasets are drawn from lower-dimensional manifolds. Current tools generate global embeddings of data, rather than the local maps used to…

机器学习 · 计算机科学 2025-08-28 Serena Hughes , Timothy Hamilton , Tom Kolokotrones , Eric J. Deeds

We introduce a new method for neighbourhood selection in linear structural equation models that improves over classical methods such as best subset selection (BSS) and the Lasso. Our method, called KL-BSS, takes advantage of the existence…

统计理论 · 数学 2025-10-07 Ming Gao , Wai Ming Tai , Bryon Aragam

A dictionary is a database of standard vectors, so that other vectors / signals are expressed as linear combinations of dictionary vectors, and the task of learning a dictionary for a given data is to find a good dictionary so that the…

机器学习 · 计算机科学 2020-07-09 Mohammed Rayyan Sheriff , Debasish Chatterjee

Dynamic Programming (DP) provides standard algorithms to solve Markov Decision Processes. However, these algorithms generally do not optimize a scalar objective function. In this paper, we draw connections between DP and (constrained)…

机器学习 · 计算机科学 2019-10-30 Nino Vieillard , Olivier Pietquin , Matthieu Geist

We present a novel method called TESALOCS (TEnsor SAmpling and LOCal Search) for multidimensional optimization, combining the strengths of gradient-free discrete methods and gradient-based approaches. The discrete optimization in our method…

最优化与控制 · 数学 2025-05-20 Konstantin Sozykin , Andrei Chertkov , Anh-Huy Phan , Ivan Oseledets , Gleb Ryzhakov

We focus on the minimization of the least square loss function either under a $k$-sparse constraint or with a sparse penalty term. Based on recent results, we reformulate the $\ell_0$ pseudo-norm exactly as a convex minimization problem by…

最优化与控制 · 数学 2019-03-07 Arne Bechensteen , Laure Blanc-Féraud , Gilles Aubert