English
Related papers

Related papers: Low-dimensional Embeddings for Interpretable Ancho…

200 papers

Finding a good classifier is a multiobjective optimization problem with different error rates and the costs to be minimized. The receiver operating characteristic is widely used in the machine learning community to analyze the performance…

Neural and Evolutionary Computing · Computer Science 2014-12-19 Jiaqi Zhao , Vitor Basto Fernandes , Licheng Jiao , Iryna Yevseyeva , Asep Maulana , Rui Li , Thomas Bäck , Michael T. M. Emmerich

Good quality monolingual word embeddings (MWEs) can be built for languages which have large amounts of unlabeled text. MWEs can be aligned to bilingual spaces using only a few thousand word translation pairs. For low resource languages…

Computation and Language · Computer Science 2021-07-28 Tobias Eder , Viktor Hangya , Alexander Fraser

Convex clustering has recently garnered increasing interest due to its attractive theoretical and computational properties, but its merits become limited in the face of high-dimensional data. In such settings, pairwise affinity terms that…

Methodology · Statistics 2021-04-02 Saptarshi Chakraborty , Jason Xu

Type-level word embeddings use the same set of parameters to represent all instances of a word regardless of its context, ignoring the inherent lexical ambiguity in language. Instead, we embed semantic concepts (or synsets) as defined in…

Computation and Language · Computer Science 2017-05-09 Pradeep Dasigi , Waleed Ammar , Chris Dyer , Eduard Hovy

Question-answering systems and voice assistants are becoming major part of client service departments of many organizations, helping them to reduce the labor costs of staff. In many such systems, there is always natural language…

Computation and Language · Computer Science 2019-04-02 Aleksandr Perevalov , Daniil Kurushin , Rustam Faizrakhmanov , Farida Khabibrakhmanova

We build on abduction-based explanations for ma-chine learning and develop a method for computing local explanations for neural network models in natural language processing (NLP). Our explanations comprise a subset of the words of the…

Artificial Intelligence · Computer Science 2021-10-19 Emanuele La Malfa , Agnieszka Zbrzezny , Rhiannon Michelmore , Nicola Paoletti , Marta Kwiatkowska

Word embeddings are fundamental to natural language processing, yet traditional approaches represent each word with a single vector, creating representational bottlenecks for polysemous words and limiting semantic expressiveness. While…

Computation and Language · Computer Science 2026-04-30 Orhan Demirci , Sezer Aptourachman , Aydın Kaya

Embedding words in a vector space has gained a lot of attention in recent years. While state-of-the-art methods provide efficient computation of word similarities via a low-dimensional matrix embedding, their motivation is often left…

Computation and Language · Computer Science 2016-09-29 Shihao Ji , Hyokun Yun , Pinar Yanardag , Shin Matsushima , S. V. N. Vishwanathan

Building successful recommender systems requires uncovering the underlying dimensions that describe the properties of items as well as users' preferences toward them. In domains like clothing recommendation, explaining users' preferences…

Information Retrieval · Computer Science 2016-04-21 Ruining He , Chunbin Lin , Jianguo Wang , Julian McAuley

Slang interpretation has been a challenging downstream task for Large Language Models (LLMs) as the expressions are inherently embedded in contextual, cultural, and linguistic frameworks. In the absence of domain-specific training data, it…

Computation and Language · Computer Science 2026-03-17 Jinghan Cao , Qingyang Ren , Xiangyun Chen , Xinjin Li , Haoxiang Gao , Yu Zhao

The paper introduces a novel framework based on category theory to enhance the explainability of artificial intelligence systems, particularly focusing on word embeddings. Key topics include the construction of categories $\mathcal{L}_T$…

Artificial Intelligence · Computer Science 2025-08-29 Ares Fabregat-Hernández , Javier Palanca , Vicent Botti

Distilling knowledge from a well-trained cumbersome network to a small one has recently become a new research topic, as lightweight neural networks with high performance are particularly in need in various resource-restricted systems. This…

Computation and Language · Computer Science 2016-07-26 Lili Mou , Ran Jia , Yan Xu , Ge Li , Lu Zhang , Zhi Jin

Increased adaptability of RNN language models leads to improved predictions that benefit many applications. However, current methods do not take full advantage of the RNN structure. We show that the most widely-used approach to adaptation…

Computation and Language · Computer Science 2017-04-24 Aaron Jaech , Mari Ostendorf

Co-occurrence statistics based word embedding techniques have proved to be very useful in extracting the semantic and syntactic representation of words as low dimensional continuous vectors. In this work, we discovered that dictionary…

Computation and Language · Computer Science 2021-03-16 Juexiao Zhang , Yubei Chen , Brian Cheung , Bruno A Olshausen

Conventional text classification models make a bag-of-words assumption reducing text into word occurrence counts per document. Recent algorithms such as word2vec are capable of learning semantic meaning and similarity between words in an…

Computation and Language · Computer Science 2018-07-11 Vincent Major , Alisa Surkis , Yindalon Aphinyanaphongs

In this paper, we propose a deep convolutional neural network-based acoustic word embedding system on code-switching query by example spoken term detection. Different from previous configurations, we combine audio data in two languages for…

Audio and Speech Processing · Electrical Eng. & Systems 2020-05-26 Murong Ma , Haiwei Wu , Xuyang Wang , Lin Yang , Junjie Wang , Ming Li

Non-convex optimization problems often arise from probabilistic modeling, such as estimation of posterior distributions. Non-convexity makes the problems intractable, and poses various obstacles for us to design efficient algorithms. In…

Machine Learning · Computer Science 2013-12-18 Khoat Than , Tu Bao Ho

We analyze the orthogonal greedy algorithm when applied to dictionaries $\mathbb{D}$ whose convex hull has small entropy. We show that if the metric entropy of the convex hull of $\mathbb{D}$ decays at a rate of $O(n^{-\frac{1}{2}-\alpha})$…

Statistics Theory · Mathematics 2022-01-25 Jonathan W. Siegel , Jinchao Xu

Low-dimensional embeddings are essential for machine learning tasks involving graphs, such as node classification, link prediction, community detection, network visualization, and network compression. Although recent studies have identified…

Machine Learning · Computer Science 2025-03-04 Nikolaos Nakis , Niels Raunkjær Holm , Andreas Lyhne Fiehn , Morten Mørup

Most popular word embedding techniques involve implicit or explicit factorization of a word co-occurrence based matrix into low rank factors. In this paper, we aim to generalize this trend by using numerical methods to factor higher-order…

Machine Learning · Statistics 2017-09-19 Eric Bailey , Shuchin Aeron