English
Related papers

Related papers: Aligned at the Start: Conceptual Groupings in LLM …

200 papers

Pretrained embeddings based on the Transformer architecture have taken the NLP community by storm. We show that they can mathematically be reframed as a sum of vector factors and showcase how to use this reframing to study the impact of…

Computation and Language · Computer Science 2022-06-09 Timothee Mickus , Denis Paperno , Mathieu Constant

Despite their remarkable ability to capture linguistic nuances across diverse languages, questions persist regarding the degree of alignment between languages in multilingual embeddings. Drawing inspiration from research on high-dimensional…

Computation and Language · Computer Science 2024-05-24 Basel Mousi , Nadir Durrani , Fahim Dalvi , Majd Hawasly , Ahmed Abdelali

A key to knowledge graph embedding (KGE) is to choose a proper representation space, e.g., point-wise Euclidean space and complex vector space. In this paper, we propose a unified perspective of embedding and introduce uncertainty into KGE…

Machine Learning · Computer Science 2024-10-01 Changyi Xiao , Xiangnan He , Yixin Cao

Over the last two decades, the Latent Position Model (LPM) has become a prominent tool to obtain model-based visualizations of networks. However, the geometric structure of the LPM is inherently symmetric, in the sense that outgoing and…

Methodology · Statistics 2026-02-02 Chaoyi Lu , Riccardo Rastelli

Generative Pretrained Transformers (GPTs) are foundational Large Language Models (LLMs) for text generation. However, individual LLMs often produce inconsistent outputs and exhibit biases, limiting their representation of diverse language…

Computation and Language · Computer Science 2025-08-06 Mari Ashiga , Wei Jie , Fan Wu , Vardan Voskanyan , Fateme Dinmohammadi , Paul Brookes , Jingzhi Gong , Zheng Wang

Although value-aligned language models (LMs) appear unbiased in explicit bias evaluations, they often exhibit stereotypes in implicit word association tasks, raising concerns about their fair usage. We investigate the mechanisms behind this…

Computation and Language · Computer Science 2025-06-10 Lihao Sun , Chengzhi Mao , Valentin Hofmann , Xuechunzi Bai

Recommender systems often struggle with data sparsity and cold-start scenarios, limiting their ability to provide accurate suggestions for new or infrequent users. This paper presents a Graph Attention Network (GAT) based Collaborative…

Information Retrieval · Computer Science 2025-10-31 Danial Ebrat , Sepideh Ahmadian , Luis Rueda

Unsupervised methods are widely used to induce latent semantic structure from large text collections, yet their outputs often contain incoherent, redundant, or poorly grounded clusters that are difficult to validate without labeled data. We…

Computation and Language · Computer Science 2026-04-21 Tunazzina Islam

Analog and mixed-signal circuit design remains challenging due to the shortage of high-quality data and the difficulty of embedding domain knowledge into automated flows. Traditional black-box optimization achieves sampling efficiency but…

Machine Learning · Computer Science 2025-09-18 Ziming Wei , Zichen Kong , Yuan Wang , David Z. Pan , Xiyuan Tang

The rapid emergence of Large Language Models (LLMs) has precipitated a profound paradigm shift in Artificial Intelligence, delivering monumental engineering successes that increasingly impact modern society. However, a critical paradox…

Computation and Language · Computer Science 2026-03-13 Zeyu Gan , Ruifeng Ren , Wei Yao , Xiaolin Hu , Gengze Xu , Chen Qian , Huayi Tang , Zixuan Gong , Xinhao Yao , Pengwei Tang , Zhenxing Dou , Yong Liu

We evaluate LLMs' language understanding capacities on simple inference tasks that most humans find trivial. Specifically, we target (i) grammatically-specified entailments, (ii) premises with evidential adverbs of uncertainty, and (iii)…

Computation and Language · Computer Science 2024-04-12 Victoria Basmov , Yoav Goldberg , Reut Tsarfaty

This paper introduces VLAP, a novel approach that bridges pretrained vision models and large language models (LLMs) to make frozen LLMs understand the visual world. VLAP transforms the embedding space of pretrained vision models into the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Jungin Park , Jiyoung Lee , Kwanghoon Sohn

Recommender systems are essential for guiding users through the vast and diverse landscape of digital content by delivering personalized and relevant suggestions. However, improving both personalization and interpretability remains a…

Information Retrieval · Computer Science 2025-08-05 Danial Ebrat , Tina Aminian , Sepideh Ahmadian , Luis Rueda

Existing network embedding approaches tackle the problem of learning low-dimensional node representations. However, networks can also be seen in the light of edges interlinking pairs of nodes. The broad goal of this paper is to introduce…

Social and Information Networks · Computer Science 2020-11-12 Giuseppe Pirrò

Social networks profoundly influence how humans form opinions, exchange information, and organize collectively. As large language models (LLMs) are increasingly embedded into social and professional environments, it is critical to…

Social and Information Networks · Computer Science 2025-10-07 Marios Papachristou , Yuan Yuan

The ability to translate diverse patterns of inputs into structured patterns of behavior has been thought to rest on both humans' and machines' ability to learn robust representations of relevant concepts. The rapid advancement of…

Artificial Intelligence · Computer Science 2025-10-02 Zach Studdiford , Timothy T. Rogers , Kushin Mukherjee , Siddharth Suresh

Graph embeddings have become a key and widely used technique within the field of graph mining, proving to be successful across a broad range of domains including social, citation, transportation and biological. Graph embedding techniques…

Machine Learning · Computer Science 2018-06-21 Stephen Bonner , Ibad Kureshi , John Brennan , Georgios Theodoropoulos , Andrew Stephen McGough , Boguslaw Obara

Knowledge graph embedding aims at modeling entities and relations with low-dimensional vectors. Most previous methods require that all entities should be seen during training, which is unpractical for real-world knowledge graphs with new…

Artificial Intelligence · Computer Science 2020-10-06 Peifeng Wang , Jialong Han , Chenliang Li , Rong Pan

Large language models (LLMs) have garnered significant attention for their superior performance in many knowledge-driven applications on the world wide web.These models are designed to train hundreds of millions or more parameters on large…

Computation and Language · Computer Science 2025-04-09 Bingchen Liu , Yuanyuan Fang , Naixing Xu , Shihao Hou , Xin Li , Qian Li

In this paper, we propose Precision-Informed Semantic Modeling (PRISM), a structured topic modeling framework combining the benefits of rich representations captured by LLMs with the low cost and interpretability of latent semantic…

Machine Learning · Computer Science 2026-04-06 Connor Douglas , Utkucan Balci , Joseph Aylett-Bullock