English
Related papers

Related papers: LLM4ES: Learning User Embeddings from Event Sequen…

200 papers

Machine learning practitioners often face significant challenges in formally integrating their prior knowledge and beliefs into predictive models, limiting the potential for nuanced and context-aware analyses. Moreover, the expertise needed…

Machine Learning · Statistics 2024-12-23 James Requeima , John Bronskill , Dami Choi , Richard E. Turner , David Duvenaud

Large Language Models (LLMs) have recently garnered significant attention in various domains, including recommendation systems. Recent research leverages the capabilities of LLMs to improve the performance and user modeling aspects of…

Information Retrieval · Computer Science 2024-11-05 Lei Chen , Chen Gao , Xiaoyi Du , Hengliang Luo , Depeng Jin , Yong Li , Meng Wang

Large Language Models (LLMs) have been widely used as general-purpose AI agents showing comparable performance on many downstream tasks. However, existing work shows that it is challenging for LLMs to integrate structured data (e.g. KG,…

Computation and Language · Computer Science 2024-02-23 Younghun Lee , Sungchul Kim , Tong Yu , Ryan A. Rossi , Xiang Chen

Large Language Models (LLMs) have revolutionized various fields with their exceptional capabilities in understanding, processing, and generating human-like text. This paper investigates the potential of LLMs in advancing Network Intrusion…

Cryptography and Security · Computer Science 2025-07-08 Shuo Yang , Xinran Zheng , Xinchen Zhang , Jinfeng Xu , Jinze Li , Donglin Xie , Weicai Long , Edith C. H. Ngai

Emotion recognition from speech is a challenging task that requires capturing both linguistic and paralinguistic cues, with critical applications in human-computer interaction and mental health monitoring. Recent works have highlighted the…

Audio and Speech Processing · Electrical Eng. & Systems 2025-08-21 Hugo Thimonier , Antony Perzo , Renaud Seguier

Salient facts of sociopolitical events are distilled into quadruples following a format of subject, relation, object, and timestamp. Machine learning methods, such as graph neural networks (GNNs) and recurrent neural networks (RNNs), have…

Computation and Language · Computer Science 2024-12-03 Libo Zhang , Yue Ning

Large Language Models (LLMs) excel at capturing latent semantics and contextual relationships across diverse modalities. However, in modeling user behavior from sequential interaction data, performance often suffers when such semantic…

Computation and Language · Computer Science 2025-10-22 Mahsa Valizadeh , Xiangjue Dong , Rui Tuo , James Caverlee

Fine-tuning LLM-based text embedders via contrastive learning maps inputs and outputs into a new representational space, discarding the LLM's output semantics. We propose LLM2Vec-Gen, a self-supervised alternative that instead produces…

Computation and Language · Computer Science 2026-04-03 Parishad BehnamGhader , Vaibhav Adlakha , Fabian David Schmidt , Nicolas Chapados , Marius Mosbach , Siva Reddy

Large language models (LLMs) have garnered significant attention for their superior performance in many knowledge-driven applications on the world wide web.These models are designed to train hundreds of millions or more parameters on large…

Computation and Language · Computer Science 2025-04-09 Bingchen Liu , Yuanyuan Fang , Naixing Xu , Shihao Hou , Xin Li , Qian Li

Large Language Models (LLMs) have significantly impacted numerous domains, including Software Engineering (SE). Many recent publications have explored LLMs applied to various SE tasks. Nevertheless, a comprehensive understanding of the…

Software Engineering · Computer Science 2024-04-11 Xinyi Hou , Yanjie Zhao , Yue Liu , Zhou Yang , Kailong Wang , Li Li , Xiapu Luo , David Lo , John Grundy , Haoyu Wang

Multimodal recommender systems (MRS) integrate heterogeneous user and item data, such as text, images, and structured information, to enhance recommendation performance. The emergence of large language models (LLMs) introduces new…

Information Retrieval · Computer Science 2025-05-16 Alejo Lopez-Avila , Jinhua Du

With the rise of large language models (LLMs), recent works have leveraged LLMs to improve the performance of click-through rate (CTR) prediction. However, we argue that a critical obstacle remains in deploying LLMs for practical use: the…

Information Retrieval · Computer Science 2024-03-29 Binzong Geng , Zhaoxin Huan , Xiaolu Zhang , Yong He , Liang Zhang , Fajie Yuan , Jun Zhou , Linjian Mo

Sentence embeddings are crucial in measuring semantic similarity. Most recent studies employed large language models (LLMs) to learn sentence embeddings. Existing LLMs mainly adopted autoregressive architecture without explicit backward…

Computation and Language · Computer Science 2024-03-15 Xianming Li , Jing Li

Autoregressive language models (LMs) generate one token at a time, yet human reasoning operates over higher-level abstractions - sentences, propositions, and concepts. This contrast raises a central question- Can LMs likewise learn to…

Computation and Language · Computer Science 2025-10-14 Hyeonbin Hwang , Byeongguk Jeon , Seungone Kim , Jiyeon Kim , Hoyeon Chang , Sohee Yang , Seungpil Won , Dohaeng Lee , Youbin Ahn , Minjoon Seo

Large Language Models (LLMs), typified by OpenAI's GPT, have marked a significant advancement in artificial intelligence. Trained on vast amounts of text data, LLMs are capable of understanding and generating human-like text across a…

Artificial Intelligence · Computer Science 2024-10-29 Haochen Zhang , Yuyang Dong , Chuan Xiao , Masafumi Oyamada

Recent advancements in Large Language Models (LLMs) have the potential to transform financial analytics by integrating numerical and textual data. However, challenges such as insufficient context when fusing multimodal information and the…

Computational Finance · Quantitative Finance 2024-11-14 Hoyoung Lee , Youngsoo Choi , Yuhee Kwon

Alongside the rapid development of Large Language Models (LLMs), there has been a notable increase in efforts to integrate LLM techniques in information retrieval (IR) and search engines (SE). Recently, an additional post-ranking stage is…

Information Retrieval · Computer Science 2024-11-05 Yang Yan , Yihao Wang , Chi Zhang , Wenyuan Hou , Kang Pan , Xingkai Ren , Zelun Wu , Zhixin Zhai , Enyun Yu , Wenwu Ou , Yang Song

Large Language Models (LLMs) excel in various natural language processing tasks, but leveraging them for dense passage embedding remains challenging. This is due to their causal attention mechanism and the misalignment between their…

Computation and Language · Computer Science 2024-08-08 Hieu Man , Nghia Trung Ngo , Franck Dernoncourt , Thien Huu Nguyen

We find that event features extracted by large language models (LLMs) are effective for text-based stock return prediction. Using a pre-trained LLM to extract event features from news articles, we propose a novel deep learning model based…

General Economics · Economics 2025-12-24 Gang Li , Dandan Qiao , Mingxuan Zheng

Recent advancements in Large Language Models (LLMs) have attracted considerable interest among researchers to leverage these models to enhance Recommender Systems (RSs). Existing work predominantly utilizes LLMs to generate knowledge-rich…

Information Retrieval · Computer Science 2024-07-25 Zhongxiang Sun , Zihua Si , Xiaoxue Zang , Kai Zheng , Yang Song , Xiao Zhang , Jun Xu