中文
相关论文

相关论文: A Systematic Review and Replicability Study of BER…

200 篇论文

Transformer-based sequential recommendation (TSR) models have shown superior performance in recommendation systems, where the quality of item representations plays a crucial role. Classical representation methods integrate item features…

信息检索 · 计算机科学 2025-04-22 Hao Deng , Haibo Xing , Kanefumi Matsuyama , Yulei Huang , Jinxin Hu , Hong Wen , Jia Xu , Zulong Chen , Yu Zhang , Xiaoyi Zeng , Jing Zhang

Large foundational models, through upstream pre-training and downstream fine-tuning, have achieved immense success in the broad AI community due to improved model performance and significant reductions in repetitive engineering. By…

信息检索 · 计算机科学 2024-03-19 Jiaqi Zhang , Yu Cheng , Yongxin Ni , Yunzhu Pan , Zheng Yuan , Junchen Fu , Youhua Li , Jie Wang , Fajie Yuan

Multi-agent systems must decide which agent is the most appropriate for a given task. We propose a novel architecture for recommending which LLM agent out of many should perform a task given a natural language prompt by extending the…

机器学习 · 计算机科学 2025-01-24 Joshua Park , Yongfeng Zhang

While large scale pre-trained language models such as BERT have achieved great success on various natural language understanding tasks, how to efficiently and effectively incorporate them into sequence-to-sequence models and the…

计算与语言 · 计算机科学 2020-10-14 Junliang Guo , Zhirui Zhang , Linli Xu , Hao-Ran Wei , Boxing Chen , Enhong Chen

Universities serve as a hub for academic collaboration, promoting the exchange of diverse ideas and perspectives among students and faculty through interdisciplinary dialogue. However, as universities expand in size, conventional networking…

信息检索 · 计算机科学 2025-09-03 Sangeetha N , Harish Thangaraj , Varun Vashisht , Eshaan Joshi , Kanishka Verma , Diya Katariya

BERT, which stands for Bidirectional Encoder Representations from Transformers, is a recently introduced language representation model based upon the transfer learning paradigm. We extend its fine-tuning procedure to address one of its…

计算与语言 · 计算机科学 2019-10-25 Raghavendra Pappagari , Piotr Żelasko , Jesús Villalba , Yishay Carmiel , Najim Dehak

Session-based recommenders, used for making predictions out of users' uninterrupted sequences of actions, are attractive for many applications. Here, for this task we propose using metric learning, where a common embedding space for…

信息检索 · 计算机科学 2021-01-08 Bartłomiej Twardowski , Paweł Zawistowski , Szymon Zaborowski

The Transformer architecture revolutionized the field of natural language processing (NLP). Transformers-based models (e.g., BERT) power many important Web services, such as search, translation, question-answering, etc. While enormous…

计算与语言 · 计算机科学 2021-02-23 Dave Dice , Alex Kogan

The collaborative ranking problem has been an important open research question as most recommendation problems can be naturally formulated as ranking problems. While much of collaborative ranking methodology assumes static ranking data, the…

机器学习 · 计算机科学 2019-08-16 Liwei Wu , Shuqing Li , Cho-Jui Hsieh , James Sharpnack

This paper presents BERT-CTC, a novel formulation of end-to-end speech recognition that adapts BERT for connectionist temporal classification (CTC). Our formulation relaxes the conditional independence assumptions used in conventional CTC…

音频与语音处理 · 电气工程与系统科学 2023-04-21 Yosuke Higuchi , Brian Yan , Siddhant Arora , Tetsuji Ogawa , Tetsunori Kobayashi , Shinji Watanabe

Sequential recommendation systems often struggle to make predictions or take action when dealing with cold-start items that have limited amount of interactions. In this work, we propose SimRec - a new approach to mitigate the cold-start…

信息检索 · 计算机科学 2024-10-30 Shaked Brody , Shoval Lagziel

Active learning has been shown to be an effective way to alleviate some of the effort required in utilising large collections of unlabelled data for machine learning tasks without needing to fully label them. The representation mechanism…

信息检索 · 计算机科学 2020-04-29 Jinghui Lu , Brian MacNamee

In sequential recommendation (SR), the self-attention mechanism of Transformer-based models acts as a low-pass filter, limiting their ability to capture high-frequency signals that reflect short-term user interests. To overcome this, BSARec…

信息检索 · 计算机科学 2025-12-22 Jan Hutter , Hua Chang Bakker , Stan Fris , Madelon Bernardy , Yuanna Liu

Sequential user modeling, a critical task in personalized recommender systems, focuses on predicting the next item a user would prefer, requiring a deep understanding of user behavior sequences. Despite the remarkable success of…

人工智能 · 计算机科学 2023-10-10 Hao Wang , Jianxun Lian , Mingqi Wu , Haoxuan Li , Jiajun Fan , Wanyue Xu , Chaozhuo Li , Xing Xie

Pre-trained and fine-tuned transformer models like BERT and T5 have improved the state of the art in ad-hoc retrieval and question-answering, but not as yet in high-recall information retrieval, where the objective is to retrieve…

信息检索 · 计算机科学 2022-08-16 Nima Sadri , Gordon V. Cormack

Sequential recommendation systems aim to provide personalized recommendations by analyzing dynamic preferences and dependencies within user behavior sequences. Recently, Transformer models can effectively capture user preferences. However,…

信息检索 · 计算机科学 2024-07-30 Shun Zhang , Runsen Zhang , Zhirong Yang

The sequential recommender (SR) system is a crucial component of modern recommender systems, as it aims to capture the evolving preferences of users. Significant efforts have been made to enhance the capabilities of SR systems. These…

信息检索 · 计算机科学 2024-09-12 Mingjia Yin , Hao Wang , Wei Guo , Yong Liu , Suojuan Zhang , Sirui Zhao , Defu Lian , Enhong Chen

Transformer structures have been widely used in sequential recommender systems (SRS). However, as user interaction histories increase, computational time and memory requirements also grow. This is mainly caused by the standard attention…

Sequential recommendation models have achieved state-of-the-art performance using self-attention mechanism. It has since been found that moving beyond only using item ID and positional embeddings leads to a significant accuracy boost when…

信息检索 · 计算机科学 2024-09-10 Linsey Pang , Amir Hossein Raffiee , Wei Liu , Keld Lundgaard

The purpose of the study is to investigate the relative effectiveness of four different sentiment analysis techniques: (1) unsupervised lexicon-based model using Sent WordNet; (2) traditional supervised machine learning model using logistic…

计算与语言 · 计算机科学 2020-07-03 Shivaji Alaparthi , Manit Mishra