中文
相关论文

相关论文: LREA: Low-Rank Efficient Attention on Modeling Lon…

200 篇论文

Click-through rate (CTR) prediction, which predicts the probability of a user clicking an ad, is a fundamental task in recommender systems. The emergence of heterogeneous information, such as user profile and behavior sequences, depicts…

Click-through rates prediction is critical in modern advertising systems, where ranking relevance and user engagement directly impact platform efficiency and business value. In this project, we explore how to model CTR more effectively…

机器学习 · 计算机科学 2025-12-01 Hongyu Yang , Chunxi Wen , Jiyin Zhang , Nanfei Shen , Shijiao Zhang , Xiyan Han

Many advanced Large Language Model (LLM) applications require long-context processing, but the self-attention module becomes a bottleneck during the prefilling stage of inference due to its quadratic time complexity with respect to sequence…

机器学习 · 计算机科学 2025-06-02 Xiaodong Ji , Hailin Zhang , Fangcheng Fu , Bin Cui

Click-through rate (CTR) prediction is a critical task in recommendation systems, serving as the ultimate filtering step to sort items for a user. Most recent cutting-edge methods primarily focus on investigating complex implicit and…

信息检索 · 计算机科学 2024-05-13 Song-Li Wu , Liang Du , Jia-Qi Yang , Yu-Ai Wang , De-Chuan Zhan , Shuang Zhao , Zi-Xun Sun

The click-through rate (CTR) reflects the ratio of clicks on a specific item to its total number of views. It has significant impact on websites' advertising revenue. Learning sophisticated models to understand and predict user behavior is…

机器学习 · 计算机科学 2020-07-29 Amit Livne , Roy Dor , Eyal Mazuz , Tamar Didi , Bracha Shapira , Lior Rokach

Click-Through Rate prediction (CTR) is a crucial task in recommender systems, and it gained considerable attention in the past few years. The primary purpose of recent research emphasizes obtaining meaningful and powerful representations…

信息检索 · 计算机科学 2022-10-26 Shereen Elsayed , Lars Schmidt-Thieme

Fine-tuning adapts a pre-trained model to downstream tasks using a small amount of labeled data. Low-Rank Adaptation (LoRA) is an efficient fine-tuning method that reduces memory and computation costs while often achieving performance close…

机器学习 · 计算机科学 2026-05-20 Ali Zindari , Rotem Mulayoff , Sebastian U. Stich

This research designs a unified architecture of CTR prediction benchmark (Bench-CTR) platform that offers flexible interfaces with datasets and components of a wide range of CTR prediction models. Moreover, we construct a comprehensive…

信息检索 · 计算机科学 2025-12-02 Shan Gao , Yanwu Yang

Learning-to-Rank (LTR) is a supervised machine learning approach that constructs models specifically designed to order a set of items or documents based on their relevance or importance to a given query or context. Despite significant…

信息检索 · 计算机科学 2026-04-17 Camilo Gomez , Pengyang Wang , Yanjie Fu

Click-through rate (CTR) is a key signal of relevance for search engine results, both organic and sponsored. CTR of a result has two core components: (a) the probability of examination of a result by a user, and (b) the perceived relevance…

机器学习 · 计算机科学 2018-10-22 Muhammad Asiful Islam , Ramakrishnan Srikant , Sugato Basu

Click-through rate (CTR) prediction is crucial for personalized online services. Sample-level retrieval-based models, such as RIM, have demonstrated remarkable performance. However, they face challenges including inference inefficiency and…

信息检索 · 计算机科学 2024-10-07 Huanshuo Liu , Bo Chen , Menghui Zhu , Jianghao Lin , Jiarui Qin , Yang Yang , Hao Zhang , Ruiming Tang

Low-rank Adaptation (LoRA) has gained popularity as a fine-tuning approach for Large Language Models (LLMs) due to its low resource requirements and good performance. While a plethora of work has investigated improving LoRA serving…

机器学习 · 计算机科学 2025-08-06 Minghao Yan , Zhuang Wang , Zhen Jia , Shivaram Venkataraman , Yida Wang

Long-context inference in Large Language Models (LLMs) is bottlenecked by the quadratic computation complexity of attention and the substantial memory footprint of Key-Value (KV) caches. While existing sparse attention mechanisms attempt to…

计算与语言 · 计算机科学 2026-02-03 Xuan Ai , Qingqing Yang , Peng Wang , Lei Deng , Lin Zhang , Renhai Chen , Gong Zhang

There is a lack of research on the analysis of per-user traffic in cellular networks, for deriving and following traffic-aware network management. \textcolor{black}{In fact, the legacy design approach, in which resource provisioning and…

系统与控制 · 电气工程与系统科学 2021-11-03 Amin Azari , Fateme Salehi , Panagiotis Papapetrou , Cicek Cavdar

Counterfactual learning to rank (CLTR) has attracted extensive attention in the IR community for its ability to leverage massive logged user interaction data to train ranking models. While the CLTR models can be theoretically unbiased when…

机器学习 · 计算机科学 2025-08-29 Zechun Niu , Zhilin Zhang , Jiaxin Mao , Qingyao Ai , Ji-Rong Wen

Multimodal click-through rate (CTR) prediction is a key technique in industrial recommender systems. It leverages heterogeneous modalities such as text, images, and behavioral logs to capture high-order feature interactions between users…

信息检索 · 计算机科学 2025-04-28 Honghao Li , Hanwei Li , Jing Zhang , Yi Zhang , Ziniu Yu , Lei Sang , Yiwen Zhang

The rapid advancements in vision-language models (VLMs), such as CLIP, have intensified the need to address distribution shifts between training and testing datasets. Although prior Test-Time Training (TTT) techniques for VLMs have…

计算机视觉与模式识别 · 计算机科学 2025-02-05 Yuto Kojima , Jiarui Xu , Xueyan Zou , Xiaolong Wang

Low-Rank Adaptation (LoRA) is the dominant parameter-efficient fine-tuning method due to its favorable compute-performance trade-off, yet it suffers from catastrophic forgetting. We study forgetting through a tractable _mean-field…

机器学习 · 计算机科学 2026-05-14 Hugo Koubbi , Louis Hernandez , Matthieu Boussard

Low-Rank Adaptation (LoRA) has emerged as a powerful and popular technique for personalization, enabling efficient adaptation of pre-trained image generation models for specific tasks without comprehensive retraining. While employing…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Tuna Han Salih Meral , Enis Simsar , Federico Tombari , Pinar Yanardag

The Softmax attention mechanism in Transformer models is notoriously computationally expensive, particularly due to its quadratic complexity, posing significant challenges in vision applications. In contrast, linear attention provides a far…

计算机视觉与模式识别 · 计算机科学 2025-03-12 Qihang Fan , Huaibo Huang , Ran He