English
Related papers

Related papers: FANS: Fast Non-Autoregressive Sequence Generation …

200 papers

Collaborative filtering (CF) is widely searched in recommendation with various types of solutions. Recent success of Graph Convolution Networks (GCN) in CF demonstrates the effectiveness of modeling high-order relationships through graphs,…

Information Retrieval · Computer Science 2023-02-13 Tianjun Wei , Jianghong Ma , Tommy W. S. Chow

Transformers achieve remarkable performance in several tasks but due to their quadratic complexity, with respect to the input's length, they are prohibitively slow for very long sequences. To address this limitation, we express the…

Machine Learning · Computer Science 2020-09-01 Angelos Katharopoulos , Apoorv Vyas , Nikolaos Pappas , François Fleuret

Attaining prototypical features to represent class distributions is well established in representation learning. However, learning prototypes online from streaming data proves a challenging endeavor as they rapidly become outdated, caused…

Computer Vision and Pattern Recognition · Computer Science 2021-10-20 Matthias De Lange , Tinne Tuytelaars

Personalized recommender systems fulfill the daily demands of customers and boost online businesses. The goal is to learn a policy that can generate a list of items that matches the user's demand or interest. While most existing methods…

Information Retrieval · Computer Science 2023-06-12 Shuchang Liu , Qingpeng Cai , Zhankui He , Bowen Sun , Julian McAuley , Dong Zheng , Peng Jiang , Kun Gai

Commercial establishments like restaurants, service centres and retailers have several sources of customer feedback about products and services, most of which need not be as structured as rated reviews provided by services like Yelp, or…

Computation and Language · Computer Science 2017-03-28 Vineet John

Non-autoregressive generation (NAG) has recently attracted great attention due to its fast inference speed. However, the generation quality of existing NAG models still lags behind their autoregressive counterparts. In this work, we show…

Computation and Language · Computer Science 2021-02-17 Yixuan Su , Deng Cai , Yan Wang , David Vandyke , Simon Baker , Piji Li , Nigel Collier

The goal of modern sequential recommender systems is often formulated in terms of next-item prediction. In this paper, we explore the applicability of generative transformer-based models for the Top-K sequential recommendation task, where…

Information Retrieval · Computer Science 2025-08-19 Anna Volodkevich , Danil Gusak , Anton Klenitskiy , Alexey Vasilev

Autoregressive models, often built on Transformer architectures, represent a powerful paradigm for generating ultra-long videos by synthesizing content in sequential chunks. However, this sequential generation process is notoriously slow.…

Computer Vision and Pattern Recognition · Computer Science 2026-02-12 Yuexiao Ma , Xuzhe Zheng , Jing Xu , Xiwei Xu , Feng Ling , Xiawu Zheng , Huafeng Kuang , Huixia Li , Xing Wang , Xuefeng Xiao , Fei Chao , Rongrong Ji

Autoregressive Transformer models have demonstrated impressive performance in video generation, but their sequential token-by-token decoding process poses a major bottleneck, particularly for long videos represented by tens of thousands of…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yang Ye , Junliang Guo , Haoyu Wu , Tianyu He , Tim Pearce , Tabish Rashid , Katja Hofmann , Jiang Bian

Flow models are effective at progressively generating realistic images, but they generally struggle to capture long-range dependencies during the generation process as they compress all the information from previous time steps into a single…

Computer Vision and Pattern Recognition · Computer Science 2025-06-17 Mude Hui , Rui-Jie Zhu , Songlin Yang , Yu Zhang , Zirui Wang , Yuyin Zhou , Jason Eshraghian , Cihang Xie

We study the problem of efficiently producing, in an online fashion, generative models of scalar, multiclass, and vector-valued outcomes that cannot be falsified on the basis of the observed data and a pre-specified collection of…

Machine Learning · Computer Science 2026-02-26 Gabriele Farina , Juan Carlos Perdomo

The malicious misuse and widespread dissemination of AI-generated images pose a significant threat to the authenticity of online information. Current detection methods often struggle to generalize to unseen generative models, and the rapid…

Computer Vision and Pattern Recognition · Computer Science 2026-01-12 Hanyi Wang , Jun Lan , Yaoyu Kang , Huijia Zhu , Weiqiang Wang , Zhuosheng Zhang , Shilin Wang

We address the challenge of efficient auto-regressive generation in sequence prediction models by introducing FutureFill, a general-purpose fast generation method for any sequence prediction algorithm based on convolutional operators.…

Machine Learning · Computer Science 2025-06-24 Naman Agarwal , Xinyi Chen , Evan Dogariu , Devan Shah , Hubert Strauss , Vlad Feinberg , Daniel Suo , Peter Bartlett , Elad Hazan

Sequential recommender systems have shown effective suggestions by capturing users' interest drift. There have been two groups of existing sequential models: user- and item-centric models. The user-centric models capture personalized…

Information Retrieval · Computer Science 2022-09-15 Dongmin Hyun , Chanyoung Park , Junsu Cho , Hwanjo Yu

Typical video classification methods often divide a video into short clips, do inference on each clip independently, then aggregate the clip-level predictions to generate the video-level results. However, processing visually similar clips…

Computer Vision and Pattern Recognition · Computer Science 2019-09-10 Linchao Zhu , Laura Sevilla-Lara , Du Tran , Matt Feiszli , Yi Yang , Heng Wang

This paper presents a novel approach that enables autoregressive video generation with high efficiency. We propose to reformulate the video generation problem as a non-quantized autoregressive modeling of temporal frame-by-frame prediction…

Computer Vision and Pattern Recognition · Computer Science 2025-03-04 Haoge Deng , Ting Pan , Haiwen Diao , Zhengxiong Luo , Yufeng Cui , Huchuan Lu , Shiguang Shan , Yonggang Qi , Xinlong Wang

Current video captioning methods usually use an encoder-decoder structure to generate text autoregressively. However, autoregressive methods have inherent limitations such as slow generation speed and large cumulative error. Furthermore,…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Junbo Wang , Liangyu Fu , Yuke Li , Yining Zhu , Ya Jing , Xuecheng Wu , Jiangbin Zheng

Generative techniques continue to evolve at an impressively high rate, driven by the hype about these technologies. This rapid advancement severely limits the application of deepfake detectors, which, despite numerous efforts by the…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Francesco Tassone , Luca Maiano , Irene Amerini

Although generative recommenders demonstrate improved performance with longer sequences, their real-time deployment is hindered by substantial computational costs. To address this challenge, we propose a simple yet effective method for…

Information Retrieval · Computer Science 2026-01-28 Qijiong Liu , Lu Fan , Zhongzhou Liu , Xiaoyu Dong , Yuankai Luo , Guoyuan An , Nuo Chen , Wei Guo , Yong Liu , Xiao-Ming Wu

Sequential recommendation aims to model dynamic user behavior from historical interactions. Existing methods rely on either explicit item IDs or general textual features for sequence modeling to understand user preferences. While promising,…

Information Retrieval · Computer Science 2023-05-30 Jiacheng Li , Ming Wang , Jin Li , Jinmiao Fu , Xin Shen , Jingbo Shang , Julian McAuley