English
Related papers

Related papers: A Deep Graph Reinforcement Learning Model for Impr…

200 papers

When an agent acquires new information, ideally it would immediately be capable of using that information to understand its environment. This is not possible using conventional deep neural networks, which suffer from catastrophic forgetting…

Machine Learning · Computer Science 2020-04-20 Tyler L. Hayes , Christopher Kanan

We formulate tracking as an online decision-making process, where a tracking agent must follow an object despite ambiguous image frames and a limited computational budget. Crucially, the agent must decide where to look in the upcoming…

Computer Vision and Pattern Recognition · Computer Science 2017-07-18 James Steven Supancic , Deva Ramanan

Click-through rate prediction plays an important role in the field of recommender system and many other applications. Existing methods mainly extract user interests from user historical behaviors. However, behavioral sequences only contain…

Information Retrieval · Computer Science 2021-09-28 Yunfei Chu , Xiaofu Chang , Kunyang Jia , Jingzhen Zhou , Hongxia Yang

Session length is a very important aspect in determining a user's satisfaction with a media streaming service. Being able to predict how long a session will last can be of great use for various downstream tasks, such as recommendations and…

Information Retrieval · Computer Science 2017-08-02 Theodore Vasiloudis , Hossein Vahabi , Ross Kravitz , Valery Rashkov

Providing a high-quality real-time video streaming experience to mobile users is one of the biggest challenges in cellular networks. This is due to the need of these services for high rates with low variability, which is not easy to…

Networking and Internet Architecture · Computer Science 2021-06-01 Fidan Mehmeti , Thomas F. La Porta

Fine tuning distributed systems is considered to be a craftsmanship, relying on intuition and experience. This becomes even more challenging when the systems need to react in near real time, as streaming engines have to do to maintain…

Distributed, Parallel, and Cluster Computing · Computer Science 2018-09-17 Luis M. Vaquero , Felix Cuadrado

Analytical dashboards are popular in business intelligence to facilitate insight discovery with multiple charts. However, creating an effective dashboard is highly demanding, which requires users to have adequate data analysis background…

Human-Computer Interaction · Computer Science 2022-09-14 Dazhen Deng , Aoyu Wu , Huamin Qu , Yingcai Wu

In computational reinforcement learning, a growing body of work seeks to construct an agent's perception of the world through predictions of future sensations; predictions about environment observations are used as additional input features…

Machine Learning · Computer Science 2022-06-15 Alexandra Kearney , Anna Koop , Johannes Günther , Patrick M. Pilarski

The increasing popularity of e-learning has created demand for improving online education through techniques such as predictive analytics and content recommendations. In this paper, we study learner outcome predictions, i.e., predictions of…

Machine Learning · Computer Science 2020-01-24 Yuwei Tu , Weiyu Chen , Christopher G. Brinton

We study the problem of evaluating persistent queries over streaming graphs in a principled fashion. These queries need to be evaluated over unbounded and very high speed graph streams. We define a streaming graph data model and query model…

Databases · Computer Science 2021-08-03 Anil Pacaci , Angela Bonifati , M. Tamer Özsu

Content Delivery Networks carry the majority of Internet traffic, and the increasing demand for video content as a major IP traffic across the Internet highlights the importance of caching and prefetching optimization algorithms.…

Networking and Internet Architecture · Computer Science 2023-10-13 Nawras Alkassab , Chin-Tser Huang , Tania Lorido Botran

We present a deep reinforcement learning approach to minimizing the execution cost of neural network computation graphs in an optimizing compiler. Unlike earlier learning-based works that require training the optimizer on the same graph to…

Machine Learning · Computer Science 2020-02-11 Aditya Paliwal , Felix Gimeno , Vinod Nair , Yujia Li , Miles Lubin , Pushmeet Kohli , Oriol Vinyals

Processing data streams arriving at high speed requires the development of models that can provide fast and accurate predictions. Although deep neural networks are the state-of-the-art for many machine learning tasks, their performance in…

Machine Learning · Computer Science 2020-04-07 Pedro Lara-Benítez , Manuel Carranza-García , Francisco Martínez-Álvarez , José C. Riquelme

Recommender systems play a crucial role in our daily lives. Feed streaming mechanism has been widely used in the recommender system, especially on the mobile Apps. The feed streaming setting provides users the interactive manner of…

Information Retrieval · Computer Science 2019-07-12 Lixin Zou , Long Xia , Zhuoye Ding , Jiaxing Song , Weidong Liu , Dawei Yin

In recent years, live streaming platforms have gained immense popularity as they allow users to broadcast their videos and interact in real-time with hosts and peers. Due to the dynamic changes of live content, accurate recommendation…

Computer Vision and Pattern Recognition · Computer Science 2023-06-27 Jiaxin Deng , Dong Shen , Shiyao Wang , Xiangyu Wu , Fan Yang , Guorui Zhou , Gaofeng Meng

This work demonstrates that training autoregressive video diffusion models from a single video stream$\unicode{x2013}$resembling the experience of embodied agents$\unicode{x2013}$is not only possible, but can also be as effective as…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Jason Yoo , Yingchen He , Saeid Naderiparizi , Dylan Green , Gido M. van de Ven , Geoff Pleiss , Frank Wood

The Click-Through Rate (CTR) prediction task is critical in industrial recommender systems, where models are usually deployed on dynamic streaming data in practical applications. Such streaming data in real-world recommender systems face…

Information Retrieval · Computer Science 2023-07-17 Qi-Wei Wang , Hongyu Lu , Yu Chen , Da-Wei Zhou , De-Chuan Zhan , Ming Chen , Han-Jia Ye

Recent work on deep reinforcement learning (DRL) has pointed out that algorithmic information about good policies can be extracted from offline data which lack explicit information about executed actions. For example, videos of humans or…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Haozhe Liu , Mingchen Zhuge , Bing Li , Yuhui Wang , Francesco Faccio , Bernard Ghanem , Jürgen Schmidhuber

Live-streaming, as an emerging media enabling real-time interaction between authors and users, has attracted significant attention. Unlike the stable playback time of traditional TV live or the fixed content of short video, live-streaming,…

Information Retrieval · Computer Science 2025-12-09 Jiangxia Cao , Ruochen Yang , Xiang Chen , Changxin Lao , Yueyang Liu , Yusheng Huang , Yuanhao Tian , Xiangyu Wu , Shuang Yang , Zhaojie Liu , Guorui Zhou

Bandwidth estimation and congestion control for real-time communications (i.e., audio and video conferencing) remains a difficult problem, despite many years of research. Achieving high quality of experience (QoE) for end users requires…

Networking and Internet Architecture · Computer Science 2019-12-06 Joyce Fang , Martin Ellis , Bin Li , Siyao Liu , Yasaman Hosseinkashi , Michael Revow , Albert Sadovnikov , Ziyuan Liu , Peng Cheng , Sachin Ashok , David Zhao , Ross Cutler , Yan Lu , Johannes Gehrke