English
Related papers

Related papers: A Deep Graph Reinforcement Learning Model for Impr…

200 papers

Many real-world auctions are dynamic processes, in which bidders interact and report information over multiple rounds with the auctioneer. The sequential decision making aspect paired with imperfect information renders analyzing the…

Computer Science and Game Theory · Computer Science 2023-12-21 Vinzenz Thoma , Michael Curry , Niao He , Sven Seuken

Deep reinforcement learning enables an agent to capture user's interest through interactions with the environment dynamically. It has attracted great interest in the recommendation research. Deep reinforcement learning uses a reward…

Information Retrieval · Computer Science 2020-11-05 Xiaocong Chen , Lina Yao , Aixin Sun , Xianzhi Wang , Xiwei Xu , Liming Zhu

For users navigating travel e-commerce websites, the process of researching products and making a purchase often results in intricate browsing patterns that span numerous sessions over an extended period of time. The resulting clickstream…

Information Retrieval · Computer Science 2024-09-23 William Black , Alexander Manlove , Jack Pennington , Andrea Marchini , Ercument Ilhan , Vilda Markeviciute

Deep networks are able to learn highly predictive models of video data. Due to video length, a common strategy is to train them on small video snippets. We apply the deep Taylor / LRP technique to understand the deep network's…

Machine Learning · Computer Science 2018-06-20 Christopher Anders , Grégoire Montavon , Wojciech Samek , Klaus-Robert Müller

Livestream e-commerce integrates live streaming and online shopping, allowing viewers to make purchases while watching. However, effective marketing strategies remain a challenge due to limited empirical research and subjective biases from…

Human-Computer Interaction · Computer Science 2023-08-03 Yuchen Wu , Yuansong Xu , Shenghan Gao , Xingbo Wang , Wenkai Song , Zhiheng Nie , Xiaomeng Fan , Quan Li

We have made significant progress towards building foundational video diffusion models. As these models are trained using large-scale unsupervised data, it has become crucial to adapt these models to specific downstream tasks. Adapting…

Computer Vision and Pattern Recognition · Computer Science 2024-07-12 Mihir Prabhudesai , Russell Mendonca , Zheyang Qin , Katerina Fragkiadaki , Deepak Pathak

Over the recent years, research and development in adaptive bitrate (ABR) algorithms for live video streaming have been successful in improving users' quality of experience (QoE) by reducing latency to near real-time levels while delivering…

Multimedia · Computer Science 2024-02-15 Adithya Raman , Bekir Turkkan , Tevfik Kosar

Highlights in a sport video are usually referred as actions that stimulate excitement or attract attention of the audience. A big effort is spent in designing techniques which find automatically highlights, in order to automatize the…

Computer Vision and Pattern Recognition · Computer Science 2017-10-03 Marco Godi , Paolo Rota , Francesco Setti

Streaming video generation, as one fundamental component in interactive world models and neural game engines, aims to generate high-quality, low-latency, and temporally coherent long video streams. However, most existing work suffers from…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Kunhao Liu , Wenbo Hu , Jiale Xu , Ying Shan , Shijian Lu

Deep learning based visual trackers entail offline pre-training on large volumes of video datasets with accurate bounding box annotations that are labor-expensive to achieve. We present a new framework to facilitate bounding box annotations…

Computer Vision and Pattern Recognition · Computer Science 2021-08-10 Kenan Dai , Jie Zhao , Lijun Wang , Dong Wang , Jianhua Li , Huchuan Lu , Xuesheng Qian , Xiaoyun Yang

High accuracy video label prediction (classification) models are attributed to large scale data. These data could be frame feature sequences extracted by a pre-trained convolutional-neural-network, which promote the efficiency for creating…

Computer Vision and Pattern Recognition · Computer Science 2019-06-04 Feng Mao , Xiang Wu , Hui Xue , Rong Zhang

Currently, deep reinforcement learning (RL) shows impressive results in complex gaming and robotic environments. Often these results are achieved at the expense of huge computational costs and require an incredible number of episodes of…

Machine Learning · Computer Science 2020-06-18 Alexey Skrynnik , Aleksey Staroverov , Ermek Aitygulov , Kirill Aksenov , Vasilii Davydov , Aleksandr I. Panov

This paper describes a system developed to help University students get more from their online lectures, tutorials, laboratory and other live sessions. We do this by logging their attention levels on their laptops during live Zoom sessions…

Multimedia · Computer Science 2021-01-19 Hyowon Lee , Mingming Liu , Hamza Riaz , Navaneethan Rajasekaren , Michael Scriney , Alan F. Smeaton

Detection and localization of actions in videos is an important problem in practice. State-of-the-art video analytics systems are unable to efficiently and effectively answer such action queries because actions often involve a complex…

Computer Vision and Pattern Recognition · Computer Science 2022-09-29 Pramod Chunduri , Jaeho Bang , Yao Lu , Joy Arulraj

Reinforcement learning is concerned with identifying reward-maximizing behaviour policies in environments that are initially unknown. State-of-the-art reinforcement learning approaches, such as deep Q-networks, are model-free and learn to…

Artificial Intelligence · Computer Science 2017-08-18 Felix Leibfried , Nate Kushman , Katja Hofmann

High-level driving behavior decision-making is an open-challenging problem for connected vehicle technology, especially in heterogeneous traffic scenarios. In this paper, a deep reinforcement learning based high-level driving behavior…

Machine Learning · Computer Science 2019-02-27 Zhengwei Bai , Baigen Cai , Wei Shangguan , Linguo Chai

Existing micro-video recommendation models exploit the interactions between users and micro-videos and/or multi-modal information of micro-videos to predict the next micro-video a user will watch, ignoring the information related to…

Information Retrieval · Computer Science 2024-05-29 Weijiang Lai , Beihong Jin , Beibei Li , Yiyuan Zheng , Rui Zhao

Media streaming is the dominant application over wireless edge (access) networks. The increasing softwarization of such networks has led to efforts at intelligent control, wherein application-specific actions may be dynamically taken to…

Systems and Control · Electrical Eng. & Systems 2024-04-18 Archana Bura , Sarat Chandra Bobbili , Shreyas Rameshkumar , Desik Rengarajan , Dileep Kalathil , Srinivas Shakkottai

Modeling users for the purpose of identifying their preferences and then personalizing services on the basis of these models is a complex task, primarily due to the need to take into consideration various explicit and implicit signals,…

Information Retrieval · Computer Science 2017-07-06 Amit Tiroshi , Tsvi Kuflik , Shlomo Berkovsky , Mohamed Ali Kaafar

Graph neural networks (GNNs) have achieved strong performance in various applications. In the real world, network data is usually formed in a streaming fashion. The distributions of patterns that refer to neighborhood information of nodes…

Machine Learning · Computer Science 2020-12-07 Junshan Wang , Guojie Song , Yi Wu , Liang Wang