English
Related papers

Related papers: Tile Classification Based Viewport Prediction with…

200 papers

This work introduces a novel interpretable machine learning method called Mixture of Decision Trees (MoDT). It constitutes a special case of the Mixture of Experts ensemble architecture, which utilizes a linear model as gating function and…

Machine Learning · Computer Science 2022-11-29 Simeon Brüggenjürgen , Nina Schaaf , Pascal Kerschke , Marco F. Huber

The explosively generated micro-videos on content sharing platforms call for recommender systems to permit personalized micro-video discovery with ease. Recent advances in micro-video recommendation have achieved remarkable performance in…

Information Retrieval · Computer Science 2021-10-11 Yujie Lu , Yingxuan Huang , Shengyu Zhang , Wei Han , Hui Chen , Zhou Zhao , Fei Wu

Many vision-related tasks benefit from reasoning over multiple modalities to leverage complementary views of data in an attempt to learn robust embedding spaces. Most deep learning-based methods rely on a late fusion technique whereby…

Computer Vision and Pattern Recognition · Computer Science 2020-03-04 Austin Reiter , Menglin Jia , Pu Yang , Ser-Nam Lim

For better user experience and business effectiveness, Click-Through Rate (CTR) prediction has been one of the most important tasks in E-commerce. Although extensive CTR prediction models have been proposed, learning good representation of…

Information Retrieval · Computer Science 2020-03-17 Xiang Li , Chao Wang , Jiwei Tan , Xiaoyi Zeng , Dan Ou , Bo Zheng

Accurate beam prediction is essential for mitigating signalling overhead and latency in integrated sensing and communication-enabled massive multi-input multi-output systems. With the aid of multimodal learning, the prediction accuracy can…

Signal Processing · Electrical Eng. & Systems 2026-05-15 Zijian Zheng , Wenqiang Yi , Hyundong Shin , Arumugam Nallanathan

Link prediction aims to identify potential missing triples in knowledge graphs. To get better results, some recent studies have introduced multimodal information to link prediction. However, these methods utilize multimodal information…

Artificial Intelligence · Computer Science 2023-03-21 Xinhang Li , Xiangyu Zhao , Jiaxing Xu , Yong Zhang , Chunxiao Xing

Motion prediction plays an essential role in autonomous driving systems, enabling autonomous vehicles to achieve more accurate local-path planning and driving decisions based on predictions of the surrounding vehicles. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Zhanwen Liu , Chao Li , Yang Wang , Nan Yang , Xing Fan , Jiaqi Ma , Xiangmo Zhao

People's looking at each other or mutual gaze is ubiquitous in our daily interactions, and detecting mutual gaze is of great significance for understanding human social scenes. Current mutual gaze detection methods focus on two-stage…

Computer Vision and Pattern Recognition · Computer Science 2022-10-07 Hang Guo , Zhengxi Hu , Jingtai Liu

The main idea of multimodal recommendation is the rational utilization of the item's multimodal information to improve the recommendation performance. Previous works directly integrate item multimodal features with item ID embeddings,…

Information Retrieval · Computer Science 2023-04-25 Yan Zhou , Jie Guo , Hao Sun , Bin Song , Fei Richard Yu

We propose FutrTrack, a modular camera-LiDAR multi-object tracking framework that builds on existing 3D detectors by introducing a transformer-based smoother and a fusion-driven tracker. Inspired by query-based tracking frameworks,…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Martha Teiko Teye , Ori Maoz , Matthias Rottmann

Motion prediction has been an essential component of autonomous driving systems since it handles highly uncertain and complex scenarios involving moving agents of different types. In this paper, we propose a Multi-Granular TRansformer…

Computer Vision and Pattern Recognition · Computer Science 2024-02-07 Yiqian Gan , Hao Xiao , Yizhe Zhao , Ethan Zhang , Zhe Huang , Xin Ye , Lingting Ge

Volumetric video, also known as hologram video, is a novel medium that portrays natural content in Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). It is expected to be the next-gen video technology and a prevalent use…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Jie Li , Zhixin Li , Zhi Liu , Pengyuan Zhou , Richang Hong , Qiyue Li , Han Hu

In this paper, we investigate wireless streaming of multi-quality tiled 360 virtual reality (VR) videos from a multi-antenna server to multiple single-antenna users in a multi-carrier system. To capture the impact of field-of-view (FoV)…

Information Theory · Computer Science 2020-09-04 Lingzhi Zhao , Ying Cui , Chengjun Guo , Zhi Liu

Multi-view projection techniques have shown themselves to be highly effective in achieving top-performing results in the recognition of 3D shapes. These methods involve learning how to combine information from multiple view-points. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Abdullah Hamdi , Faisal AlZahrani , Silvio Giancola , Bernard Ghanem

Multi-token prediction has emerged as a promising objective for improving language model pretraining, but its benefits have not consistently generalized to other settings such as fine-tuning. In this paper, we propose MuToR, a simple and…

Computation and Language · Computer Science 2025-05-16 Anastasios Gerontopoulos , Spyros Gidaris , Nikos Komodakis

We describe DS@GT's second-place solution to the PlantCLEF 2025 challenge on multi-species plant identification in vegetation quadrat images. Our pipeline combines (i) a fine-tuned Vision Transformer ViTD2PC24All for patch-level inference,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-09 Murilo Gustineli , Anthony Miyaguchi , Adrian Cheung , Divyansh Khattak

Automated salient object detection (SOD) plays an increasingly crucial role in many computer vision applications. By reformulating the depth information as supervision rather than as input, depth-supervised convolutional neural networks…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Heqin Zhu , Xu Sun , Yuexiang Li , Kai Ma , S. Kevin Zhou , Yefeng Zheng

Mixed-type time series (MTTS) is a bimodal data type that is common in many domains, such as healthcare, finance, environmental monitoring, and social media. It consists of regularly sampled continuous time series and irregularly sampled…

Machine Learning · Computer Science 2026-02-04 Simon Dietz , Thomas Altstidl , Dario Zanca , Björn Eskofier , An Nguyen

Video prediction is a challenging computer vision task that has a wide range of applications. In this work, we present a new family of Transformer-based models for video prediction. Firstly, an efficient local spatial-temporal separation…

Computer Vision and Pattern Recognition · Computer Science 2022-12-13 Xi Ye , Guillaume-Alexandre Bilodeau

In the surveillance and defense domain, multi-target detection and classification (MTD) is considered essential yet challenging due to heterogeneous inputs from diverse data sources and the computational complexity of algorithms designed…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 Ngoc Tuyen Do , Tri Nhu Do