English
Related papers

Related papers: Feature Fusion Revisited: Multimodal CTR Predictio…

200 papers

Large language models (LLMs) are increasingly used to automate feature engineering in tabular learning. Given task-specific information, LLMs can propose diverse feature transformation operations to enhance downstream model performance.…

Machine Learning · Computer Science 2026-01-30 Zhuoyan Li , Aditya Bansal , Jinzhao Li , Shishuang He , Zhuoran Lu , Mutian Zhang , Qin Liu , Yiwei Yang , Swati Jain , Ming Yin , Yunyao Li

Text Image Machine Translation (TIMT)-the task of translating textual content embedded in images-is critical for applications in accessibility, cross-lingual information access, and real-world document understanding. However, TIMT remains a…

Computation and Language · Computer Science 2025-05-27 Zhaopeng Feng , Yupu Liang , Shaosheng Cao , Jiayuan Su , Jiahan Ren , Zhe Xu , Yao Hu , Wenxuan Huang , Jian Wu , Zuozhu Liu

Enhancing the multimodal reasoning capabilities of Multimodal Large Language Models (MLLMs) is a challenging task that has attracted increasing attention in the community. Recently, several studies have applied Reinforcement Learning with…

Machine Learning · Computer Science 2026-03-04 Tong Xiao , Xin Xu , Zhenya Huang , Hongyu Gao , Quan Liu , Qi Liu , Enhong Chen

Large language models (LLMs) exhibit a variety of promising capabilities in robotics, including long-horizon planning and commonsense reasoning. However, their performance in place recognition is still underexplored. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2024-06-26 Zonglin Lyu , Juexiao Zhang , Mingxuan Lu , Yiming Li , Chen Feng

Multi-task learning (MTL) enables the efficient transfer of extra knowledge acquired from other tasks. The high correlation between multimodal sentiment analysis (MSA) and multimodal emotion recognition (MER) supports their joint training.…

Artificial Intelligence · Computer Science 2025-05-21 Shuo Zhang , Jinsong Zhang , Zhejun Zhang , Lei Li

Multi-task large language models (MTLLMs) are important for many applications at the wireless edge, where users demand specialized models to handle multiple tasks efficiently. However, training MTLLMs is complex and exhaustive, particularly…

Signal Processing · Electrical Eng. & Systems 2026-02-09 Aladin Djuhera , Vlad C. Andrei , Mohsen Pourghasemian , Haris Gacanin , Holger Boche , Walid Saad

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

Computation and Language · Computer Science 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

This paper addresses the prediction of commercial (brand) memorability as part of "Subtask 2: Commercial/Ad Memorability" within the "Memorability: Predicting movie and commercial memorability" task at the MediaEval 2025 workshop…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Aleksandar Pramov

Enhancing the temporal understanding of Multimodal Large Language Models (MLLMs) is essential for advancing long-form video analysis, enabling tasks such as temporal localization, action detection, and time-sensitive question answering.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Tao Wu , Li Yang , Gen Zhan , Yabin Zhang , Yiting Liao , Junlin Li , Deliang Fu , Li Zhang , Limin Wang

Continual learning enables AI systems to acquire new knowledge while retaining previously learned information. While traditional unimodal methods have made progress, the rise of Multimodal Large Language Models (MLLMs) brings new challenges…

Computer Vision and Pattern Recognition · Computer Science 2026-01-01 Haiyang Guo , Fei Zhu , Hongbo Zhao , Fanhu Zeng , Wenzhuo Liu , Shijie Ma , Da-Han Wang , Xu-Yao Zhang

Recently, large language models (LLMs) have notably positioned them as capable tools for addressing complex optimization challenges. Despite this recognition, a predominant limitation of existing LLM-based optimization methods is their…

Artificial Intelligence · Computer Science 2024-03-05 Yuxiao Huang , Wenjie Zhang , Liang Feng , Xingyu Wu , Kay Chen Tan

Viewport prediction is a crucial aspect of tile-based 360 video streaming system. However, existing trajectory based methods lack of robustness, also oversimplify the process of information construction and fusion between different modality…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Zhihao Zhang , Yiwei Chen , Weizhan Zhang , Caixia Yan , Qinghua Zheng , Qi Wang , Wangdu Chen

Connecting text and visual modalities plays an essential role in generative intelligence. For this reason, inspired by the success of large language models, significant research efforts are being devoted to the development of Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Davide Caffagni , Federico Cocchi , Luca Barsellotti , Nicholas Moratelli , Sara Sarto , Lorenzo Baraldi , Lorenzo Baraldi , Marcella Cornia , Rita Cucchiara

Visual place recognition (VPR) remains challenging due to significant viewpoint changes and appearance variations. Mainstream works tackle these challenges by developing various feature aggregation methods to transform deep features into…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Teng Wang , Lingquan Meng , Lei Cheng , Changyin Sun

Eye-Tracking data is a very useful source of information to study cognition and especially language comprehension in humans. In this paper, we describe our systems for the CMCL 2022 shared task on predicting eye-tracking information. We…

Computation and Language · Computer Science 2022-04-12 Sunit Bhattacharya , Rishu Kumar , Ondrej Bojar

Recently, there has been growing interest in developing the next-generation recommender systems (RSs) based on pretrained large language models (LLMs). However, the semantic gap between natural language and recommendation tasks is still not…

Information Retrieval · Computer Science 2024-02-23 Yaochen Zhu , Liang Wu , Qi Guo , Liangjie Hong , Jundong Li

Reinforcement Learning with Verifiable Rewards (RLVR) has recently emerged as a powerful paradigm for post-training large language models (LLMs), achieving state-of-the-art performance on tasks with structured, verifiable answers. Applying…

Computer Vision and Pattern Recognition · Computer Science 2025-06-06 Yiqing Liang , Jielin Qiu , Wenhao Ding , Zuxin Liu , James Tompkin , Mengdi Xu , Mengzhou Xia , Zhengzhong Tu , Laixi Shi , Jiacheng Zhu

Click-through rate (CTR) prediction has become increasingly indispensable for various Internet applications. Traditional CTR models convert the multi-field categorical data into ID features via one-hot encoding, and extract the…

Information Retrieval · Computer Science 2024-06-27 Jianghao Lin , Bo Chen , Hangyu Wang , Yunjia Xi , Yanru Qu , Xinyi Dai , Kangning Zhang , Ruiming Tang , Yong Yu , Weinan Zhang

As the field of Multimodal Large Language Models (MLLMs) continues to evolve, their potential to revolutionize artificial intelligence is particularly promising, especially in addressing mathematical reasoning tasks. Current mathematical…

Large language models (LLMs) have recently shown promise in recommendation by providing rich semantic knowledge. While most existing approaches rely on external textual corpora to align LLMs with recommender systems, we revisit a more…

Information Retrieval · Computer Science 2026-04-21 Wuhan Chen , Min Gao , Xin Xia , Zongwei Wang , Wentao Li , Shane Culpepper