English
Related papers

Related papers: HyperFusion: Hierarchical Multimodal Ensemble Lear…

200 papers

Spatial transcriptomics (ST) bridges gene expression and tissue morphology but faces clinical adoption barriers due to technical complexity and prohibitive costs. While computational methods predict gene expression from H&E-stained…

Computer Vision and Pattern Recognition · Computer Science 2025-11-20 Ziqiao Weng , Yaoyu Fang , Jiahe Qian , Xinkun Wang , Lee AD Cooper , Weidong Cai , Bo Zhou

Time series forecasting presents significant challenges due to the complex temporal dependencies at multiple time scales. This paper introduces ScatterFusion, a novel framework that synergistically integrates scattering transforms with…

Machine Learning · Computer Science 2026-01-29 Wei Li

With the prevalence of social media, there has recently been a proliferation of recommenders that shift their focus from individual modeling to group recommendation. Since the group preference is a mixture of various predilections from…

Information Retrieval · Computer Science 2022-03-22 Junwei Zhang , Min Gao , Junliang Yu , Lei Guo , Jundong Li , Hongzhi Yin

Multimodal fusion is crucial in joint decision-making systems for rendering holistic judgments. Since multimodal data changes in open environments, dynamic fusion has emerged and achieved remarkable progress in numerous applications.…

Computer Vision and Pattern Recognition · Computer Science 2024-11-06 Bing Cao , Yinan Xia , Yi Ding , Changqing Zhang , Qinghua Hu

The main idea of multimodal recommendation is the rational utilization of the item's multimodal information to improve the recommendation performance. Previous works directly integrate item multimodal features with item ID embeddings,…

Information Retrieval · Computer Science 2023-04-25 Yan Zhou , Jie Guo , Hao Sun , Bin Song , Fei Richard Yu

Emotion recognition is relevant in various domains, ranging from healthcare to human-computer interaction. Physiological signals, being beyond voluntary control, offer reliable information for this purpose, unlike speech and facial…

Machine Learning · Computer Science 2024-10-11 Eleonora Lopez , Aurelio Uncini , Danilo Comminiello

"SMP Challenge" aims to discover novel prediction tasks for numerous data on social multimedia and seek excellent research teams. Making predictions via social multimedia data (e.g. photos, videos or news) is not only helps us to make…

Multimedia · Computer Science 2020-01-22 Bo Wu , Wen-Huang Cheng , Peiye Liu , Bei Liu , Zhaoyang Zeng , Jiebo Luo

Multimodal affective computing, learning to recognize and interpret human affects and subjective information from multiple data sources, is still challenging because: (i) it is hard to extract informative features to represent human affects…

Computation and Language · Computer Science 2018-05-23 Yue Gu , Kangning Yang , Shiyu Fu , Shuhong Chen , Xinyu Li , Ivan Marsic

Unified multimodal models have recently shown remarkable gains in both capability and versatility, yet most leading systems are still trained from scratch and require substantial computational resources. In this paper, we show that…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Zeyu Wang , Zilong Chen , Chenhui Gou , Feng Li , Chaorui Deng , Deyao Zhu , Kunchang Li , Weihao Yu , Haoqin Tu , Haoqi Fan , Cihang Xie

Social media is a popular platform for timely information sharing. One of the important challenges for social media platforms like Twitter is whether to trust news shared on them when there is no systematic news verification process. On the…

Machine Learning · Computer Science 2020-04-28 Chandra Mouli Madhav Kotteti , Xishuang Dong , Lijun Qian

Multimodal sentiment analysis (MSA) integrates various modalities, such as text, image, and audio, to provide a more comprehensive understanding of sentiment. However, effective MSA is challenged by alignment and fusion issues. Alignment…

Computer Vision and Pattern Recognition · Computer Science 2025-12-08 Yuhua Wen , Qifei Li , Yingying Zhou , Yingming Gao , Zhengqi Wen , Jianhua Tao , Ya Li

Modern sociology has profoundly uncovered many convincing social criteria for behavioural analysis. Unfortunately, many of them are too subjective to be measured and presented in online social networks. On the other hand, data mining…

Social and Information Networks · Computer Science 2023-01-09 Xiangguo Sun , Hong Cheng , Bo Liu , Jia Li , Hongyang Chen , Guandong Xu , Hongzhi Yin

Social media produces large amounts of contents every day. To help users quickly capture what they need, keyphrase prediction is receiving a growing attention. Nevertheless, most prior efforts focus on text modeling, largely ignoring the…

Computer Vision and Pattern Recognition · Computer Science 2020-11-04 Yue Wang , Jing Li , Michael R. Lyu , Irwin King

The evolution of social media popularity exhibits rich temporality, i.e., popularities change over time at various levels of temporal granularity. This is influenced by temporal variations of public attentions or user activities. For…

Social and Information Networks · Computer Science 2018-01-19 Bo Wu , Wen-Huang Cheng , Yongdong Zhang , Tao Mei

Social media platforms serve as central hubs for content dissemination, opinion expression, and public engagement across diverse modalities. Accurately predicting the popularity of social media videos enables valuable applications in…

Computer Vision and Pattern Recognition · Computer Science 2025-07-02 Liliang Ye , Yunyao Zhang , Yafeng Wu , Yi-Ping Phoebe Chen , Junqing Yu , Wei Yang , Zikai Song

With millions of images that are shared online on social networking sites, effective methods for image privacy prediction are highly needed. In this paper, we propose an approach for fusing object, scene context, and image tags modalities…

Computer Vision and Pattern Recognition · Computer Science 2019-03-07 Ashwini Tonge , Cornelia Caragea

Social Media has seen a tremendous growth in the last decade and is continuing to grow at a rapid pace. With such adoption, it is increasingly becoming a rich source of data for opinion mining and sentiment analysis. The detection and…

Machine Learning · Computer Science 2019-12-18 Rahul Radhakrishnan Iyer , Jing Chen , Haonan Sun , Keyang Xu

Multimodal sentiment analysis, a pivotal task in affective computing, seeks to understand human emotions by integrating cues from language, audio, and visual signals. While many recent approaches leverage complex attention mechanisms and…

Computation and Language · Computer Science 2025-05-09 Nischal Mandal , Yang Li

Hypergraph can capture complex and higher-order dependencies among learners and learning resources in personalized educational recommender systems. Many existing hypergraph-based recommendation approaches underexplored the dynamic…

Information Retrieval · Computer Science 2026-03-17 Tao Xie , Yan Li , Yongpan Sheng , Jian Liao

Preliminary detection of mild depression could immensely help in effective treatment of the common mental health disorder. Due to the lack of proper awareness and the ample mix of stigmas and misconceptions present within the society,…