English
Related papers

Related papers: Cross-Modal Dual-Causal Learning for Long-Term Act…

200 papers

Multimodal large language models (MLLMs) have demonstrated remarkable potential in bridging visual and textual reasoning, yet their reliance on text-centric priors often limits their ability to disentangle semantically similar actions in…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Zhenlong Yuan , Xiangyan Qu , Chengxuan Qian , Rui Chen , Jing Tang , Lei Sun , Xiangxiang Chu , Dapeng Zhang , Yiwei Wang , Yujun Cai , Shuo Li

Vision-language models (VLMs) have achieved impressive performance across a wide range of multimodal reasoning tasks, but they often struggle to disentangle fine-grained visual attributes and reason about underlying causal relationships.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-18 Guangzhi Xiong , Sanchit Sinha , Zhenghao He , Aidong Zhang

Multimodal embedding models, built upon causal Vision Language Models (VLMs), have shown promise in various tasks. However, current approaches face three key limitations: the use of causal attention in VLM backbones is suboptimal for…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Haonan Chen , Hong Liu , Yuping Luo , Liang Wang , Nan Yang , Furu Wei , Zhicheng Dou

Foundation models for vision have transformed visual recognition with powerful pretrained representations and strong zero-shot capabilities, yet their potential for data-efficient learning remains largely untapped. Active Learning (AL) aims…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Huy Hoang Nguyen , Cédric Jung , Shirin Salehi , Tobias Glück , Anke Schmeink , Andreas Kugi

Multi-modal machine learning (ML) models can process data in multiple modalities (e.g., video, audio, text) and are useful for video content analysis in a variety of problems (e.g., object detection, scene understanding, activity…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Palash Goyal , Saurabh Sahu , Shalini Ghosh , Chul Lee

Deep learning-based models encounter challenges when processing long-tailed data in the real world. Existing solutions usually employ some balancing strategies or transfer learning to deal with the class imbalance problem, based on the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Changyao Tian , Wenhai Wang , Xizhou Zhu , Jifeng Dai , Yu Qiao

Large Vision-Language Models (LVLMs) achieve strong performance on visual question answering benchmarks, yet often rely on spurious correlations rather than genuine causal reasoning. Existing evaluations primarily assess the correctness of…

Artificial Intelligence · Computer Science 2026-02-25 Dhita Putri Pratama , Soyeon Caren Han , Yihao Ding

The World Wide Web thrives on intelligent services that rely on accurate time series classification, which has recently witnessed significant progress driven by advances in deep learning. However, existing studies face challenges in domain…

Machine Learning · Computer Science 2026-01-16 Zhipeng Liu , Peibo Duan , Xuan Tang , Haodong Jing , Mingyang Geng , Yongsheng Huang , Jialu Xu , Bin Zhang , Binwu Wang

Contrastive vision-language models such as CLIP have demonstrated strong performance across a wide range of multimodal tasks by learning from aligned image-text pairs. However, their ability to handle complex, real-world web documents…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Yiqi Lin , Alex Jinpeng Wang , Linjie Li , Zhengyuan Yang , Mike Zheng Shou

Large Multimodal Models (LMMs) have demonstrated impressive performance in short video understanding tasks but face great challenges when applied to long video understanding. In contrast, Large Language Models (LLMs) exhibit outstanding…

Computer Vision and Pattern Recognition · Computer Science 2024-10-03 Hongchen Wei , Zhenzhong Chen

Power system time series analytics is critical in understanding the system operation conditions and predicting the future trends. Despite the wide adoption of Artificial Intelligence (AI) tools, many AI-based time series analytical models…

Signal Processing · Electrical Eng. & Systems 2025-11-12 Zhenghao Zhou , Yiyan Li , Xinjie Yu , Runlong Liu , Zelin Guo , Zheng Yan , Mo-Yuen Chow , Yuqi Yang , Yang Xu

In the field of Artificial Intelligence for Information Technology Operations, causal discovery is pivotal for operation and maintenance of graph construction, facilitating downstream industrial tasks such as root cause analysis. Temporal…

Artificial Intelligence · Computer Science 2024-05-28 Peiwen Li , Xin Wang , Zeyang Zhang , Yuan Meng , Fang Shen , Yue Li , Jialong Wang , Yang Li , Wenweu Zhu

Videos are inherently multimodal. This paper studies the problem of how to fully exploit the abundant multimodal clues for improved video categorization. We introduce a hybrid deep learning framework that integrates useful clues from…

Multimedia · Computer Science 2017-06-15 Yu-Gang Jiang , Zuxuan Wu , Jinhui Tang , Zechao Li , Xiangyang Xue , Shih-Fu Chang

DNN-based cross-modal retrieval has become a research hotspot, by which users can search results across various modalities like image and text. However, existing methods mainly focus on the pairwise correlation and reconstruction error of…

Machine Learning · Computer Science 2017-04-06 Xin Huang , Yuxin Peng

Recent years have seen a surge of interest in anomaly detection for tackling industrial defect detection, event detection, etc. However, existing unsupervised anomaly detectors, particularly those for the vision modality, face significant…

Computer Vision and Pattern Recognition · Computer Science 2023-10-05 Dong Chen , Kaihang Pan , Guoming Wang , Yueting Zhuang , Siliang Tang

Transformer neural networks are increasingly replacing prior architectures in a wide range of applications in different data modalities. The increasing size and computational demands of fine-tuning large pre-trained transformer neural…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Yuliang Cai , Mohammad Rostami

Large Language Models (LLMs) struggle with long-context code due to window limitations. Existing textual code compression methods mitigate this via selective filtering but often disrupt dependency closure, causing semantic fragmentation. To…

Software Engineering · Computer Science 2026-02-03 Jianping Zhong , Guochang Li , Chen Zhi , Junxiao Han , Zhen Qin , Xinkui Zhao , Nan Wang , Shuiguang Deng , Jianwei Yin

The integration of Large Language Models (LLMs) with visual encoders has recently shown promising performance in visual understanding tasks, leveraging their inherent capability to comprehend and generate human-like text for visual…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Heqing Zou , Tianze Luo , Guiyang Xie , Victor , Zhang , Fengmao Lv , Guangcong Wang , Junyang Chen , Zhuochen Wang , Hansheng Zhang , Huaijian Zhang

Industrial anomaly detection (IAD) plays a crucial role in the maintenance and quality control of manufacturing processes. In this paper, we propose a novel approach, Vision-Language Anomaly Detection via Contrastive Cross-Modal Training…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Kun Qian , Tianyu Sun , Wenhong Wang

Recent advances in vision-language models (VLMs) have greatly improved cross-modal semantic understanding, yet significant limitations remain in fine-grained discrimination and deep causal reasoning tasks. Existing VLMs often rely on…

Machine Learning · Computer Science 2025-06-24 Jusheng Zhang , Kaitong Cai , Yijia Fan , Jian Wang , Keze Wang