English
Related papers

Related papers: CCTVBench: Contrastive Consistency Traffic VideoQA…

200 papers

Recent advancements in Multimodal Large Language Models (MLLMs) have demonstrated impressive capabilities in general visual understanding. However, their application to safety-critical driving scenarios remains limited by an inability to…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Tomaso Trinci , Henrique Piñeiro Monteagudo , Leonardo Taccari

Multimodal models like CLIP have gained significant attention due to their remarkable zero-shot performance across various tasks. However, studies have revealed that CLIP can inadvertently learn spurious associations between target…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Wei Jie Yeo , Rui Mao , Moloud Abdar , Erik Cambria , Ranjan Satapathy

The increasing rate of road accidents worldwide results not only in significant loss of life but also imposes billions financial burdens on societies. Current research in traffic crash frequency modeling and analysis has predominantly…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Zhiwen Fan , Pu Wang , Yang Zhao , Yibo Zhao , Boris Ivanovic , Zhangyang Wang , Marco Pavone , Hao Frank Yang

Most existing video understanding benchmarks for multimodal large language models (MLLMs) focus only on short videos. The limited number of benchmarks for long video understanding often rely solely on multiple-choice questions (MCQs).…

Computer Vision and Pattern Recognition · Computer Science 2024-12-17 Guo Chen , Yicheng Liu , Yifei Huang , Yuping He , Baoqi Pei , Jilan Xu , Yali Wang , Tong Lu , Limin Wang

Efficiently capturing the complex spatiotemporal representations from large-scale unlabeled traffic data remains to be a challenging task. In considering of the dilemma, this work employs the advanced contrastive learning and proposes a…

Machine Learning · Computer Science 2023-12-19 Lincan Li , Kaixiang Yang , Fengji Luo , Jichao Bi

Contrastive learning has nearly closed the gap between supervised and self-supervised learning of image representations, and has also been explored for videos. However, prior work on contrastive learning for video data has not explored the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Ishan Dave , Rohit Gupta , Mamshad Nayeem Rizve , Mubarak Shah

LLM coding benchmarks face a credibility crisis: widespread solution leakage and test quality issues undermine SWE-bench Verified, while existing detection methods--paraphrase consistency, n-gram overlap, perplexity analysis--never directly…

Computation and Language · Computer Science 2026-04-02 Tae-Eun Song

We present Cycle-Contrastive Learning (CCL), a novel self-supervised method for learning video representation. Following a nature that there is a belong and inclusion relation of video and its frames, CCL is designed to find correspondences…

Computer Vision and Pattern Recognition · Computer Science 2020-10-29 Quan Kong , Wenpeng Wei , Ziwei Deng , Tomoaki Yoshinaga , Tomokazu Murakami

Large vision-language models (LVLMs) are increasingly being applied to multi-view image inputs captured from diverse viewpoints. However, despite this growing use, current LVLMs often confuse or mismatch visual information originating from…

Computer Vision and Pattern Recognition · Computer Science 2026-03-26 Wooje Park , Insu Lee , Soohyun Kim , Jaeyun Jang , Minyoung Noh , Kyuhong Shim , Byonghyo Shim

Labeling videos at scale is impractical. Consequently, self-supervised visual representation learning is key for efficient video analysis. Recent success in learning image representations suggests contrastive learning is a promising…

Computer Vision and Pattern Recognition · Computer Science 2021-05-03 Nishant Rai , Ehsan Adeli , Kuan-Hui Lee , Adrien Gaidon , Juan Carlos Niebles

Adept traffic models are critical to both planning and closed-loop simulation for autonomous vehicles (AV), and key design objectives include accuracy, diverse multimodal behaviors, interpretability, and downstream compatibility. Recently,…

Machine Learning · Computer Science 2023-12-01 Yuxiao Chen , Sander Tonkens , Marco Pavone

Accurate road damage detection is crucial for timely infrastructure maintenance and public safety, but existing vision-only datasets and models lack the rich contextual understanding that textual information can provide. To address this…

Computational Engineering, Finance, and Science · Computer Science 2025-12-11 Xi Xiao , Yunbei Zhang , Janet Wang , Lin Zhao , Yuxiang Wei , Hengjia Li , Yanshu Li , Xinyuan Song , Xiao Wang , Swalpa Kumar Roy , Hao Xu , Tianyang Wang

Flow-matching video generators produce temporally coherent, high-fidelity outputs yet routinely violate elementary physics because their reconstruction objectives penalize per-frame deviations without distinguishing physically consistent…

Computer Vision and Pattern Recognition · Computer Science 2026-03-30 Abolfazl Meyarian , Amin Karimi Monsefi , Rajiv Ramnath , Ser-Nam Lim

Multiview clustering (MVC) segregates data samples into meaningful clusters by synthesizing information across multiple views. Moreover, deep learning-based methods have demonstrated their strong feature learning capabilities in MVC…

Machine Learning · Computer Science 2024-03-22 Hao Yang , Hua Mao , Wai Lok Woo , Jie Chen , Xi Peng

Traffic sign is a critical map feature for navigation and traffic control. Nevertheless, current methods for traffic sign recognition rely on traditional deep learning models, which typically suffer from significant performance degradation…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Guoyang Zhao , Fulong Ma , Weiqing Qi , Chenguang Zhang , Yuxuan Liu , Ming Liu , Jun Ma

Recently, more and more people study online for the convenience of access to massive learning materials (e.g. test questions/notes), thus accurately understanding learning materials became a crucial issue, which is essential for many…

Computation and Language · Computer Science 2023-03-15 He Zhu , Xihua Li , Xuemin Zhao , Yunbo Cao , Shan Yu

Multimodal Large Language Models (MLLMs) are increasingly deployed in real-world applications, yet their ability to make context-aware safety decisions remains limited. Existing methods often fail to balance oversensitivity (unjustified…

Computation and Language · Computer Science 2025-09-24 Zheyuan Liu , Zhangchen Xu , Guangyao Dou , Xiangchi Yuan , Zhaoxuan Tan , Radha Poovendran , Meng Jiang

Multi-modal reasoning in visual question answering (VQA) has witnessed rapid progress recently. However, most reasoning models heavily rely on shortcuts learned from training data, which prevents their usage in challenging real-world…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Qi Zheng , Chaoyue Wang , Daqing Liu , Dadong Wang , Dacheng Tao

Multi-view learning methods often focus on improving decision accuracy, while neglecting the decision uncertainty, limiting their suitability for safety-critical applications. To mitigate this, researchers propose trusted multi-view…

Machine Learning · Computer Science 2024-10-08 Ying Liu , Lihong Liu , Cai Xu , Xiangyu Song , Ziyu Guan , Wei Zhao

This paper focuses to detect the fake news on the short video platforms. While significant research efforts have been devoted to this task with notable progress in recent years, current detection accuracy remains suboptimal due to the rapid…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Junxi Wang , Jize liu , Na Zhang , Yaxiong Wang