English
Related papers

Related papers: Perception Without Engagement: Dissecting the Caus…

200 papers

Large language models trained with reinforcement learning (RL) for mathematical reasoning face a fundamental challenge: on problems the model cannot solve at all - "cliff" prompts - the RL gradient vanishes entirely, preventing any learning…

Machine Learning · Computer Science 2026-03-26 Ken Ding

While large language models (LLMs) have demonstrated remarkable capabilities in language modeling, recent studies reveal that they often fail on out-of-distribution (OOD) samples due to spurious correlations acquired during pre-training.…

Machine Learning · Computer Science 2025-06-12 Shurui Gui , Shuiwang Ji

Vision and language models frequently ignore semantically critical input edits, defaulting to pretraining priors. For example, models will confidently assert a five-legged dog has four legs; consequently, on the VLMBias benchmark, GPT 5.2…

Computation and Language · Computer Science 2026-05-12 Yijin Ni , Simon Yu , Peng Qi

Comprehending long videos remains a significant challenge for Large Multi-modal Models (LMMs). Current LMMs struggle to process even minutes to hours videos due to their lack of explicit memory and retrieval mechanisms. To address this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-07 Sameer Malik , Moyuru Yamada , Ayush Singh , Dishank Aggarwal

Causal discovery aims to identify causal relationships between variables and is a fundamental problem across the sciences. Traditional statistical causal discovery (SCD) methods rely solely on observational data and ignore the contextual…

Artificial Intelligence · Computer Science 2026-05-27 Hao Duong Le , Xin Xia , Haijie Xu , Chen Zhang

Long-context memory systems often fail under fixed budgets, but end-to-end evaluation does not reveal whether evidence was discarded during compression or preserved but never retrieved. We introduce a four-condition diagnostic protocol that…

Computation and Language · Computer Science 2026-05-26 Jiangnan Yu , Kisson Songqi Lin , Jilong Wu

Visual hallucinations in Large Language Models (LLMs), where the model generates responses that are inconsistent with the visual input, pose a significant challenge to their reliability, particularly in contexts where precise and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-30 Nokimul Hasan Arif , Shadman Rabby , Md Hefzul Hossain Papon , Sabbir Ahmed

Text-to-video models have made remarkable advancements through optimization on high-quality text-video pairs, where the textual prompts play a pivotal role in determining quality of output videos. However, achieving the desired output often…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Yatai Ji , Jiacheng Zhang , Jie Wu , Shilong Zhang , Shoufa Chen , Chongjian GE , Peize Sun , Weifeng Chen , Wenqi Shao , Xuefeng Xiao , Weilin Huang , Ping Luo

Vision-Language Models (VLMs) achieve strong cross-modal performance, yet recent evidence suggests they over-rely on textual descriptions while under-utilizing visual evidence -- a phenomenon termed ``text shortcut learning.'' We propose an…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Lijie Zhou

Multimodal Large Language Models demonstrate strong performance on multimodal benchmarks, yet often exhibit poor robustness when exposed to spurious modality interference, such as irrelevant text in vision understanding, or irrelevant…

Machine Learning · Computer Science 2026-01-30 Rui Cai , Bangzheng Li , Xiaofei Wen , Muhao Chen , Zhe Zhao

Reinforcement Learning with Verifiable Rewards (RLVR) is a promising paradigm for enhancing the reasoning ability in Large Language Models (LLMs). However, prevailing methods primarily rely on self-exploration or a single off-policy teacher…

Computation and Language · Computer Science 2025-10-10 Xiaoyang Yuan , Yujuan Ding , Yi Bin , Wenqi Shao , Jinyu Cai , Jingkuan Song , Yang Yang , Heng Tao Shen

Recent papers show LLMs achieve near-random accuracy in causal relation classification, raising questions about whether such failures arise from limited pretraining exposure or deeper representational gaps. We investigate this under…

Computation and Language · Computer Science 2025-09-25 Oscar Lithgow-Serrano , Vani Kanjirangat , Alessandro Antonucci

The integration of multimodal data including pathology images and gene profiles is widely applied in precise survival prediction. Despite recent advances in multimodal survival models, collecting complete modalities for multimodal fusion…

Machine Learning · Computer Science 2025-03-25 Yingxue Xu , Fengtao Zhou , Chenyu Zhao , Yihui Wang , Can Yang , Hao Chen

Learning constraint-satisfying policies from offline data without risky online interaction is crucial for safety-critical decision making. Conventional methods typically learn cost value functions from abundant unsafe samples to define…

Machine Learning · Computer Science 2026-05-05 Ruiqi Xue , Lei Yuan , Kainuo Cheng , Jing-Wen Yang , Yang Yu

Missing modalities consistently lead to significant performance degradation in multimodal models. Existing approaches either synthesize missing modalities at high computational cost or apply prompt-based fine-tuning that relies only on…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Hongye Zhu , Xuan Liu , Yanwen Ba , Jingye Xue , Shigeng Zhang

The rapid rise of deepfake technology poses a severe threat to social and political stability by enabling hyper-realistic synthetic media capable of manipulating public perception. However, existing detection methods struggle with two core…

Computation and Language · Computer Science 2026-01-27 Gautam Siddharth Kashyap , Harsh Joshi , Niharika Jain , Ebad Shabbir , Jiechao Gao , Nipun Joshi , Usman Naseem

Large multimodal models (LMMs) have recently emerged as a powerful tool for long video understanding (LVU), prompting the development of standardized LVU benchmarks to evaluate their performance. However, our investigation reveals a rather…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Wentao Ma , Weiming Ren , Yiming Jia , Zhuofeng Li , Ping Nie , Ge Zhang , Wenhu Chen

Direct Preference Optimization (DPO) has shown promising results in aligning generative outputs with human preferences by distinguishing between chosen and rejected samples. However, a critical limitation of DPO is likelihood displacement,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Ruojun Xu , Yu Kai , Xuhua Ren , Jiaxiang Cheng , Bing Ma , Tianxiang Zheng , Qinhlin Lu

Causal learning is the key to obtaining stable predictions and answering \textit{what if} problems in decision-makings. In causal learning, it is central to seek methods to estimate the average treatment effect (ATE) from observational…

Machine Learning · Statistics 2022-12-07 Yiyan Huang , Cheuk Hang Leung , Qi Wu , Xing Yan

In this paper, we introduce CodingTeachLLM, a large language model (LLM) designed for coding teaching. Specially, we aim to enhance the coding ability of LLM and lead it to better teaching mode in education context. Thus, we propose an…

Machine Learning · Computer Science 2025-04-02 Zhangquan Chen , Chunjiang Liu , Haobin Duan