English
Related papers

Related papers: Can Multimodal Large Language Models be Guided to …

200 papers

Ultrasound interpretation requires both precise lesion localization and holistic clinical reasoning, yet existing methods typically excel at only one of these capabilities: specialized detectors offer strong localization but limited…

Computer Vision and Pattern Recognition · Computer Science 2026-05-01 Jing Zhang , Wentao Jiang , Tao Huang , Zhiwei Wang , Jianxin Liu , Jian Chen , Ping Ye , Gang Wang , Zengmao Wang , Bo Du , Dacheng Tao

Eye-tracking data reveals valuable insights into users' cognitive states but is difficult to analyze due to its structured, non-linguistic nature. While large language models (LLMs) excel at reasoning over text, they struggle with temporal…

Human-Computer Interaction · Computer Science 2025-07-25 Dongyang Guo , Yasmeen Abdrabou , Enkeleda Thaqi , Enkelejda Kasneci

Software systems often record important runtime information in logs to help with troubleshooting. Log-based anomaly detection has become a key research area that aims to identify system issues through log data, ultimately enhancing the…

Software Engineering · Computer Science 2025-04-15 Wei Guan , Jian Cao , Shiyou Qian , Jianqi Gao , Chun Ouyang

Recent advances in visual industrial anomaly detection have demonstrated exceptional performance in identifying and segmenting anomalous regions while maintaining fast inference speeds. However, anomaly classification-distinguishing…

Computer Vision and Pattern Recognition · Computer Science 2025-05-06 Sassan Mokhtar , Arian Mousakhan , Silvio Galesso , Jawad Tayyub , Thomas Brox

Multimodal Large Language Models (MLLMs) are gaining increasing popularity in both academia and industry due to their remarkable performance in various applications such as visual question answering, visual perception, understanding, and…

Computation and Language · Computer Science 2024-09-09 Jian Li , Weiheng Lu , Hao Fei , Meng Luo , Ming Dai , Min Xia , Yizhang Jin , Zhenye Gan , Ding Qi , Chaoyou Fu , Ying Tai , Wankou Yang , Yabiao Wang , Chengjie Wang

The recent rapid development of deep learning has laid a milestone in industrial Image Anomaly Detection (IAD). In this paper, we provide a comprehensive review of deep learning-based image anomaly detection techniques, from the…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Jiaqi Liu , Guoyang Xie , Jinbao Wang , Shangnian Li , Chengjie Wang , Feng Zheng , Yaochu Jin

Anomaly detection is facing with emerging challenges in many important industry domains, such as cyber security and online recommendation and advertising. The recent trend in these areas calls for anomaly detection on time-evolving data…

Machine Learning · Computer Science 2019-07-16 Zheng Gao , Lin Guo , Chi Ma , Xiao Ma , Kai Sun , Hang Xiang , Xiaoqiang Zhu , Hongsong Li , Xiaozhong Liu

We introduce a novel, general-purpose audio generation framework specifically designed for anomaly detection and localization. Unlike existing datasets that predominantly focus on industrial and machine-related sounds, our framework focuses…

Multimodal Large Language Models (MLLMs) enhance the potential of natural language processing. However, their actual impact on document information extraction remains unclear. In particular, it is unclear whether an MLLM-only…

Computation and Language · Computer Science 2026-03-04 Jiyuan Shen , Peiyue Yuan , Atin Ghosh , Yifan Mai , Daniel Dahlmeier

Recently, Multimodal Large Language Models (MLLMs) have sparked great research interests owing to their exceptional content-reasoning and instruction-following capabilities. To effectively instruct an MLLM, in addition to conventional…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Jiacheng Zhang , Yang Jiao , Shaoxiang Chen , Jingjing Chen , Yu-Gang Jiang

Open-vocabulary detection (OVD) is a challenging task to detect and classify objects from an unrestricted set of categories, including those unseen during training. Existing open-vocabulary detectors are limited by complex visual-textual…

Computer Vision and Pattern Recognition · Computer Science 2025-02-27 Caixiong Li , Xiongwei Zhao , Jinhang Zhang , Xing Zhang , Qihao Sun , Zhou Wu

Video anomaly detection is a subject of great interest across industrial and academic domains due to its crucial role in computer vision applications. However, the inherent unpredictability of anomalies and the scarcity of anomaly samples…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Yalong Jiang , Liquan Mao

The deployment and application of Large Language Models (LLMs) is hindered by their memory inefficiency, computational demands, and the high costs of API inferences. Traditional distillation methods, which transfer the capabilities of LLMs…

Computation and Language · Computer Science 2024-11-21 Yifei Zhang , Bo Pan , Chen Ling , Yuntong Hu , Liang Zhao

Within the rapidly evolving domain of Electronic Design Automation (EDA), Large Language Models (LLMs) have emerged as transformative technologies, offering unprecedented capabilities for optimizing and automating various aspects of…

Machine Learning · Computer Science 2025-01-17 Jingyu Pan , Guanglei Zhou , Chen-Chia Chang , Isaac Jacobson , Jiang Hu , Yiran Chen

In the wake of relentless digital transformation, data-driven solutions are emerging as powerful tools to address multifarious industrial tasks such as forecasting, anomaly detection, planning, and even complex decision-making. Although…

Artificial Intelligence · Computer Science 2023-10-18 Xu Yang , Xiao Yang , Weiqing Liu , Jinhui Li , Peng Yu , Zeqi Ye , Jiang Bian

The increasing complexity of industrial anomaly detection (IAD) has positioned multimodal detection methods as a focal area of machine vision research. However, dedicated multimodal datasets specifically tailored for IAD remain limited.…

With the rapid development of China high-speed railway, drivers face increasingly significant technical challenges during operations, such as fault handling. Currently, drivers depend on the onboard mechanic when facing technical issues,…

Artificial Intelligence · Computer Science 2025-01-15 Y. C. Luo , J. Xun , W. Wang , R. Z. Zhang , Z. C. Zhao

Time-series anomaly detection (TSAD) increasingly demands explanations that articulate not only if an anomaly occurred, but also what pattern it exhibits and why it is anomalous. Leveraging the impressive explanatory capabilities of Large…

Machine Learning · Computer Science 2025-11-12 Tian Lan , Hao Duong Le , Jinbo Li , Wenjun He , Meng Wang , Chenghao Liu , Chen Zhang

Multimodal Large Language Models (MLLMs) have shown remarkable proficiency on general-purpose vision-language benchmarks, reaching or even exceeding human-level performance. However, these evaluations typically rely on standard…

Computer Vision and Pattern Recognition · Computer Science 2026-02-03 Wenjin Hou , Wei Liu , Han Hu , Xiaoxiao Sun , Serena Yeung-Levy , Hehe Fan

Large language models (LLMs) are increasingly applied to open-ended, interpretive annotation tasks, such as thematic analysis by researchers or generating feedback on student work by teachers. These tasks involve free-text annotations…

Computation and Language · Computer Science 2025-09-04 Hyunji Nam , Lucia Langlois , James Malamut , Mei Tan , Dorottya Demszky