English
Related papers

Related papers: Can Large Language Models Grasp Event Signals? Exp…

200 papers

Traffic safety remains a critical global concern, with timely and accurate accident detection essential for hazard reduction and rapid emergency response. Infrastructure-based vision sensors offer scalable and efficient solutions for…

Computer Vision and Pattern Recognition · Computer Science 2025-09-26 Ilhan Skender , Kailin Tong , Selim Solmaz , Daniel Watzenig

$ $The synergy of language and vision models has given rise to Large Language and Vision Assistant models (LLVAs), designed to engage users in rich conversational experiences intertwined with image-based queries. These comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2024-01-02 Ashhadul Islam , Md. Rafiul Biswas , Wajdi Zaghouani , Samir Brahim Belhaouari , Zubair Shah

Zero-shot learning (ZSL) aims to classify objects that are not observed or seen during training. It relies on class semantic description to transfer knowledge from the seen classes to the unseen classes. Existing methods of obtaining class…

Computer Vision and Pattern Recognition · Computer Science 2023-10-19 Fahimul Hoque Shubho , Townim Faisal Chowdhury , Ali Cheraghian , Morteza Saberi , Nabeel Mohammed , Shafin Rahman

Large Language Models (LLMs) have been successfully used in many natural-language tasks and applications including text generation and AI chatbots. They also are a promising new technology for concept-oriented deep learning (CODL). However,…

Machine Learning · Computer Science 2023-09-21 Daniel T. Chang

Domain-specific knowledge can significantly contribute to addressing a wide variety of vision tasks. However, the generation of such knowledge entails considerable human labor and time costs. This study investigates the potential of Large…

Large scale Vision-Language (VL) models have shown tremendous success in aligning representations between visual and text modalities. This enables remarkable progress in zero-shot recognition, image generation & editing, and many other…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Wei Lin , Leonid Karlinsky , Nina Shvetsova , Horst Possegger , Mateusz Kozinski , Rameswar Panda , Rogerio Feris , Hilde Kuehne , Horst Bischof

Contextual cues related to a person's pose and interactions with objects and other people in the scene can provide valuable information for gaze following. While existing methods have focused on dedicated cue extraction methods, in this…

Computer Vision and Pattern Recognition · Computer Science 2024-06-07 Anshul Gupta , Pierre Vuillecard , Arya Farkhondeh , Jean-Marc Odobez

Recently, large pre-trained language models (LLMs) have demonstrated superior language understanding abilities, including zero-shot causal reasoning. However, it is unclear to what extent their capabilities are similar to human ones. We…

Computation and Language · Computer Science 2023-11-14 Xudong Hong , Margarita Ryzhova , Daniel Adrian Biondi , Vera Demberg

Language models~(LMs) gradually become general-purpose interfaces in the interactive and embodied world, where the understanding of physical concepts is an essential prerequisite. However, it is not yet clear whether LMs can understand…

Computation and Language · Computer Science 2023-05-24 Lei Li , Jingjing Xu , Qingxiu Dong , Ce Zheng , Qi Liu , Lingpeng Kong , Xu Sun

This study examines the feasibility of applying large language models (LLMs) for forecasting the impact of traffic incidents on the traffic flow. The use of LLMs for this task has several advantages over existing machine learning-based…

Artificial Intelligence · Computer Science 2025-07-08 George Jagadeesh , Srikrishna Iyer , Michal Polanowski , Kai Xin Thia

Sensor data streams provide valuable information around activities and context for downstream applications, though integrating complementary information can be challenging. We show that large language models (LLMs) can be used for late…

Reading comprehension tests are used in a variety of applications, reaching from education to assessing the comprehensibility of simplified texts. However, creating such tests manually and ensuring their quality is difficult and…

Computation and Language · Computer Science 2024-05-22 Andreas Säuberli , Simon Clematide

Recently, various illustrative examples have shown the impressive ability of generative large language models (LLMs) to perform NLP related tasks. ChatGPT undoubtedly is the most representative model. We empirically evaluate ChatGPT's…

Software Engineering · Computer Science 2023-07-20 Jianzhang Zhang , Yiyang Chen , Nan Niu , Yinglin Wang , Chuang Liu

Generative AI offers a simple, prompt-based alternative to fine-tuning smaller BERT-style LLMs for text classification tasks. This promises to eliminate the need for manually labeled training data and task-specific model training. However,…

Computation and Language · Computer Science 2024-08-19 Martin Juan José Bucher , Marco Martini

Large-scale visual-language pre-trained models (VLPM) have proven their excellent performance in downstream object detection for natural scenes. However, zero-shot nuclei detection on H\&E images via VLPMs remains underexplored. The large…

Computer Vision and Pattern Recognition · Computer Science 2023-07-03 Yongjian Wu , Yang Zhou , Jiya Saiyin , Bingzheng Wei , Maode Lai , Jianzhong Shou , Yubo Fan , Yan Xu

This study quantifies how prompting strategies interact with large language models (LLMs) to automate the screening stage of systematic literature reviews (SLRs). We evaluate six LLMs (GPT-4o, GPT-4o-mini, DeepSeek-Chat-V3,…

Computation and Language · Computer Science 2025-10-21 Binglan Han , Anuradha Mathrani , Teo Susnjak

Large language models (LLMs) and vision-language models (VLMs) have been increasingly used in robotics for high-level cognition, but their use for low-level cognition, such as interpreting sensor information, remains underexplored. In…

Robotics · Computer Science 2024-08-09 Masashi Osada , Gustavo A. Garcia Ricardez , Yosuke Suzuki , Tadahiro Taniguchi

Previous learning-based vulnerability detection methods relied on either medium-sized pre-trained models or smaller neural networks from scratch. Recent advancements in Large Pre-Trained Language Models (LLMs) have showcased remarkable…

Software Engineering · Computer Science 2024-01-30 Xin Zhou , Ting Zhang , David Lo

This paper presents novel benchmarks for evaluating vision-language models (VLMs) in zero-shot recognition, focusing on granularity and specificity. Although VLMs excel in tasks like image captioning, they face challenges in open-world…

Computer Vision and Pattern Recognition · Computer Science 2024-06-19 Zhenlin Xu , Yi Zhu , Tiffany Deng , Abhay Mittal , Yanbei Chen , Manchen Wang , Paolo Favaro , Joseph Tighe , Davide Modolo

Large Language Models (LLMs) are transforming the robotics domain by enabling robots to comprehend and execute natural language instructions. The cornerstone benefits of LLM include processing textual data from technical manuals,…