English
Related papers

Related papers: Error Notebook-Guided, Training-Free Part Retrieva…

200 papers

Vision-language models (VLMs) have shown strong potential for scientific image understanding, but general-purpose models often lack the domain-specific visual knowledge required for reliable materials characterization. In this work, we…

Materials Science · Physics 2026-05-11 Quanliang Liu , Jungtaek Kim , Kangwook Lee , Hyunseok Oh

All text-based language problems can be reduced to either generation or embedding. Current models only perform well at one or the other. We introduce generative representational instruction tuning (GRIT) whereby a large language model is…

Computation and Language · Computer Science 2025-03-04 Niklas Muennighoff , Hongjin Su , Liang Wang , Nan Yang , Furu Wei , Tao Yu , Amanpreet Singh , Douwe Kiela

This paper presents a detailed evaluation of a Retrieval-Augmented Generation (RAG) system that integrates large language models (LLMs) to enhance information retrieval and instruction generation for maintenance personnel across diverse…

Information Retrieval · Computer Science 2025-02-28 Akos Nagy , Yannis Spyridis , Vasileios Argyriou

We explore and improve the capabilities of LLMs to generate data for grammatical error correction (GEC). When merely producing parallel sentences, their patterns are too simplistic to be valuable as a corpus. To address this issue, we…

Computation and Language · Computer Science 2024-06-12 Jeiyoon Park , Chanjun Park , Heuiseok Lim

Vehicle make and model recognition (VMMR) is an important task in intelligent transportation systems, but existing approaches struggle to adapt to newly released models. Contrastive Language-Image Pretraining (CLIP) provides strong…

Computer Vision and Pattern Recognition · Computer Science 2025-10-22 Wei-Chia Chang , Yan-Ann Chen

Large language model (LLM) based task plans and corresponding human demonstrations for embodied AI may be noisy, with unnecessary actions, redundant navigation, and logical errors that reduce policy quality. We propose an iterative…

Artificial Intelligence · Computer Science 2026-01-01 Ananth Hariharan , Vardhan Dongre , Dilek Hakkani-Tür , Gokhan Tur

Software engineers are increasingly adding semantic search capabilities to applications using a strategy known as Retrieval Augmented Generation (RAG). A RAG system involves finding documents that semantically match a query and then passing…

Software Engineering · Computer Science 2024-02-05 Scott Barnett , Stefanus Kurniawan , Srikanth Thudumu , Zach Brannelly , Mohamed Abdelrazek

Monitoring the chain-of-thought (CoT) of reasoning models is a promising approach for detecting covert misbehavior (i.e., hidden objectives) in code generation tasks. While large models (GPT-5, Gemini-3-Flash) can serve as effective CoT…

Cryptography and Security · Computer Science 2026-05-14 Nirav Diwan , Han Wang , Berkcan Kapusuzoglu , Ramin Moradi , Supriyo Chakraborty , Giri Iyengar , Sambit Sahu , Huan Zhang , Gang Wang

Visual Language Navigation (VLN) is one of the fundamental capabilities for embodied intelligence and a critical challenge that urgently needs to be addressed. However, existing methods are still unsatisfactory in terms of both success rate…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Dekang Qi , Shuang Zeng , Xinyuan Chang , Feng Xiong , Shichao Xie , Xiaolong Wu , Mu Xu

We propose a novel three-step prompt-tuning method for Bengali Grammatical Error Explanation (BGEE) using state-of-the-art large language models (LLMs) such as GPT-4, GPT-3.5 Turbo, and Llama-2-70b. Our approach involves identifying and…

Computation and Language · Computer Science 2025-04-09 Subhankar Maity , Aniket Deroy

This study addresses construction site hazard identification by proposing a retrieval-augmented framework that enhances large language models (LLMs) without requiring fine-tuning. Current LLM-based approaches face limitations: image-text…

Artificial Intelligence · Computer Science 2025-11-11 Jiawei Li , Chengye Yang , Yaochen Zhang , Weilin Sun , Lei Meng , Xiangxu Meng

Context: The rapid evolution of Large Language Models (LLMs) has sparked significant interest in leveraging their capabilities for automating code review processes. Prior studies often focus on developing LLMs for code review automation,…

Software Engineering · Computer Science 2024-06-18 Chanathip Pornprasit , Chakkrit Tantithamthavorn

Large Language Models (LLMs) evaluation is a patchy and inconsistent landscape, and it is becoming clear that the quality of automatic evaluation metrics is not keeping up with the pace of development of generative models. We aim to improve…

Computation and Language · Computer Science 2023-10-24 Andrea Sottana , Bin Liang , Kai Zou , Zheng Yuan

Despite the syntactic fluency of Large Language Models (LLMs), ensuring their logical correctness in high-stakes domains remains a fundamental challenge. We present a neurosymbolic framework that combines LLMs with SMT solvers to produce…

Computation and Language · Computer Science 2026-05-05 Vikash Singh , Darion Cassel , Nathaniel Weir , Nick Feng , Sam Bayless

Vision-language models (VLMs) frequently generate hallucinated content plausible but incorrect claims about image content. We propose a training-free self-correction framework enabling VLMs to iteratively refine responses through…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Kassoum Sanogo , Renzo Ardiccioni

As the field of Multimodal Large Language Models (MLLMs) continues to evolve, their potential to revolutionize artificial intelligence is particularly promising, especially in addressing mathematical reasoning tasks. Current mathematical…

Medical vision-language models (Med-VLMs) have shown impressive results in tasks such as report generation and visual question answering, but they still face several limitations. Most notably, they underutilize patient metadata and lack…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Fangqi Cheng , Surajit Ray , Xiaochen Yang

Multimodal large language models (MLLMs), such as GPT-4o, Gemini, LLaVA, and Flamingo, have made significant progress in integrating visual and textual modalities, excelling in tasks like visual question answering (VQA), image captioning,…

Computer Vision and Pattern Recognition · Computer Science 2024-12-31 Junxiao Xue , Quan Deng , Fei Yu , Yanhao Wang , Jun Wang , Yuehua Li

To build a French national electronic injury surveillance system based on emergency room visits, we aim to develop a coding system to classify their causes from clinical notes in free-text. Supervised learning techniques have shown good…

Computation and Language · Computer Science 2021-04-08 Binbin Xu , Cédric Gil-Jardiné , Frantz Thiessard , Eric Tellier , Marta Avalos , Emmanuel Lagarde

This study is a pioneering endeavor to investigate the capabilities of Large Language Models (LLMs) in addressing conceptual questions within the domain of mechanical engineering with a focus on mechanics. Our examination involves a…

Computation and Language · Computer Science 2024-01-25 Jie Tian , Jixin Hou , Zihao Wu , Peng Shu , Zhengliang Liu , Yujie Xiang , Beikang Gu , Nicholas Filla , Yiwei Li , Ning Liu , Xianyan Chen , Keke Tang , Tianming Liu , Xianqiao Wang