English
Related papers

Related papers: Vision Language Models for Optimization-Driven Int…

200 papers

Human-robot collaboration requires robots to quickly infer user intent, provide transparent reasoning, and assist users in achieving their goals. Our recent work introduced GUIDER, our framework for inferring navigation and manipulation…

Robotics · Computer Science 2025-08-18 Cesar Alan Contreras , Manolis Chiou , Alireza Rastegarpanah , Michal Szulik , Rustam Stolkin

Vision-Language Models (VLMs) have recently shown promising advancements in sequential decision-making tasks through task-specific fine-tuning. However, common fine-tuning methods, such as Supervised Fine-Tuning (SFT) and Reinforcement…

Computation and Language · Computer Science 2025-03-26 Haoqiang Kang , Enna Sachdeva , Piyush Gupta , Sangjae Bae , Kwonjoon Lee

The increasing proliferation of IoT devices and AI applications has created a demand for scalable and efficient computing solutions, particularly for applications requiring real-time processing. The compute continuum integrates edge and…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-14 Negin Akbari , John Grundy , Aamir Cheema , Adel N. Toosi

This study aims to systematically evaluate the performance of large language models (LLMs) in abstract visual reasoning problems. We examined four LLM models (GPT-4.1-Mini, Claude-3.5-Haiku, Gemini-1.5-Flash, Llama-3.3-70b) utilizing four…

Artificial Intelligence · Computer Science 2025-11-18 Sinan Urgun , Seçkin Arı

Intent detection is a critical component of task-oriented dialogue systems (TODS) which enables the identification of suitable actions to address user utterances at each dialog turn. Traditional approaches relied on computationally…

Computation and Language · Computer Science 2024-10-03 Gaurav Arora , Shreya Jain , Srujana Merugu

Large language models (LLMs), especially generative pre-trained transformers (GPTs), have recently demonstrated outstanding ability in information comprehension and problem-solving. This has motivated many studies in applying LLMs to…

Machine Learning · Computer Science 2024-05-21 Han Zhang , Akram Bin Sediq , Ali Afana , Melike Erol-Kantarci

The rapid advancement toward sixth-generation (6G) wireless networks has significantly intensified the complexity and scale of optimization problems, including resource allocation and trajectory design, often formulated as combinatorial…

Networking and Internet Architecture · Computer Science 2025-09-09 Bisheng Wei , Ruihong Jiang , Ruichen Zhang , Yinqiu Liu , Dusit Niyato , Yaohua Sun , Yang Lu , Yonghui Li , Shiwen Mao , Chau Yuen , Marco Di Renzo , Mugen Peng

Autonomous driving systems often infer pedestrian yielding behavior from geometric and kinematic cues alone, limiting their ability to reason about visual scene context and age-dependent behavioral variability. This limitation can produce…

Systems and Control · Electrical Eng. & Systems 2026-04-28 Qingwen Pu , Kun Xie , Yuxiang Liu

Vision language models (VLM) have demonstrated remarkable performance across various downstream tasks. However, understanding fine-grained visual-linguistic concepts, such as attributes and inter-object relationships, remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Wujian Peng , Sicheng Xie , Zuyao You , Shiyi Lan , Zuxuan Wu

This study introduces a novel approach for traffic control systems by using Large Language Models (LLMs) as traffic controllers. The study utilizes their logical reasoning, scene understanding, and decision-making capabilities to optimize…

Computation and Language · Computer Science 2024-11-19 Sari Masri , Huthaifa I. Ashqar , Mohammed Elhenawy

Vision-Language Models (VLMs) have recently seen significant advancements through integrating with Large Language Models (LLMs). The VLMs, which process image and text modalities simultaneously, have demonstrated the ability to learn and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-10 Vahid Azizi , Fatemeh Koochaki

Multimodal Vision-Language Models (VLMs) enable powerful applications from their fused understanding of images and language, but many perform poorly on UI tasks due to the lack of UI training data. In this paper, we adapt a recipe for…

Human-Computer Interaction · Computer Science 2023-10-10 Yue Jiang , Eldon Schoop , Amanda Swearngin , Jeffrey Nichols

In this paper, we provide an extensive analysis of multi-label intent classification using Large Language Models (LLMs) that are open-source, publicly available, and can be run in consumer hardware. We use the MultiWOZ 2.1 dataset, a…

Computation and Language · Computer Science 2025-09-15 Adnan Ahmad , Philine Kowol , Stefan Hillmann , Sebastian Möller

Vision-language models (VLMs) frequently generate hallucinated content plausible but incorrect claims about image content. We propose a training-free self-correction framework enabling VLMs to iteratively refine responses through…

Computer Vision and Pattern Recognition · Computer Science 2025-12-11 Kassoum Sanogo , Renzo Ardiccioni

Intent-oriented controlled video captioning aims to generate targeted descriptions for specific targets in a video based on customized user intent. Current Large Visual Language Models (LVLMs) have gained strong instruction following and…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Tianheng Qiu , Jingchun Gao , Jingyu Li , Huiyi Leong , Xuan Huang , Xi Wang , Xiaocheng Zhang , Kele Xu , Lan Zhang

Mining the latent intentions from large volumes of natural language inputs is a key step to help data analysts design and refine Intelligent Virtual Assistants (IVAs) for customer service. To aid data analysts in this task we present Verint…

Computation and Language · Computer Science 2022-02-03 Xinyu Chen , Ian Beaver

Large Language Models (LLMs) have achieved remarkable reliability and advanced capabilities through extended test-time reasoning. However, extending these capabilities to Multi-modal Large Language Models (MLLMs) remains a significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-20 Yuhao Dong , Zuyan Liu , Shulin Tian , Yongming Rao , Ziwei Liu

State-of-the-art Vision-Language Models (VLMs) ground the vision and the language modality primarily via projecting the vision tokens from the encoder to language-like tokens, which are directly fed to the Large Language Model (LLM)…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Sivan Doveh , Shaked Perek , M. Jehanzeb Mirza , Wei Lin , Amit Alfassy , Assaf Arbelle , Shimon Ullman , Leonid Karlinsky

Large Vision-Language Models (LVLMs) enable sophisticated reasoning over images and videos, yet their inference is hindered by a systemic efficiency barrier known as visual token dominance. This overhead is driven by a multi-regime…

Computation and Language · Computer Science 2026-04-15 Jun Zhang , Yicheng Ji , Feiyang Ren , Yihang Li , Bowen Zeng , Zonghao Chen , Ke Chen , Lidan Shou , Gang Chen , Huan Li

The field of vision-and-language (VL) understanding has made unprecedented progress with end-to-end large pre-trained VL models (VLMs). However, they still fall short in zero-shot reasoning tasks that require multi-step inferencing. To…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Haoxuan You , Zhecan Wang , Rui Sun , Long Chen , Gengyu Wang , Hammad A. Ayyubi , Kai-Wei Chang , Shih-Fu Chang