English
Related papers

Related papers: DesignMinds: Enhancing Video-Based Design Ideation…

200 papers

Advancements in large language models (LLMs) have demonstrated their potential in facilitating high-level reasoning, logical reasoning and robotics planning. Recently, LLMs have also been able to generate reward functions for low-level…

Robotics · Computer Science 2024-02-21 Marta Skreta , Zihan Zhou , Jia Lin Yuan , Kourosh Darvish , Alán Aspuru-Guzik , Animesh Garg

Compared with Large Language Models (LLMs), Large Vision-Language Models (LVLMs) can also accept images as input, thus showcasing more interesting emergent capabilities and demonstrating impressive performance on various vision-language…

Computer Vision and Pattern Recognition · Computer Science 2024-09-26 Runpeng Yu , Weihao Yu , Xinchao Wang

Recently, large language models (LLMs) have demonstrated impressive capabilities in dealing with new tasks with the help of in-context learning (ICL). In the study of Large Vision-Language Models (LVLMs), when implementing ICL, researchers…

Computation and Language · Computer Science 2024-12-11 Ellen Yi-Ge , Jiechao Gao , Wei Han , Wei Zhu

Generative AI has transformed the fields of Design and Manufacturing by providing efficient and automated methods for generating and modifying 3D objects. One approach involves using Large Language Models (LLMs) to generate Computer- Aided…

Machine Learning · Computer Science 2025-03-03 Kamel Alrashedy , Pradyumna Tambwekar , Zulfiqar Zaidi , Megan Langwasser , Wei Xu , Matthew Gombolay

In recent years, multimodal large language models (MLLMs) have achieved remarkable progress, primarily attributed to effective paradigms for integrating visual and textual information. The dominant connector-based paradigm projects visual…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Xinpeng Dong , Min Zhang , Kairong Han , Xu Tan , Fei Wu , Kun Kuang

The growing interest in vision-language models (VLMs) has been driven by improvements in large language models and vision transformers. Despite the abundance of literature on this subject, we observe that critical decisions regarding the…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Hugo Laurençon , Léo Tronchon , Matthieu Cord , Victor Sanh

Large Language Models (LLMs) show potential for enhancing robotic path planning. This paper assesses visual input's utility for multimodal LLMs in such tasks via a comprehensive benchmark. We evaluated 15 multimodal LLMs on generating valid…

Robotics · Computer Science 2025-07-17 Jacinto Colan , Ana Davila , Yasuhisa Hasegawa

Recent advancements in large language models (LLMs) demonstrate strong potential for generating novel research ideas, yet such ideas often struggle with feasibility and effectiveness. In this paper, we investigate whether augmenting LLMs…

Computation and Language · Computer Science 2026-03-03 Xiao Liu , Xinyi Dong , Xinyang Gao , Yansong Feng , Xun Pang

As Large Language Models (LLMs) and other forms of Generative AI permeate various aspects of our lives, their application for learning and education has provided opportunities and challenges. This paper presents an investigation into the…

Computers and Society · Computer Science 2023-06-06 Daniel Leiker , Sara Finnigan , Ashley Ricker Gyllen , Mutlu Cukurova

Large Language Models (LLMs) have recently emerged as a focal point of research and application, driven by their unprecedented ability to understand and generate text with human-like quality. Even more recently, LLMs have been extended into…

Computation and Language · Computer Science 2024-04-03 Kilian Carolan , Laura Fennelly , Alan F. Smeaton

Large vision-language models (LVLMs) have achieved impressive results in various vision-language tasks. However, despite showing promising performance, LVLMs suffer from hallucinations caused by language bias, leading to diminished focus on…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Haozhe Zhao , Shuzheng Si , Liang Chen , Yichi Zhang , Maosong Sun , Mingjia Zhang , Baobao Chang

Multimodal Vision Language Models (VLMs) have emerged as a transformative topic at the intersection of computer vision and natural language processing, enabling machines to perceive and reason about the world through both visual and textual…

Computer Vision and Pattern Recognition · Computer Science 2025-04-08 Zongxia Li , Xiyang Wu , Hongyang Du , Fuxiao Liu , Huy Nghiem , Guangyao Shi

We ask the question: to what extent can recent large-scale language and image generation models blend visual concepts? Given an arbitrary object, we identify a relevant object and generate a single-sentence description of the blend of the…

Computation and Language · Computer Science 2021-06-29 Songwei Ge , Devi Parikh

Generative large language models (LLMs) exhibit impressive capabilities, which can be further augmented by integrating a pre-trained vision model into the original LLM to create a multimodal LLM (MLLM). However, this integration often…

Computation and Language · Computer Science 2025-08-14 Shikhar Srivastava , Md Yousuf Harun , Robik Shrestha , Christopher Kanan

Recent progress in large language models (LLMs) has shown that reasoning improves when intermediate thoughts are externalized into explicit workspaces, such as chain-of-thought traces or tool-augmented reasoning. Yet, visual language models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-22 Oindrila Saha , Vojtech Krs , Radomir Mech , Subhransu Maji , Matheus Gadelha , Kevin Blackburn-Matzen

Video-Language Models (VLMs) have demonstrated impressive multi-modal reasoning capabilities across diverse computer vision applications. However, these VLMs are task-specific and assume that both video and language inputs are complete.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-28 Xiang Fang , Wanlong Fang , Changshuo Wang , Keke Tang , Daizong Liu , Siyi Wang , Wei Ji

Fashion content generation is an emerging area at the intersection of artificial intelligence and creative design, with applications ranging from virtual try-on to culturally diverse design prototyping. Existing methods often struggle with…

Computation and Language · Computer Science 2025-01-28 Spencer Ramsey , Amina Grant , Jeffrey Lee

Architects adopt visual scripting and parametric design tools to explore more expansive design spaces (Coates, 2010), refine their thinking about the geometric logic of their design (Woodbury, 2010), and overcome conventional software…

Computation and Language · Computer Science 2024-12-05 Moritz Rietschel , Fang Guo , Kyle Steinfeld

Large language models (LLMs) are used not only for problem solving but also for creative ideation; however, eliciting serendipitous insights that are both novel and internally coherent remains difficult. While stochastic sampling promotes…

Computation and Language · Computer Science 2026-01-13 Makoto Sato

Large Language Models (LLMs), with remarkable conversational capability, have emerged as AI assistants that can handle both visual and textual modalities. However, their effectiveness in joint video and language understanding has not been…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Ruipu Luo , Ziwang Zhao , Min Yang , Zheming Yang , Minghui Qiu , Tao Wang , Zhongyu Wei , Yanhao Wang , Cen Chen