English
Related papers

Related papers: Sketch2Feedback: Grammar-in-the-Loop Framework for…

200 papers

Multimodal large language models (MLLMs) have advanced perception across text, vision, and audio, yet they often struggle with structured cross-modal reasoning, particularly when integrating audio and visual signals. We introduce…

Computer Vision and Pattern Recognition · Computer Science 2025-06-20 Zhenghao Xing , Xiaowei Hu , Chi-Wing Fu , Wenhai Wang , Jifeng Dai , Pheng-Ann Heng

Assessing artistic creativity is foundational to creativity research and arts education, yet manual scoring (e.g., Torrance Tests of Creative Thinking) is labor-intensive at scale. Prior machine-learning approaches show promise for visual…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Zhehan Zhang , Meihua Qian , Li Luo , Siyu Huang , Chaoyi Zhou , Ripon Saha , Xinxin Song

As Vision-Language Models (VLMs) grow in sophistication, their ability to perform reasoning is coming under increasing supervision. While they excel at many tasks, their grasp of fundamental scientific principles, such as physics, remains…

Machine Learning · Computer Science 2025-09-11 Pranav Pawar , Kavish Shah , Akshat Bhalani , Komal Kasat , Dev Mittal , Hadi Gala , Deepali Patil , Nikita Raichada , Monali Deshmukh

Using LLMs to give educational feedback to students for their assignments has attracted much attention in the AI in Education field. Yet, there is currently no large-scale open-source dataset of student assignments that includes detailed…

Computers and Society · Computer Science 2025-08-11 Keyang Qian , Kaixun Yang , Wei Dai , Flora Jin , Yixin Cheng , Rui Guan , Sadia Nawaz , Zachari Swiecki , Guanliang Chen , Lixiang Yan , Dragan Gašević

We present Liquid, an auto-regressive generation paradigm that seamlessly integrates visual comprehension and generation by tokenizing images into discrete codes and learning these code embeddings alongside text tokens within a shared…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Junfeng Wu , Yi Jiang , Chuofan Ma , Yuliang Liu , Hengshuang Zhao , Zehuan Yuan , Song Bai , Xiang Bai

Large Language Models (LLMs) are increasingly used for code generation, yet quantum code generation is still evaluated mostly within single frameworks, making it difficult to separate quantum reasoning from framework familiarity. We…

Reinforcement learning (RL) training of large language models (LLMs) on unverifiable tasks is challenging even when a reasonable-quality reference answer is available. We propose a constrained RL training framework that (i) optimizes a…

Recent work has questioned whether large language models (LLMs) can perform genuine in-context learning (ICL) for scientific experimental design, with prior studies suggesting that LLM-based agents exhibit no sensitivity to experimental…

Text-to-image (T2I) models are capable of generating visually impressive images, yet they often fail to accurately capture specific attributes in user prompts, such as the correct number of objects with the specified colors. The diversity…

Computer Vision and Pattern Recognition · Computer Science 2025-12-03 Kevin David Hayes , Micah Goldblum , Vikash Sehwag , Gowthami Somepalli , Ashwinee Panda , Tom Goldstein

Large Language Models (LLMs) demonstrate impressive capabilities in natural language processing but suffer from inaccuracies and logical inconsistencies known as hallucinations. This compromises their reliability, especially in domains…

Artificial Intelligence · Computer Science 2025-12-08 Ruslan Idelfonso Magana Vsevolodovna , Marco Monti

Recent advances in Vision-Language Models (VLMs) have benefited from Reinforcement Learning (RL) for enhanced reasoning. However, existing methods still face critical limitations, including the lack of low-level visual information and…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 Zhiheng Wu , Tong Wang , Shuning Wang , Naiming Liu , Yumeng Zhang

Recent advances in Large Multimodal Models (LMMs) have expanded their capabilities to video understanding, with Text-to-Video (T2V) models excelling in generating videos from textual prompts. However, they still frequently produce…

Despite showing increasingly human-like conversational abilities, state-of-the-art dialogue models often suffer from factual incorrectness and hallucination of knowledge (Roller et al., 2020). In this work we explore the use of…

Computation and Language · Computer Science 2021-04-16 Kurt Shuster , Spencer Poff , Moya Chen , Douwe Kiela , Jason Weston

Multimodal Large Language Models (MLLMs) have shown remarkable capability in assisting disease diagnosis in medical visual question answering (VQA). However, their outputs remain vulnerable to hallucinations (i.e., responses that contradict…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Mengyuan Jin , Zehui Liao , Yong Xia

Spatial intelligence is a critical frontier for Multimodal Large Language Models (MLLMs), empowering them to comprehend the physical world. Drawing inspiration from human perception mechanisms, prior studies attempt to construct a spatial…

Computer Vision and Pattern Recognition · Computer Science 2026-03-10 Yibin Huang , Wang Xu , Wanyue Zhang , Helu Zhi , Jingjing Huang , Yangbin Xu , Yangang Sun , Conghui Zhu , Tiejun Zhao

Large language models (LLMs) are being increasingly adopted in the software engineering domain, yet the robustness of their grasp on core software design concepts remains unclear. We conduct an empirical study to systematically evaluate…

Software Engineering · Computer Science 2025-12-30 Mootez Saad , Boqi Chen , José Antonio Hernández López , Dániel Varró , Tushar Sharma

Multimodal large language models (MLLMs) have shown promising reasoning abilities, yet evaluating their performance in specialized domains remains challenging. STEM reasoning is a particularly valuable testbed because it provides highly…

Computer Vision and Pattern Recognition · Computer Science 2026-05-11 Jing Jin , Hao Liu , Yan Bai , Yihang Lou , Zhenke Wang , Tianrun Yuan , Juntong Chen , Yongkang Zhu , Fanhu Zeng , Xuanyu Zhu , Tao Feng , Yige Xu

Recent advancements in large language models (LLMs) have demonstrated substantial progress in reasoning capabilities, such as DeepSeek-R1, which leverages rule-based reinforcement learning to enhance logical reasoning significantly.…

Artificial Intelligence · Computer Science 2025-06-24 Zeyu Liu , Yuhang Liu , Guanghao Zhu , Congkai Xie , Zhen Li , Jianbo Yuan , Xinyao Wang , Qing Li , Shing-Chi Cheung , Shengyu Zhang , Fei Wu , Hongxia Yang

Recently, large language models (LLMs) have demonstrated impressive capabilities in dealing with new tasks with the help of in-context learning (ICL). In the study of Large Vision-Language Models (LVLMs), when implementing ICL, researchers…

Computation and Language · Computer Science 2024-12-11 Ellen Yi-Ge , Jiechao Gao , Wei Han , Wei Zhu

Large Language Models (LLMs) exhibit impressive performance across various domains but still struggle with arithmetic reasoning tasks. Recent work shows the effectiveness of prompt design methods in enhancing reasoning capabilities.…

Computation and Language · Computer Science 2024-10-11 Wenting Tan , Dongxiao Chen , Jieting Xue , Zihao Wang , Taijie Chen