English
Related papers

Related papers: Boosting Text-to-Chart Retrieval through Training …

200 papers

Being able to effectively read scientific plots, or chart understanding, is a central part toward building effective agents for science. However, existing multimodal large language models (MLLMs), especially open-source ones, are still…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Yuwei Yang , Zeyu Zhang , Yunzhong Hou , Zhuowan Li , Gaowen Liu , Ali Payani , Yuan-Sen Ting , Liang Zheng

Chart-to-summary generation can help explore data, communicate insights, and help the visually impaired people. Multi-modal generative models have been used to produce fluent summaries, but they can suffer from factual and perceptual…

Computation and Language · Computer Science 2024-05-30 Syrine Krichene , Francesco Piccinno , Fangyu Liu , Julian Martin Eisenschlos

While AI systems have made remarkable progress in processing unstructured text, structured data such as graphs stored in databases, continues to grow rapidly yet remains difficult for neural models to effectively utilize. We introduce…

Databases · Computer Science 2026-03-09 Yufei Li , Yisen Gao , Jiaxin Bai , Jiaxuan Xiong , Haoyu Huang , Zhongwei Xie , Hong Ting Tsang , Yangqiu Song

Large language models excel in general tasks, yet assessing their reliability in logic-heavy, precision-critical domains like finance, law, and healthcare remains challenging. To address this, we introduce BizFinBench, the first benchmark…

Artificial Intelligence · Computer Science 2025-05-27 Guilong Lu , Xuntao Guo , Rongjunchen Zhang , Wenqiao Zhu , Ji Liu

Natural language and search interfaces intuitively facilitate data exploration and provide visualization responses to diverse analytical queries based on the underlying datasets. However, these interfaces often fail to interpret more…

Human-Computer Interaction · Computer Science 2024-02-20 Alexander Bendeck , Dennis Bromley , Vidya Setlur

In this paper, we introduce ReasonEmbed, a novel text embedding model developed for reasoning-intensive document retrieval. Our work includes three key technical contributions. First, we propose ReMixer, a new data synthesis method that…

Information Retrieval · Computer Science 2026-04-21 Jianlyu Chen , Junwei Lan , Chaofan Li , Defu Lian , Zheng Liu

Recent works show that interactive documents connecting text with visualizations facilitate reading comprehension. However, creating this type of content requires specialized knowledge. We present ChartText, a method that links text with…

Human-Computer Interaction · Computer Science 2022-01-14 Joao Pinheiro , Jorge Poco

Emotion understanding is a core capability for LLMs to interact effectively with humans, yet existing evaluation paradigms rely on discrete emotion label prediction and fail to capture the cognitive processes underlying emotion generation.…

Artificial Intelligence · Computer Science 2026-05-19 Zhaoyue Sun , Hainiu Xu , Andero Uusberg , James J. Gross , Petr Slovak , Yulan He

Chart summarization is crucial for enhancing data accessibility and the efficient consumption of information. However, existing methods, including those with Multimodal Large Language Models (MLLMs), primarily focus on low-level data…

Artificial Intelligence · Computer Science 2026-02-24 Yuhang Bai , Yujuan Ding , Shanru Lin , Wenqi Fan

Graph models are fundamental to data analysis in domains rich with complex relationships. Text-to-Graph-Query-Language (Text-to-GQL) systems act as a translator, converting natural language into executable graph queries. This capability…

Artificial Intelligence · Computer Science 2026-02-13 Songlin Lyu , Lujie Ban , Zihang Wu , Tianqi Luo , Jirong Liu , Chenhao Ma , Yuyu Luo , Nan Tang , Shipeng Qi , Heng Lin , Yongchao Liu , Chuntao Hong

Recent advances in frontier large language models have enabled code review agents that operate in open-ended, reasoning-intensive settings. However, the lack of standardized benchmarks and granular evaluation protocols makes it difficult to…

Software Engineering · Computer Science 2026-03-13 Kristen Pereira , Neelabh Sinha , Rajat Ghosh , Debojyoti Dutta

Recent advances in text-to-image generation have improved the quality of synthesized images, but evaluations mainly focus on aesthetics or alignment with text prompts. Thus, it remains unclear whether these models can accurately represent a…

Computer Vision and Pattern Recognition · Computer Science 2025-07-29 Hsin-Ping Huang , Xinyi Wang , Yonatan Bitton , Hagai Taitelbaum , Gaurav Singh Tomar , Ming-Wei Chang , Xuhui Jia , Kelvin C. K. Chan , Hexiang Hu , Yu-Chuan Su , Ming-Hsuan Yang

The emergence of Multi-modal Large Language Models (MLLMs) presents new opportunities for chart understanding. However, due to the fine-grained nature of these tasks, applying MLLMs typically requires large, high-quality datasets for…

Computation and Language · Computer Science 2025-10-08 Yifan Wu , Lutao Yan , Leixian Shen , Yinan Mei , Jiannan Wang , Yuyu Luo

Recent years have seen rapid advances in AI-driven image generation. Early diffusion models emphasized perceptual quality, while newer multimodal models like GPT-4o-image integrate high-level reasoning, improving semantic understanding and…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Yifan Chang , Yukang Feng , Jianwen Sun , Jiaxin Ai , Chuanhao Li , S. Kevin Zhou , Kaipeng Zhang

Retrieval-Augmented Generation (RAG) has become critical for knowledge-intensive applications, yet evaluating its performance in vertical domains remains difficult due to domain complexity, diverse context scales, and heavy reliance on…

Computation and Language · Computer Science 2026-05-27 Jingbin Qian , Congwen Yi , Min Xia , Wen Wu , Jun Zhu , Jian Guan

Data management has traditionally relied on synthetic data generators to generate structured benchmarks, like the TPC suite, where we can control important parameters like data size and its distribution precisely. These benchmarks were…

Databases · Computer Science 2023-08-09 Koyena Pal , Aamod Khatiwada , Roee Shraga , Renée J. Miller

Patent retrieval underpins critical decisions in innovation, examination, and IP strategy, yet progress has been hampered by the absence of benchmarks that reflect the diversity of real world search scenarios. We address this gap with two…

Information Retrieval · Computer Science 2026-04-28 Younes Djemmal , You Zuo , Kim Gerdes , Kirian Guiller

The recent advancements in Vision Language Models (VLMs) have demonstrated progress toward true intelligence requiring robust reasoning capabilities. Beyond pattern recognition, linguistic reasoning must integrate with visual comprehension,…

Artificial Intelligence · Computer Science 2026-04-06 Yunfei Bai , Amit Dhanda , Shekhar Jain

Automating the conversion of UI images into web code is a critical task for front-end development and rapid prototyping. Advances in multimodal large language models (MLLMs) have made WebUI-to-Code increasingly feasible, yet existing…

Artificial Intelligence · Computer Science 2025-10-10 Peichao Lai , Jinhui Zhuang , Kexuan Zhang , Ningchang Xiong , Shengjie Wang , Yanwei Xu , Chong Chen , Yilei Wang , Bin Cui

Enterprise software companies maintain thousands of user interface screens across products and versions, creating critical challenges for design consistency, pattern discovery, and compliance check. Existing approaches rely on visual…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Maroun Ayli , Youssef Bakouny , Tushar Sharma , Nader Jalloul , Hani Seifeddine , Rima Kilany