English
Related papers

Related papers: $C^2$: Scalable Auto-Feedback for LLM-based Chart …

200 papers

Large language models (LLMs) can solve problems step-by-step. While this chain-of-thought (CoT) reasoning boosts LLMs' performance, it is unclear if LLMs \textit{know} when to use CoT and whether those CoT are always necessary to answer the…

Computation and Language · Computer Science 2024-03-21 Cheng-Han Chiang , Hung-yi Lee

Chart question answering (ChartQA) tasks play a critical role in interpreting and extracting insights from visualization charts. While recent advancements in multimodal large language models (MLLMs) like GPT-4o have shown promise in…

Computation and Language · Computer Science 2024-11-07 Yifan Wu , Lutao Yan , Leixian Shen , Yunhai Wang , Nan Tang , Yuyu Luo

Automated code generation using large language models (LLMs) has gained attention due to its efficiency and adaptability. However, real-world coding tasks or benchmarks like HumanEval and StudentEval often lack dedicated training datasets,…

Software Engineering · Computer Science 2025-01-15 Shuai Wang , Liang Ding , Yibing Zhan , Yong Luo , Zheng He , Dapeng Tao

UML and ER diagrams are foundational in computer science education but come with challenges for learners due to the need for abstract thinking, contextual understanding, and mastery of both syntax and semantics. These complexities are…

Human-Computer Interaction · Computer Science 2025-08-01 Sebastian Gürtl , Gloria Schimetta , David Kerschbaumer , Michael Liut , Alexander Steinmaurer

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

Artificial Intelligence · Computer Science 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

Despite the success of Large Language Models (LLMs) on various tasks following human instructions, controlling model generation at inference time poses a persistent challenge. In this paper, we introduce Ctrl-G, an adaptable framework that…

Computation and Language · Computer Science 2024-08-20 Honghua Zhang , Po-Nien Kung , Masahiro Yoshida , Guy Van den Broeck , Nanyun Peng

The growing need to integrate information from a large number of diverse sources poses significant scalability challenges for data integration systems. These systems often rely on manually written schema mappings, which are complex,…

Databases · Computer Science 2025-06-02 Christopher Buss , Mahdis Safari , Arash Termehchy , Stefan Lee , David Maier

Chart-to-code generation is a critical task in automated data visualization, translating complex chart structures into executable programs. While recent Multi-modal Large Language Models (MLLMs) improve chart representation, existing…

Software Engineering · Computer Science 2025-12-01 Yifei Wang , Jacky Keung , Zhenyu Mao , Jingyu Zhang , Yuchen Cao

As AI becomes fundamental in sectors like healthcare, explainable AI (XAI) tools are essential for trust and transparency. However, traditional user studies used to evaluate these tools are often costly, time consuming, and difficult to…

Artificial Intelligence · Computer Science 2024-10-24 Francesco Bombassei De Bona , Gabriele Dominici , Tim Miller , Marc Langheinrich , Martin Gjoreski

Like humans, large language models (LLMs) do not always generate the best output on their first try. Motivated by how humans refine their written text, we introduce Self-Refine, an approach for improving initial outputs from LLMs through…

Large language models (LLMs) hold promise for sustainable manufacturing, but often hallucinate industrial codes and emission factors, undermining regulatory and investment decisions. We introduce CircuGraphRAG, a retrieval-augmented…

As large language models (LLMs) advance, it becomes more challenging to reliably evaluate their output due to the high costs of human evaluation. To make progress towards better LLM autoraters, we introduce FLAMe, a family of Foundational…

Computation and Language · Computer Science 2024-07-16 Tu Vu , Kalpesh Krishna , Salaheddin Alzubi , Chris Tar , Manaal Faruqui , Yun-Hsuan Sung

In education, the capability of generating human-like text of Large Language Models (LLMs) inspired work on how they can increase the efficiency of learning and teaching. We study the affordability of these models for educators and students…

Computation and Language · Computer Science 2025-03-06 Bianca Raimondi , Saverio Giallorenzo , Maurizio Gabbrielli

Large Language Models (LLMs) offer new potential for automating documentation-to-code traceability, yet their capabilities remain underexplored. We present a comprehensive evaluation of LLMs (Claude 3.5 Sonnet, GPT-4o, and o3-mini) in…

Software Engineering · Computer Science 2025-08-08 Ebube Alor , SayedHassan Khatoonabadi , Emad Shihab

Emerging multimodal large language models (MLLMs) exhibit great potential for chart question answering (CQA). Recent efforts primarily focus on scaling up training datasets (i.e., charts, data tables, and question-answer (QA) pairs) through…

Computer Vision and Pattern Recognition · Computer Science 2024-08-13 Xingchen Zeng , Haichuan Lin , Yilin Ye , Wei Zeng

Automatically generating feedback via large language models (LLMs) in intelligent tutoring systems and online learning platforms has the potential to improve the learning outcomes of many students. However, both feedback generation and…

Computation and Language · Computer Science 2024-12-13 Alexander Scarlatos , Digory Smith , Simon Woodhead , Andrew Lan

Large Language Models (LLMs) have been subject to extensive research in the past few years. This is particularly true for the potential of LLMs to generate formative programming feedback for novice learners at university. In contrast to…

Computers and Society · Computer Science 2025-04-03 Imen Azaiz , Natalie Kiesler , Sven Strickroth , Anni Zhang

Inference-time computation is a powerful paradigm to enhance the performance of large language models (LLMs), with Best-of-N sampling being a widely used technique. However, this method is computationally expensive, requiring both (1) an…

Computation and Language · Computer Science 2024-10-04 Rohin Manvi , Anikait Singh , Stefano Ermon

Large language models (LLM) hold significant potential for applications in biomedicine, but they struggle with hallucinations and outdated knowledge. While retrieval-augmented generation (RAG) is generally employed to address these issues,…

Computation and Language · Computer Science 2025-09-23 Jiwoong Sohn , Yein Park , Chanwoong Yoon , Sihyeon Park , Hyeon Hwang , Mujeen Sung , Hyunjae Kim , Jaewoo Kang

Tabular data is prevalent across various industries, necessitating significant time and effort for users to understand and manipulate for their information-seeking purposes. The advancements in large language models (LLMs) have shown…

Computation and Language · Computer Science 2023-11-01 Yilun Zhao , Haowei Zhang , Shengyun Si , Linyong Nan , Xiangru Tang , Arman Cohan