English
Related papers

Related papers: Efficiency with Rigor! A Trustworthy LLM-powered W…

200 papers

As large language models (LLMs) play an increasingly important role in code generation, enhancing both correctness and efficiency has become crucial. Current methods primarily focus on correctness, often overlooking efficiency. To address…

Computation and Language · Computer Science 2025-06-17 Dong Huang , Guangtao Zeng , Jianbo Dai , Meng Luo , Han Weng , Yuhao Qing , Heming Cui , Zhijiang Guo , Jie M. Zhang

Advancement in Large Language Models (LLMs) reasoning capabilities enables them to solve scientific problems with enhanced efficacy. Thereby, a high-quality benchmark for comprehensive and appropriate assessment holds significance, while…

Large Language Models (LLMs) have shown great potential in reasoning tasks through test-time scaling methods like self-consistency with majority voting. However, this approach often leads to diminishing returns in accuracy and high…

Machine Learning · Computer Science 2025-08-22 Yichao Fu , Xuewei Wang , Yuandong Tian , Jiawei Zhao

Large Language Models (LLMs) have demonstrated promising capabilities in solving mathematical reasoning tasks, leveraging Chain-of-Thought (CoT) data as a vital component in guiding answer generation. Current paradigms typically generate…

Computation and Language · Computer Science 2025-03-20 Honglin Lin , Zhuoshi Pan , Yu Li , Qizhi Pei , Xin Gao , Mengzhang Cai , Conghui He , Lijun Wu

With the rapid advancement of AI, software engineering increasingly relies on AI-driven approaches, particularly language models (LMs), to enhance code performance. However, the trustworthiness and reliability of LMs remain significant…

Software Engineering · Computer Science 2025-03-19 Jingzhi Gong

Large Language Models (LLMs) perform well on basic programming problems. However, they encounter challenges when dealing with complex tasks involving the use of diverse algorithmic and data structure skills, particularly programming…

Software Engineering · Computer Science 2024-02-02 Tao Huang , Zhihong Sun , Zhi Jin , Ge Li , Chen Lyu

Digital educational environments are expanding toward complex AI and human discourse, providing researchers with an abundance of data that offers deep insights into learning and instructional processes. However, traditional qualitative…

Large Language Models (LLMs) excel in text generation, reasoning, and decision-making, enabling their adoption in high-stakes domains such as healthcare, law, and transportation. However, their reliability is a major concern, as they often…

Computation and Language · Computer Science 2025-06-05 Xiaoou Liu , Tiejin Chen , Longchao Da , Chacha Chen , Zhen Lin , Hua Wei

Conversational AI systems have emerged as key enablers of human-like interactions across diverse sectors. Nevertheless, the balance between linguistic nuance and factual accuracy has proven elusive. In this paper, we first introduce…

Computation and Language · Computer Science 2024-06-18 Ahtsham Zafar , Venkatesh Balavadhani Parthasarathy , Chan Le Van , Saad Shahid , Aafaq Iqbal khan , Arsalan Shahid

Deductive coding is a widely used qualitative research method for determining the prevalence of themes across documents. While useful, deductive coding is often burdensome and time consuming since it requires researchers to read, interpret,…

Computation and Language · Computer Science 2023-06-28 Robert Chew , John Bollenbacher , Michael Wenger , Jessica Speer , Annice Kim

Large Language Models (LLMs) have emerged as powerful tools for generating data across various modalities. By transforming data from a scarce resource into a controllable asset, LLMs mitigate the bottlenecks imposed by the acquisition costs…

While Large Language Models (LLMs) demonstrate exceptional performance in a multitude of Natural Language Processing (NLP) tasks, they encounter challenges in practical applications, including issues with hallucinations, inadequate…

Computation and Language · Computer Science 2024-06-13 Yihao Li , Ru Zhang , Jianyi Liu

This study introduces \textbf{InteractEval}, a framework that integrates human expertise and Large Language Models (LLMs) using the Think-Aloud (TA) method to generate attributes for checklist-based text evaluation. By combining human…

Computation and Language · Computer Science 2025-02-21 SeongYeub Chu , JongWoo Kim , MunYong Yi

In the realm of predictive analytics, the nuanced domain knowledge of investigators often remains underutilized, confined largely to subjective interpretations and ad hoc decision-making. This paper explores the potential of Large Language…

Machine Learning · Computer Science 2024-05-15 Phoebe Jing , Yijing Gao , Yuanhang Zhang , Xianlong Zeng

Large language models (LLMs) have emerged as versatile tools in various daily applications. However, they are fraught with issues that undermine their utility and trustworthiness. These include the incorporation of erroneous references…

Computation and Language · Computer Science 2023-09-13 Dongyub Lee , Taesun Whang , Chanhee Lee , Heuiseok Lim

Large Language Models (LLMs) have emerged as a transformative AI paradigm, profoundly influencing daily life through their exceptional language understanding and contextual generation capabilities. Despite their remarkable performance, LLMs…

Artificial Intelligence · Computer Science 2024-12-10 Yedi Zhang , Yufan Cai , Xinyue Zuo , Xiaokun Luan , Kailong Wang , Zhe Hou , Yifan Zhang , Zhiyuan Wei , Meng Sun , Jun Sun , Jing Sun , Jin Song Dong

Large language models (LLMs) perform strongly on many language tasks but still struggle with complex multi-step reasoning across disciplines. Existing reasoning datasets often lack disciplinary breadth, reasoning depth, and diversity, as…

Computation and Language · Computer Science 2026-02-03 Weize Liu , Yongchi Zhao , Yijia Luo , Mingyu Xu , Jiaheng Liu , Yanan Li , Xiguo Hu , Zhiqi Bai , Yuchi Xu , Wenbo Su , Bo Zheng

While AI-assisted individual qualitative analysis has been substantially studied, AI-assisted collaborative qualitative analysis (CQA)-a process that involves multiple researchers working together to interpret data-remains relatively…

Human-Computer Interaction · Computer Science 2023-07-26 Jie Gao , Kenny Tsu Wei Choo , Junming Cao , Roy Ka Wei Lee , Simon Perrault

It is expected that in the near future, AI software development assistants will play an important role in the software industry. However, current software development assistants tend to be unreliable, often producing incorrect, unsafe, or…

Software Engineering · Computer Science 2024-01-24 Daniel Maninger , Krishna Narasimhan , Mira Mezini

Large Language Models (LLMs) are increasingly used for planning tasks, offering unique capabilities not found in classical planners such as generating explanations and iterative refinement. However, trust--a critical factor in the adoption…

Artificial Intelligence · Computer Science 2025-02-28 Shenghui Chen , Yunhao Yang , Kayla Boggess , Seongkook Heo , Lu Feng , Ufuk Topcu