English
Related papers

Related papers: LLMSTEP: LLM proofstep suggestions in Lean

200 papers

Recent advancements in Large Language Models (LLMs) have shown significant potential in enhancing recommender systems. However, addressing the cold-start recommendation problem, where users lack historical data, remains a considerable…

Information Retrieval · Computer Science 2025-04-29 Hai-Dang Kieu , Minh Duc Nguyen , Thanh-Son Nguyen , Dung D. Le

Large language models (LLMs) have achieved remarkable breakthroughs in new dialogue capabilities by leveraging instruction tuning, which refreshes human impressions of dialogue systems. The long-standing goal of dialogue systems is to be…

Computation and Language · Computer Science 2024-04-01 Jiao Ou , Junda Lu , Che Liu , Yihong Tang , Fuzheng Zhang , Di Zhang , Kun Gai

Large language models have emerged as a promising approach towards achieving general-purpose AI agents. The thriving open-source LLM community has greatly accelerated the development of agents that support human-machine dialogue interaction…

Computer Vision and Pattern Recognition · Computer Science 2023-11-07 Zhenfei Yin , Jiong Wang , Jianjian Cao , Zhelun Shi , Dingning Liu , Mukai Li , Lu Sheng , Lei Bai , Xiaoshui Huang , Zhiyong Wang , Jing Shao , Wanli Ouyang

Design assistants are frameworks, tools or applications intended to facilitate both the creative and technical facets of design processes. Large language models (LLMs) are AI systems engineered to analyze and produce text resembling human…

Human-Computer Interaction · Computer Science 2025-02-12 Swaroop Panda

This study underscores the pivotal role of syntax feedback in augmenting the syntactic proficiency of students. Recognizing the challenges faced by learners in mastering syntactic nuances, we introduce a specialized dataset named…

Computation and Language · Computer Science 2025-01-15 Kamyar Zeinalipour , Mehak Mehak , Fatemeh Parsamotamed , Marco Maggini , Marco Gori

We introduce DABstep, a novel benchmark for evaluating AI agents on realistic multi-step data analysis tasks. DABstep comprises over 450 real-world challenges derived from a financial analytics platform, requiring models to combine…

Machine Learning · Computer Science 2025-07-01 Alex Egg , Martin Iglesias Goyanes , Friso Kingma , Andreu Mora , Leandro von Werra , Thomas Wolf

This dissertation presents an evaluation of several language models on software defect datasets. A language Model (LM) "can provide word representation and probability indication of word sequences as the core component of an NLP system."…

Software Engineering · Computer Science 2019-09-24 Kailun Wang

Large Language Models (LLMs) have demonstrated impressive capability in many natural language tasks. However, the auto-regressive generation process makes LLMs prone to produce errors, hallucinations and inconsistent statements when…

Artificial Intelligence · Computer Science 2024-07-23 Chaojie Wang , Yanchen Deng , Zhiyi Lyu , Liang Zeng , Jujie He , Shuicheng Yan , Bo An

Recommending cold items remains a significant challenge in billion-scale online recommendation systems. While warm items benefit from historical user behaviors, cold items rely solely on content features, limiting their recommendation…

Information Retrieval · Computer Science 2024-12-30 Feiran Huang , Yuanchen Bei , Zhenghang Yang , Junyi Jiang , Hao Chen , Qijie Shen , Senzhang Wang , Fakhri Karray , Philip S. Yu

Traditional language model-based theorem proving assumes that by training on a sufficient amount of formal proof data, a model will learn to prove theorems. Our key observation is that a wealth of informal information that is not present in…

Artificial Intelligence · Computer Science 2025-03-18 Haohan Lin , Zhiqing Sun , Sean Welleck , Yiming Yang

Recent advances have shown that optimizing prompts for Large Language Models (LLMs) can significantly improve task performance, yet many optimization techniques rely on heuristics or manual exploration. We present LatentPrompt, a…

Computation and Language · Computer Science 2025-08-05 Mateusz Bystroński , Grzegorz Piotrowski , Nitesh V. Chawla , Tomasz Kajdanowicz

Large Language Models (LLMs) are increasingly integrated into code editors to provide AI-powered code suggestions. Yet many of these suggestions are ignored, resulting in wasted computation, increased latency, and unnecessary interruptions.…

Software Engineering · Computer Science 2026-02-10 Mohammad Nour Al Awad , Sergey Ivanov , Olga Tikhonova

A growing number of tools have used Large Language Models (LLMs) to support developers' code understanding. However, developers still face several barriers to using such tools, including challenges in describing their intent in natural…

Software Engineering · Computer Science 2024-08-09 Jonan Richards , Mairieli Wessel

We introduce a machine-learning-based tool for the Lean proof assistant that suggests relevant premises for theorems being proved by a user. The design principles for the tool are (1) tight integration with the proof assistant, (2) ease of…

Artificial Intelligence · Computer Science 2023-06-16 Bartosz Piotrowski , Ramon Fernández Mir , Edward Ayers

\textit{Background:} The use of large language models in software testing is growing fast as they support numerous tasks, from test case generation to automation, and documentation. However, their adoption often relies on informal…

Software Engineering · Computer Science 2025-10-21 Maria Deolinda Santana , Cleyton Magalhaes , Ronnie de Souza Santos

Large language models (LLMs) open up new horizons for sequential recommendations, owing to their remarkable language comprehension and generation capabilities. However, there are still numerous challenges that should be addressed to…

Information Retrieval · Computer Science 2024-03-29 Yuling Wang , Changxin Tian , Binbin Hu , Yanhua Yu , Ziqi Liu , Zhiqiang Zhang , Jun Zhou , Liang Pang , Xiao Wang

The progress in natural language processing (NLP) research over the last years, offers novel business opportunities for companies, as automated user interaction or improved data analysis. Building sophisticated NLP applications requires…

Computation and Language · Computer Science 2021-11-17 Philipp Kohl , Oliver Schmidts , Lars Klöser , Henri Werth , Bodo Kraft , Albert Zündorf

Prompt engineering is a new paradigm for enhancing the performance of trained neural network models. For optimizing text-style prompts, existing methods usually individually operate small portions of a text step by step, which either breaks…

Computation and Language · Computer Science 2023-10-03 Yujian Betterest Li , Kai Wu

While intelligent virtual assistants like Siri, Alexa, and Google Assistant have become ubiquitous in modern life, they still face limitations in their ability to follow multi-step instructions and accomplish complex goals articulated in…

Machine Learning · Computer Science 2023-12-13 Yanchu Guan , Dong Wang , Zhixuan Chu , Shiyu Wang , Feiyue Ni , Ruihua Song , Longfei Li , Jinjie Gu , Chenyi Zhuang

This paper considers the development of an AI-based provably-correct mathematical proof tutor. While Large Language Models (LLMs) allow seamless communication in natural language, they are error prone. Theorem provers such as Lean allow for…

Machine Learning · Computer Science 2026-03-05 Manooshree Patel , Rayna Bhattacharyya , Thomas Lu , Arnav Mehta , Niels Voss , Narges Norouzi , Gireeja Ranade