English
Related papers

Related papers: Convergence Theory for Iterative LLM-Based Neural …

200 papers

Large language models (LLMs) achieve strong average performance yet remain unreliable at the instance level, with frequent hallucinations, brittle failures, and poorly calibrated confidence. We study reliability through the lens of…

Artificial Intelligence · Computer Science 2026-01-13 Pranav Kallem

Recent advancements in large language models (LLMs) have sparked considerable interest in automated theorem proving and a prominent line of research integrates stepwise LLM-based provers into tree search. In this paper, we introduce a novel…

Artificial Intelligence · Computer Science 2025-05-20 Junyu Lai , Jiakun Zhang , Shuo Xu , Taolue Chen , Zihang Wang , Yao Yang , Jiarui Zhang , Chun Cao , Jingwei Xu

Large Language Models (LLMs) have emerged as powerful tools capable of accomplishing a broad spectrum of tasks. Their abilities span numerous areas, and one area where they have made a significant impact is in the domain of code generation.…

Neural and Evolutionary Computing · Computer Science 2024-04-18 Muhammad U. Nasir , Sam Earle , Christopher Cleghorn , Steven James , Julian Togelius

High-Level Synthesis (HLS) compiles algorithmic C/C++ descriptions into hardware, with Quality of Results (QoR) -- latency and resource utilization -- critically governed by pragma configurations and code structure. Existing LLM-based HLS…

Machine Learning · Computer Science 2026-05-14 Qingyun Zou , Feng Yu , Hongshi Tan , Yao Chen , Bingsheng He , WengFai Wong

Networks found with Neural Architecture Search (NAS) achieve state-of-the-art performance in a variety of tasks, out-performing human-designed networks. However, most NAS methods heavily rely on human-defined assumptions that constrain the…

Computer Vision and Pattern Recognition · Computer Science 2023-01-10 Vasco Lopes , Luís A. Alexandre

This project reproduces and extends the recently proposed ``Recursive Language Models'' (RLMs) framework by Zhang et al. (2026). This framework enables Large Language Models (LLMs) to process near-infinite contexts by offloading the prompt…

Computation and Language · Computer Science 2026-03-04 Daren Wang

A series of recent papers has used a parsing algorithm due to Shen et al. (2018) to recover phrase-structure trees based on proxies for "syntactic depth." These proxy depths are obtained from the representations learned by recurrent…

Computation and Language · Computer Science 2019-09-23 Chris Dyer , Gábor Melis , Phil Blunsom

Neural Architecture Search (NAS) is quickly becoming the go-to approach to optimize the structure of Deep Learning (DL) models for complex tasks such as Image Classification or Object Detection. However, many other relevant applications of…

The prevailing assumption of an exponential decay in large language model (LLM) reliability with sequence length, predicated on independent per-token error probabilities, posits an inherent limitation for long autoregressive outputs. Our…

Computation and Language · Computer Science 2026-05-07 Mikhail L. Arbuzov , Sisong Bei , Ziwei Dong , Dmitri Kalaev , Alexey A. Shvets

Large language model (LLM) self-correction -- the ability to detect and fix errors in generated outputs -- remains largely ad hoc, relying on generic prompts such as "please reconsider your answer" without systematic error analysis or…

Artificial Intelligence · Computer Science 2026-05-19 Yuning Wu , Yingmin Liu , Yang Shu

Large language models (LLMs) exhibit strong semantic understanding, yet struggle when user instructions involve ambiguous or conceptually misaligned terms. We propose the Language Graph Model (LGM) to enhance conceptual clarity by…

Computation and Language · Computer Science 2025-11-06 Wenchang Lei , Ping Zou , Yue Wang , Feng Sun , Lei Zhao

Several data warehouse and database providers have recently introduced extensions to SQL called AI Queries, enabling users to specify functions and conditions in SQL that are evaluated by LLMs, thereby broadening significantly the kinds of…

Recursive processing is considered a hallmark of human linguistic abilities. A recent study evaluated recursive processing in recurrent neural language models (RNN-LMs) and showed that such models perform below chance level on embedded…

Computation and Language · Computer Science 2021-10-15 Yair Lakretz , Théo Desbordes , Dieuwke Hupkes , Stanislas Dehaene

In the realm of black-box jailbreak attacks on large language models (LLMs), the feasibility of constructing a narrow safety proxy, a lightweight model designed to predict the attack success rate (ASR) of adversarial prompts, remains…

Cryptography and Security · Computer Science 2025-12-01 Tianyu Zhang , Zihang Xi , Jingyu Hua , Sheng Zhong

Current large language models (LLMs) primarily rely on linear sequence generation and massive parameter counts, yet they severely struggle with complex algorithmic reasoning. While recent reasoning architectures, such as the Hierarchical…

Artificial Intelligence · Computer Science 2026-03-25 Vasiliy A. Es'kin , Mikhail E. Smorkalov

Neural architecture search (NAS) traditionally requires significant human expertise or automated trial-and-error to design deep learning models. We present NN-Caption, an LLM-guided neural architecture search pipeline that generates…

Machine Learning · Computer Science 2025-12-18 Krunal Jesani , Dmitry Ignatov , Radu Timofte

The abilities of modern large language models (LLMs) in solving natural language processing, complex reasoning, sentiment analysis and other tasks have been extraordinary which has prompted their extensive adoption. Unfortunately, these…

Artificial Intelligence · Computer Science 2024-05-29 Anthony Sarah , Sharath Nittur Sridhar , Maciej Szankin , Sairam Sundaresan

The integration of Large Language Models (LLMs) with Neural Architecture Search (NAS) has introduced new possibilities for automating the design of neural architectures. However, most existing methods face critical limitations, including…

Artificial Intelligence · Computer Science 2026-05-19 Zhe Li , Zhiwei Lin , Yongtao Wang

The explainability of recommendation systems is crucial for enhancing user trust and satisfaction. Leveraging large language models (LLMs) offers new opportunities for comprehensive recommendation logic generation. However, in existing…

Information Retrieval · Computer Science 2024-07-04 Hongke Zhao , Songming Zheng , Likang Wu , Bowen Yu , Jing Wang

Parameter-efficient tuning (PET) methods fit pre-trained language models (PLMs) to downstream tasks by either computing a small compressed update for a subset of model parameters, or appending and fine-tuning a small number of new model…

Computation and Language · Computer Science 2023-05-29 Neal Lawton , Anoop Kumar , Govind Thattai , Aram Galstyan , Greg Ver Steeg