English
Related papers

Related papers: Measuring Progress on Scalable Oversight for Large…

200 papers

Large Language Models (LLMs), AI models trained on massive text corpora with remarkable language understanding and generation capabilities, are transforming the field of Autonomous Driving (AD). As AD systems evolve from rule-based and…

Artificial Intelligence · Computer Science 2024-07-30 Yun Li , Kai Katsumata , Ehsan Javanmardi , Manabu Tsukada

The rapid growth of Large Language Models (LLMs) has been a driving force in transforming various domains, reshaping the artificial general intelligence landscape. However, the increasing computational and memory demands of these models…

Computation and Language · Computer Science 2024-04-22 Tianyu Ding , Tianyi Chen , Haidong Zhu , Jiachen Jiang , Yiqi Zhong , Jinxin Zhou , Guangzhi Wang , Zhihui Zhu , Ilya Zharkov , Luming Liang

This paper examines the challenges associated with achieving life-long superalignment in AI systems, particularly large language models (LLMs). Superalignment is a theoretical framework that aspires to ensure that superintelligent AI…

Computers and Society · Computer Science 2024-03-25 Gokul Puthumanaillam , Manav Vora , Pranay Thangeda , Melkior Ornik

Large language models (LLMs) have emerged as powerful tools for many AI problems and exhibit remarkable in-context learning (ICL) capabilities. Compositional ability, solving unseen complex tasks that combine two or more simple tasks, is an…

Computation and Language · Computer Science 2024-08-13 Zhuoyan Xu , Zhenmei Shi , Yingyu Liang

Test-time scaling has recently emerged as a promising approach for enhancing the reasoning capabilities of large language models or vision-language models during inference. Although a variety of test-time scaling strategies have been…

Computation and Language · Computer Science 2025-06-17 Gyutaek Oh , Seoyeon Kim , Sangjoon Park , Byung-Hoon Kim

As Large Language Models (LLMs) rise in popularity, it is necessary to assess their capability in critically relevant domains. We present a comprehensive evaluation framework, grounded in science communication research, to assess LLM…

Utilizing tools with Large Language Models (LLMs) is essential for grounding AI agents in real-world applications. The prevailing approach involves few-shot prompting with demonstrations or fine-tuning with expert annotations. However, mere…

Computation and Language · Computer Science 2024-10-10 Xiaohan Wang , Dian Li , Yilin Zhao , Sinbadliu , Hui Wang

Current AI alignment methodologies rely on human-provided demonstrations or judgments, and the learned capabilities of AI systems would be upper-bounded by human capabilities as a result. This raises a challenging research question: How can…

Machine Learning · Computer Science 2024-12-11 Zhiqing Sun , Longhui Yu , Yikang Shen , Weiyang Liu , Yiming Yang , Sean Welleck , Chuang Gan

The rapid development of Artificial Intelligence (AI) has revolutionized numerous fields, with large language models (LLMs) and computer vision (CV) systems driving advancements in natural language understanding and visual processing,…

Computation and Language · Computer Science 2024-12-04 Yunkai Dang , Kaichen Huang , Jiahao Huo , Yibo Yan , Sirui Huang , Dongrui Liu , Mengxi Gao , Jie Zhang , Chen Qian , Kun Wang , Yong Liu , Jing Shao , Hui Xiong , Xuming Hu

Peer review remains the central quality-control mechanism of science, yet its ability to fulfill this role is increasingly strained. Empirical studies document serious shortcomings: long publication delays, escalating reviewer burden…

While Large Language Models (LLMs) are fundamentally next-token prediction systems, their practical applications extend far beyond this basic function. From natural language processing and text generation to conversational assistants and…

Computation and Language · Computer Science 2025-03-10 Vishakha Agrawal , Archie Chaudhury , Shreya Agrawal

With the advent of large language models (LLMs), there is a growing interest in applying LLMs to scientific tasks. In this work, we conduct an experimental study to explore applicability of LLMs for configuring, annotating, translating,…

Human-Computer Interaction · Computer Science 2025-10-13 Orcun Yildiz , Tom Peterka

This review synthesizes the nascent but critical field of developmental interpretability for Large Language Models. We chart the field's evolution from static, post-hoc analysis of trained models to a dynamic investigation of the training…

Computation and Language · Computer Science 2025-08-25 Ihor Kendiukhov

Large language models (LLMs) have shown significant potential to change how we write, communicate, and create, leading to rapid adoption across society. This dissertation examines how individuals and institutions are adapting to and…

Computation and Language · Computer Science 2025-06-24 Weixin Liang

One of the major impediments to the development of new task-oriented dialogue (TOD) systems is the need for human evaluation at multiple stages and iterations of the development process. In an effort to move toward automated evaluation of…

Computation and Language · Computer Science 2023-09-26 Sam Davidson , Salvatore Romeo , Raphael Shu , James Gung , Arshit Gupta , Saab Mansour , Yi Zhang

A Large Language Model (LLM) represents a cutting-edge artificial intelligence model that generates coherent content, including grammatically precise sentences, human-like paragraphs, and syntactically accurate code snippets. LLMs can play…

Software Engineering · Computer Science 2023-12-11 Robson Santos , Italo Santos , Cleyton Magalhaes , Ronnie de Souza Santos

Recent advancements in Large Language Models have sparked interest in their potential for robotic task planning. While these models demonstrate strong generative capabilities, their effectiveness in producing structured and executable plans…

Robotics · Computer Science 2025-08-01 Kai Goebel , Patrik Zips

Mental health is a growing global concern, prompting interest in AI-driven solutions to expand access to psychosocial support. \emph{Peer support}, grounded in lived experience, offers a valuable complement to professional care. However,…

Human-Computer Interaction · Computer Science 2026-04-10 Kellie Yu Hui Sim , Roy Ka-Wei Lee , Kenny Tsu Wei Choo

This work presents an analytical framework for the design and analysis of LLM-based algorithms, i.e., algorithms that contain one or multiple calls of large language models (LLMs) as sub-routines and critically rely on the capabilities of…

Machine Learning · Computer Science 2025-10-14 Yanxi Chen , Yaliang Li , Bolin Ding , Jingren Zhou

Modern statistical machine learning (SML) methods share a major limitation with the early approaches to AI: there is no scalable way to adapt them to new domains. Human learning solves this in part by leveraging a rich, shared, updateable…

Artificial Intelligence · Computer Science 2016-12-26 C. J. C. Burges , T. Hart , Z. Yang , S. Cucerzan , R. W. White , A. Pastusiak , J. Lewis