English
Related papers

Related papers: Model Behavior Specification by Leveraging LLM Sel…

200 papers

Harnessing the power of human-annotated data through Supervised Fine-Tuning (SFT) is pivotal for advancing Large Language Models (LLMs). In this paper, we delve into the prospect of growing a strong LLM out of a weak one without the need…

Machine Learning · Computer Science 2024-06-18 Zixiang Chen , Yihe Deng , Huizhuo Yuan , Kaixuan Ji , Quanquan Gu

Large Language Models (LLMs) have demonstrated remarkable capabilities in open-ended text generation tasks. However, the inherent open-ended nature of these tasks implies that there is always room for improvement in the quality of model…

Computation and Language · Computer Science 2024-09-16 Ziqi Wang , Le Hou , Tianjian Lu , Yuexin Wu , Yunxuan Li , Hongkun Yu , Heng Ji

Large Language Models (LLMs) have recently emerged as planners for language-instructed agents, generating sequences of actions to accomplish natural language tasks. However, their reliability remains a challenge, especially in long-horizon…

Robotics · Computer Science 2025-11-11 Jun Wang , Yevgeniy Vorobeychik , Yiannis Kantaros

Large language models (LLMs) have shown promise in robotic procedural planning, yet their human-centric reasoning often omits the low-level, grounded details needed for robotic execution. Vision-language models (VLMs) offer a path toward…

Robotics · Computer Science 2025-07-22 Chan Young Park , Jillian Fisher , Marius Memmel , Dipika Khullar , Seoho Yun , Abhishek Gupta , Yejin Choi

Large Language Models (LLMs) have demonstrated their capabilities across various tasks, from language translation to complex reasoning. Understanding and predicting human behavior and biases are crucial for artificial intelligence (AI)…

Artificial Intelligence · Computer Science 2024-08-06 Thuy Ngoc Nguyen , Kasturi Jamale , Cleotilde Gonzalez

Large language models (LLMs) have demonstrated that large-scale pretraining enables systems to adapt rapidly to new problems with little supervision in the language domain. This success, however, has not translated as effectively to the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Pablo Acuaviva , Aram Davtyan , Mariam Hassan , Sebastian Stapf , Ahmad Rahimi , Alexandre Alahi , Paolo Favaro

Instruction tuning -- supervised fine-tuning using instruction-response pairs -- is a key step in making pre-trained large language models (LLMs) instructable. Meanwhile, LLMs perform multitask learning during their pre-training, acquiring…

Computation and Language · Computer Science 2025-09-16 Seokhyun An , Minji Kim , Hyounghun Kim

Large Language Models (LLMs) are increasingly used to simulate human users in interactive settings such as therapy, education, and social role-play. While these simulations enable scalable training and evaluation of AI agents, off-the-shelf…

Computation and Language · Computer Science 2025-11-04 Marwa Abdulhai , Ryan Cheng , Donovan Clay , Tim Althoff , Sergey Levine , Natasha Jaques

Large language models (LLMs) have achieved remarkable breakthroughs in new dialogue capabilities by leveraging instruction tuning, which refreshes human impressions of dialogue systems. The long-standing goal of dialogue systems is to be…

Computation and Language · Computer Science 2024-04-01 Jiao Ou , Junda Lu , Che Liu , Yihong Tang , Fuzheng Zhang , Di Zhang , Kun Gai

The alignments of reasoning abilities between smaller and larger Language Models are largely conducted via Supervised Fine-Tuning (SFT) using demonstrations generated from robust Large Language Models (LLMs). Although these approaches…

Computation and Language · Computer Science 2025-01-28 Leonardo Ranaldi , Andrè Freitas

Recent advancements in artificial intelligence (AI) and machine learning have reignited interest in their impact on Computer-based Learning (CBL). AI-driven tools like ChatGPT and Intelligent Tutoring Systems (ITS) have enhanced learning…

Computers and Society · Computer Science 2025-05-07 Mohsen Balavar , Wenli Yang , David Herbert , Soonja Yeom

The use of large language model (LLM)-powered chatbots, such as ChatGPT, has become popular across various domains, supporting a range of tasks and processes. However, due to the intrinsic complexity of LLMs, effective prompting is more…

Video procedure planning, i.e., planning a sequence of action steps given the video frames of start and goal states, is an essential ability for embodied AI. Recent works utilize Large Language Models (LLMs) to generate enriched action step…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Dejie Yang , Zijing Zhao , Yang Liu

Personalized Large Language Models (LLMs) have been shown to be an effective way to create more engaging and enjoyable user-AI interactions. While previous studies have explored using prompts to elicit specific personality traits in LLMs,…

Computation and Language · Computer Science 2025-11-26 Shi-Wei Dai , Yan-Wei Shie , Tsung-Huan Yang , Lun-Wei Ku , Yung-Hui Li

Large language models (LLMs), initially developed for generative AI, are now evolving into agentic AI systems, which make decisions in complex, real-world contexts. Unfortunately, while their generative capabilities are well-documented,…

Artificial Intelligence · Computer Science 2026-04-02 Matthew DosSantos DiSorbo , Harang Ju , Sinan Aral

To facilitate the wider adoption of robotics, accessible programming tools are required for non-experts. Observational learning enables intuitive human skills transfer through hands-on demonstrations, but relying solely on visual input can…

Robotics · Computer Science 2025-07-29 Elena Merlo , Marta Lagomarsino , Arash Ajoudani

Large language models (LLMs) are increasingly deployed as autonomous decision-makers in strategic settings, yet we have limited tools for understanding their high-level behavioral traits. We use activation steering methods in game-theoretic…

Artificial Intelligence · Computer Science 2026-03-24 Johnathan Sun , Andrew Zhang

Recent advances in large language models (LLMs) demonstrate their potential as educational tutors. However, different tutoring strategies benefit different student personalities, and mismatches can be counterproductive to student outcomes.…

Computation and Language · Computer Science 2026-01-14 Donya Rooein , Sankalan Pal Chowdhury , Mariia Eremeeva , Yuan Qin , Debora Nozza , Mrinmaya Sachan , Dirk Hovy

Guiding large language models with a selected set of human-authored demonstrations is a common practice for improving LLM applications. However, human effort can be costly, especially in specialized domains (e.g., clinical diagnosis), and…

Artificial Intelligence · Computer Science 2024-08-23 Kai Tzu-iunn Ong , Taeyoon Kwon , Jinyoung Yeo

Motion planning in complex scenarios is the core challenge in autonomous driving. Conventional methods apply predefined rules or learn from driving data to plan the future trajectory. Recent methods seek the knowledge preserved in large…

Robotics · Computer Science 2024-06-12 Ruijun Zhang , Xianda Guo , Wenzhao Zheng , Chenming Zhang , Kurt Keutzer , Long Chen