English
Related papers

Related papers: SLALOM: Simulation Lifecycle Analysis via Longitud…

200 papers

Large language models (LLMs) are increasingly used as simulated participants in social science experiments, but their behavior is often unstable and highly sensitive to design choices. Prior evaluations frequently conflate base-model…

Artificial Intelligence · Computer Science 2026-02-03 Xuan Liu , Haoyang Shang , Zizhang Liu , Xinyan Liu , Yunze Xiao , Yiwen Tu , Haojian Jin

The advancement of Large Language Models (LLMs) has led to significant improvements in various service domains, including search, recommendation, and chatbot applications. However, applying state-of-the-art (SOTA) research to industrial…

Computation and Language · Computer Science 2025-05-30 Chiwan Park , Wonjun Jang , Daeryong Kim , Aelim Ahn , Kichang Yang , Woosung Hwang , Jihyeon Roh , Hyerin Park , Hyosun Wang , Min Seok Kim , Jihoon Kang

Large Language Models (LLMs) excel as passive responders, but teaching them to be proactive, goal-oriented partners, a critical capability in high-stakes domains, remains a major challenge. Current paradigms either myopically optimize…

Computation and Language · Computer Science 2025-11-10 Fei Wei , Daoyuan Chen , Ce Wang , Yilun Huang , Yushuo Chen , Xuchen Pan , Yaliang Li , Bolin Ding

As Large Language Models (LLMs) evolve into interactive agents, understanding their behavioral alignment within human social dynamics becomes essential. While behavioral game theory offers a framework to study these interactions, previous…

Multiagent Systems · Computer Science 2026-05-26 Inseo Jung , Yoonseok Oh , Kyungryul Back , Jinkyu Kim , Jungbeom Lee

Code large language models (CodeLLMs) and agents are increasingly being integrated into complex software engineering tasks spanning the entire Software Development Life Cycle (SDLC). Benchmarking is critical for rigorously evaluating these…

Software Engineering · Computer Science 2026-03-09 Kaixin Wang , Tianlin Li , Xiaoyu Zhang , Chong Wang , Weisong Sun , Yang Liu , Aishan Liu , Xianglong Liu , Chao Shen , Bin Shi

Large Language Models (LLMs) are transforming scholarly tasks like search and summarization, but their reliability remains uncertain. Current evaluation metrics for testing LLM reliability are primarily automated approaches that prioritize…

Human-Computer Interaction · Computer Science 2026-02-25 Anna Martin-Boyle , William Humphreys , Martha Brown , Cara Leckey , Harmanpreet Kaur

We present a framework for migrating production Large Language Model (LLM) based systems when the underlying model reaches end-of-life or requires replacement. The key contribution is a Bayesian statistical approach that calibrates…

Artificial Intelligence · Computer Science 2026-05-01 Emma Casey , David Roberts , David Sim , Ian Beaver

Online abuse has grown increasingly complex, spanning toxic language, harassment, manipulation, and fraudulent behavior. Traditional machine-learning approaches dependent on static classifiers and labor-intensive labeling struggle to keep…

Computation and Language · Computer Science 2026-04-02 Suraj Kath , Sanket Badhe , Preet Shah , Ashwin Sampathkumar , Shivani Gupta

The recent wave of artificial intelligence, epitomized by large language models (LLMs),has presented opportunities and challenges for methodological innovation in political science,sparking discussions on a potential paradigm shift in the…

Computers and Society · Computer Science 2025-11-06 Zhenyu Wang , Dequan Wang , Yi Xu , Lingfeng Zhou , Yiqi Zhou

Recently, remarkable progress has been made over large language models (LLMs), demonstrating their unprecedented capability in varieties of natural language tasks. However, completely training a large general-purpose model from the scratch…

Machine Learning · Computer Science 2024-02-06 Yushan Jiang , Zijie Pan , Xikun Zhang , Sahil Garg , Anderson Schneider , Yuriy Nevmyvaka , Dongjin Song

Large Language Models (LLMs) have emerged as a transformative AI paradigm, profoundly influencing daily life through their exceptional language understanding and contextual generation capabilities. Despite their remarkable performance, LLMs…

Artificial Intelligence · Computer Science 2024-12-10 Yedi Zhang , Yufan Cai , Xinyue Zuo , Xiaokun Luan , Kailong Wang , Zhe Hou , Yifan Zhang , Zhiyuan Wei , Meng Sun , Jun Sun , Jing Sun , Jin Song Dong

Large Language Models (LLMs) can serve as world models to enhance agent decision-making in digital environments by simulating future states and predicting action outcomes, potentially eliminating costly trial-and-error exploration. However,…

Computation and Language · Computer Science 2026-03-10 Kai Mei , Jiang Guo , Shuaichen Chang , Mingwen Dong , Dongkyu Lee , Xing Niu , Jiarong Jiang

While Large Language Models (LLMs) achieve near-human performance on standard benchmarks, their capabilities often fail to generalize to complex, real-world problems. To bridge this gap, we introduce DeepQuestion, a scalable, automated…

Computation and Language · Computer Science 2026-03-02 Ali Khoramfar , Ali Ramezani , Mohammad Mahdi Mohajeri , Mohammad Javad Dousti , Majid Nili Ahmadabadi , Heshaam Faili

Developing and validating psychometric scales requires large samples, multiple testing phases, and substantial resources. Recent advances in Large Language Models (LLMs) enable the generation of synthetic participant data by prompting…

Human-Computer Interaction · Computer Science 2025-12-30 Enrico Cipriani , Pavel Okopnyi , Danilo Menicucci , Simone Grassini

Large Audio Language Models (LALMs) are increasingly applied to audio understanding and multimodal reasoning, yet their ability to locate when events occur remains underexplored. We present the first systematic study of temporal bias in…

Computation and Language · Computer Science 2025-10-15 Jiayu Yao , Shenghua Liu , Yiwei Wang , Rundong Cheng , Lingrui Mei , Baolong Bi , Zhen Xiong , Xueqi Cheng

Large language models (LLMs) have shown promise in complex reasoning and tool-based decision making, motivating their application to real-world supply chain management. However, supply chain workflows require reliable long-horizon,…

Artificial Intelligence · Computer Science 2026-05-14 Shengyue Guan , Yihao Liu , Lang Cao

Tool use enables large language models (LLMs) to access external information, invoke software systems, and act in digital environments beyond what can be solved from model parameters alone. Early research mainly studied whether a model…

The exponential growth of text-based data in domains such as healthcare, education, and social sciences has outpaced the capacity of traditional qualitative analysis methods, which are time-intensive and prone to subjectivity. Large…

Large Language Models (LLMs) have recently shown exceptional potential in time series forecasting, leveraging their inherent sequential reasoning capabilities to model complex temporal dynamics. However, existing approaches typically employ…

Machine Learning · Computer Science 2026-02-16 Xingyu Zhang , Hanyun Du , Zeen Song , Jianqi Zhang , Changwen Zheng , Wenwen Qiang

As large language models (LLMs) continue to advance, improving them solely through human supervision is becoming increasingly costly and limited in scalability. As models approach human-level capabilities in certain domains, human feedback…

Computation and Language · Computer Science 2026-03-27 Haoyan Yang , Mario Xerri , Solha Park , Huajian Zhang , Yiyang Feng , Sai Akhil Kogilathota , Jiawei Zhou