English
Related papers

Related papers: InSTA: Towards Internet-Scale Training For Agents

200 papers

Large language models (LLMs) and high-capacity encoders have advanced zero and few-shot classification, but their inference cost and latency limit practical deployment. We propose training lightweight text classifiers using dynamically…

Computation and Language · Computer Science 2026-01-26 Gaurav Maheshwari , Kevin El Haddad

Recent advances in large language models (LLMs) have shown promising results in medical diagnosis, with some studies indicating superior performance compared to human physicians in specific scenarios. However, the diagnostic capabilities of…

Artificial Intelligence · Computer Science 2025-03-24 Zhoujian Sun , Ziyi Liu , Cheng Luo , Jiebin Chu , Zhengxing Huang

Large Language Models (LLMs) are reshaping recommender systems by leveraging extensive world knowledge and semantic reasoning to interpret user intent. However, effectively integrating these capabilities with collaborative signals while…

Information Retrieval · Computer Science 2026-02-13 Yang Wu , Haoze Wang , Qian Li , Jun Zhang , Huan Yu , Jie Jiang

Large language model (LLM) agents are becoming competent at straightforward web tasks, such as opening an item page or submitting a form, but still struggle with objectives that require long horizon navigation, large scale information…

Artificial Intelligence · Computer Science 2025-10-09 Jingbo Yang , Bairu Hou , Wei Wei , Shiyu Chang , Yujia Bao

The deployment of agent systems in an enterprise environment is often hindered by several challenges: common models lack domain-specific process knowledge, leading to disorganized plans, missing key tools, and poor execution stability. To…

Training AI models has always been challenging, especially when there is a need for custom models to provide personalized services. Algorithm engineers often face a lengthy process to iteratively develop models tailored to specific business…

Artificial Intelligence · Computer Science 2023-11-27 Haoyuan Li , Hao Jiang , Tianke Zhang , Zhelun Yu , Aoxiong Yin , Hao Cheng , Siming Fu , Yuhao Zhang , Wanggui He

The pursuit of human-level artificial intelligence (AI) has significantly advanced the development of autonomous agents and Large Language Models (LLMs). LLMs are now widely utilized as decision-making agents for their ability to interpret…

Environments are the bottleneck for self-improving agents. Current terminal benchmarks were built for evaluation, not training; reinforcement learning requires a scalable pipeline, not just a dataset. We introduce Endless Terminals, a fully…

Machine Learning · Computer Science 2026-02-17 Kanishk Gandhi , Shivam Garg , Noah D. Goodman , Dimitris Papailiopoulos

Improving Large Language Model (LLM) agents for sequential decision-making tasks typically requires extensive task-specific knowledge engineering--custom prompts, curated examples, and specialized observation/action spaces. We investigate a…

Machine Learning · Computer Science 2025-05-20 Vishnu Sarukkai , Zhiqiang Xie , Kayvon Fatahalian

Large Language Models are being increasingly deployed as the decision-making core of autonomous agents capable of effecting change in external environments. Yet, in conversational benchmarks, which simulate real-world customer-centric issue…

Computation and Language · Computer Science 2026-04-29 Amir Saeidi , Venkatesh Mishra , Souradeep Mukhopadhyay , Gaowen Liu , Ali Payani , Jayanth Srinivasa , Chitta Baral

The potential of Large Language Model (LLM) as agents has been widely acknowledged recently. Thus, there is an urgent need to quantitatively \textit{evaluate LLMs as agents} on challenging tasks in interactive environments. We present…

Multimodal large language models (MLLMs) have demonstrated strong capabilities in visual understanding, yet they remain limited in complex, multi-step reasoning that requires deep searching and integrating visual evidence with external…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Xiangyu Peng , Can Qin , An Yan , Xinyi Yang , Zeyuan Chen , Ran Xu , Chien-Sheng Wu

Website Fingerprinting (WFP) uses deep learning models to classify encrypted network traffic to infer visited websites. While historically effective, prior methods fail to generalize to modern web environments. Single-page applications…

Cryptography and Security · Computer Science 2025-09-17 Chuxu Song , Dheekshith Dev Manohar Mekala , Hao Wang , Richard Martin

Developing AI agents to autonomously manipulate graphical user interfaces is a long challenging task. Recent advances in data scaling law inspire us to train computer-use agents with a scaled instruction set, yet using behavior cloning to…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Fanbin Lu , Zhisheng Zhong , Ziqin Wei , Shu Liu , Chi-Wing Fu , Jiaya Jia

Large Language Model (LLM) Agents are an emerging computing paradigm that blends generative machine learning with tools such as code interpreters, web browsing, email, and more generally, external resources. These agent-based systems…

Cryptography and Security · Computer Science 2024-10-23 Xiaohan Fu , Shuheng Li , Zihan Wang , Yihao Liu , Rajesh K. Gupta , Taylor Berg-Kirkpatrick , Earlence Fernandes

The development of autonomous web agents, powered by Large Language Models (LLMs) and reinforcement learning (RL), represents a significant step towards general-purpose AI assistants. However, training these agents is severely hampered by…

Computation and Language · Computer Science 2026-04-21 Hang Ding , Peidong Liu , Junqiao Wang , Ziwei Ji , Meng Cao , Rongzhao Zhang , Lynn Ai , Eric Yang , Tianyu Shi , Lei Yu

Large language models (LLMs) have evolved into agentic systems capable of autonomous tool use and multi-step reasoning for complex problem-solving. However, post-training approaches building upon general-purpose foundation models…

Recent SOTA approaches for embodied learning via interaction directly employ large language models (LLMs) as agents to determine the next steps in an environment. Due to their world knowledge and reasoning capabilities, LLM agents achieve…

Computation and Language · Computer Science 2024-07-15 Abhay Zala , Jaemin Cho , Han Lin , Jaehong Yoon , Mohit Bansal

Phishing websites remain a significant cybersecurity threat, necessitating accurate and cost-effective detection mechanisms. In this paper, we present CLASP, a novel system that effectively identifies phishing websites by leveraging…

Cryptography and Security · Computer Science 2025-10-22 Fouad Trad , Ali Chehab

Recently, large language model (LLM)-based agents have achieved significant success in interactive environments, attracting significant academic and industrial attention. Despite these advancements, current research predominantly focuses on…

Computation and Language · Computer Science 2025-05-22 Peng Wang , Ruihan Tao , Qiguang Chen , Mengkang Hu , Libo Qin