English
Related papers

Related papers: Dr. Zero: Self-Evolving Search Agents without Trai…

200 papers

Data Darwinism (Part I) established a ten-level hierarchy for data processing, showing that stronger processing can unlock greater data value. However, that work relied on manually designed strategies for a single category. Modern…

Artificial Intelligence · Computer Science 2026-03-17 Tiantian Mi , Dongming Shan , Zhen Huang , Yiwei Qin , Muhang Xie , Yuxuan Qiao , Yixiu Liu , Chenyang Zhou , Pengfei Liu

Current approaches rely on zero-shot evaluation due to the absence of training data; while proprietary models such as GPT-4 exhibit strong reasoning capabilities, smaller open-source models remain ineffective at complex tool use. To address…

Artificial Intelligence · Computer Science 2026-05-05 Hyunji Min , Sangwon Jung , Junyoung Sung , Dosung Lee , Leekyeung Han , Paul Hongsuck Seo

Large language models (LLMs) have demonstrated remarkable capabilities across a range of text-generation tasks. However, LLMs still struggle with problems requiring multi-step decision-making and environmental feedback, such as online…

Artificial Intelligence · Computer Science 2025-02-18 Zhenfang Chen , Delin Chen , Rui Sun , Wenjun Liu , Chuang Gan

Multimodal Large Language Model (MLLM)-driven image restoration agent demonstrates effectiveness in degradation coupling scenarios by flexibly selecting tools and determining removal orders. However, their zero-shot planning often fails…

Computer Vision and Pattern Recognition · Computer Science 2026-05-22 Kailin Zhuang , Jiawei Wu , Zhi Jin

Self-improvement training enables the large reasoning models (LRMs) to improve themselves by self-generating reasoning trajectories as training data without external supervision. However, we find that this method often falls short in…

Computation and Language · Computer Science 2026-05-26 Qihuang Zhong , Liang Ding , Juhua Liu , Bo Du , Leszek Rutkowski , Dacheng Tao

Post-training has become the dominant recipe for turning a language model into a competent search-augmented reasoning agent. A line of recent work pushes its performance further by adding elaborate machinery on top of this standard…

Artificial Intelligence · Computer Science 2026-05-27 Zihan Liang , Yufei Ma , Ben Chen , Zhipeng Qian , Xuxin Zhang , Huangyu Dai , Lingtao Mao

Current Large Language Models (LLMs) have shown strong reasoning capabilities in commonsense question answering benchmarks, but the process underlying their success remains largely opaque. As a consequence, recent approaches have equipped…

Computation and Language · Computer Science 2024-10-08 Francesco Maria Molfese , Simone Conia , Riccardo Orlando , Roberto Navigli

We introduce Open-Reasoner-Zero, the first open source implementation of large-scale reasoning-oriented RL training on the base model focusing on scalability, simplicity and accessibility. Through extensive experiments, we demonstrate that…

Machine Learning · Computer Science 2025-07-08 Jingcheng Hu , Yinmin Zhang , Qi Han , Daxin Jiang , Xiangyu Zhang , Heung-Yeung Shum

Motion sensor time-series are central to Human Activity Recognition (HAR), yet conventional approaches are constrained to fixed activity sets and typically require costly parameter retraining to adapt to new behaviors. While Large Language…

Computation and Language · Computer Science 2026-04-14 Zechen Li , Baiyu Chen , Hao Xue , Flora D. Salim

Self-evolving memory systems are unprecedentedly reshaping the evolutionary paradigm of large language model (LLM)-based agents. Prior work has predominantly relied on manually engineered memory architectures to store trajectories, distill…

Computation and Language · Computer Science 2025-12-23 Guibin Zhang , Haotian Ren , Chong Zhan , Zhenhong Zhou , Junhao Wang , He Zhu , Wangchunshu Zhou , Shuicheng Yan

Zero-shot text learning enables text classifiers to handle unseen classes efficiently, alleviating the need for task-specific training data. A simple approach often relies on comparing embeddings of query (text) to those of potential…

Information Retrieval · Computer Science 2024-06-28 Tassallah Abdullahi , Ritambhara Singh , Carsten Eickhoff

Vision-Language-Action (VLA) models excel in robotic manipulation but are constrained by their heavy reliance on expert demonstrations, leading to demonstration bias and limiting performance. Reinforcement learning (RL) is a vital…

Robotics · Computer Science 2025-12-02 Senyu Fei , Siyin Wang , Li Ji , Ao Li , Shiduo Zhang , Liming Liu , Jinlong Hou , Jingjing Gong , Xianzhong Zhao , Xipeng Qiu

Recent advances in test-time scaling have led to the emergence of thinking LLMs that exhibit self-reflective behaviors and multi-step reasoning. While RL drives this self-improvement paradigm, a recent study (Gandhi et al., 2025) shows that…

Artificial Intelligence · Computer Science 2025-08-22 Aswin RRV , Jacob Dineen , Divij Handa , Md Nayem Uddin , Mihir Parmar , Chitta Baral , Ben Zhou

Learning to search is the task of building artificial agents that learn to autonomously use a search box to find information. So far, it has been shown that current language models can learn symbolic query reformulation policies, in…

Computation and Language · Computer Science 2023-03-30 Michelle Chen Huebscher , Christian Buck , Massimiliano Ciaramita , Sascha Rothe

The Enterprise Intelligence Platform must integrate logs from numerous third-party vendors in order to perform various downstream tasks. However, vendor documentation is often unavailable at test time. It is either misplaced, mismatched,…

Artificial Intelligence · Computer Science 2025-10-17 Wen-Kwang Tsao , Yao-Ching Yu , Chien-Ming Huang

Self-improvement is a significant techniques within the realm of large language model (LLM), aiming to enhance the LLM performance without relying on external data. Despite its significance, generally how LLM performances evolve during the…

Machine Learning · Computer Science 2026-02-10 Yifan Sun , Yushan Liang , Zhen Zhang , Xin Liu , Jiaye Teng

Deep search has become a crucial capability for frontier multimodal agents, enabling models to solve complex questions through active search, evidence verification, and multi-step reasoning. Despite rapid progress, top-tier multimodal…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Shuang Chen , Kaituo Feng , Hangting Chen , Wenxuan Huang , Dasen Dai , Quanxin Shou , Yunlong Lin , Xiangyu Yue , Shenghua Gao , Tianyu Pang

While current software agents powered by large language models (LLMs) and agentic reinforcement learning (RL) can boost programmer productivity, their training data (e.g., GitHub issues and pull requests) and environments (e.g.,…

Software Engineering · Computer Science 2026-05-20 Yuxiang Wei , Zhiqing Sun , Emily McMilin , Jonas Gehring , David Zhang , Gabriel Synnaeve , Daniel Fried , Lingming Zhang , Sida Wang

Conventional Retrieval-Augmented Generation (RAG) systems often struggle with complex multi-hop queries over long documents due to their single-pass retrieval. We introduce MM-Doc-R1, a novel framework that employs an agentic, vision-aware…

Computation and Language · Computer Science 2026-04-16 Jiahang Lin , Kai Hu , Binghai Wang , Yuhao Zhou , Zhiheng Xi , Honglin Guo , Shichun Liu , Junzhe Wang , Shihan Dou , Enyu Zhou , Hang Yan , Zhenhua Han , Tao Gui , Qi Zhang , Xuanjing Huang

Clinical image interpretation is inherently multi-step and tool-centric: clinicians iteratively combine visual evidence with patient context, quantify findings, and refine their decisions through a sequence of specialized procedures. While…

Artificial Intelligence · Computer Science 2026-03-09 Lin Fan , Pengyu Dai , Zhipeng Deng , Haolin Wang , Xun Gong , Yefeng Zheng , Yafei Ou