English
Related papers

Related papers: Deep Researcher with Test-Time Diffusion

200 papers

The capabilities of large language models (LLMs) are widely regarded as relying on autoregressive models (ARMs). We challenge this notion by introducing LLaDA, a diffusion model trained from scratch under the pre-training and supervised…

Computation and Language · Computer Science 2025-10-21 Shen Nie , Fengqi Zhu , Zebin You , Xiaolu Zhang , Jingyang Ou , Jun Hu , Jun Zhou , Yankai Lin , Ji-Rong Wen , Chongxuan Li

Deep research agents have emerged as powerful tools for automating complex intellectual tasks through multi-step reasoning and web-based information seeking. While recent efforts have successfully enhanced these agents by scaling depth…

Artificial Intelligence · Computer Science 2026-02-10 Xiaoqiang Lin , Jun Hao Liew , Silvio Savarese , Junnan Li

Large language models (LLMs) are catalyzing the development of autonomous AI research agents for scientific and engineering discovery. We present FM Agent, a novel and general-purpose multi-agent framework that leverages a synergistic…

Large Language Models (LLMs) demonstrate impressive capabilities but lack robust temporal intelligence, struggling to integrate reasoning about the past with predictions and plausible generations of the future. Meanwhile, existing methods…

Computation and Language · Computer Science 2025-06-04 Zijia Liu , Peixuan Han , Haofei Yu , Haoru Li , Jiaxuan You

The modern generative audio models can be used by an adversary in an unlawful manner, specifically, to impersonate other people to gain access to private information. To mitigate this issue, speech deepfake detection (SDD) methods started…

Recently, diffusion models have excelled in image generation tasks and have also been applied to neural language processing (NLP) for controllable text generation. However, the application of diffusion models in a cross-lingual setting is…

Computation and Language · Computer Science 2023-08-01 Linyao Chen , Aosong Feng , Boming Yang , Zihui Li

Diffusion models, a family of generative models based on deep learning, have become increasingly prominent in cutting-edge machine learning research. With a distinguished performance in generating samples that resemble the observed data,…

Machine Learning · Computer Science 2023-05-02 Lequan Lin , Zhengkun Li , Ruikun Li , Xuliang Li , Junbin Gao

Large Language Models (LLMs) have shown remarkable reasoning capabilities, while their practical applications are limited by severe factual hallucinations due to limitations in the timeliness, accuracy, and comprehensiveness of their…

Artificial Intelligence · Computer Science 2025-06-10 Xinyan Guan , Jiali Zeng , Fandong Meng , Chunlei Xin , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun , Jie Zhou

Prompt learning has demonstrated promising results in fine-tuning pre-trained multimodal models. However, the performance improvement is limited when applied to more complex and fine-grained tasks. The reason is that most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2025-05-01 Weicai Yan , Wang Lin , Zirun Guo , Ye Wang , Fangming Feng , Xiaoda Yang , Zehan Wang , Tao Jin

In recent years, diffusion based methods have emerged as a powerful paradigm for generative modeling. Although discrete diffusion for natural language processing has been explored to a lesser extent, it shows promise for tasks requiring…

Machine Learning · Computer Science 2025-03-25 Andrew Kiruluta , Andreas Lemos

Reranking plays a crucial role in modern multi-stage recommender systems by rearranging the initial ranking list to model interplay between items. Considering the inherent challenges of reranking such as combinatorial searching space, some…

Information Retrieval · Computer Science 2023-08-15 Xiao Lin , Xiaokai Chen , Chenyang Wang , Hantao Shu , Linfeng Song , Biao Li , Peng jiang

Autoregressive Models (ARMs) have long dominated the landscape of Large Language Models. Recently, a new paradigm has emerged in the form of diffusion-based Large Language Models (dLLMs), which generate text by iteratively denoising masked…

Machine Learning · Computer Science 2025-06-10 Zhiyuan Liu , Yicun Yang , Yaojie Zhang , Junjie Chen , Chang Zou , Qingyuan Wei , Shaobo Wang , Linfeng Zhang

Large language models (LLMs) accelerate software development but often exhibit instability, non-determinism, and weak adherence to development discipline in unconstrained workflows. While test-driven development (TDD) provides a structured…

Software Engineering · Computer Science 2026-04-30 Tarlan Hasanli , Shahbaz Siddeeq , Bishwash Khanal , Pyry Kotilainen , Tommi Mikkonen , Pekka Abrahamsson

Large language models (LLMs) have shown remarkable success across a wide range of natural language generation tasks, where proper prompt designs make great impacts. While existing prompting methods are normally restricted to providing…

Computation and Language · Computer Science 2023-06-01 Bei Li , Rui Wang , Junliang Guo , Kaitao Song , Xu Tan , Hany Hassan , Arul Menezes , Tong Xiao , Jiang Bian , JingBo Zhu

The increasing complexity and workload of clinical radiology leads to inevitable oversights and mistakes in their use as diagnostic tools, causing delayed treatments and sometimes life-threatening harm to patients. While large language…

Computation and Language · Computer Science 2025-11-14 Jinge Wu , Zhaolong Wu , Ruizhe Li , Tong Chen , Abul Hasan , Yunsoo Kim , Jason P. Y. Cheung , Teng Zhang , Honghan Wu

We aim to develop a multimodal research agent capable of explicit reasoning and planning, multi-tool invocation, and cross-modal information synthesis, enabling it to conduct deep research tasks. However, we observe three main challenges in…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Huanjin Yao , Qixiang Yin , Min Yang , Ziwang Zhao , Yibo Wang , Haotian Luo , Jingyi Zhang , Jiaxing Huang

Given a user's complex information need, a multi-agent Deep Research system iteratively plans, retrieves, and synthesizes evidence across hundreds of documents to produce a high-quality answer. In one possible architecture, an orchestrator…

Information Retrieval · Computer Science 2026-04-06 Arthur Câmara , Vincent Slot , Jakub Zavrel

Deep research agents perform multi-step research to produce long-form, well-attributed answers. However, most open deep research agents are trained on easily verifiable short-form QA tasks via reinforcement learning with verifiable rewards,…

This paper introduces Agent-Based Auto Research, a structured multi-agent framework designed to automate, coordinate, and optimize the full lifecycle of scientific research. Leveraging the capabilities of large language models (LLMs) and…

Recent advances in Large Language Models (LLMs) demonstrate that chain-of-thought prompting and deep reasoning substantially enhance performance on complex tasks, and multi-agent systems can further improve accuracy by enabling model…

Artificial Intelligence · Computer Science 2025-10-16 Zehui Ling , Deshu Chen , Yichi Zhang , Yuchen Liu , Xigui Li , Xin Guo , Yuan Cheng