English
Related papers

Related papers: MobileIPL: Enhancing Mobile Agents Thinking Proces…

200 papers

The recent development of chain-of-thought (CoT) decoding has enabled large language models (LLMs) to generate explicit logical reasoning paths for complex problem-solving. However, research indicates that these paths are not always…

Computation and Language · Computer Science 2024-11-01 Xuan Zhang , Chao Du , Tianyu Pang , Qian Liu , Wei Gao , Min Lin

Despite the advancements in in-context learning (ICL) for large language models (LLMs), current research centers on specific prompt engineering, such as demonstration selection, with the expectation that a single iteration of demonstrations…

Computation and Language · Computer Science 2024-06-05 Jiaxi Yang , Binyuan Hui , Min Yang , Bailin Wang , Bowen Li , Binhua Li , Fei Huang , Yongbin Li

Recent advances in Reinforcement Learning with Verifiable Rewards (RLVR) for Large Language Model (LLM) reasoning have been hindered by a persistent challenge: exploration collapse. The semantic homogeneity of random rollouts often traps…

Machine Learning · Computer Science 2026-01-12 Huilin Deng , Hongchen Luo , Yue Zhu , Long Li , Zhuoyue Chen , Xinghao Zhao , Ming Li , Jihai Zhang , Mengchang Wang , Yang Cao , Yu Kang

Online Reinforcement Learning (RL) offers a promising paradigm for enhancing GUI agents through direct environment interaction. However, its effectiveness is severely hindered by inefficient credit assignment in long-horizon tasks and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-06 Han Xiao , Guozhi Wang , Hao Wang , Shilong Liu , Yuxiang Chai , Yue Pan , Yufeng Zhou , Xiaoxin Chen , Yafei Wen , Hongsheng Li

The reasoning capabilities of Large Language Models (LLMs) have led to their increasing employment in several critical applications, particularly education, where they support problem-solving, tutoring, and personalized study.…

Human-Computer Interaction · Computer Science 2026-01-27 Runtao Zhou , Giang Nguyen , Nikita Kharya , Anh Totti Nguyen , Chirag Agarwal

Post-training, particularly reinforcement learning (RL) using self-play-generated data, has become a new learning paradigm for large language models (LLMs). However, scaling RL to develop a general reasoner remains a research challenge, as…

Artificial Intelligence · Computer Science 2024-10-02 Tianlong Wang , Junzhe Chen , Xueting Han , Jing Bai

The recent DeepSeek-R1 has showcased the emergence of reasoning capabilities in LLMs through reinforcement learning (RL) with rule-based rewards. Despite its success in language models, its application in multi-modal domains, particularly…

Artificial Intelligence · Computer Science 2025-05-27 Zhengxi Lu , Yuxiang Chai , Yaxuan Guo , Xi Yin , Liang Liu , Hao Wang , Han Xiao , Shuai Ren , Guanjing Xiong , Hongsheng Li

Iterative data generation and model re-training can effectively align large language models(LLMs) to human preferences. The process of data sampling is crucial, as it significantly influences the success of policy improvement. Repeated…

Computation and Language · Computer Science 2024-10-07 Hai Ye , Hwee Tou Ng

Chain-of-thought (CoT) reasoning in vision language models (VLMs) is crucial for improving interpretability and trustworthiness. However, current training recipes lack robust CoT reasoning data, relying on datasets dominated by short…

Artificial Intelligence · Computer Science 2024-10-22 Ruohong Zhang , Bowen Zhang , Yanghao Li , Haotian Zhang , Zhiqing Sun , Zhe Gan , Yinfei Yang , Ruoming Pang , Yiming Yang

As language models have become increasingly successful at a wide array of tasks, different prompt engineering methods have been developed alongside them in order to adapt these models to new tasks. One of them is Tree-of-Thoughts (ToT), a…

Human-Computer Interaction · Computer Science 2024-09-04 Alan Boyle , Isha Gupta , Sebastian Hönig , Lukas Mautner , Kenza Amara , Furui Cheng , Mennatallah El-Assady

Route recommendation aims to provide users with optimal travel plans that satisfy diverse and complex requirements. Classical routing algorithms (e.g., shortest-path and constraint-aware search) are efficient but assume structured inputs…

Artificial Intelligence · Computer Science 2025-10-08 Tao Zhe , Rui Liu , Fateme Memar , Xiao Luo , Wei Fan , Xinyue Ye , Zhongren Peng , Dongjie Wang

Large Language Models (LLMs) often require domain-specific fine-tuning to address targeted tasks, which risks degrading their general capabilities. Maintaining a balance between domain-specific enhancements and general model utility is a…

Computation and Language · Computer Science 2025-06-05 Jun Rao , Zepeng Lin , Xuebo Liu , Xiaopeng Ke , Lian Lian , Dong Jin , Shengjun Cheng , Jun Yu , Min Zhang

In the field of MLLM-based GUI agents, compared to smartphones, the PC scenario not only features a more complex interactive environment, but also involves more intricate intra- and inter-app workflows. To address these issues, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2025-02-24 Haowei Liu , Xi Zhang , Haiyang Xu , Yuyang Wanyan , Junyang Wang , Ming Yan , Ji Zhang , Chunfeng Yuan , Changsheng Xu , Weiming Hu , Fei Huang

Recent advances in world models have shown promise for modeling future dynamics of environmental states, enabling agents to reason and act without accessing real environments. Current methods mainly perform single-step or fixed-horizon…

Computation and Language · Computer Science 2026-03-17 Youwei Liu , Jian Wang , Hanlin Wang , Beichen Guo , Wenjie Li

A growing number of service providers are exploring methods to improve server utilization and reduce power consumption by co-scheduling high-priority latency-critical workloads with best-effort workloads. This practice requires strict…

Machine Learning · Computer Science 2023-03-28 Drew Penney , Bin Li , Jaroslaw Sydir , Lizhong Chen , Charlie Tai , Stefan Lee , Eoin Walsh , Thomas Long

Users often omit essential details in their requests to LLM-based agents, resulting in under-specified inputs for tool use. This poses a fundamental challenge for tool-augmented agents, as API execution typically requires complete…

Computation and Language · Computer Science 2026-04-21 Yejin Yoon , Minseo Kim , Taeuk Kim

While Pre-trained Language Models (PLMs) internalize a great amount of world knowledge, they have been shown incapable of recalling these knowledge to solve tasks requiring complex & multi-step reasoning. Similar to how humans develop a…

Computation and Language · Computer Science 2022-10-25 Boshi Wang , Xiang Deng , Huan Sun

Large Language Models (LLMs) were shown to struggle with long-term planning, which may be caused by the limited way in which they explore the space of possible solutions. We propose an architecture where a Reinforcement Learning (RL) Agent…

Machine Learning · Computer Science 2024-10-18 Yoav Alon , Cristina David

Research on LLM technologies is rapidly emerging, with most of them employ a 'fast thinking' approach to inference. Most LLMs generate the final result based solely on a single query and LLM's reasoning capabilities. However, with the…

Computation and Language · Computer Science 2025-11-14 Jianfeng Pan , Senyou Deng , Shaomang Huang

Agents centered around Large Language Models (LLMs) are now capable of automating mobile device operations for users. After fine-tuning to learn a user's mobile operations, these agents can adhere to high-level user instructions online.…

Human-Computer Interaction · Computer Science 2024-01-18 Tinghe Ding