English
Related papers

Related papers: JaxARC: A High-Performance JAX-based Environment f…

200 papers

We propose Pgx, a suite of board game reinforcement learning (RL) environments written in JAX and optimized for GPU/TPU accelerators. By leveraging JAX's auto-vectorization and parallelization over accelerators, Pgx can efficiently scale to…

Artificial Intelligence · Computer Science 2024-01-17 Sotetsu Koyamada , Shinri Okano , Soichiro Nishimori , Yu Murata , Keigo Habara , Haruka Kita , Shin Ishii

Reinforcement learning has been demonstrated to outperform even the best humans in complex domains like video games. However, running reinforcement learning experiments on the required scale for autonomous driving is extremely difficult.…

Machine Learning · Computer Science 2024-11-06 Moritz Harmel , Anubhav Paras , Andreas Pasternak , Nicholas Roy , Gary Linscott

We present an implementation of interval analysis and mixed monotone interval reachability analysis as function transforms in Python, fully composable with the computational framework JAX. The resulting toolbox inherits several key features…

Systems and Control · Electrical Eng. & Systems 2024-05-02 Akash Harapanahalli , Saber Jafarpour , Samuel Coogan

Analytical reasoning is an essential and challenging task that requires a system to analyze a scenario involving a set of particular circumstances and perform reasoning over it to make conclusions. In this paper, we study the challenge of…

Computation and Language · Computer Science 2021-04-16 Wanjun Zhong , Siyuan Wang , Duyu Tang , Zenan Xu , Daya Guo , Jiahai Wang , Jian Yin , Ming Zhou , Nan Duan

Inductive program synthesis, or programming by example, requires synthesizing functions from input-output examples that generalize to unseen inputs. While large language model agents have shown promise in programming tasks guided by natural…

Programming Languages · Computer Science 2025-08-11 Anjiang Wei , Tarun Suresh , Jiannan Cao , Naveen Kannan , Yuheng Wu , Kai Yan , Thiago S. F. X. Teixeira , Ke Wang , Alex Aiken

Recent advances in agentic frameworks have enabled AI agents to perform complex reasoning and decision-making. However, evidence comparing their reasoning performance, efficiency, and practical suitability remains limited. To address this…

Artificial Intelligence · Computer Science 2026-04-21 Zeeshan Rasheed , Abdul Malik Sami , Muhammad Waseem , Kai-Kristian Kemell , Mika Saari , Pekka Abrahamsson

In this work, the case is made for a wholistic top-down re-envisioning of the system stack from the programming language level down through the system architecture to bridge this complexity gap. The key goal of our design is to address the…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-06-20 Jason Mars

Large Language Models (LLMs) demonstrate exceptional capability across diverse tasks. However, their deployment in long-context scenarios is hindered by two challenges: computational inefficiency and redundant information. We propose RAM…

Computation and Language · Computer Science 2026-03-02 Jiwei Tang , Shilei Liu , Zhicheng Zhang , Qingsong Lv , Runsong Zhao , Tingwei Lu , Langming Liu , Haibin Chen , Yujin Yuan , Hai-Tao Zheng , Wenbo Su , Bo Zheng

Games have long been used as benchmarks and testing environments for research in artificial intelligence. A key step in supporting this research was the development of game description languages: frameworks that compile domain-specific code…

Artificial Intelligence · Computer Science 2026-03-27 Graham Todd , Alexander G. Padula , Dennis J. N. J. Soemers , Julian Togelius

Self-Consistency mitigates hallucinations in Large Language Models (LLMs) by sampling multiple reasoning paths,but it lacks a systematic approach to determine the optimal number of samples or select the most faithful rationale. To address…

Computation and Language · Computer Science 2025-02-05 Guangya Wan , Yuqi Wu , Jie Chen , Sheng Li

Reinforcement learning (RL) has become a pivotal component of large language model (LLM) post-training, and agentic RL extends this paradigm to operate as agents through multi-turn interaction and tool use. Scaling such systems exposes two…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-10-08 Zheyue Tan , Mustapha Abdullahi , Tuo Shi , Huining Yuan , Zelai Xu , Chao Yu , Boxun Li , Bo Zhao

Reasoning about actions and change (RAC) is essential to understand and interact with the ever-changing environment. Previous AI research has shown the importance of fundamental and indispensable knowledge of actions, i.e., preconditions…

Computation and Language · Computer Science 2022-11-28 Weinan He , Canming Huang , Zhanhao Xiao , Yongmei Liu

Translating complex reinforcement learning (RL) environments into high-performance implementations has traditionally required months of specialized engineering. We present a closed-loop methodology that produces equivalent high-performance…

Machine Learning · Computer Science 2026-05-19 Seth Karten , Rahul Dev Appapogu , Chi Jin

We are on the cusp where Artificial Intelligence (AI) and Extended Reality (XR) are converging to unlock new paradigms of interactive computing. However, a significant gap exists between the ecosystems of these two fields: while AI research…

Text-to-audio systems, while increasingly performant, are slow at inference time, thus making their latency unpractical for many creative applications. We present Adversarial Relativistic-Contrastive (ARC) post-training, the first…

Reasoning about Actions and Change (RAC) has historically played a pivotal role in solving foundational AI problems, such as the frame problem. It has driven advancements in AI fields, such as non-monotonic and commonsense reasoning. RAC…

Computational Complexity · Computer Science 2025-03-04 Divij Handa , Pavel Dolin , Shrinidhi Kumbhar , Tran Cao Son , Chitta Baral

Providing timely, consistent, and high-quality feedback in large-scale higher education courses remains a persistent challenge, often constrained by instructor workload and resource limitations. This study presents an LLM-powered, agentic…

Computers and Society · Computer Science 2026-01-13 Reza Vatankhah Barenji , Nazila Salimi , Sina Khoshgoftar

To understand how well a proposed augmented reality (AR) solution works, existing papers often conducted tailored and isolated evaluations for specific AR tasks, e.g., depth or lighting estimation, and compared them to easy-to-setup…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-07-18 Ashkan Ganj , Yiqin Zhao , Federico Galbiati , Tian Guo

The existing methods for evaluating the inference abilities of Large Language Models (LLMs) have been predominantly results-centric, making it challenging to assess the inference process comprehensively. We introduce a novel approach using…

Computation and Language · Computer Science 2024-11-26 Seungpil Lee , Woochang Sim , Donghyeon Shin , Wongyu Seo , Jiwon Park , Seokki Lee , Sanha Hwang , Sejin Kim , Sundong Kim

Reinforcement learning (RL) has become a dominant paradigm for training large language models (LLMs), particularly for reasoning tasks. Effective RL for LLMs requires massive parallelization and poses an urgent need for efficient training…

Machine Learning · Computer Science 2026-03-03 Wei Fu , Jiaxuan Gao , Xujie Shen , Chen Zhu , Zhiyu Mei , Chuyi He , Shusheng Xu , Guo Wei , Jun Mei , Jiashu Wang , Tongkai Yang , Binhang Yuan , Yi Wu