English
Related papers

Related papers: Bigger, Regularized, Optimistic: scaling for compu…

200 papers

Reinforcement learning (RL) is widely used for humanoid control, with on-policy methods such as Proximal Policy Optimization (PPO) enabling robust training via large-scale parallel simulation and, in some cases, zero-shot deployment to real…

Robotics · Computer Science 2026-02-24 Weidong Huang , Zhehan Li , Hangxin Liu , Biao Hou , Yao Su , Jingwen Zhang

Distributionally robust optimization (DRO) has shown lot of promise in providing robustness in learning as well as sample based optimization problems. We endeavor to provide DRO solutions for a class of sum of fractionals, non-convex…

Machine Learning · Computer Science 2022-06-01 Avinandan Bose , Arunesh Sinha , Tien Mai

While Reinforcement Learning (RL) shows promise in training tool-use Large Language Models (LLMs) using verifiable outcome rewards, existing methods largely overlook the potential of reasoning rewards based on chain-of-thought quality for…

Computation and Language · Computer Science 2026-01-16 Zihan Lin , Xiaohan Wang , Hexiong Yang , Jiajun Chai , Jie Cao , Guojun Yin , Wei Lin , Ran He

Training a deep neural network to maximize a target objective has become the standard recipe for successful machine learning over the last decade. These networks can be optimized with supervised learning, if the target objective is…

Machine Learning · Computer Science 2025-05-12 Bernhard Jaeger , Andreas Geiger

While traditional Deep Learning (DL) optimization methods treat all training samples equally, Distributionally Robust Optimization (DRO) adaptively assigns importance weights to different samples. However, a significant gap exists between…

The objective of this study is to develop a good risk model for classifying business delinquency by simultaneously exploring several machine learning based methods including regularization, hyper-parameter optimization, and model ensembling…

Machine Learning · Computer Science 2020-10-13 Yan Wang , Xuelei Sherry Ni

Many real-world domains are subject to a structured non-stationarity which affects the agent's goals and the environmental dynamics. Meta-reinforcement learning (RL) has been shown successful for training agents that quickly adapt to…

Machine Learning · Computer Science 2021-05-20 Riccardo Poiani , Andrea Tirinzoni , Marcello Restelli

Group distributionally robust optimization (GDRO) aims to develop models that perform well across $m$ distributions simultaneously. Existing GDRO algorithms can only process a fixed number of samples per iteration, either 1 or $m$, and…

Machine Learning · Computer Science 2025-05-22 Haomin Bai , Dingzhi Yu , Shuai Li , Haipeng Luo , Lijun Zhang

This study explores integrating reinforcement learning (RL) with idealised climate models to address key parameterisation challenges in climate science. Current climate models rely on complex mathematical parameterisations to represent…

Machine Learning · Computer Science 2025-04-17 Pritthijit Nath , Henry Moss , Emily Shuckburgh , Mark Webb

Model-based Reinforcement Learning estimates the true environment through a world model in order to approximate the optimal policy. This family of algorithms usually benefits from better sample efficiency than their model-free counterparts.…

Machine Learning · Computer Science 2021-10-27 Valentin Charvet , Bjørn Sand Jensen , Roderick Murray-Smith

An emerging field of sequential decision problems is safe Reinforcement Learning (RL), where the objective is to maximize the reward while obeying safety constraints. Being able to handle constraints is essential for deploying RL agents in…

Robotics · Computer Science 2023-03-08 Nick Bührer , Zhejun Zhang , Alexander Liniger , Fisher Yu , Luc Van Gool

In decision-making under uncertainty, Contextual Robust Optimization (CRO) provides reliability by minimizing the worst-case decision loss over a prediction set. While recent advances use conformal prediction to construct prediction sets…

Machine Learning · Statistics 2025-12-25 Yajie Bao , Yang Hu , Haojie Ren , Peng Zhao , Changliang Zou

In this paper we address the problem of performing statistical inference for large scale data sets i.e., Big Data. The volume and dimensionality of the data may be so high that it cannot be processed or stored in a single computing node. We…

Methodology · Statistics 2016-04-20 Shahab Basiri , Esa Ollila , Visa Koivunen

Reinforcement Learning (RL) with PPO-like clip objectives has become the standard choice for reward-based fine-tuning of large language models (LLMs). Although recent work has explored improved estimators of advantages and normalization,…

Machine Learning · Computer Science 2026-02-24 Philipp Becker , Niklas Freymuth , Serge Thilges , Fabian Otto , Gerhard Neumann

Optimization modeling and solving are fundamental to the application of Operations Research (OR) in real-world decision making, yet the process of translating natural language problem descriptions into formal models and solver code remains…

Artificial Intelligence · Computer Science 2025-11-13 Zezhen Ding , Zhen Tan , Jiheng Zhang , Tianlong Chen

Learned optimization has emerged as a promising alternative to hand-crafted optimizers, with the potential to discover stronger learned update rules that enable faster, hyperparameter-free training of neural networks. A critical element for…

Machine Learning · Computer Science 2025-06-23 Abhinav Moudgil , Boris Knyazev , Guillaume Lajoie , Eugene Belilovsky

Despite the numerous advances, reinforcement learning remains away from widespread acceptance for autonomous controller design as compared to classical methods due to lack of ability to effectively tackle the reality gap. The reliance on…

Machine Learning · Computer Science 2024-09-23 Narendra Patwardhan , Zequn Wang

Continuous-time reinforcement learning (CTRL) provides a principled framework for sequential decision-making in environments where interactions evolve continuously over time. Despite its empirical success, the theoretical understanding of…

Machine Learning · Computer Science 2025-05-22 Runze Zhao , Yue Yu , Adams Yiyue Zhu , Chen Yang , Dongruo Zhou

Self-improvement training enables the large reasoning models (LRMs) to improve themselves by self-generating reasoning trajectories as training data without external supervision. However, we find that this method often falls short in…

Computation and Language · Computer Science 2026-05-26 Qihuang Zhong , Liang Ding , Juhua Liu , Bo Du , Leszek Rutkowski , Dacheng Tao

Reinforcement learning (RL) has demonstrated potential in enhancing the reasoning capabilities of large language models (LLMs), but such training typically demands substantial efforts in creating and annotating data. In this work, we…

Computation and Language · Computer Science 2025-10-06 Hangfan Zhang , Siyuan Xu , Zhimeng Guo , Huaisheng Zhu , Shicheng Liu , Xinrun Wang , Qiaosheng Zhang , Yang Chen , Peng Ye , Lei Bai , Shuyue Hu