English
Related papers

Related papers: 6D (2,0) Bootstrap with soft-Actor-Critic

200 papers

The two-time scale nature of SAC, which is an actor-critic algorithm, is characterised by the fact that the critic estimate has not converged for the actor at any given time, but since the critic learns faster than the actor, it ensures…

We initiate the bootstrap program for $\mathcal{N}=3$ superconformal field theories (SCFTs) in four dimensions. The problem is considered from two fronts: the protected subsector described by a $2d$ chiral algebra, and crossing symmetry for…

High Energy Physics - Theory · Physics 2017-04-26 Madalena Lemos , Pedro Liendo , Carlo Meneghelli , Vladimir Mitev

Recent advances in deep reinforcement learning have achieved impressive results in a wide range of complex tasks, but poor sample efficiency remains a major obstacle to real-world deployment. Soft actor-critic (SAC) mitigates this problem…

Machine Learning · Computer Science 2024-09-10 Luca Della Libera

As an important type of reinforcement learning algorithms, actor-critic (AC) and natural actor-critic (NAC) algorithms are often executed in two ways for finding optimal policies. In the first nested-loop design, actor's one update of…

Machine Learning · Computer Science 2020-05-11 Tengyu Xu , Zhe Wang , Yingbin Liang

Soft actor-critic (SAC) in reinforcement learning is expected to be one of the next-generation robot control schemes. Its ability to maximize policy entropy would make a robotic controller robust to noise and perturbation, which is useful…

Machine Learning · Computer Science 2023-07-04 Taisuke Kobayashi

The Soft Actor-Critic (SAC) algorithm, a state-of-the-art method in maximum entropy reinforcement learning, traditionally relies on minimizing reverse Kullback-Leibler (KL) divergence for policy updates. However, this approach leads to an…

Machine Learning · Computer Science 2025-06-03 Yixian Zhang , Huaze Tang , Changxu Wei , Wenbo Ding

Model-free deep reinforcement learning (RL) algorithms have been demonstrated on a range of challenging decision making and control tasks. However, these methods typically suffer from two major challenges: very high sample complexity and…

Machine Learning · Computer Science 2018-08-10 Tuomas Haarnoja , Aurick Zhou , Pieter Abbeel , Sergey Levine

We study the numerical bounds obtained using a conformal-bootstrap method - advocated in ref. [1] but never implemented so far - where different points in the plane of conformal cross ratios $z$ and $\bar z$ are sampled. In contrast to the…

High Energy Physics - Theory · Physics 2016-11-04 Alejandro Castedo Echeverri , Benedict von Harling , Marco Serone

Soft Actor-Critic algorithm is widely recognized for its robust performance across a range of deep reinforcement learning tasks, where it leverages the tanh transformation to constrain actions within bounded limits. However, this…

Machine Learning · Computer Science 2025-04-23 Yanjun Chen , Xinming Zhang , Xianghui Wang , Zhiqiang Xu , Xiaoyu Shen , Wei Zhang

We suggest a way to implement conformal bootstrap program for the case of the ${\cal N}=1$ SCFT in three dimensions using the previous analysis of the Ising model in \cite{CB}. We find approximate values for the conformal dimensions of…

High Energy Physics - Theory · Physics 2013-10-31 Denis Bashkirov

Robust Reinforcement Learning aims to derive optimal behavior that accounts for model uncertainty in dynamical systems. However, previous studies have shown that by considering the worst case scenario, robust policies can be overly…

Machine Learning · Computer Science 2018-10-25 Esther Derman , Daniel J. Mankowitz , Timothy A. Mann , Shie Mannor

Motion planning is the soul of robot decision making. Classical planning algorithms like graph search and reaction-based algorithms face challenges in cases of dense and dynamic obstacles. Deep learning algorithms generate suboptimal…

Robotics · Computer Science 2023-09-08 Chengmin Zhou , Xin Lu , Jiapeng Dai , Bingding Huang , Xiaoxu Liu , Pasi Fränti

We study the conformal bootstrap for 4-point functions of stress tensors in parity-preserving 3d CFTs. To set up the bootstrap equations, we analyze the constraints of conformal symmetry, permutation symmetry, and conservation on the…

High Energy Physics - Theory · Physics 2018-04-04 Anatoly Dymarsky , Filip Kos , Petr Kravchuk , David Poland , David Simmons-Duffin

We implement the conformal bootstrap for N=4 superconformal field theories in four dimensions. Consistency of the four-point function of the stress-energy tensor multiplet imposes significant upper bounds for the scaling dimensions of…

High Energy Physics - Theory · Physics 2022-08-22 Christopher Beem , Leonardo Rastelli , Balt C. van Rees

We analyse the OPE of any two 1/2 BPS operators of (2,0) SCFT$_6$ by constructing all possible three-point functions that they can form with another, in general long operator. Such three-point functions are uniquely determined by…

High Energy Physics - Theory · Physics 2010-02-03 B. Eden , S. Ferrara , E. Sokatchev

Exploration-exploitation dilemma has long been a crucial issue in reinforcement learning. In this paper, we propose a new approach to automatically balance between these two. Our method is built upon the Soft Actor-Critic (SAC) algorithm,…

Machine Learning · Computer Science 2020-08-03 Yufei Wang , Tianwei Ni

In this work we initiate the conformal bootstrap program for ${\mathcal N}=2$ superconformal field theories in four dimensions. We promote an abstract operator-algebraic viewpoint in order to unify the description of Lagrangian and…

High Energy Physics - Theory · Physics 2019-03-25 Christopher Beem , Madalena Lemos , Pedro Liendo , Leonardo Rastelli , Balt C. van Rees

We derive exact relations between certain integrals of the conserved flavor current four point function in 4d $\mathcal{N}=2$ conformal field theories (CFTs) and derivatives of the mass deformed sphere free energy, which can be computed…

High Energy Physics - Theory · Physics 2023-05-02 Shai M. Chester

The crossing equations of a conformal field theory can be systematically truncated to a finite, closed system of polynomial equations. In certain cases, solutions of the truncated equations place strict bounds on the space of all unitary…

High Energy Physics - Theory · Physics 2019-06-26 Nima Afkhami-Jeddi , Thomas Hartman , Amirhossein Tajdini

Reinforcement learning has been proven to be highly effective in handling complex control tasks. Traditional methods typically use unimodal distributions, such as Gaussian distributions, to model the output of value distributions. However,…

Machine Learning · Computer Science 2025-07-14 Tong Liu , Yinuo Wang , Xujie Song , Wenjun Zou , Liangfa Chen , Likun Wang , Bin Shuai , Jingliang Duan , Shengbo Eben Li