Browse State-of-the-Art › Distributional Reinforcement Learning
Distributional Reinforcement Learning
43 papers with code · 0 benchmarks · 0 datasets archive 2025-07-28
Value distribution is the distribution of the random return received by a reinforcement learning agent. it been used for a specific purpose such as implementing risk-aware behaviour.
We have random return Z whose expectation is the value Q. This random return is also described by a recursive equation, but one of a distributional nature
Description from the archive archive 2025-07-28.
Benchmarks archive 2025-07-28
No benchmark for this task in the archive.
Libraries
Not in the archive: the export carries no per-task library table, so there is nothing to show at snapshot 2025-07-28.
Datasets archive 2025-07-28
No dataset record in the archive lists this task.
Subtasks archive 2025-07-28
No subtask under this task in the archive's task tree.
Papers archive 2025-07-28
archive papers tagged: 137 · with a code link: 43 · where Syntology ran a sample: 16 (12 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument) Syntology
Show: all tagged papersonly where code ran (16 of 137 tagged: 12 with a run with no instrument failure, 4 where every run was a failure of Syntology's instrument)
Page 1 of 2: papers 1 to 100 of 137, in archive order: by repositories listed in the archive (most first), then newest first, not by stars (the archive holds no stars, so PwC's “Social” and “Latest” sorts cannot be reproduced). Papers that list no repository come after every paper that lists one.
Papers without a page here are shown as plain text. A Syntology line reads “N ran (of which C constructed an object rather than computing a result; K with no instrument failure: H honoured, V violated, P with no contract checked; I where Syntology's instrument failed) · U unverified”; the figure “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. When the archive marks a repository official for the paper, the line starts with that repository's state (the archive's flag, not a verdict on who wrote the code); hover it for the repositories the samples that ran came from. The first sentence of the abstract is shown for the first 30 papers; every abstract is on its paper's page.
-
14 Jun 2018 19 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)In this work, we build on recent advances in distributional reinforcement learning to give a generally applicable, flexible, and state-of-the-art distributional variant of DQN.
-
27 Oct 2017 17 repositories listed Syntology 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)In this paper, we build on recent work advocating a distributional approach to reinforcement learning in which the distribution over returns is modeled explicitly instead of only estimating the mean.
-
5 Nov 2019 6 repositories listed Syntology 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified (of 10 harvested samples)The key challenge in practical distributional RL algorithms lies in how to parameterize estimated distributions so as to better approximate the true continuous distribution.
-
13 Jul 2020 3 repositories listed Syntology official (archive's flag): 4 ran · 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 4 samples that ran constructed an object rather than computing a result (of 6 harvested samples)To improve the sample efficiency of policy-gradient based reinforcement learning algorithms, we propose implicit distributional actor-critic (IDAC) that consists of a distributional critic, built on two deep generator…
-
5 Nov 2018 3 repositories listed Syntology community repositories only · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified (of 3 harvested samples) · 2 pointer-only (licence)In this paper, we propose the Quantile Option Architecture (QUOTA) for exploration based on recent advances in distributional reinforcement learning (RL).
-
26 Oct 2021 2 repositories listedTo fully inherit the benefits of distributional RL and hybrid reward architectures, we introduce Multi-Dimensional Distributional DQN (MD3QN), which extends distributional RL to model the joint return distribution from…
-
23 May 2019 2 repositories listed Syntology official (archive's flag): 1 ran · 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample)Reinforcement learning agents are faced with two types of uncertainty.
-
24 Jun 2025 1 repository listedWe propose an easy to implement method built on top of distributional reinforcement learning (DRL) algorithms to deal with the overestimation in a locally adaptive way.
-
27 Feb 2025 1 repository listedWe introduce a novel Inverse Reinforcement Learning (IRL) approach that overcomes limitations of fixed reward assignments and constrained flexibility in implicit reward regularization.
-
21 Jan 2025 1 repository listedMulti-Agent Reinforcement Learning (MARL) has gained significant traction for solving complex real-world tasks, but the inherent stochasticity and uncertainty in these environments pose substantial challenges to…
-
3 Jan 2025 1 repository listed Syntology official (archive's flag): 2 ran · 3 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)Additionally, we provide a clear interpretation of the learned policy by leveraging the distribution of returns in DRL and the decomposition of static coherent risk measures.
-
22 Aug 2024 1 repository listedHowever, these risk measures depend on the accurate estimation of extreme quantiles in the loss distribution's tail, which can be imprecise in QR-based DRL due to the rarity and extremity of tail data, as highlighted in…
-
CTD4 -- A Deep Continuous Distributional Actor-Critic Agent with a Kalman Fusion of Multiple Critics4 May 2024 1 repository listedCategorical Distributional Reinforcement Learning (CDRL) has demonstrated superior sample efficiency in learning complex tasks compared to conventional Reinforcement Learning (RL) approaches.
-
13 Feb 2024 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified (of 4 harvested samples)This paper contributes a new approach for distributional reinforcement learning which elucidates a clean separation of transition structure and reward in the learning process.
-
11 Feb 2024 1 repository listedWe present a novel statistical approach to incorporating uncertainty awareness in model-free distributional reinforcement learning involving quantile regression-based deep Q networks.
-
2 Feb 2024 1 repository listedIn contrast, we study the more manageable expectation-extended statistical distances and provide a novel theoretical justification on their validity for learning the return distribution.
-
4 Jan 2024 1 repository listedDistributional Reinforcement Learning (RL) estimates return distribution mainly by learning quantile values via minimizing the quantile Huber loss function, entailing a threshold parameter often selected heuristically…
-
9 Dec 2023 1 repository listedWe propose a novel algorithmic framework for distributional reinforcement learning, based on learning finite-dimensional mean embeddings of return distributions.
-
29 Sep 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 2 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 4 pointer-only (licence)This implies the distributional policy evaluation problem can be solved with sample efficiency.
-
12 Aug 2023 1 repository listedQuantifying uncertainty about a policy's long-term performance is important to solve sequential decision-making tasks.
-
30 Jul 2023 1 repository listedAlthough distributional reinforcement learning (DRL) has been widely examined in the past few years, very few studies investigate the validity of the obtained Q-function estimator in the distributional setting.
-
4 Jul 2023 1 repository listedWe consider the problem of learning models for risk-sensitive reinforcement learning.
-
25 May 2023 1 repository listed Syntology official: harvested, nothing ran · 0 ran · 1 unverified (of 1 harvested sample) · 1 pointer-only (licence)In online RL, we propose a DistRL algorithm that constructs confidence sets using maximum likelihood estimation.
-
22 Feb 2023 1 repository listedWe propose a novel, interpretable trajectory tracker integrating a Distributional Reinforcement Learning disturbance estimator for unknown aerodynamic effects with a Stochastic Model Predictive Controller (SMPC).
-
3 Feb 2023 1 repository listedWe introduce Distributional Constrained Policy Optimization (DCPO), a novel approach for reliable constraint satisfaction in RL.
-
26 Jan 2023 1 repository listed Syntology official (archive's flag): 3 ran · 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified (of 4 harvested samples) · 3 pointer-only (licence)In safety-critical robotic tasks, potential failures must be reduced, and multiple constraints must be met, such as avoiding collisions, limiting energy consumption, and maintaining balance.
-
30 Dec 2022 1 repository listedClassical reinforcement learning (RL) techniques are generally concerned with the design of decision-making policies driven by the maximisation of the expected outcome.
-
17 Oct 2022 1 repository listedIn this paper, we propose a framework for intelligent vehicles to conduct JRC, with minimal prior knowledge of the system model and a tunable performance balance, in an environment where surrounding vehicles execute…
-
13 Jun 2022 1 repository listedIn this work, we build recent advances in distributional reinforcement learning to give a state-of-art distributional variant of the model based on the IQN.
-
10 May 2022 1 repository listedWe show how D4PG can be used in conjunction with quantile regression to develop a hedging strategy for a trader responsible for derivatives that arrive stochastically and depend on a single underlying asset.
-
28 Mar 2022 1 repository listed
-
1 Feb 2022 1 repository listed
-
14 Dec 2021 1 repository listed
-
12 Nov 2021 1 repository listed
-
1 Oct 2021 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples)
-
17 Sep 2021 1 repository listed
-
12 Jul 2021 1 repository listed Syntology official (archive's flag): 4 ran · 4 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified (of 5 harvested samples) · 5 pointer-only (licence)
-
6 Jun 2021 1 repository listed
-
21 Jan 2021 1 repository listed Syntology official: no sample here; runs from other or unrecorded repositories · 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified (of 1 harvested sample) · 1 pointer-only (licence)
-
24 Jul 2020 1 repository listed Syntology official (archive's flag): 2 ran · 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified (of 2 harvested samples) · 2 pointer-only (licence)
-
18 Dec 2019 1 repository listed Syntology official (archive's flag): 5 ran · 5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified (of 7 harvested samples)
-
18 Dec 2018 1 repository listed
-
13 May 2018 1 repository listed
-
Distributional Reinforcement Learning on Path-dependent Options16 Jul 2025 0 repositories listed
-
Second-Order Bounds for [0,1]-Valued Regression via Betting Loss16 Jul 2025 0 repositories listed
-
CTRLS: Chain-of-Thought Reasoning via Latent State-Transition10 Jul 2025 0 repositories listed
-
A Point-Based Algorithm for Distributional Reinforcement Learning in Partially Observable Domains10 May 2025 0 repositories listed
-
Flow Models for Unbounded and Geometry-Aware Distributional Reinforcement Learning7 May 2025 0 repositories listed
-
Deep Distributional Learning with Non-crossing Quantile Network11 Apr 2025 0 repositories listed
-
Offline and Distributional Reinforcement Learning for Wireless Communications4 Apr 2025 0 repositories listed
-
Adaptive Nesterov Accelerated Distributional Deep Hedging for Efficient Volatility Risk Management25 Feb 2025 0 repositories listed
-
A Finite Sample Analysis of Distributional TD Learning with Linear Function Approximation20 Feb 2025 0 repositories listed
-
Robust Probabilistic Model Checking with Continuous Reward Domains6 Feb 2025 0 repositories listed
-
Risk-averse policies for natural gas futures trading using distributional reinforcement learning8 Jan 2025 0 repositories listed
-
Hedging and Pricing Structured Products Featuring Multiple Underlying Assets2 Nov 2024 0 repositories listed
-
Bellman Diffusion: Generative Modeling as Learning a Linear Operator in the Distribution Space2 Oct 2024 0 repositories listed
-
Offline and Distributional Reinforcement Learning for Radio Resource Management25 Sep 2024 0 repositories listed
-
Foundations of Multivariate Distributional Reinforcement Learning31 Aug 2024 0 repositories listed
-
Bellman Unbiasedness: Toward Provably Efficient Distributional Reinforcement Learning with General Value Function Approximation31 Jul 2024 0 repositories listed
-
On Policy Evaluation Algorithms in Distributional Reinforcement Learning19 Jul 2024 0 repositories listed
-
PG-Rainbow: Using Distributional Reinforcement Learning in Policy Gradient Methods18 Jul 2024 0 repositories listed
-
Policy Gradient Methods for Risk-Sensitive Distributional Reinforcement Learning with Provable Convergence23 May 2024 0 repositories listed
-
Statistical Efficiency of Distributional Temporal Difference Learning and Freedman's Inequality in Hilbert Spaces9 Mar 2024 0 repositories listed
-
Provable Risk-Sensitive Distributional Reinforcement Learning with General Function Approximation28 Feb 2024 0 repositories listed
-
Uncertainty-Aware Transient Stability-Constrained Preventive Redispatch: A Distributional Reinforcement Learning Approach14 Feb 2024 0 repositories listed
-
Near-Minimax-Optimal Distributional Reinforcement Learning with a Generative Model12 Feb 2024 0 repositories listed
-
More Benefits of Being Distributional: Second-Order Bounds for Reinforcement Learning11 Feb 2024 0 repositories listed
-
Distributional Reinforcement Learning-based Energy Arbitrage Strategies in Imbalance Settlement Mechanism23 Dec 2023 0 repositories listed
-
Noise Distribution Decomposition based Multi-Agent Distributional Reinforcement Learning12 Dec 2023 0 repositories listed
-
An introduction to reinforcement learning for neuroscience13 Nov 2023 0 repositories listed
-
Beyond Average Return in Markov Decision Processes31 Oct 2023 0 repositories listed
-
Pitfall of Optimism: Distributional Reinforcement Learning by Randomizing Risk Criterion25 Oct 2023 0 repositories listed
-
Distributional Reinforcement Learning with Online Risk-awareness Adaption8 Oct 2023 0 repositories listed
-
Learning Risk-Aware Quadrupedal Locomotion using Distributional Reinforcement Learning25 Sep 2023 0 repositories listed
-
Deep Reinforcement Learning for Artificial Upwelling Energy Management20 Aug 2023 0 repositories listed
-
Cramer Type Distances for Learning Gaussian Mixture Models by Gradient Descent13 Jul 2023 0 repositories listed
-
Is Risk-Sensitive Reinforcement Learning Properly Resolved?2 Jul 2023 0 repositories listed
-
Diverse Projection Ensembles for Distributional Reinforcement Learning12 Jun 2023 0 repositories listed
-
PACER: A Fully Push-forward-based Distributional Reinforcement Learning Algorithm11 Jun 2023 0 repositories listed
-
Improving the generalizability and robustness of large-scale traffic signal control2 Jun 2023 0 repositories listed
-
The Statistical Benefits of Quantile Temporal-Difference Learning for Value Estimation28 May 2023 0 repositories listed
-
Distributional Reinforcement Learning with Dual Expectile-Quantile Regression26 May 2023 0 repositories listed
-
One-Step Distributional Reinforcement Learning27 Apr 2023 0 repositories listed
-
Policy Evaluation in Distributional LQR23 Mar 2023 0 repositories listed
-
Toward Risk-based Optimistic Exploration for Cooperative Multi-Agent Reinforcement Learning3 Mar 2023 0 repositories listed
-
Multi-compartment Neuron and Population Encoding Powered Spiking Neural Network for Deep Distributional Reinforcement Learning18 Jan 2023 0 repositories listed
-
An Analysis of Quantile Temporal-Difference Learning11 Jan 2023 0 repositories listed
-
Invariance to Quantile Selection in Distributional Continuous Control29 Dec 2022 0 repositories listed
-
Bridging Distributional and Risk-sensitive Reinforcement Learning with Provable Regret Bounds25 Oct 2022 0 repositories listed
-
How Does Return Distribution in Distributional Reinforcement Learning Help Optimization?29 Sep 2022 0 repositories listed
-
Normality-Guided Distributional Reinforcement Learning for Continuous Control28 Aug 2022 0 repositories listed
-
The Nature of Temporal Difference Errors in Multi-step Distributional Reinforcement Learning15 Jul 2022 0 repositories listed
-
Risk Perspective Exploration in Distributional Reinforcement Learning28 Jun 2022 0 repositories listed
-
Robust Reinforcement Learning with Distributional Risk-averse formulation14 Jun 2022 0 repositories listed
-
A Simulation Environment and Reinforcement Learning Method for Waste Reduction30 May 2022 0 repositories listed
-
Interpretable Stochastic Model Predictive Control using Distributional Reinforced Estimation for Quadrotor Tracking Systems14 May 2022 0 repositories listed
-
Distributional Reinforcement Learning for Scheduling of Chemical Production Processes1 Mar 2022 0 repositories listed
-
Exploration with Multi-Sample Target Values for Distributional Reinforcement Learning6 Feb 2022 0 repositories listed
-
On solutions of the distributional Bellman equation31 Jan 2022 0 repositories listed
Syntology lines on 17 of the papers shown; no Syntology record for the others (a paper without an arXiv id cannot be joined to the graph, and absence from the graph layer is not a recorded non-run). “Ran” means the sample executed on a synthesized fixture, not that the paper's result was reproduced; each line links to that paper's sample list. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. For agents: get_harvested_code_for_paper(arxiv_id) lists each paper's samples; how to connect.
Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections