Papers › Dueling Network Architectures for Deep Reinforcement Learning

Dueling Network Architectures for Deep Reinforcement Learning

20 Nov 2015arXiv:1511.06581archive 2025-07-28

Ziyu Wang, Tom Schaul, Matteo Hessel, Hado van Hasselt, Marc Lanctot, Nando de Freitas

In recent years there have been many successes of using deep representations in reinforcement learning. Still, many of these applications use conventional architectures, such as convolutional networks, LSTMs, or auto-encoders. In this paper, we present a new neural network architecture for model-free reinforcement learning. Our dueling network represents two separate estimators: one for the state value function and one for the state-dependent action advantage function. The main benefit of this factoring is to generalize learning across actions without imposing any change to the underlying reinforcement learning algorithm. Our results show that this architecture leads to better policy evaluation in the presence of many similar-valued actions. Moreover, the dueling architecture enables our RL agent to outperform the state-of-the-art on the Atari 2600 domain.

PaperPDFCodeCode Syntology ran

In Syntology View this paper on Syntology, its page in Syntology's graph. That page adds which of its functions are also present in other papers' code Syntology holds, with dates, and its dated run record as JSON and a README badge. It also lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

Syntology 11 code samples harvested from 6 repositories linked to this paper: 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 3 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified. Where Syntology's instrument failed: 1 where our contract draft was wrong; 1 where the contract check could not run; failures of Syntology's instrument, not of the code.

By repository: community (archive-listed): 11 samples from 6 repositories, 7 ran (5 with no instrument failure; 2 where Syntology's instrument failed). The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

No sample is linked to this paper from 32 of its repositories that Syntology harvested for other papers:

Levels written between 2026-09-22 and 2026-09-26 (UTC): the dates Syntology's graph wrote each sample's verification level, not when the code executed.

73 repositories listed; official and paper-mentioned ones first.

170928/-Review-Dueling-Deep-Q-Network mentioned on GitHubtfSyntology: not harvested report
1jsingh/rl_navigation mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified); nothing checks that they implement this paper's method. report
Adrelf/DRL-navigation mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified) and Prioritized Experience Replay (arXiv:1511.05952; that paper's own run record: 80 ran (of which 62 constructed an object rather than computing a result; 72 with no instrument failure: 4 honoured, 0 violated, 68 with no contract checked; 8 where Syntology's instrument failed) · 31 unverified); nothing checks that they implement this paper's method. report
BY571/DQN-Atari-Agents mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
Brandon-Rozek/DeepRL mentioned on GitHubSyntology: not harvested report
Curt-Park/rainbow-is-all-you-need mentioned on GitHubMITSyntology: not harvested report
FaboNo/DRLND mentioned on GitHubpytorchGPL-3.0Syntology: not harvested report
HussonnoisMaxence/RL_Algorithms mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified) and Prioritized Experience Replay (arXiv:1511.05952; that paper's own run record: 80 ran (of which 62 constructed an object rather than computing a result; 72 with no instrument failure: 4 honoured, 0 violated, 68 with no contract checked; 8 where Syntology's instrument failed) · 31 unverified); nothing checks that they implement this paper's method. report
JBGUIMBAUD/deep-reenforcement-learning mentioned on GitHubpytorchSyntology: not harvested report
JuliaPOMDP/DeepQLearning.jl mentioned on GitHubNOASSERTIONSyntology: not harvested report
KDL-umass/saliency_maps mentioned on GitHubSyntology: not harvested report
MEOWMEOW114/nd893-p1-navigation-banana mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified); nothing checks that they implement this paper's method. report
MOVzeroOne/DQN mentioned on GitHubpytorchSyntology: 2 samples, 1 ran (1 instrument-failed) · 1 unverified report
NervanaSystems/coach mentioned on GitHubtfSyntology: not harvested report
OMS1996/Carla_The_RL_Self-Driving-Car mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Prioritized Experience Replay (arXiv:1511.05952; that paper's own run record: 80 ran (of which 62 constructed an object rather than computing a result; 72 with no instrument failure: 4 honoured, 0 violated, 68 with no contract checked; 8 where Syntology's instrument failed) · 31 unverified); nothing checks that they implement this paper's method. report
R-Sweke/DeepQ-Decoding mentioned on GitHubtfGPL-3.0Syntology: not harvested report
SayhoKim/tetrisRL mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Playing Atari with Deep Reinforcement Learning (arXiv:1312.5602; that paper's own run record: 64 ran (of which 24 constructed an object rather than computing a result; 46 with no instrument failure: 5 honoured, 0 violated, 41 with no contract checked; 18 where Syntology's instrument failed) · 53 unverified) and Prioritized Experience Replay (arXiv:1511.05952; that paper's own run record: 80 ran (of which 62 constructed an object rather than computing a result; 72 with no instrument failure: 4 honoured, 0 violated, 68 with no contract checked; 8 where Syntology's instrument failed) · 31 unverified); nothing checks that they implement this paper's method. report
ZainRaza14/deepRL mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Continuous control with deep reinforcement learning (arXiv:1509.02971; that paper's own run record: 163 ran (of which 126 constructed an object rather than computing a result; 152 with no instrument failure: 3 honoured, 0 violated, 149 with no contract checked; 11 where Syntology's instrument failed) · 143 unverified); nothing checks that they implement this paper's method. report
abryeemessi/Wednesday mentioned on GitHubSyntology: not harvested report
alessandrositta/Flatland_challenge mentioned on GitHubpytorchSyntology: not harvested report
atavakol/action-branching-agents mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Prioritized Experience Replay (arXiv:1511.05952; that paper's own run record: 80 ran (of which 62 constructed an object rather than computing a result; 72 with no instrument failure: 4 honoured, 0 violated, 68 with no contract checked; 8 where Syntology's instrument failed) · 31 unverified); nothing checks that they implement this paper's method. report
austinsilveria/Banana-Collection-DQN mentioned on GitHubpytorchSyntology: not harvested report
botforge/simplementation mentioned on GitHubpytorchSyntology: 2 samples, 2 ran (0 instrument-failed) · 0 unverified report
chainer/chainerrl mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to ChainerRL: A Deep Reinforcement Learning Library (arXiv:1912.03905; that paper's own run record: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
clarky104/carla_aebs mentioned on GitHubpytorchApache-2.0Syntology: not harvested report
cocolico14/N-step-Dueling-DDQN-PER-Pacman mentioned on GitHubSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Prioritized Experience Replay (arXiv:1511.05952; that paper's own run record: 80 ran (of which 62 constructed an object rather than computing a result; 72 with no instrument failure: 4 honoured, 0 violated, 68 with no contract checked; 8 where Syntology's instrument failed) · 31 unverified); nothing checks that they implement this paper's method. report
cove9988/TradingGym mentioned on GitHubSyntology: not harvested report
dxyang/DQN_pytorch mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
eddynelson/dqn mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Playing Atari with Deep Reinforcement Learning (arXiv:1312.5602; that paper's own run record: 64 ran (of which 24 constructed an object rather than computing a result; 46 with no instrument failure: 5 honoured, 0 violated, 41 with no contract checked; 18 where Syntology's instrument failed) · 53 unverified) and Prioritized Experience Replay (arXiv:1511.05952; that paper's own run record: 80 ran (of which 62 constructed an object rather than computing a result; 72 with no instrument failure: 4 honoured, 0 violated, 68 with no contract checked; 8 where Syntology's instrument failed) · 31 unverified); nothing checks that they implement this paper's method. report
ethanmclark1/carla_aebs mentioned on GitHubpytorchApache-2.0Syntology: not harvested report
facebookresearch/Horizon mentioned on GitHubpytorchSyntology: not harvested report
facebookresearch/ReAgent mentioned on GitHubpytorchSyntology: not harvested report
fengsterooni/dql mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified); nothing checks that they implement this paper's method. report
gouxiangchen/dueling-DQN-pytorch mentioned on GitHubpytorchSyntology: not harvested report
guillaumeboniface/bananaland mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified); nothing checks that they implement this paper's method. report
hemilpanchiwala/Dueling-Network-Architectures mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified); nothing checks that they implement this paper's method. report
hemilpanchiwala/Dueling_Network_Architectures mentioned on GitHubpytorchSyntology: not harvested report
iDataist/Navigation-with-Deep-Q-Network mentioned on GitHubpytorchMITSyntology: not harvested report
jezzarax/drlnd_p1_navigation mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified); nothing checks that they implement this paper's method. report
jsztompka/DuelDQN mentioned on GitHubpytorchMITSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
kmdanielduan/DQN_Family_PyTorch mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Playing Atari with Deep Reinforcement Learning (arXiv:1312.5602; that paper's own run record: 64 ran (of which 24 constructed an object rather than computing a result; 46 with no instrument failure: 5 honoured, 0 violated, 41 with no contract checked; 18 where Syntology's instrument failed) · 53 unverified), Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified) and Prioritized Experience Replay (arXiv:1511.05952; that paper's own run record: 80 ran (of which 62 constructed an object rather than computing a result; 72 with no instrument failure: 4 honoured, 0 violated, 68 with no contract checked; 8 where Syntology's instrument failed) · 31 unverified); nothing checks that they implement this paper's method. report
kshitij-ingale/Reinforcement-Learning mentioned on GitHubtfSyntology: not harvested report
ku2482/sac-discrete.pytorch mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Prioritized Experience Replay (arXiv:1511.05952; that paper's own run record: 80 ran (of which 62 constructed an object rather than computing a result; 72 with no instrument failure: 4 honoured, 0 violated, 68 with no contract checked; 8 where Syntology's instrument failed) · 31 unverified); nothing checks that they implement this paper's method. report
la3lma/Chez mentioned on GitHubtfSyntology: not harvested report
la3lma/chezjulia mentioned on GitHubtfSyntology: not harvested report
marload/DeepRL-TensorFlow2 mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Playing Atari with Deep Reinforcement Learning (arXiv:1312.5602; that paper's own run record: 64 ran (of which 24 constructed an object rather than computing a result; 46 with no instrument failure: 5 honoured, 0 violated, 41 with no contract checked; 18 where Syntology's instrument failed) · 53 unverified), Continuous control with deep reinforcement learning (arXiv:1509.02971; that paper's own run record: 163 ran (of which 126 constructed an object rather than computing a result; 152 with no instrument failure: 3 honoured, 0 violated, 149 with no contract checked; 11 where Syntology's instrument failed) · 143 unverified), Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified) and 2 more (every one in this page's JSON twin); nothing checks that they implement this paper's method. report
mightypirate1/DRL-Tetris mentioned on GitHubtfGPL-3.0Syntology: not harvested report
mindspore-courses/Rainbow-MindSpore mentioned on GitHubmindsporeSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Prioritized Experience Replay (arXiv:1511.05952; that paper's own run record: 80 ran (of which 62 constructed an object rather than computing a result; 72 with no instrument failure: 4 honoured, 0 violated, 68 with no contract checked; 8 where Syntology's instrument failed) · 31 unverified); nothing checks that they implement this paper's method. report
mohit8935/Deep-Q-Learning-Paper mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified); nothing checks that they implement this paper's method. report
nathanin/pad mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Playing Atari with Deep Reinforcement Learning (arXiv:1312.5602; that paper's own run record: 64 ran (of which 24 constructed an object rather than computing a result; 46 with no instrument failure: 5 honoured, 0 violated, 41 with no contract checked; 18 where Syntology's instrument failed) · 53 unverified); nothing checks that they implement this paper's method. report
nbopardi/smb mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Prioritized Experience Replay (arXiv:1511.05952; that paper's own run record: 80 ran (of which 62 constructed an object rather than computing a result; 72 with no instrument failure: 4 honoured, 0 violated, 68 with no contract checked; 8 where Syntology's instrument failed) · 31 unverified); nothing checks that they implement this paper's method. report
near32/regym mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified) and Proximal Policy Optimization Algorithms (arXiv:1707.06347; that paper's own run record: 99 ran (of which 53 constructed an object rather than computing a result; 71 with no instrument failure: 7 honoured, 2 violated, 62 with no contract checked; 28 where Syntology's instrument failed) · 77 unverified); nothing checks that they implement this paper's method. report
opplieam/Pong-Deep-RL mentioned on GitHubpytorchApache-2.0Syntology: 4 samples, 2 ran (1 instrument-failed) · 2 unverified report
philtabor/Deep-Q-Learning-Paper-To-Code mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified); nothing checks that they implement this paper's method. report
prajwalgatti/DRL-Continuous-Control mentioned on GitHubSyntology: not harvested report
prajwalgatti/DRL-Navigation mentioned on GitHubSyntology: not harvested report
rybread1/DeepRlTrex mentioned on GitHubtfnot reachable when probed 2026-09-18 — repositories for recent papers often appear after camera-readySyntology: not harvested report
rybread1/deep-rl-trex mentioned on GitHubtfnot reachable when probed 2026-09-18 — repositories for recent papers often appear after camera-readySyntology: not harvested report
shashwatsaxena571/DRL-navigation mentioned on GitHubpytorchnot reachable when probed 2026-09-18 — repositories for recent papers often appear after camera-readySyntology: not harvested report
shehrum/RL_Navigation mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified); nothing checks that they implement this paper's method. report
tensorlayer/RLzoo mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Trust Region Policy Optimization (arXiv:1502.05477; that paper's own run record: 7 ran (of which 2 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 10 unverified), Continuous control with deep reinforcement learning (arXiv:1509.02971; that paper's own run record: 163 ran (of which 126 constructed an object rather than computing a result; 152 with no instrument failure: 3 honoured, 0 violated, 149 with no contract checked; 11 where Syntology's instrument failed) · 143 unverified), Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified) and 3 more (every one in this page's JSON twin); nothing checks that they implement this paper's method. report
tensorpack/tensorpack mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Playing Atari with Deep Reinforcement Learning (arXiv:1312.5602; that paper's own run record: 64 ran (of which 24 constructed an object rather than computing a result; 46 with no instrument failure: 5 honoured, 0 violated, 41 with no contract checked; 18 where Syntology's instrument failed) · 53 unverified), Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networks (arXiv:1511.06434; that paper's own run record: 128 ran (of which 61 constructed an object rather than computing a result; 111 with no instrument failure: 3 honoured, 0 violated, 108 with no contract checked; 17 where Syntology's instrument failed) · 91 unverified) and Improved Training of Wasserstein GANs (arXiv:1704.00028; that paper's own run record: 27 ran (of which 10 constructed an object rather than computing a result; 19 with no instrument failure: 1 honoured, 0 violated, 18 with no contract checked; 8 where Syntology's instrument failed) · 22 unverified); nothing checks that they implement this paper's method. report
utarumo/RL_implementation mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified); nothing checks that they implement this paper's method. report
wtingda/DeepRLBreakout mentioned on GitHubtfMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Asynchronous Methods for Deep Reinforcement Learning (arXiv:1602.01783; that paper's own run record: 60 ran (of which 20 constructed an object rather than computing a result; 50 with no instrument failure: 2 honoured, 1 violated, 47 with no contract checked; 10 where Syntology's instrument failed) · 35 unverified); nothing checks that they implement this paper's method. report
xusophia/DataSciFinalProj mentioned on GitHubpytorchSyntology: not harvested report
zynk13/dueling-dqn-Reinforcement-learning mentioned on GitHubSyntology: not harvested report
chandar-lab/RLHive pytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Playing Atari with Deep Reinforcement Learning (arXiv:1312.5602; that paper's own run record: 64 ran (of which 24 constructed an object rather than computing a result; 46 with no instrument failure: 5 honoured, 0 violated, 41 with no contract checked; 18 where Syntology's instrument failed) · 53 unverified) and Prioritized Experience Replay (arXiv:1511.05952; that paper's own run record: 80 ran (of which 62 constructed an object rather than computing a result; 72 with no instrument failure: 4 honoured, 0 violated, 68 with no contract checked; 8 where Syntology's instrument failed) · 31 unverified); nothing checks that they implement this paper's method. report
labmlai/annotated_deep_learning_paper_implementations pytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Playing Atari with Deep Reinforcement Learning (arXiv:1312.5602; that paper's own run record: 64 ran (of which 24 constructed an object rather than computing a result; 46 with no instrument failure: 5 honoured, 0 violated, 41 with no contract checked; 18 where Syntology's instrument failed) · 53 unverified), Adam: A Method for Stochastic Optimization (arXiv:1412.6980; that paper's own run record: 27 ran (of which 7 constructed an object rather than computing a result; 23 with no instrument failure: 4 honoured, 2 violated, 17 with no contract checked; 4 where Syntology's instrument failed) · 10 unverified), Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift (arXiv:1502.03167; that paper's own run record: 19 ran (of which 5 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified) and 12 more (every one in this page's JSON twin); nothing checks that they implement this paper's method. report
opendilab/DI-engine pytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Hindsight Experience Replay (arXiv:1707.01495; that paper's own run record: 16 ran (of which 10 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified), Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context (arXiv:1901.02860; that paper's own run record: 67 ran (of which 37 constructed an object rather than computing a result; 49 with no instrument failure: 4 honoured, 1 violated, 44 with no contract checked; 18 where Syntology's instrument failed) · 76 unverified), Decision Transformer: Reinforcement Learning via Sequence Modeling (arXiv:2106.01345; that paper's own run record: 17 ran (of which 10 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified) and 1 more (every one in this page's JSON twin); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

11 samples harvested: 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 3 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified. “Where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. That date is not when the samples ran.

3ran · honoured contract
1ran · our draft was wrong
1ran; the contract check could not run
2ran
4unverified

Licence: 7 of the 11 samples are pointer only, meaning Syntology does not serve that copy's text. For 1 of them, this paper's copy is under a permissive licence and cleared, but the stored copy of the same code that Syntology serves is not; the licence label's tooltip gives Syntology's recorded reason. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 6 repositories linked to this paper, official or community; the list below is grouped by repository, each group headed by its name and what it is to the paper. 1 sample whose link to this paper records no repository is listed under one of this paper's own repositories, because identical code was harvested from it for another paper. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. A line beginning “fixture:” under a sample that ran gives the arguments Syntology's fixture called the sample with, each as name:type/rank/element kind (? where none was recorded), and the type of what the fixture's run returned, exactly as the harness recorded them; the arguments and the returned type were recorded by two separate runs of the same fixture. No output value is shown, and a returned type says nothing about whether the output was right. “Level recorded” gives the UTC date when Syntology's graph wrote the sample's verification level, not when the code executed; where the level was written before Syntology's graph kept that date, the row says “level recorded, date not recorded”. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself. “Our draft was wrong” and “the contract check could not run” are failures of Syntology's instrument, not of the code: the sample ran on Syntology's synthesized input, and then the drafted contract did not describe it, or the check itself raised an error (RAISES), lacked a dependency (DEP_MISSING) or ran out of time (TIMEOUT); hover the label for which. A metamorphic tier, where shown, is evidence of the output's shape, not that the sample implements the method.

Each sample ends with its code_sha256. A sample's code_sha256 is Syntology's identity for that exact code. It is printed in full (16 hexadecimal characters for every sample in this build), and get_code(code_sha256="…") takes it exactly as printed. An agent calls it on Syntology's MCP service (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples are grouped by repository: a repository marked official first, then by how directly the repository is tied to the paper, then in the archive's order; never by how many ran. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of six reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar); this paper's copy was not located, so its licence is not recorded; or this paper's copy is cleared, but the stored copy of the same code that Syntology serves is not. Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

A function or class name links to its page when the name occurs in the harvested code of at least 5 papers; the name is a string, not an identity. A census tag appears when Syntology's census ran implementations with that name on one shared input per bucket: it gives how many were compared, from how many papers, and how many distinct outputs they produced, and names this sample's bucket when this sample was one of them.

BY571/DQN-Atari-Agents community (archive-listed) 1 sample, 0 ran · 1 unverified
run in 143 papers run_atari_dqn.py identical code Syntology harvested from this repository for another paper; this paper's link records no repository, path or licence of its own unverified licence of this copy not recorded · 34182f569fae27fe · report
MOVzeroOne/DQN community (archive-listed) 2 samples, 1 ran (1 instrument-failed) · 1 unverified
observation_converter src/run_model.py ran; the contract check could not run (RAISES) no licence file found · pointer only · 833c1425c5723274 · report fixture: returned Tensor · level recorded 2026-09-22
choose_action in 6 papers src/run_model.py unverified no licence file found · pointer only · 2bd713d31dc46902 · report
botforge/simplementation community (archive-listed) 2 samples, 2 ran (0 instrument-failed) · 0 unverified
epsilon_at_t 3.DUELING-DQN_Dueling-Network-Architectures-for-Deep-Reinforcement-Learning-Wang-etal-2016/dueling-dqn_atari.py ran · honoured contract fingerprinted no licence file found · pointer only · 6adde85b00312c5e · report fixture: signature t:int/0/int · returned float · level recorded 2026-09-22
epsilon_at_t 3.DUELING-DQN_Dueling-Network-Architectures-for-Deep-Reinforcement-Learning-Wang-etal-2016/dueling-dqn_cart-pole.py ran · honoured contract fingerprinted no licence file found · pointer only · a2b004f06bf87d09 · report fixture: signature t:int/0/int · returned float · level recorded 2026-09-22
dxyang/DQN_pytorch community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
sample_n_unique utils/replay_buffer.py ran · honoured contract no licence file found · pointer only · 7075d6afeb7b8d73 · report fixture: signature sampling_f:callable/0/?, n:int/0/int · returned list · level recorded 2026-09-22
jsztompka/DuelDQN community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
huber_loss in 34 papers
census: 6 implementations from 7 papers, 5 distinct outputs across 5 buckets, one shared input per bucket
custom_loss.py ran fingerprinted MIT (permissive) · 1248c71a0df5e5fa · report fixture: signature input:Tensor/2/float, target:Tensor/2/float, weights:Tensor/2/float · returned Tensor · level recorded 2026-09-26
opplieam/Pong-Deep-RL community (archive-listed) 4 samples, 2 ran (1 instrument-failed) · 2 unverified
make_atari in 17 papers atari_wrappers.py ran · our draft was wrong Apache-2.0 (permissive) here; the stored copy is pointer only · c8ff0fd6f22e92e8 · report fixture: signature env_id:str/0/str · returned MaxAndSkipEnv · level recorded 2026-09-24
preprocess_frame utils.py ran fingerprinted Apache-2.0 (permissive) · d1bb8929c5088f8a · report fixture: signature frame:ndarray/2/float · returned Tensor · level recorded 2026-09-26
calculate_epsilon utils.py unverified Apache-2.0 (permissive) · e1f9d6790a63ec62 · report
wrap_deepmind in 17 papers atari_wrappers.py unverified Apache-2.0 (permissive) · 72ea138169370d83 · report

Tasks

Atari GamesDeep Reinforcement LearningReinforcement LearningReinforcement Learning (RL)reinforcement-learning

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Atari Games Atari 2600 Alien Duel noop Score 4461.4 #20 of 49 Archive leaderboard report
Atari Games Atari 2600 Alien Prior+Duel noop Score 3941.0 #23 of 49 Archive leaderboard report
Atari Games Atari 2600 Alien DDQN (tuned) noop Score 3747.7 #24 of 49 Archive leaderboard report
Atari Games Atari 2600 Alien Duel hs Score 1486.5 #33 of 49 Archive leaderboard report
Atari Games Atari 2600 Alien Prior+Duel hs Score 823.7 #43 of 49 Archive leaderboard report
Atari Games Atari 2600 Amidar Duel noop Score 2354.5 #9 of 48 Archive leaderboard report
Atari Games Atari 2600 Amidar Prior+Duel noop Score 2296.8 #10 of 48 Archive leaderboard report
Atari Games Atari 2600 Amidar DDQN (tuned) noop Score 1793.3 #13 of 48 Archive leaderboard report
Atari Games Atari 2600 Amidar Prior+Duel hs Score 238.4 #35 of 48 Archive leaderboard report
Atari Games Atari 2600 Amidar Duel hs Score 172.7 #43 of 48 Archive leaderboard report
Atari Games Atari 2600 Assault Prior+Duel noop Score 11477.0 #15 of 45 Archive leaderboard report
Atari Games Atari 2600 Assault Prior+Duel hs Score 10950.6 #18 of 45 Archive leaderboard report
Atari Games Atari 2600 Assault DDQN (tuned) noop Score 5393.2 #28 of 45 Archive leaderboard report
Atari Games Atari 2600 Assault Duel noop Score 4621.0 #29 of 45 Archive leaderboard report
Atari Games Atari 2600 Assault Duel hs Score 3994.8 #31 of 45 Archive leaderboard report
Atari Games Atari 2600 Asterix Prior+Duel noop Score 375080.0 #10 of 49 Archive leaderboard report
Atari Games Atari 2600 Asterix Prior+Duel hs Score 364200.0 #12 of 49 Archive leaderboard report
Atari Games Atari 2600 Asterix Duel noop Score 28188.0 #23 of 49 Archive leaderboard report
Atari Games Atari 2600 Asterix DDQN (tuned) noop Score 17356.5 #32 of 49 Archive leaderboard report
Atari Games Atari 2600 Asterix Duel hs Score 15840.0 #35 of 49 Archive leaderboard report
Atari Games Atari 2600 Asteroids Duel noop Score 2837.7 #22 of 43 Archive leaderboard report
Atari Games Atari 2600 Asteroids Duel hs Score 2035.4 #26 of 43 Archive leaderboard report
Atari Games Atari 2600 Asteroids Prior+Duel noop Score 1192.7 #37 of 43 Archive leaderboard report
Atari Games Atari 2600 Asteroids DDQN (tuned) noop Score 734.7 #42 of 43 Archive leaderboard report
Atari Games Atari 2600 Atlantis Duel hs Score 445360.0 #26 of 42 Archive leaderboard report
Atari Games Atari 2600 Atlantis Prior+Duel noop Score 395762.0 #28 of 42 Archive leaderboard report
Atari Games Atari 2600 Atlantis Duel noop Score 382572.0 #29 of 42 Archive leaderboard report
Atari Games Atari 2600 Atlantis DDQN (tuned) noop Score 106056.0 #38 of 42 Archive leaderboard report
Atari Games Atari 2600 Bank Heist Duel noop Score 1611.9 #5 of 45 Archive leaderboard report
Atari Games Atari 2600 Bank Heist Prior+Duel noop Score 1503.1 #6 of 45 Archive leaderboard report
Atari Games Atari 2600 Bank Heist Duel hs Score 1129.3 #20 of 45 Archive leaderboard report
Atari Games Atari 2600 Bank Heist DDQN (tuned) noop Score 1030.6 #24 of 45 Archive leaderboard report
Atari Games Atari 2600 Battle Zone Duel noop Score 37150.0 #18 of 47 Archive leaderboard report
Atari Games Atari 2600 Battle Zone Prior+Duel noop Score 35520.0 #19 of 47 Archive leaderboard report
Atari Games Atari 2600 Battle Zone DDQN (tuned) noop Score 31700.0 #22 of 47 Archive leaderboard report
Atari Games Atari 2600 Battle Zone Duel hs Score 31320.0 #24 of 47 Archive leaderboard report
Atari Games Atari 2600 Beam Rider Prior+Duel noop Score 30276.5 #14 of 49 Archive leaderboard report
Atari Games Atari 2600 Beam Rider Duel hs Score 14591.3 #25 of 49 Archive leaderboard report
Atari Games Atari 2600 Beam Rider DDQN (tuned) noop Score 13772.8 #27 of 49 Archive leaderboard report
Atari Games Atari 2600 Beam Rider Duel noop Score 12164.0 #30 of 49 Archive leaderboard report
Atari Games Atari 2600 Berzerk Prior+Duel noop Score 3409.0 #11 of 39 Archive leaderboard report
Atari Games Atari 2600 Berzerk Duel noop Score 1472.6 #20 of 39 Archive leaderboard report
Atari Games Atari 2600 Berzerk DDQN (tuned) noop Score 1225.4 #24 of 39 Archive leaderboard report
Atari Games Atari 2600 Berzerk Duel hs Score 910.6 #29 of 39 Archive leaderboard report
Atari Games Atari 2600 Bowling DDQN (tuned) noop Score 68.1 #20 of 44 Archive leaderboard report
Atari Games Atari 2600 Bowling Duel hs Score 65.7 #21 of 44 Archive leaderboard report
Atari Games Atari 2600 Bowling Duel noop Score 65.5 #22 of 44 Archive leaderboard report
Atari Games Atari 2600 Bowling Prior+Duel noop Score 46.7 #34 of 44 Archive leaderboard report
Atari Games Atari 2600 Boxing Duel noop Score 99.4 #16 of 45 Archive leaderboard report
Atari Games Atari 2600 Boxing Prior+Duel noop Score 98.9 #19 of 45 Archive leaderboard report
Atari Games Atari 2600 Boxing DDQN (tuned) noop Score 91.6 #29 of 45 Archive leaderboard report
Atari Games Atari 2600 Boxing Duel hs Score 77.3 #32 of 45 Archive leaderboard report
Atari Games Atari 2600 Breakout DDQN (tuned) noop Score 418.5 #25 of 58 Archive leaderboard report
Atari Games Atari 2600 Breakout Duel hs Score 411.6 #26 of 58 Archive leaderboard report
Atari Games Atari 2600 Breakout Prior+Duel noop Score 366.0 #32 of 58 Archive leaderboard report
Atari Games Atari 2600 Breakout Duel noop Score 345.3 #37 of 58 Archive leaderboard report
Atari Games Atari 2600 Centipede Prior+Duel noop Score 7687.5 #23 of 45 Archive leaderboard report
Atari Games Atari 2600 Centipede Duel noop Score 7561.4 #25 of 45 Archive leaderboard report
Atari Games Atari 2600 Centipede DDQN (tuned) noop Score 5409.4 #29 of 45 Archive leaderboard report
Atari Games Atari 2600 Centipede Duel hs Score 4881.0 #30 of 45 Archive leaderboard report
Atari Games Atari 2600 Chopper Command Prior+Duel noop Score 13185.0 #17 of 45 Archive leaderboard report
Atari Games Atari 2600 Chopper Command Duel noop Score 11215.0 #19 of 45 Archive leaderboard report
Atari Games Atari 2600 Chopper Command DDQN (tuned) noop Score 5809.0 #29 of 45 Archive leaderboard report
Atari Games Atari 2600 Chopper Command Duel hs Score 3784.0 #36 of 45 Archive leaderboard report
Atari Games Atari 2600 Crazy Climber Prior+Duel noop Score 162224.0 #14 of 49 Archive leaderboard report
Atari Games Atari 2600 Crazy Climber Duel noop Score 143570.0 #18 of 49 Archive leaderboard report
Atari Games Atari 2600 Crazy Climber Duel hs Score 124566.0 #28 of 49 Archive leaderboard report
Atari Games Atari 2600 Crazy Climber DDQN (tuned) noop Score 117282.0 #32 of 49 Archive leaderboard report
Atari Games Atari 2600 Defender Duel noop Score 42214.0 #16 of 21 Archive leaderboard report
Atari Games Atari 2600 Defender Prior+Duel noop Score 41324.5 #17 of 21 Archive leaderboard report
Atari Games Atari 2600 Defender Prior+Duel hs Score 34415.0 #19 of 21 Archive leaderboard report
Atari Games Atari 2600 Demon Attack Prior+Duel noop Score 72878.6 #23 of 46 Archive leaderboard report
Atari Games Atari 2600 Demon Attack Duel noop Score 60813.3 #31 of 46 Archive leaderboard report
Atari Games Atari 2600 Demon Attack DDQN (tuned) noop Score 58044.2 #32 of 46 Archive leaderboard report
Atari Games Atari 2600 Demon Attack Duel hs Score 56322.8 #33 of 46 Archive leaderboard report
Atari Games Atari 2600 Double Dunk Duel noop Score 0.1 #22 of 43 Archive leaderboard report
Atari Games Atari 2600 Double Dunk Duel hs Score -0.8 #31 of 43 Archive leaderboard report
Atari Games Atari 2600 Double Dunk DDQN (tuned) noop Score -5.5 #32 of 43 Archive leaderboard report
Atari Games Atari 2600 Double Dunk Prior+Duel noop Score -12.5 #36 of 43 Archive leaderboard report
Atari Games Atari 2600 Enduro Prior+Duel noop Score 2306.4 #11 of 48 Archive leaderboard report
Atari Games Atari 2600 Enduro Duel noop Score 2258.2 #12 of 48 Archive leaderboard report
Atari Games Atari 2600 Enduro Duel hs Score 2077.4 #18 of 48 Archive leaderboard report
Atari Games Atari 2600 Enduro DDQN (tuned) noop Score 1211.8 #28 of 48 Archive leaderboard report
Atari Games Atari 2600 Fishing Derby Duel noop Score 46.4 #13 of 44 Archive leaderboard report
Atari Games Atari 2600 Fishing Derby Prior+Duel noop Score 41.3 #17 of 44 Archive leaderboard report
Atari Games Atari 2600 Fishing Derby DDQN (tuned) noop Score 15.5 #30 of 44 Archive leaderboard report
Atari Games Atari 2600 Fishing Derby Duel hs Score -4.1 #40 of 44 Archive leaderboard report
Atari Games Atari 2600 Freeway DDQN (tuned) noop Score 33.3 #17 of 59 Archive leaderboard report
Atari Games Atari 2600 Freeway Prior+Duel noop Score 33.0 #19 of 59 Archive leaderboard report
Atari Games Atari 2600 Freeway Duel hs Score 0.2 #53 of 59 Archive leaderboard report
Atari Games Atari 2600 Freeway Duel noop Score 0.0 #57 of 59 Archive leaderboard report
Atari Games Atari 2600 Frostbite Prior+Duel noop Score 7413.0 #13 of 53 Archive leaderboard report
Atari Games Atari 2600 Frostbite Duel noop Score 4672.8 #16 of 53 Archive leaderboard report
Atari Games Atari 2600 Frostbite Duel hs Score 2332.4 #29 of 53 Archive leaderboard report
Atari Games Atari 2600 Frostbite DDQN (tuned) noop Score 1683.3 #32 of 53 Archive leaderboard report
Atari Games Atari 2600 Gopher Prior+Duel noop Score 104368.2 #11 of 43 Archive leaderboard report
Atari Games Atari 2600 Gopher Duel hs Score 20051.4 #23 of 43 Archive leaderboard report
Atari Games Atari 2600 Gopher Duel noop Score 15718.4 #26 of 43 Archive leaderboard report
Atari Games Atari 2600 Gopher DDQN (tuned) noop Score 14840.8 #28 of 43 Archive leaderboard report
Atari Games Atari 2600 Gravitar Duel noop Score 588.0 #27 of 53 Archive leaderboard report
Atari Games Atari 2600 Gravitar DDQN (tuned) noop Score 412.0 #38 of 53 Archive leaderboard report
Atari Games Atari 2600 Gravitar Duel hs Score 297.0 #45 of 53 Archive leaderboard report
Atari Games Atari 2600 Gravitar Prior+Duel noop Score 238.0 #50 of 53 Archive leaderboard report
Atari Games Atari 2600 HERO Prior+Duel noop Score 21036.5 #25 of 44 Archive leaderboard report
Atari Games Atari 2600 HERO Duel noop Score 20818.2 #28 of 44 Archive leaderboard report
Atari Games Atari 2600 HERO DDQN (tuned) noop Score 20130.2 #30 of 44 Archive leaderboard report
Atari Games Atari 2600 HERO Duel hs Score 15207.9 #33 of 44 Archive leaderboard report
Atari Games Atari 2600 Ice Hockey Duel noop Score 0.5 #17 of 43 Archive leaderboard report
Atari Games Atari 2600 Ice Hockey Duel hs Score -1.3 #25 of 43 Archive leaderboard report
Atari Games Atari 2600 Ice Hockey DDQN (tuned) noop Score -2.7 #26 of 43 Archive leaderboard report
Atari Games Atari 2600 Ice Hockey Prior+Duel noop Score -0.4 #30 of 43 Archive leaderboard report
Atari Games Atari 2600 James Bond DDQN (tuned) noop Score 1358.0 #20 of 45 Archive leaderboard report
Atari Games Atari 2600 James Bond Duel noop Score 1312.5 #21 of 45 Archive leaderboard report
Atari Games Atari 2600 James Bond Duel hs Score 835.5 #25 of 45 Archive leaderboard report
Atari Games Atari 2600 James Bond Prior+Duel noop Score 812.0 #26 of 45 Archive leaderboard report
Atari Games Atari 2600 Kangaroo Duel noop Score 14854.0 #8 of 47 Archive leaderboard report
Atari Games Atari 2600 Kangaroo DDQN (tuned) noop Score 12992.0 #18 of 47 Archive leaderboard report
Atari Games Atari 2600 Kangaroo Duel hs Score 10334.0 #25 of 47 Archive leaderboard report
Atari Games Atari 2600 Kangaroo Prior+Duel noop Score 1792.0 #34 of 47 Archive leaderboard report
Atari Games Atari 2600 Krull Duel noop Score 11451.9 #11 of 45 Archive leaderboard report
Atari Games Atari 2600 Krull Prior+Duel noop Score 10374.4 #18 of 45 Archive leaderboard report
Atari Games Atari 2600 Krull Duel hs Score 8051.6 #30 of 45 Archive leaderboard report
Atari Games Atari 2600 Krull DDQN (tuned) noop Score 7920.5 #31 of 45 Archive leaderboard report
Atari Games Atari 2600 Kung-Fu Master Prior+Duel noop Score 48375.0 #17 of 43 Archive leaderboard report
Atari Games Atari 2600 Kung-Fu Master Duel noop Score 34294.0 #28 of 43 Archive leaderboard report
Atari Games Atari 2600 Kung-Fu Master DDQN (tuned) noop Score 29710.0 #33 of 43 Archive leaderboard report
Atari Games Atari 2600 Kung-Fu Master Duel hs Score 24288.0 #37 of 43 Archive leaderboard report
Atari Games Atari 2600 Montezuma's Revenge Duel hs Score 22.0 #38 of 50 Archive leaderboard report
Atari Games Atari 2600 Ms. Pacman Duel noop Score 6283.5 #15 of 47 Archive leaderboard report
Atari Games Atari 2600 Ms. Pacman Prior+Duel noop Score 3327.3 #26 of 47 Archive leaderboard report
Atari Games Atari 2600 Ms. Pacman DDQN (tuned) noop Score 2711.4 #29 of 47 Archive leaderboard report
Atari Games Atari 2600 Ms. Pacman Duel hs Score 2250.6 #34 of 47 Archive leaderboard report
Atari Games Atari 2600 Name This Game Prior+Duel noop Score 15572.5 #15 of 43 Archive leaderboard report
Atari Games Atari 2600 Name This Game Duel noop Score 11971.1 #24 of 43 Archive leaderboard report
Atari Games Atari 2600 Name This Game Duel hs Score 11185.1 #26 of 43 Archive leaderboard report
Atari Games Atari 2600 Name This Game DDQN (tuned) noop Score 10616.0 #28 of 43 Archive leaderboard report
Atari Games Atari 2600 Phoenix Prior+Duel hs Score 63597.0 #13 of 21 Archive leaderboard report
Atari Games Atari 2600 Pong Duel noop Score 21.0 #1 of 52 Archive leaderboard report
Atari Games Atari 2600 Pong DDQN (tuned) noop Score 20.9 #17 of 52 Archive leaderboard report
Atari Games Atari 2600 Pong Prior+Duel noop Score 20.9 #18 of 52 Archive leaderboard report
Atari Games Atari 2600 Pong Duel hs Score 18.8 #38 of 52 Archive leaderboard report
Atari Games Atari 2600 Private Eye Duel hs Score 292.6 #29 of 52 Archive leaderboard report
Atari Games Atari 2600 Private Eye Prior+Duel noop Score 206.0 #34 of 52 Archive leaderboard report
Atari Games Atari 2600 Private Eye DDQN (tuned) noop Score 129.7 #40 of 52 Archive leaderboard report
Atari Games Atari 2600 Private Eye Duel noop Score 103.0 #42 of 52 Archive leaderboard report
Atari Games Atari 2600 Q*Bert Duel noop Score 19220.3 #20 of 57 Archive leaderboard report
Atari Games Atari 2600 Q*Bert Prior+Duel noop Score 18760.3 #21 of 57 Archive leaderboard report
Atari Games Atari 2600 Q*Bert DDQN (tuned) noop Score 15088.5 #28 of 57 Archive leaderboard report
Atari Games Atari 2600 Q*Bert Duel hs Score 14175.8 #32 of 57 Archive leaderboard report
Atari Games Atari 2600 River Raid Duel noop Score 21162.6 #11 of 41 Archive leaderboard report
Atari Games Atari 2600 River Raid Prior+Duel noop Score 20607.6 #12 of 41 Archive leaderboard report
Atari Games Atari 2600 River Raid Duel hs Score 16569.4 #17 of 41 Archive leaderboard report
Atari Games Atari 2600 River Raid DDQN (tuned) noop Score 14884.5 #20 of 41 Archive leaderboard report
Atari Games Atari 2600 Road Runner Duel noop Score 69524.0 #12 of 44 Archive leaderboard report
Atari Games Atari 2600 Road Runner Prior+Duel noop Score 62151.0 #14 of 44 Archive leaderboard report
Atari Games Atari 2600 Road Runner Duel hs Score 58549.0 #16 of 44 Archive leaderboard report
Atari Games Atari 2600 Road Runner DDQN (tuned) noop Score 44127.0 #29 of 44 Archive leaderboard report
Atari Games Atari 2600 Robotank Duel noop Score 65.3 #14 of 42 Archive leaderboard report
Atari Games Atari 2600 Robotank DDQN (tuned) noop Score 65.1 #15 of 42 Archive leaderboard report
Atari Games Atari 2600 Robotank Duel hs Score 62.0 #22 of 42 Archive leaderboard report
Atari Games Atari 2600 Robotank Prior+Duel noop Score 27.5 #33 of 42 Archive leaderboard report
Atari Games Atari 2600 Seaquest Duel noop Score 50254.2 #11 of 57 Archive leaderboard report
Atari Games Atari 2600 Seaquest Duel hs Score 37361.6 #12 of 57 Archive leaderboard report
Atari Games Atari 2600 Seaquest DDQN (tuned) noop Score 16452.7 #18 of 57 Archive leaderboard report
Atari Games Atari 2600 Seaquest Prior+Duel noop Score 931.6 #47 of 57 Archive leaderboard report
Atari Games Atari 2600 Space Invaders Prior+Duel noop Score 15311.5 #16 of 55 Archive leaderboard report
Atari Games Atari 2600 Space Invaders Duel noop Score 6427.3 #19 of 55 Archive leaderboard report
Atari Games Atari 2600 Space Invaders Duel hs Score 5993.1 #20 of 55 Archive leaderboard report
Atari Games Atari 2600 Space Invaders DDQN (tuned) noop Score 2525.5 #34 of 55 Archive leaderboard report
Atari Games Atari 2600 Star Gunner Prior+Duel noop Score 125117.0 #15 of 43 Archive leaderboard report
Atari Games Atari 2600 Star Gunner Duel hs Score 90804.0 #17 of 43 Archive leaderboard report
Atari Games Atari 2600 Star Gunner Duel noop Score 89238.0 #18 of 43 Archive leaderboard report
Atari Games Atari 2600 Star Gunner DDQN (tuned) noop Score 60142.0 #27 of 43 Archive leaderboard report
Atari Games Atari 2600 Tennis Duel noop Score 5.1 #16 of 43 Archive leaderboard report
Atari Games Atari 2600 Tennis Duel hs Score 4.4 #17 of 43 Archive leaderboard report
Atari Games Atari 2600 Tennis Prior+Duel noop Score 0.0 #22 of 43 Archive leaderboard report
Atari Games Atari 2600 Tennis DDQN (tuned) noop Score -22.8 #31 of 43 Archive leaderboard report
Atari Games Atari 2600 Time Pilot Duel noop Score 11666.0 #21 of 44 Archive leaderboard report
Atari Games Atari 2600 Time Pilot DDQN (tuned) noop Score 8339.0 #27 of 44 Archive leaderboard report
Atari Games Atari 2600 Time Pilot Prior+Duel noop Score 7553.0 #30 of 44 Archive leaderboard report
Atari Games Atari 2600 Time Pilot Duel hs Score 6601.0 #32 of 44 Archive leaderboard report
Atari Games Atari 2600 Tutankham Prior+Duel noop Score 245.9 #17 of 44 Archive leaderboard report
Atari Games Atari 2600 Tutankham DDQN (tuned) noop Score 218.4 #21 of 44 Archive leaderboard report
Atari Games Atari 2600 Tutankham Duel noop Score 211.4 #23 of 44 Archive leaderboard report
Atari Games Atari 2600 Tutankham Duel hs Score 48.0 #41 of 44 Archive leaderboard report
Atari Games Atari 2600 Up and Down Duel noop Score 44939.6 #23 of 44 Archive leaderboard report
Atari Games Atari 2600 Up and Down Prior+Duel noop Score 33879.1 #24 of 44 Archive leaderboard report
Atari Games Atari 2600 Up and Down Duel hs Score 24759.2 #27 of 44 Archive leaderboard report
Atari Games Atari 2600 Up and Down DDQN (tuned) noop Score 22972.2 #28 of 44 Archive leaderboard report
Atari Games Atari 2600 Venture Duel noop Score 497.0 #22 of 55 Archive leaderboard report
Atari Games Atari 2600 Venture Duel hs Score 200.0 #28 of 55 Archive leaderboard report
Atari Games Atari 2600 Venture DDQN (tuned) noop Score 98.0 #32 of 55 Archive leaderboard report
Atari Games Atari 2600 Venture Prior+Duel noop Score 48.0 #37 of 55 Archive leaderboard report
Atari Games Atari 2600 Video Pinball Prior+Duel noop Score 479197.0 #17 of 42 Archive leaderboard report
Atari Games Atari 2600 Video Pinball DDQN (tuned) noop Score 309941.9 #23 of 42 Archive leaderboard report
Atari Games Atari 2600 Video Pinball Duel hs Score 110976.2 #32 of 42 Archive leaderboard report
Atari Games Atari 2600 Video Pinball Duel noop Score 98209.5 #33 of 42 Archive leaderboard report
Atari Games Atari 2600 Wizard of Wor Prior+Duel noop Score 12352.0 #17 of 41 Archive leaderboard report
Atari Games Atari 2600 Wizard of Wor Duel noop Score 7855.0 #24 of 41 Archive leaderboard report
Atari Games Atari 2600 Wizard of Wor DDQN (tuned) noop Score 7492.0 #25 of 41 Archive leaderboard report
Atari Games Atari 2600 Wizard of Wor Duel hs Score 7054.0 #27 of 41 Archive leaderboard report
Atari Games Atari 2600 Zaxxon Prior+Duel noop Score 13886.0 #19 of 41 Archive leaderboard report
Atari Games Atari 2600 Zaxxon Duel noop Score 12944.0 #21 of 41 Archive leaderboard report
Atari Games Atari 2600 Zaxxon Duel hs Score 10164.0 #26 of 41 Archive leaderboard report
Atari Games Atari 2600 Zaxxon DDQN (tuned) noop Score 10163.0 #27 of 41 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: Dueling Network

ConvolutionDense ConnectionsDouble Q-learningDueling Network

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections