Papers › Continuous control with deep reinforcement learning

Continuous control with deep reinforcement learning

9 Sep 2015arXiv:1509.02971archive 2025-07-28

Timothy P. Lillicrap, Jonathan J. Hunt, Alexander Pritzel, Nicolas Heess, Tom Erez, Yuval Tassa, David Silver, Daan Wierstra

We adapt the ideas underlying the success of Deep Q-Learning to the continuous action domain. We present an actor-critic, model-free algorithm based on the deterministic policy gradient that can operate over continuous action spaces. Using the same learning algorithm, network architecture and hyper-parameters, our algorithm robustly solves more than 20 simulated physics tasks, including classic problems such as cartpole swing-up, dexterous manipulation, legged locomotion and car driving. Our algorithm is able to find policies whose performance is competitive with those found by a planning algorithm with full access to the dynamics of the domain and its derivatives. We further demonstrate that for many of the tasks the algorithm can learn policies end-to-end: directly from raw pixel inputs.

PaperPDFCodeCode Syntology ranMethod as code

In Syntology View this paper on Syntology, its page in Syntology's graph. That page adds which of its functions are also present in other papers' code Syntology holds, with dates, and its dated run record as JSON and a README badge. It also lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

Syntology 306 code samples: 305 from 87 repositories linked to this paper, 1 identical to code harvested from another paper's repository. Across all 306: 163 ran (of which 126 constructed an object rather than computing a result; 152 with no instrument failure: 3 honoured, 0 violated, 149 with no contract checked; 11 where Syntology's instrument failed) · 143 unverified. Where Syntology's instrument failed: 5 where our contract draft was wrong; 6 where the contract check could not run; failures of Syntology's instrument, not of the code.

By repository: community (archive-listed): 305 samples from 87 repositories, 162 ran (152 with no instrument failure; 10 where Syntology's instrument failed); 1 identical to code first harvested elsewhere. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

No sample is linked to this paper from 17 of its repositories that Syntology harvested for other papers:

Levels written between 2026-09-22 and 2026-09-26 (UTC): the dates Syntology's graph wrote each sample's verification level, not when the code executed.

161 repositories listed; official and paper-mentioned ones first.

AgrawalAmey/safe-explorer mentioned on GitHubpytorchSyntology: not harvested report
AlexandraFilimokhina/MountainCarConrinious_DDPG mentioned on GitHubSyntology: not harvested report
Brook1711/RIS_components mentioned on GitHubtfSyntology: not harvested report
Crevass/Hybrid-Agent mentioned on GitHubtfSyntology: 2 samples, 0 ran · 2 unverified report
DanielLSM/safe-rl-tutorial mentioned on GitHubtfSyntology: 2 samples, 0 ran · 2 unverified report
Dekki-Aero/DDPG mentioned on GitHubtfSyntology: 5 samples, 4 ran (0 instrument-failed) · 1 unverified report
EyaRhouma/collaboration-competition-MADDPG mentioned on GitHubpytorchSyntology: 2 samples, 2 ran (0 instrument-failed) · 0 unverified report
FlyienSHaDOw/continuous_control mentioned on GitHubtorchSyntology: not harvested report
FlyienSHaDOw/project_2_continuous_control mentioned on GitHubtorchSyntology: not harvested report
Gouet/DDPG_PendulumV1 mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
HJDQN/HJQ mentioned on GitHubpytorchSyntology: 10 samples, 6 ran (1 instrument-failed) · 4 unverified report
InSpaceAI/RL-Zoo mentioned on GitHubtfSyntology: 4 samples, 1 ran (0 instrument-failed) · 3 unverified report
IvanVigor/Deep-Deterministic-Policy-Gradient-Unity-Env mentioned on GitHubpytorchSyntology: 4 samples, 3 ran (0 instrument-failed) · 1 unverified report
IvanVigor/MADDPG-Unity mentioned on GitHubpytorchMITSyntology: not harvested report
J93T/TP4-DDPG mentioned on GitHubpytorchSyntology: 5 samples, 4 ran (0 instrument-failed) · 1 unverified report
JL321/mujo-2DHalf-Cheetah mentioned on GitHubtfSyntology: not harvested report
JL321/mujo-2DWalker mentioned on GitHubtfSyntology: not harvested report
JonasRSV/DDPG mentioned on GitHubtfSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
JonasRSV/PGTensorflow mentioned on GitHubtfSyntology: not harvested report
KAIST-AILab/deeprl_practice_colab mentioned on GitHubSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Prioritized Experience Replay (arXiv:1511.05952; that paper's own run record: 80 ran (of which 62 constructed an object rather than computing a result; 72 with no instrument failure: 4 honoured, 0 violated, 68 with no contract checked; 8 where Syntology's instrument failed) · 31 unverified) and Generative Adversarial Imitation Learning (arXiv:1606.03476; that paper's own run record: 24 ran (of which 6 constructed an object rather than computing a result; 22 with no instrument failure: 2 honoured, 1 violated, 19 with no contract checked; 2 where Syntology's instrument failed) · 12 unverified); nothing checks that they implement this paper's method. report
KelvinYang0320/deepbots-panda mentioned on GitHubpytorchSyntology: 3 samples, 2 ran (0 instrument-failed) · 1 unverified report
Kikumu/Reinforcement-Learning-repo mentioned on GitHubSyntology: not harvested report
LM095/DDPG-implementation mentioned on GitHubpytorchMITSyntology: not harvested report
MLCS-Yonsei/ddpg-control mentioned on GitHubtfSyntology: 7 samples, 0 ran · 7 unverified report
MathPhysSim/PER-NAF mentioned on GitHubtfSyntology: 4 samples, 1 ran (0 instrument-failed) · 3 unverified report
Medabid1/RL_Project mentioned on GitHubpytorchSyntology: 3 samples, 2 ran (0 instrument-failed) · 1 unverified report
MrSyee/pg-is-all-you-need mentioned on GitHubMITSyntology: not harvested report
NOHYC/autonomous_driving_car_project mentioned on GitHubMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Learning Lightweight Lane Detection CNNs by Self Attention Distillation (arXiv:1908.00821; that paper's own run record: 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
NervanaSystems/coach mentioned on GitHubtfSyntology: not harvested report
Pechckin/MountainCar mentioned on GitHubSyntology: not harvested report
PeterJochem/Deep_RL mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
PeterJochem/Double_Deep_QLearning mentioned on GitHubtfSyntology: not harvested report
Philori22/DDPG-aigym mentioned on GitHubpytorchSyntology: 4 samples, 2 ran (0 instrument-failed) · 2 unverified report
Remtasya/DDPG-Actor-Critic-Reinforcement-Learning-Reacher-Environment mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Asynchronous Methods for Deep Reinforcement Learning (arXiv:1602.01783; that paper's own run record: 60 ran (of which 20 constructed an object rather than computing a result; 50 with no instrument failure: 2 honoured, 1 violated, 47 with no contract checked; 10 where Syntology's instrument failed) · 35 unverified); nothing checks that they implement this paper's method. report
SaminYeasar/off_policy_ac mentioned on GitHubpytorchSyntology: 3 samples, 2 ran (0 instrument-failed) · 1 unverified report
SergiPonsa/Reinforcement-Learning-Sergi mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
Sheldonmao/Learning-To-walk mentioned on GitHubSyntology: not harvested report
SimonRamstedt/ddpg mentioned on GitHubtfSyntology: 2 samples, 0 ran · 2 unverified report
Souphis/mobile_robot_rl mentioned on GitHubtfSyntology: 15 samples, 11 ran (2 instrument-failed) · 4 unverified report
T3chy/DDPG mentioned on GitHubpytorchSyntology: 5 samples, 4 ran (0 instrument-failed) · 1 unverified report
TheInfamousWayne/ddpg mentioned on GitHubpytorchSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
VasaKiDD/TD3-deep-rl-research mentioned on GitHubpytorchSyntology: 2 samples, 2 ran (0 instrument-failed) · 0 unverified report
WittmannF/quadcopter-best-practices mentioned on GitHubSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
YangRui2015/Modular_HER mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Hindsight Experience Replay (arXiv:1707.01495; that paper's own run record: 16 ran (of which 10 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
YoUNG824/DDPG mentioned on GitHubtfSyntology: 5 samples, 2 ran (0 instrument-failed) · 3 unverified report
ZainRaza14/deepRL mentioned on GitHubpytorchSyntology: 4 samples, 3 ran (0 instrument-failed) · 1 unverified report
ZiyangY/IndProject-RL-in-Supply-chain mentioned on GitHubpytorchSyntology: 3 samples, 3 ran (0 instrument-failed) · 0 unverified report
abbadka/quadcopter mentioned on GitHubSyntology: 3 samples, 0 ran · 3 unverified report
ai-winter/python_motion_planning mentioned on GitHubGPL-3.0Syntology: not harvested report
ailab-pku/rl-framework mentioned on GitHubpytorchSyntology: 3 samples, 0 ran · 3 unverified report
alathiya/RL-Quadcoptor-Flying mentioned on GitHubSyntology: 4 samples, 1 ran (0 instrument-failed) · 3 unverified report
alhabk/SGEE--pytorch mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Self-Imitation Learning (arXiv:1806.05635; that paper's own run record: 3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
andreidi/AC_DDPG_walker mentioned on GitHubtfSyntology: 2 samples, 2 ran (0 instrument-failed) · 0 unverified report
anita-hu/TF2-RL mentioned on GitHubtfSyntology: 8 samples, 4 ran (2 instrument-failed) · 4 unverified report
avivelor/UnityMachineLearningForProjectButterfly mentioned on GitHubSyntology: 10 samples, 0 ran · 10 unverified report
b06b01073/continuous-control mentioned on GitHubpytorchSyntology: 3 samples, 3 ran (0 instrument-failed) · 0 unverified report
bacdavid/HER mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Hindsight Experience Replay (arXiv:1707.01495; that paper's own run record: 16 ran (of which 10 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
backgom2357/Recommender_system_via_deep_RL mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
baturaysaglam/RIS-MISO-Deep-Reinforcement-Learning mentioned on GitHubpytorchSyntology: 3 samples, 3 ran (0 instrument-failed) · 0 unverified report
baturaysaglam/ac-off-poc mentioned on GitHubpytorchSyntology: 3 samples, 3 ran (0 instrument-failed) · 0 unverified report
baturaysaglam/dase mentioned on GitHubpytorchnot reachable when probed 2026-09-17 — repositories for recent papers often appear after camera-readySyntology: not harvested report
bidimensional/Tennis mentioned on GitHubSyntology: not harvested report
biemann/Continuous-Control mentioned on GitHubpytorchSyntology: 4 samples, 3 ran (0 instrument-failed) · 1 unverified report
bitterbloom/Reinforcement-Learning mentioned on GitHubpytorchSyntology: not harvested report
bmeyers/VirtualMicrogridSegmentation mentioned on GitHubtfSyntology: 8 samples, 4 ran (0 instrument-failed) · 4 unverified report
chainer/chainerrl mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to ChainerRL: A Deep Reinforcement Learning Library (arXiv:1912.03905; that paper's own run record: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
claudeHifly/BipedalWalker-v3 mentioned on GitHubpytorchSyntology: 4 samples, 4 ran (0 instrument-failed) · 0 unverified report
dan-lennox/ml-udacity-quadcopter-rl mentioned on GitHubSyntology: 5 samples, 2 ran (0 instrument-failed) · 3 unverified report
darkrush/meta_learn mentioned on GitHubtfSyntology: not harvested report
dchetelat/acer mentioned on GitHubpytorchSyntology: 2 samples, 0 ran · 2 unverified report
denizmguen/IANNWTF2019-Project mentioned on GitHubtfSyntology: 3 samples, 0 ran · 3 unverified report
dfki-ric-underactuated-lab/torque_limited_simple_pendulum mentioned on GitHubtfSyntology: 11 samples, 9 ran (3 instrument-failed) · 2 unverified report
dpoulopoulos/drl_collaborate_compete mentioned on GitHubpytorchSyntology: 4 samples, 4 ran (0 instrument-failed) · 0 unverified report
dpoulopoulos/drl_continuous_control mentioned on GitHubpytorchSyntology: not harvested report
dyth/doublegum mentioned on GitHubjaxSyntology: 5 samples, 1 ran (0 instrument-failed) · 4 unverified report
facebookresearch/Horizon mentioned on GitHubpytorchSyntology: not harvested report
fdcl-gwu/gym-rotor mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Reducing Overestimation Bias in Multi-Agent Domains Using Double Centralized Critics (arXiv:1910.01465; that paper's own run record: 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
feruxhi/thoughts mentioned on GitHubtfSyntology: not harvested report
fhbzc/FishAgentSimulation mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
fiberleif/nc_ddpg mentioned on GitHubtfSyntology: not harvested report
flavioschneider/ml_papers_presentations mentioned on GitHubMITSyntology: not harvested report
floodsung/DDPG mentioned on GitHubtfMITSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
flowersteam/curious mentioned on GitHubSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Hindsight Experience Replay (arXiv:1707.01495; that paper's own run record: 16 ran (of which 10 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 5 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
fshamshirdar/pytorch-rdpg mentioned on GitHubpytorchSyntology: 13 samples, 10 ran (1 instrument-failed) · 3 unverified report
georgkruse/cleanqrl mentioned on GitHubpytorchSyntology: not harvested report
ghliu/pytorch-ddpg mentioned on GitHubpytorchSyntology: 6 samples, 5 ran (0 instrument-failed) · 1 unverified report
guillaumeboniface/reacher mentioned on GitHubpytorchSyntology: 4 samples, 3 ran (0 instrument-failed) · 1 unverified report
gwthomas/gtml mentioned on GitHubtfSyntology: not harvested report
h-aboutalebi/SparceReward mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a... (arXiv:1801.01290; that paper's own run record: 91 ran (of which 61 constructed an object rather than computing a result; 73 with no instrument failure: 3 honoured, 1 violated, 69 with no contract checked; 18 where Syntology's instrument failed) · 57 unverified); nothing checks that they implement this paper's method. report
halajadallah/RL-Quadcopter_project mentioned on GitHubSyntology: 3 samples, 0 ran · 3 unverified report
hamishs/JAX-RL mentioned on GitHubjaxSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
hemilpanchiwala/Hindsight-Experience-Replay mentioned on GitHubpytorchSyntology: 4 samples, 3 ran (0 instrument-failed) · 1 unverified report
iDataist/Continuous-Control-with-Deep-Deterministic-Policy-Gradient mentioned on GitHubpytorchSyntology: 5 samples, 4 ran (0 instrument-failed) · 1 unverified report
iDataist/Tennis-With-Multi-Agent-Reinforcement mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
krasing/DRLearningCollaboration mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
krasing/DRLearningContinuousControl mentioned on GitHubpytorchSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
kushagra06/DDPG mentioned on GitHubtfSyntology: not harvested report
liampetti/DDPG mentioned on GitHubtfSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
liuyuezhang/pyrl mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Asynchronous Methods for Deep Reinforcement Learning (arXiv:1602.01783; that paper's own run record: 60 ran (of which 20 constructed an object rather than computing a result; 50 with no instrument failure: 2 honoured, 1 violated, 47 with no contract checked; 10 where Syntology's instrument failed) · 35 unverified) and Proximal Policy Optimization Algorithms (arXiv:1707.06347; that paper's own run record: 99 ran (of which 53 constructed an object rather than computing a result; 71 with no instrument failure: 7 honoured, 2 violated, 62 with no contract checked; 28 where Syntology's instrument failed) · 77 unverified); nothing checks that they implement this paper's method. report
luke-bhan/TwitterSentimentAnalysisTool mentioned on GitHubSyntology: not harvested report
lukebhan/TwitterSentimentAnalysisTool mentioned on GitHubSyntology: not harvested report
madhur-tandon/RL-Project mentioned on GitHubpytorchSyntology: 5 samples, 4 ran (0 instrument-failed) · 1 unverified report
madvn/DDPG mentioned on GitHubtfSyntology: 3 samples, 0 ran · 3 unverified report
majercakdavid/gym-virtual-quant-trading mentioned on GitHubpytorchSyntology: 6 samples, 3 ran (0 instrument-failed) · 3 unverified report
marload/DeepRL-TensorFlow2 mentioned on GitHubtfSyntology: 4 samples, 1 ran (0 instrument-failed) · 3 unverified report
massquantity/DBRL mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
mathformoso/RL-playground---ddpg mentioned on GitHubtfSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
matthewsparr/Reinforcement-Learning-Lesson mentioned on GitHubSyntology: not harvested report
mindspore-courses/Deep-Reinforcement-Learning-Algorithms-with-MindSpore mentioned on GitHubmindsporeSyntology: not harvested report
montaserFath/Reinforcement-Learning-for-Prosthetics mentioned on GitHubSyntology: not harvested report
nav74neet/ddpg4biped mentioned on GitHubtfSyntology: not harvested report
nav74neet/ddpg_biped mentioned on GitHubtfSyntology: not harvested report
nav74neet/rl4biped mentioned on GitHubtfSyntology: not harvested report
parilo/rl-server mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
petsol/ContinuousControl_UnityAgent_DDPG_Udacity mentioned on GitHubpytorchSyntology: not harvested report
prajwalgatti/DRL-Collaboration-and-Competition mentioned on GitHubSyntology: not harvested report
prajwalgatti/DRL-Continuous-Control mentioned on GitHubSyntology: not harvested report
rikluost/RL_DQN_Pong mentioned on GitHubtfSyntology: not harvested report
rk1998/robot-sac mentioned on GitHubtfSyntology: not harvested report
s-sd/task-amenability mentioned on GitHubtfSyntology: not harvested report
samiranrl/ODSC_2019_RL mentioned on GitHubpytorchSyntology: not harvested report
samuelmat19/DDPG-tf2 mentioned on GitHubtfSyntology: 5 samples, 2 ran (1 instrument-failed) · 3 unverified report
saoudh/Reinforcement-Learning mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
sayantanauddy/hierarchical_bipedal_controller mentioned on GitHubtfSyntology: not harvested report
schatty/D4PG-pytorch mentioned on GitHubpytorchSyntology: not harvested report
seungjaeryanlee/osim-rl-helper mentioned on GitHubSyntology: not harvested report
shahabi8/Deep-Reinforcement-Learning mentioned on GitHubSyntology: 3 samples, 0 ran · 3 unverified report
shahin-01/vqa-ad mentioned on GitHubpytorchSyntology: not harvested report
shakedzy/warehouse mentioned on GitHubSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Reinforcement Learning with Deep Energy-Based Policies (arXiv:1702.08165; that paper's own run record: 0 ran · 1 unverified); nothing checks that they implement this paper's method. report
shehrum/RL_Continous-Control mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
siyuofzhou/DDPG mentioned on GitHubtfSyntology: not harvested report
sliao-mi-luku/DeepRL-multiple-agents-tennis-udacity-drlnd-p3 mentioned on GitHubpytorchSyntology: 3 samples, 2 ran (0 instrument-failed) · 1 unverified report
songrotek/DDPG mentioned on GitHubtfMITSyntology: not harvested report
soumik12345/DDPG mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
stevenpjg/ddpg-aigym mentioned on GitHubtfSyntology: 4 samples, 0 ran · 4 unverified report
susan-amin/SparseBaseline1 mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
taku-y/20181125-pybullet mentioned on GitHubtfSyntology: not harvested report
tegg89/DLCamp_Jeju2018 mentioned on GitHubtfApache-2.0Syntology: 7 samples, 1 ran (0 instrument-failed) · 6 unverified report
tegg89/magnet mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Multi-Agent Reinforcement Learning with Relevance Graphs (arXiv:1811.12557; that paper's own run record: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified); nothing checks that they implement this paper's method. report
tegg89/magnn mentioned on GitHubtfApache-2.0Syntology: not harvested report
tegg89/mann mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
tensorlayer/RLzoo mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
thainv0212/re-ddpg mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
tilkb/thermoai mentioned on GitHubtfSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
wassname/rl-portfolio-management mentioned on GitHubMITSyntology: 4 samples, 2 ran (0 instrument-failed) · 2 unverified report
wpiszlogin/driver_critic mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
wwydmanski/rl_tennis mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
xtma/simple-pytorch-rl mentioned on GitHubpytorchSyntology: 4 samples, 4 ran (0 instrument-failed) · 0 unverified report
xuyuandong/simple-ddpg mentioned on GitHubtfMITSyntology: not harvested report
xyshadow/baseline_ddpg mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
yukezhu/tensorflow-reinforce mentioned on GitHubtfSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
yusme/DDPG mentioned on GitHubtfnot reachable when probed 2026-09-18 — repositories for recent papers often appear after camera-readySyntology: not harvested report
2023-MindSpore-1/ms-code-210 mindsporeSyntology: not harvested report
DLR-RM/stable-baselines3 pytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Hyperparameter Trajectory Inference with Conditional Lagrangian Optimal Transport (arXiv:2603.01771; that paper's own run record: 6 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 1 violated, 2 with no contract checked; 3 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
JorgeA-RD/Reinforcement-Learning-Agents tfSyntology: 3 samples, 3 ran (0 instrument-failed) · 0 unverified report
arnomoonens/yarll tfSyntology: 3 samples, 3 ran (0 instrument-failed) · 0 unverified report
facebookresearch/rl jaxSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to RL4CO: an Extensive Reinforcement Learning for Combinatorial Optimization Benchmark (arXiv:2306.17100; that paper's own run record: 12 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified); nothing checks that they implement this paper's method. report
hill-a/stable-baselines tfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep Reinforcement Learning with Double Q-learning (arXiv:1509.06461; that paper's own run record: 56 ran (of which 38 constructed an object rather than computing a result; 55 with no instrument failure: 0 honoured, 0 violated, 55 with no contract checked; 1 where Syntology's instrument failed) · 50 unverified) and Prioritized Experience Replay (arXiv:1511.05952; that paper's own run record: 80 ran (of which 62 constructed an object rather than computing a result; 72 with no instrument failure: 4 honoured, 0 violated, 68 with no contract checked; 8 where Syntology's instrument failed) · 31 unverified); nothing checks that they implement this paper's method. report
jakegrigsby/deep_control pytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Towards Automatic Actor-Critic Solutions to Continuous Control (arXiv:2106.08918; that paper's own run record: 0 ran · 1 unverified); nothing checks that they implement this paper's method. report
ray-project/ray Syntology: not harvested report
toni-sm/skrl jaxMITSyntology: not harvested report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

306 samples harvested: 163 ran (of which 126 constructed an object rather than computing a result; 152 with no instrument failure: 3 honoured, 0 violated, 149 with no contract checked; 11 where Syntology's instrument failed) · 143 unverified. “Where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Syntology's record for this page has not changed since , the first build that kept a record date for it; when this build read Syntology's graph is in the build record. That date is not when the samples ran.

3ran · honoured contract
5ran · our draft was wrong
6ran; the contract check could not run
149ran
143unverified

Licence: 163 of the 306 samples are pointer only, meaning Syntology does not serve that copy's text. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 87 repositories linked to this paper, official or community; the list below is grouped by repository, each group headed by its name and what it is to the paper. 1 sample is listed last, in a group without a repository. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. A line beginning “fixture:” under a sample that ran gives the arguments Syntology's fixture called the sample with, each as name:type/rank/element kind (? where none was recorded), and the type of what the fixture's run returned, exactly as the harness recorded them; the arguments and the returned type were recorded by two separate runs of the same fixture. No output value is shown, and a returned type says nothing about whether the output was right. “Level recorded” gives the UTC date when Syntology's graph wrote the sample's verification level, not when the code executed; where the level was written before Syntology's graph kept that date, the row says “level recorded, date not recorded”. For 22 samples that ran, the graph records a signature this page does not show: for a class the fixture built without calling, the harness called the object with inputs it made up itself, so the recorded signature is the harness's probe, not the fixture's arguments. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself. “Our draft was wrong” and “the contract check could not run” are failures of Syntology's instrument, not of the code: the sample ran on Syntology's synthesized input, and then the drafted contract did not describe it, or the check itself raised an error (RAISES), lacked a dependency (DEP_MISSING) or ran out of time (TIMEOUT); hover the label for which. A metamorphic tier, where shown, is evidence of the output's shape, not that the sample implements the method.

Each sample ends with its code_sha256. A sample's code_sha256 is Syntology's identity for that exact code. It is printed in full (16 hexadecimal characters for every sample in this build), and get_code(code_sha256="…") takes it exactly as printed. An agent calls it on Syntology's MCP service (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples are grouped by repository: a repository marked official first, then by how directly the repository is tied to the paper, then in the archive's order; never by how many ran. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of six reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar); this paper's copy was not located, so its licence is not recorded; or this paper's copy is cleared, but the stored copy of the same code that Syntology serves is not. Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

A function or class name links to its page when the name occurs in the harvested code of at least 5 papers; the name is a string, not an identity. A census tag appears when Syntology's census ran implementations with that name on one shared input per bucket: it gives how many were compared, from how many papers, and how many distinct outputs they produced, and names this sample's bucket when this sample was one of them.

Crevass/Hybrid-Agent community (archive-listed) 2 samples, 0 ran · 2 unverified
Agent in 42 papers agent.py unverified no licence file found · pointer only · 40c191818d46c0c5 · report
normal_dist agent.py unverified no licence file found · pointer only · 54074d019aff0495 · report
DanielLSM/safe-rl-tutorial community (archive-listed) 2 samples, 0 ran · 2 unverified
Buffer in 23 papers tutorial/ddpg.py unverified MIT (permissive) · 96855c8d20a0088b · report
DDPG tutorial/ddpg.py unverified MIT (permissive) · e88bf23758633506 · report
Dekki-Aero/DDPG community (archive-listed) 5 samples, 4 ran (0 instrument-failed) · 1 unverified
Prioritized_experience_replay DDPG-TF/ddpg/ddpg.py ran no licence file found · pointer only · b07dfe06f4498bba · report fixture: returned Prioritized_experience_replay · level recorded 2026-09-22
Replay_Buffer DDPG-TF/ddpg/ddpg.py ran no licence file found · pointer only · 66d85c7900951847 · report fixture: returned Replay_Buffer · level recorded 2026-09-22
_actor_network DDPG-TF/ddpg/ddpg.py ran no licence file found · pointer only · ca95bd1bfa26d31f · report fixture: returned _actor_network · level recorded 2026-09-22
_critic_network DDPG-TF/ddpg/ddpg.py ran no licence file found · pointer only · fe8293ee7abbf8aa · report fixture: returned _critic_network · level recorded 2026-09-22
DDPG DDPG-TF/ddpg/ddpg.py unverified no licence file found · pointer only · ae6be9eb7b4764c8 · report
EyaRhouma/collaboration-competition-MADDPG community (archive-listed) 2 samples, 2 ran (0 instrument-failed) · 0 unverified
DDPG MADDPG_agent.py ran no licence file found · pointer only · dc719785d5a0b9f7 · report fixture: returned DDPG · level recorded 2026-09-22
OUNoise in 6 papers MADDPG_agent.py ran no licence file found · pointer only · 0562ed655f21cba8 · report fixture: returned OUNoise · level recorded 2026-09-22
Gouet/DDPG_PendulumV1 community (archive-listed) 1 sample, 0 ran · 1 unverified
Actor in 68 papers ddpg.py unverified no licence file found · pointer only · 4abb7a0681b9f8e3 · report
HJDQN/HJQ community (archive-listed) 10 samples, 6 ran (1 instrument-failed) · 4 unverified
Actor in 68 papers algorithms/ddpg/ddpg.py ran · metamorphic tier: deterministic fingerprinted no licence file found · pointer only · 4ea2dabac66df07c · report fixture: returned Actor · level recorded 2026-09-22
CircularBuffer algorithms/ddpg/ddpg.py ran no licence file found · pointer only · 59f7f71edc829572 · report fixture: returned CircularBuffer · level recorded 2026-09-22
Critic in 60 papers algorithms/ddpg/ddpg.py ran · metamorphic tier: deterministic no licence file found · pointer only · a51e802f97dc5850 · report fixture: returned Critic · level recorded 2026-09-22
DDPGAgent in 5 papers algorithms/ddpg/ddpg.py ran no licence file found · pointer only · b51369036ab5a352 · report fixture: returned DDPGAgent · level recorded 2026-09-22
ReplayBuffer in 33 papers algorithms/ddpg/ddpg.py ran no licence file found · pointer only · a15460ad3a6b391e · report fixture: returned ReplayBuffer · level recorded 2026-09-22
get_env_spec algorithms/ddpg/ddpg.py ran · our draft was wrong no licence file found · pointer only · cf7f0fe0d3ac16d9 · report fixture: signature env:MockEnv/0/? · returned tuple · level recorded 2026-09-22
freeze in 9 papers algorithms/ddpg/ddpg.py unverified no licence file found · pointer only · a6b3153326abaddd · report
run_ddpg algorithms/ddpg/ddpg.py unverified no licence file found · pointer only · 14b6d9e3982a117c · report
set_log_dir algorithms/ddpg/ddpg.py unverified no licence file found · pointer only · e58c3a477f895e6c · report
unfreeze algorithms/ddpg/ddpg.py unverified no licence file found · pointer only · 24c0dee0fb0fec39 · report
InSpaceAI/RL-Zoo community (archive-listed) 4 samples, 1 ran (0 instrument-failed) · 3 unverified
OU_noise DDPG.py ran no licence file found · pointer only · e76268df8017c794 · report fixture: returned OU_noise · level recorded 2026-09-22
Actor in 68 papers DDPG.py unverified no licence file found · pointer only · 8afc63f093262b83 · report
Critic in 60 papers DDPG.py unverified no licence file found · pointer only · a36fc940a0f3eb1b · report
DDPGAgent in 5 papers DDPG.py unverified no licence file found · pointer only · 4b11a27451c374cd · report
IvanVigor/Deep-Deterministic-Policy-Gradient-Unity-Env community (archive-listed) 4 samples, 3 ran (0 instrument-failed) · 1 unverified
Actor in 68 papers ddpg_agent.py ran · metamorphic tier: deterministic fingerprinted GPL-3.0 (copyleft) · pointer only · 2233e3bf2203e01d · report fixture: returned Actor · level recorded 2026-09-22
Critic in 60 papers ddpg_agent.py ran · metamorphic tier: deterministic GPL-3.0 (copyleft) · pointer only · 7a433b7591cb1ad7 · report fixture: returned Critic · level recorded 2026-09-22
OUNoise in 6 papers ddpg_agent.py ran GPL-3.0 (copyleft) · pointer only · d7af24edd798e11c · report fixture: returned OUNoise · level recorded 2026-09-22
Agent in 42 papers ddpg_agent.py unverified GPL-3.0 (copyleft) · pointer only · 8950c65039fc4fe3 · report
J93T/TP4-DDPG community (archive-listed) 5 samples, 4 ran (0 instrument-failed) · 1 unverified
Actor in 68 papers ddpg.py ran · metamorphic tier: deterministic no licence file found · pointer only · 6d718c5a05a53b10 · report fixture: returned Actor · level recorded 2026-09-22
Critic in 60 papers ddpg.py ran · metamorphic tier: deterministic no licence file found · pointer only · 5029b7b1380f0988 · report fixture: returned Critic · level recorded 2026-09-22
OrnsteinUhlenbeckProcess ddpg.py ran no licence file found · pointer only · ef85fd5d912b3855 · report fixture: returned OrnsteinUhlenbeckProcess · level recorded 2026-09-22
ReplayBuffer in 33 papers ddpg.py ran no licence file found · pointer only · 79dfb108cab48c77 · report fixture: returned ReplayBuffer · level recorded 2026-09-22
DDPGAgent in 5 papers ddpg.py unverified no licence file found · pointer only · d96fe6b321763c14 · report
JonasRSV/DDPG community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
ExperienceReplay in 5 papers ddpg.py ran no licence file found · pointer only · e60542a6e12b3525 · report fixture: returned ExperienceReplay · level recorded 2026-09-22
DDPG ddpg.py unverified no licence file found · pointer only · 77ca3b0e41fef94a · report
KelvinYang0320/deepbots-panda community (archive-listed) 3 samples, 2 ran (0 instrument-failed) · 1 unverified
ActorNetwork Panda_RL/controllers/robot_supervisor_manager/agent/ddpg.py ran fingerprinted MIT (permissive) · 375a3ee63ca7c68d · report fixture: returned ActorNetwork · level recorded 2026-09-22
CriticNetwork in 5 papers Panda_RL/controllers/robot_supervisor_manager/agent/ddpg.py ran MIT (permissive) · 6429748a5267bb8a · report fixture: returned CriticNetwork · level recorded 2026-09-22
DDPGAgent in 5 papers Panda_RL/controllers/robot_supervisor_manager/agent/ddpg.py unverified MIT (permissive) · c0e725d5bf9fb153 · report
MLCS-Yonsei/ddpg-control community (archive-listed) 7 samples, 0 ran · 7 unverified
ActorNet ddpg.py unverified MIT (permissive) · 36fb14c831b75e4f · report
ActorNet_bn ddpg.py unverified MIT (permissive) · 883fbd58c181e487 · report
CriticNet ddpg.py unverified MIT (permissive) · 42be45cafdda9bc6 · report
CriticNet_bn ddpg.py unverified MIT (permissive) · 2961cc94350daaae · report
DDPG ddpg.py unverified MIT (permissive) · 9f83c78d8022ed75 · report
batch_norm in 46 papers ddpg.py unverified MIT (permissive) · 7484fd6def5722c7 · report
grad_inverter ddpg.py unverified MIT (permissive) · ff560a45eef0d026 · report
MathPhysSim/PER-NAF community (archive-listed) 4 samples, 1 ran (0 instrument-failed) · 3 unverified
ReplayBuffer in 33 papers pernaf/pernaf/naf.py ran MIT (permissive) · d8fadcf1cbc892d5 · report fixture: returned ReplayBuffer · level recorded 2026-09-22
NAF pernaf/pernaf/naf.py unverified MIT (permissive) · c3b2071edfe94da7 · report
PrioritizedReplayBuffer pernaf/pernaf/naf.py unverified MIT (permissive) · b34e1d14d05b3345 · report
ReplayBufferPER pernaf/pernaf/naf.py unverified MIT (permissive) · 05a3439d18f70f4b · report
Medabid1/RL_Project community (archive-listed) 3 samples, 2 ran (0 instrument-failed) · 1 unverified
ActorCriticDeterministic network/Networks.py ran no licence file found · pointer only · c9b4479f17459322 · report fixture: returned ActorCriticDeterministic · level recorded 2026-09-22
to_tensor in 92 papers
census: 8 implementations from 8 papers, 3 distinct outputs across 3 buckets, one shared input per bucket this sample: bucket 1 of 3, arg 1: rank 2, kind float, dtype float32
network/Networks.py ran · honoured contract fingerprinted no licence file found · pointer only · f0945ef1933b173a · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22
init_weights in 109 papers network/Networks.py unverified no licence file found · pointer only · 269f19cc9358c590 · report
PeterJochem/Deep_RL community (archive-listed) 1 sample, 0 ran · 1 unverified
Agent in 42 papers DDPG/pendulum/myAgent_pendulum.py unverified no licence file found · pointer only · 684ee98628f58937 · report
Philori22/DDPG-aigym community (archive-listed) 4 samples, 2 ran (0 instrument-failed) · 2 unverified
Actor in 68 papers ddpg.py ran · metamorphic tier: invariant fingerprinted no licence file found · pointer only · 8f5c14d98d39f3b9 · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22
Critic in 60 papers ddpg.py ran · metamorphic tier: deterministic fingerprinted no licence file found · pointer only · 4c5d9db3e7d648c9 · report fixture: signature x:Tensor/2/float, u:Tensor/2/float · returned tuple · level recorded 2026-09-22
DDPG ddpg.py unverified no licence file found · pointer only · b861cffa858f460c · report
ReplayBuffer in 33 papers ddpg.py unverified no licence file found · pointer only · 1229a5d8dea62487 · report
SaminYeasar/off_policy_ac community (archive-listed) 3 samples, 2 ran (0 instrument-failed) · 1 unverified
Actor in 68 papers DDPG/DDPG.py ran · metamorphic tier: invariant fingerprinted no licence file found · pointer only · 200b44ea7ead9ab6 · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22
Critic in 60 papers DDPG/DDPG.py ran · metamorphic tier: invariant no licence file found · pointer only · daeec7442740e76e · report fixture: signature x:Tensor/2/float, u:Tensor/2/float · returned Tensor · level recorded 2026-09-22
DDPG DDPG/DDPG.py unverified no licence file found · pointer only · a7f923df06fb12c2 · report
SergiPonsa/Reinforcement-Learning-Sergi community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
Actor in 68 papers ddpg pendulum/model_comented.py ran MIT (permissive) · da2a0693988d4238 · report fixture: returned Actor · level recorded 2026-09-22
SimonRamstedt/ddpg community (archive-listed) 2 samples, 0 ran · 2 unverified
hist_summaries ddpg_nets_dm.py unverified MIT (permissive) · e78231c9f4eb9c2f · report
policy in 5 papers ddpg_nets_dm.py unverified MIT (permissive) · 698f442074344c97 · report
Souphis/mobile_robot_rl community (archive-listed) 15 samples, 11 ran (2 instrument-failed) · 4 unverified
Critic in 60 papers mobile_robot_rl/agents/sac.py ran fingerprinted MIT (permissive) · 40513685bd8b8200 · report fixture: returned Critic · level recorded 2026-09-22
DoubleCritic mobile_robot_rl/agents/sac.py ran MIT (permissive) · 8f17f70a798c9257 · report fixture: returned DoubleCritic · level recorded 2026-09-22
FactorizedNoisyLinear mobile_robot_rl/agents/sac.py ran MIT (permissive) · a75c153872d7f256 · report fixture: returned FactorizedNoisyLinear · level recorded 2026-09-22
GaussianActor mobile_robot_rl/agents/sac.py ran MIT (permissive) · 5b62ad877a674563 · report fixture: signature x:Tensor/2/float, raw_action:NoneType/0/?, deterministic:bool/0/bool · returned tuple · level recorded 2026-09-24
IndependentNoisyLinear mobile_robot_rl/agents/sac.py ran MIT (permissive) · 98596830b8e76bd9 · report fixture: returned IndependentNoisyLinear · level recorded 2026-09-22
Logger in 25 papers mobile_robot_rl/agents/sac.py ran MIT (permissive) · 416bd507555ea4fa · report fixture: returned Logger · level recorded 2026-09-22
ReplayMemory in 11 papers mobile_robot_rl/agents/sac.py ran MIT (permissive) · 0d87c7101b2953f2 · report fixture: returned ReplayMemory · level recorded 2026-09-22
Rollout mobile_robot_rl/agents/sac.py ran MIT (permissive) · 4618f3f110556784 · report fixture: returned Rollout · level recorded 2026-09-22
ValueHead mobile_robot_rl/agents/sac.py ran MIT (permissive) · 1d6614860f0f4b57 · report fixture: returned ValueHead · level recorded 2026-09-22
_get_layer mobile_robot_rl/agents/sac.py ran · our draft was wrong MIT (permissive) · 34bfe74d89d0491d · report fixture: signature layer_type:str/0/str, input_dim:int/0/int, output_dim:int/0/int, sigma_init:float/0/float · returned FactorizedNoisyLinear · level recorded 2026-09-22
mse_loss in 73 papers
census: 8 implementations from 12 papers, 6 distinct outputs across 4 buckets, one shared input per bucket this sample: bucket 1 of 4, arg 1: rank 2, kind float, dtype float32 · arg 2: rank 2, kind float, dtype float32
mobile_robot_rl/agents/sac.py ran · our draft was wrong MIT (permissive) · d08ac0b87604485e · report fixture: signature prediction:Tensor/2/float, target:Tensor/2/float, reduction:Reduction/0/? · returned Tensor · level recorded 2026-09-22
BaseOffPolicy mobile_robot_rl/agents/sac.py unverified MIT (permissive) · c836b46b3c210e6a · report
GaussianPolicyHead mobile_robot_rl/agents/sac.py unverified MIT (permissive) · d702970461989ce2 · report
Reduction mobile_robot_rl/agents/sac.py unverified MIT (permissive) · adb269cf9b74e9a6 · report
SAC in 8 papers mobile_robot_rl/agents/sac.py unverified MIT (permissive) · 1be47476efdc31c1 · report
T3chy/DDPG community (archive-listed) 5 samples, 4 ran (0 instrument-failed) · 1 unverified
ActorNetwork ddpg_torch.py ran fingerprinted GPL-3.0 (copyleft) · pointer only · 39110b4bbc0661d2 · report fixture: returned ActorNetwork · level recorded 2026-09-22
CriticNetwork in 5 papers ddpg_torch.py ran GPL-3.0 (copyleft) · pointer only · c64a46f5ad45b01a · report fixture: returned CriticNetwork · level recorded 2026-09-22
OUActionNoise ddpg_torch.py ran GPL-3.0 (copyleft) · pointer only · ef632145448c9d94 · report fixture: returned OUActionNoise · level recorded 2026-09-22
ReplayBuffer in 33 papers ddpg_torch.py ran GPL-3.0 (copyleft) · pointer only · 7ebcb237f3ac8b6b · report fixture: returned ReplayBuffer · level recorded 2026-09-22
Agent in 42 papers ddpg_torch.py unverified GPL-3.0 (copyleft) · pointer only · 513584b85fd46561 · report
TheInfamousWayne/ddpg community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
Actor in 68 papers ddpg.py ran · metamorphic tier: deterministic fingerprinted Apache-2.0 (permissive) · 976480803a792876 · report fixture: returned Actor · level recorded 2026-09-22
DDPG ddpg.py unverified Apache-2.0 (permissive) · dcb47558604bda70 · report
VasaKiDD/TD3-deep-rl-research community (archive-listed) 2 samples, 2 ran (0 instrument-failed) · 0 unverified
Critic in 60 papers agent/DDPG.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · db5f4c6c0d3a50b4 · report fixture: returned Critic · level recorded 2026-09-22
DDPG agent/DDPG.py ran Apache-2.0 (permissive) · 8fadcc5f80d1e9b5 · report fixture: returned DDPG · level recorded 2026-09-22
WittmannF/quadcopter-best-practices community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
OUNoise in 6 papers agent.py ran no licence file found · pointer only · 6d50e581fbec00bb · report fixture: returned OUNoise · level recorded 2026-09-22
DDPG agent.py unverified no licence file found · pointer only · e8dad0570efe7ab9 · report
YoUNG824/DDPG community (archive-listed) 5 samples, 2 ran (0 instrument-failed) · 3 unverified
OUNoise in 6 papers ddpg.py ran MIT (permissive) · 85896c6b57d5891f · report fixture: returned OUNoise · level recorded 2026-09-22
ReplayBuffer in 33 papers ddpg.py ran MIT (permissive) · cbd6d4cba3c8f7b0 · report fixture: returned ReplayBuffer · level recorded 2026-09-22
ActorNetwork ddpg.py unverified MIT (permissive) · 18c75ab6a06581a4 · report
CriticNetwork in 5 papers ddpg.py unverified MIT (permissive) · ebdd58004bdf82fd · report
DDPG ddpg.py unverified MIT (permissive) · ced83557bfb5a383 · report
ZainRaza14/deepRL community (archive-listed) 4 samples, 3 ran (0 instrument-failed) · 1 unverified
Actor in 68 papers DDPG/ddpg_agent.py ran fingerprinted no licence file found · pointer only · 8062e958090e2e1f · report fixture: returned Actor · level recorded 2026-09-22
Critic in 60 papers DDPG/ddpg_agent.py ran no licence file found · pointer only · 2cee98e5475e680a · report fixture: returned Critic · level recorded 2026-09-22
OUNoise in 6 papers DDPG/ddpg_agent.py ran no licence file found · pointer only · 21303179927140a0 · report fixture: returned OUNoise · level recorded 2026-09-22
Agent in 42 papers DDPG/ddpg_agent.py unverified no licence file found · pointer only · caf348a3362776fb · report
ZiyangY/IndProject-RL-in-Supply-chain community (archive-listed) 3 samples, 3 ran (0 instrument-failed) · 0 unverified
Actor in 68 papers DDPG-based RNN/DDPG.py ran no licence file found · pointer only · 1f1a916ff3cde3a5 · report fixture: returned Actor · level recorded 2026-09-22
Critic in 60 papers DDPG-based RNN/DDPG.py ran no licence file found · pointer only · 111a712bc883469d · report fixture: returned Critic · level recorded 2026-09-22
DDPG DDPG-based RNN/DDPG.py ran no licence file found · pointer only · 4343e52712fa663d · report fixture: returned DDPG · level recorded 2026-09-22
abbadka/quadcopter community (archive-listed) 3 samples, 0 ran · 3 unverified
Actor in 68 papers agents/ddpg/agent.py unverified no licence file found · pointer only · 017ef34f0499756e · report
Critic in 60 papers agents/ddpg/agent.py unverified no licence file found · pointer only · 4080c577fc710255 · report
DDPG agents/ddpg/agent.py unverified no licence file found · pointer only · ae000ab63f993f26 · report
ailab-pku/rl-framework community (archive-listed) 3 samples, 0 ran · 3 unverified
Actor_network DDPG/tensorflow/DDPG.py unverified no licence file found · pointer only · 5c21d19fa9ff6b4b · report
Critic_network DDPG/tensorflow/DDPG.py unverified no licence file found · pointer only · e8ec892b92d9062e · report
DDPG_model DDPG/tensorflow/DDPG.py unverified no licence file found · pointer only · b2fbe2ad70b688a2 · report
alathiya/RL-Quadcoptor-Flying community (archive-listed) 4 samples, 1 ran (0 instrument-failed) · 3 unverified
ReplayBuffer in 33 papers agents/agent.py ran no licence file found · pointer only · a1866c0223c9dca1 · report fixture: returned ReplayBuffer · level recorded 2026-09-22
Actor in 68 papers agents/agent.py unverified no licence file found · pointer only · f6231123b603e20f · report
Critic in 60 papers agents/agent.py unverified no licence file found · pointer only · cf0cfca323e5c3c4 · report
DDPG agents/agent.py unverified no licence file found · pointer only · 1853e9d1db43078d · report
andreidi/AC_DDPG_walker community (archive-listed) 2 samples, 2 ran (0 instrument-failed) · 0 unverified
FCBody keras_models.py ran no licence file found · pointer only · 44abfcb21806cc13 · report fixture: returned FCBody · level recorded 2026-09-22
MLPActor keras_models.py ran no licence file found · pointer only · 6b17610b667cbc34 · report fixture: returned MLPActor · level recorded 2026-09-22
anita-hu/TF2-RL community (archive-listed) 8 samples, 4 ran (2 instrument-failed) · 4 unverified
NormalNoise DDPG/TF2_DDPG_Basic.py ran · metamorphic tier: well formed MIT (permissive) · d4f94d4568e6a3f3 · report fixture: returned ndarray · level recorded 2026-09-22
OrnsteinUhlenbeckNoise DDPG/TF2_DDPG_Basic.py ran · metamorphic tier: well formed MIT (permissive) · 132cdd71f41a5c43 · report fixture: returned ndarray · level recorded 2026-09-22
actor DDPG/TF2_DDPG_Basic.py ran; the contract check could not run (RAISES) MIT (permissive) · dceb05d9d5cc7ee5 · report fixture: signature state_shape:tuple/1/int, action_dim:int/0/int, action_bound:float/0/float, action_shift:ndarray/1/float, units:tuple/1/int · returned Functional · level recorded 2026-09-22
critic DDPG/TF2_DDPG_Basic.py ran; the contract check could not run (RAISES) MIT (permissive) · edb5292361905292 · report fixture: signature state_shape:tuple/1/int, action_dim:int/0/int, units:tuple/1/int · returned Functional · level recorded 2026-09-22
DDPG DDPG/TF2_DDPG_Basic.py unverified MIT (permissive) · caf935ecdc9a432e · report
Memory in 19 papers DDPG/TF2_DDPG_Basic.py unverified MIT (permissive) · 84a671ee7bad8513 · report
SumTree DDPG/TF2_DDPG_Basic.py unverified MIT (permissive) · 97e32fd094fe28c9 · report
update_target_weights DDPG/TF2_DDPG_Basic.py unverified MIT (permissive) · ac16f6e8f09e31bc · report
avivelor/UnityMachineLearningForProjectButterfly community (archive-listed) 10 samples, 0 ran · 10 unverified
CameraResolution ml-agents/mlagents/trainers/sac/models.py unverified MIT (permissive) · 222a72ff1d084586 · report
EncoderType ml-agents/mlagents/trainers/sac/models.py unverified MIT (permissive) · 9c10e0c8cad8f8a1 · report
LearningModel ml-agents/mlagents/trainers/sac/models.py unverified MIT (permissive) · c3809b45fe3af363 · report
LearningRateSchedule ml-agents/mlagents/trainers/sac/models.py unverified MIT (permissive) · 709bf3140064269c · report
SACModel ml-agents/mlagents/trainers/sac/models.py unverified MIT (permissive) · 7b82c41b5ad0e056 · report
SACNetwork ml-agents/mlagents/trainers/sac/models.py unverified MIT (permissive) · 338005115fd3efac · report
SACPolicyNetwork ml-agents/mlagents/trainers/sac/models.py unverified MIT (permissive) · 8a1d8ca5ca9e0472 · report
SACTargetNetwork ml-agents/mlagents/trainers/sac/models.py unverified MIT (permissive) · ac81a4e465c9a89b · report
UnityException ml-agents/mlagents/trainers/sac/models.py unverified MIT (permissive) · 2d6179a73f14ca5e · report
UnityTrainerException ml-agents/mlagents/trainers/sac/models.py unverified MIT (permissive) · 28af75dd1e756e4d · report
b06b01073/continuous-control community (archive-listed) 3 samples, 3 ran (0 instrument-failed) · 0 unverified
Actor in 68 papers ddpg.py ran no licence file found · pointer only · b7b4ba4db14ceff3 · report fixture: returned Actor · level recorded 2026-09-22
Agent in 42 papers ddpg.py ran no licence file found · pointer only · b5564eaf87a00dd7 · report fixture: returned Agent · level recorded 2026-09-22
Critic in 60 papers ddpg.py ran no licence file found · pointer only · ba54cbfa6390641d · report fixture: returned Critic · level recorded 2026-09-22
backgom2357/Recommender_system_via_deep_RL community (archive-listed) 1 sample, 0 ran · 1 unverified
ActorNetwork actor.py unverified no licence file found · pointer only · 9c01f30e9f1052e8 · report
baturaysaglam/RIS-MISO-Deep-Reinforcement-Learning community (archive-listed) 3 samples, 3 ran (0 instrument-failed) · 0 unverified
Actor in 68 papers DDPG.py ran fingerprinted MIT (permissive) · 6eca632bf823e7db · report fixture: returned Actor · level recorded 2026-09-22
Critic in 60 papers DDPG.py ran MIT (permissive) · 65567268c56c2f46 · report fixture: returned Critic · level recorded 2026-09-22
DDPG DDPG.py ran MIT (permissive) · 84cb9968a76ef8e6 · report fixture: returned DDPG · level recorded 2026-09-22
baturaysaglam/ac-off-poc community (archive-listed) 3 samples, 3 ran (0 instrument-failed) · 0 unverified
AC_Off_POC_DDPG DDPG & TD3/AC_Off_POC_DDPG.py ran MIT (permissive) · f13dfb890ccc97a8 · report fixture: returned AC_Off_POC_DDPG · level recorded 2026-09-22
Actor in 68 papers DDPG & TD3/AC_Off_POC_DDPG.py ran · metamorphic tier: deterministic fingerprinted MIT (permissive) · 024ce7deaed96813 · report fixture: returned Actor · level recorded 2026-09-22
Critic in 60 papers DDPG & TD3/AC_Off_POC_DDPG.py ran · metamorphic tier: deterministic MIT (permissive) · f2987dfa659c5d53 · report fixture: returned Critic · level recorded 2026-09-22
biemann/Continuous-Control community (archive-listed) 4 samples, 3 ran (0 instrument-failed) · 1 unverified
Actor in 68 papers ddpg_agent.py ran fingerprinted no licence file found · pointer only · 59b451ca369c1de8 · report fixture: returned Actor · level recorded 2026-09-22
Critic in 60 papers ddpg_agent.py ran no licence file found · pointer only · b78a712913941f90 · report fixture: returned Critic · level recorded 2026-09-22
OUNoise in 6 papers ddpg_agent.py ran no licence file found · pointer only · 06e140e447cd7fb3 · report fixture: returned OUNoise · level recorded 2026-09-22
Agent in 42 papers ddpg_agent.py unverified no licence file found · pointer only · 364b3433ab267478 · report
bmeyers/VirtualMicrogridSegmentation community (archive-listed) 8 samples, 4 ran (0 instrument-failed) · 4 unverified
LinearSchedule virtual_microgrids/algorithms/ddpg.py ran fingerprinted BSD-2-Clause (permissive) · 8496458fca8ba950 · report fixture: signature t:int/0/int · returned NoneType · level recorded 2026-09-24
LogSchedule virtual_microgrids/algorithms/ddpg.py ran · metamorphic tier: deterministic fingerprinted BSD-2-Clause (permissive) · cada5e0bd569171d · report fixture: signature t:int/0/int · returned NoneType · level recorded 2026-09-22
ReplayBuffer in 33 papers virtual_microgrids/algorithms/ddpg.py ran · metamorphic tier: well formed fingerprinted BSD-2-Clause (permissive) · 88607f875726a410 · report fixture: signature batch_size:int/0/int · returned tuple · level recorded 2026-09-22
get_logger in 383 papers virtual_microgrids/algorithms/ddpg.py ran BSD-2-Clause (permissive) · 0132cf6a5e04f2ad · report fixture: signature filename:str/0/str · returned Logger · level recorded 2026-09-22
ActorNetwork virtual_microgrids/algorithms/ddpg.py unverified BSD-2-Clause (permissive) · fbe0975fffcc8005 · report
CriticNetwork in 5 papers virtual_microgrids/algorithms/ddpg.py unverified BSD-2-Clause (permissive) · 4644458fd0a4374e · report
DDPG virtual_microgrids/algorithms/ddpg.py unverified BSD-2-Clause (permissive) · 42c7eae4db28a7cb · report
export_plot virtual_microgrids/algorithms/ddpg.py unverified BSD-2-Clause (permissive) · dfd2f69c5bd6bd73 · report
claudeHifly/BipedalWalker-v3 community (archive-listed) 4 samples, 4 ran (0 instrument-failed) · 0 unverified
Actor in 68 papers DDPG/ddpg_agent.py ran fingerprinted no licence file found · pointer only · 328c50f6e3095851 · report fixture: returned Actor · level recorded 2026-09-22
Agent in 42 papers DDPG/ddpg_agent.py ran no licence file found · pointer only · 584aca50891286f5 · report fixture: returned Agent · level recorded 2026-09-22
Critic in 60 papers DDPG/ddpg_agent.py ran no licence file found · pointer only · 6e0920a743c03903 · report fixture: returned Critic · level recorded 2026-09-22
OUNoise in 6 papers DDPG/ddpg_agent.py ran no licence file found · pointer only · affd388fecde62eb · report fixture: returned OUNoise · level recorded 2026-09-22
dan-lennox/ml-udacity-quadcopter-rl community (archive-listed) 5 samples, 2 ran (0 instrument-failed) · 3 unverified
OUNoise in 6 papers agents/agent.py ran no licence file found · pointer only · 046c7d82e0f35a06 · report fixture: returned OUNoise · level recorded 2026-09-22
ReplayBuffer in 33 papers agents/agent.py ran no licence file found · pointer only · 48908dfdd43f1c2f · report fixture: returned ReplayBuffer · level recorded 2026-09-22
Actor in 68 papers agents/agent.py unverified no licence file found · pointer only · 8bd7d62053fbfae5 · report
Critic in 60 papers agents/agent.py unverified no licence file found · pointer only · 42b59cfab688e3f5 · report
DDPG agents/agent.py unverified no licence file found · pointer only · 51208e609141fcee · report
dchetelat/acer community (archive-listed) 2 samples, 0 ran · 2 unverified
ActorCritic in 10 papers brain.py unverified MIT (permissive) · 26052e22d5d45a91 · report
ContinuousActorCritic brain.py unverified MIT (permissive) · 53c5f2f2df73a0e0 · report
denizmguen/IANNWTF2019-Project community (archive-listed) 3 samples, 0 ran · 3 unverified
DDPGAgent in 5 papers ddpg.py unverified no licence file found · pointer only · 5b513793c76f96d8 · report
OrnsteinUhlenbeck ddpg.py unverified no licence file found · pointer only · cd47b224d263fba6 · report
ReplayBuffer in 33 papers ddpg.py unverified no licence file found · pointer only · 49ac8c4b2338f149 · report
dfki-ric-underactuated-lab/torque_limited_simple_pendulum community (archive-listed) 11 samples, 9 ran (3 instrument-failed) · 2 unverified
Agent in 42 papers software/python/simple_pendulum/reinforcement_learning/ddpg/ddpg.py ran BSD-3-Clause (permissive) · d7979806fed71eee · report fixture: returned Agent · level recorded 2026-09-22
OUActionNoise software/python/simple_pendulum/reinforcement_learning/ddpg/ddpg.py ran BSD-3-Clause (permissive) · ed77765a89c3c5ba · report fixture: returned OUActionNoise · level recorded 2026-09-22
PendulumPlant software/python/simple_pendulum/reinforcement_learning/ddpg/ddpg.py ran BSD-3-Clause (permissive) · eb1ba8dec1905c59 · report fixture: returned PendulumPlant · level recorded 2026-09-22
ReplayBuffer in 33 papers software/python/simple_pendulum/reinforcement_learning/ddpg/ddpg.py ran BSD-3-Clause (permissive) · 3869ba95ec3a2e1a · report fixture: returned ReplayBuffer · level recorded 2026-09-22
SimplePendulumEnv software/python/simple_pendulum/reinforcement_learning/ddpg/ddpg.py ran BSD-3-Clause (permissive) · 837dcd3ff834a51f · report fixture: returned SimplePendulumEnv · level recorded 2026-09-22
Simulator software/python/simple_pendulum/reinforcement_learning/ddpg/ddpg.py ran BSD-3-Clause (permissive) · 1d2fffeddc2ad914 · report fixture: returned Simulator · level recorded 2026-09-22
get_actor software/python/simple_pendulum/reinforcement_learning/ddpg/ddpg.py ran; the contract check could not run (RAISES) BSD-3-Clause (permissive) · 5f358d33ffd43ed3 · report fixture: signature state_shape:tuple/1/int, upper_bound:float/0/float, verbose:bool/0/bool · returned Functional · level recorded 2026-09-22
get_arrow software/python/simple_pendulum/reinforcement_learning/ddpg/ddpg.py ran · our draft was wrong BSD-3-Clause (permissive) · 57f92caea351b30b · report fixture: signature radius:float/0/float, centX:float/0/float, centY:float/0/float, angle_:float/0/float, theta2_:float/0/float, color_:str/0/str · returned tuple · level recorded 2026-09-22
get_critic software/python/simple_pendulum/reinforcement_learning/ddpg/ddpg.py ran; the contract check could not run (RAISES) BSD-3-Clause (permissive) · a143a950a76e3523 · report fixture: signature state_shape:tuple/1/int, n_actions:int/0/int, verbose:bool/0/bool · returned Functional · level recorded 2026-09-22
ddpg_trainer software/python/simple_pendulum/reinforcement_learning/ddpg/ddpg.py unverified BSD-3-Clause (permissive) · fa624e896014aa19 · report
set_arrow_properties software/python/simple_pendulum/reinforcement_learning/ddpg/ddpg.py unverified BSD-3-Clause (permissive) · c6840dd2ce1ed774 · report
dpoulopoulos/drl_collaborate_compete community (archive-listed) 4 samples, 4 ran (0 instrument-failed) · 0 unverified
Critic in 60 papers ddpg_agent.py ran · metamorphic tier: deterministic no licence file found · pointer only · 4210d97aa24222d8 · report fixture: returned Critic · level recorded 2026-09-22
DDPGAgent in 5 papers ddpg_agent.py ran no licence file found · pointer only · 037ce510df007080 · report fixture: returned DDPGAgent · level recorded 2026-09-22
OUNoise in 6 papers ddpg_agent.py ran no licence file found · pointer only · e47034c4a39da307 · report fixture: returned OUNoise · level recorded 2026-09-22
ReplayBuffer in 33 papers ddpg_agent.py ran no licence file found · pointer only · 1a3c5297309ff7b3 · report fixture: returned ReplayBuffer · level recorded 2026-09-22
dyth/doublegum community (archive-listed) 5 samples, 1 ran (0 instrument-failed) · 4 unverified
PRNGKeys policies_cont/agents/DDPG.py ran BSD-3-Clause (permissive) · f6a31a3f71f0c87a · report fixture: returned PRNGKeys · level recorded 2026-09-22
Actor in 68 papers policies_cont/agents/DDPG.py unverified BSD-3-Clause (permissive) · c5cbbbbfdd3a367c · report
Critic in 60 papers policies_cont/agents/DDPG.py unverified BSD-3-Clause (permissive) · 6040d49d762613d7 · report
DDPG policies_cont/agents/DDPG.py unverified BSD-3-Clause (permissive) · 7c027fdd3a59bfb8 · report
sn policies_cont/agents/DDPG.py unverified BSD-3-Clause (permissive) · 0374c56639501f7a · report
fhbzc/FishAgentSimulation community (archive-listed) 1 sample, 0 ran · 1 unverified
Actor in 68 papers train_RL.py unverified no licence file found · pointer only · 0d51c1e5212918ec · report
floodsung/DDPG community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
makeFilteredEnv filter_env.py ran MIT (permissive) · f39751e02169b745 · report fixture: signature env:SimpleEnv/0/? · returned FilteredEnv · level recorded 2026-09-26
fshamshirdar/pytorch-rdpg community (archive-listed) 13 samples, 10 ran (1 instrument-failed) · 3 unverified
AnnealedGaussianProcess rdpg.py ran no licence file found · pointer only · 3ad5029d3ca03531 · report fixture: returned AnnealedGaussianProcess · level recorded 2026-09-22
Critic in 60 papers rdpg.py ran · metamorphic tier: deterministic no licence file found · pointer only · 060c46e5cc508cc5 · report fixture: returned Critic · level recorded 2026-09-22
EpisodicMemory rdpg.py ran no licence file found · pointer only · 07b241d4ab8ac0cb · report fixture: returned EpisodicMemory · level recorded 2026-09-22
Evaluator in 8 papers rdpg.py ran no licence file found · pointer only · ff0baff75d5cb615 · report fixture: returned Evaluator · level recorded 2026-09-22
Memory in 19 papers rdpg.py ran no licence file found · pointer only · a5e014313403ae12 · report fixture: returned Memory · level recorded 2026-09-22
OrnsteinUhlenbeckProcess rdpg.py ran no licence file found · pointer only · 37ebaf510f179bf4 · report fixture: returned OrnsteinUhlenbeckProcess · level recorded 2026-09-22
RandomProcess rdpg.py ran no licence file found · pointer only · ab1c58fa8208bfec · report fixture: returned RandomProcess · level recorded 2026-09-22
RingBuffer rdpg.py ran no licence file found · pointer only · 3f3476b061f68f18 · report fixture: returned RingBuffer · level recorded 2026-09-22
fanin_init in 12 papers rdpg.py ran; the contract check could not run (RAISES) · metamorphic tier: well formed fingerprinted no licence file found · pointer only · 0d0842514b1844a1 · report fixture: signature size:tuple/1/int, fanin:NoneType/0/? · returned Tensor · level recorded 2026-09-22
zeroed_observation rdpg.py ran · honoured contract fingerprinted no licence file found · pointer only · b5cc72675b688b00 · report fixture: signature observation:ndarray/2/float · returned ndarray · level recorded 2026-09-22
Actor in 68 papers rdpg.py unverified no licence file found · pointer only · 958765de0feeec56 · report
Agent in 42 papers rdpg.py unverified no licence file found · pointer only · f21df3758ed39418 · report
RDPG rdpg.py unverified no licence file found · pointer only · 66f422ab00f28663 · report
ghliu/pytorch-ddpg community (archive-listed) 6 samples, 5 ran (0 instrument-failed) · 1 unverified
Actor in 68 papers ddpg.py ran · metamorphic tier: deterministic fingerprinted Apache-2.0 (permissive) · fb986aef8cb19dcb · report fixture: returned Actor · level recorded 2026-09-22
Critic in 60 papers ddpg.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · f93619eb32cfaf3d · report fixture: returned Critic · level recorded 2026-09-22
RingBuffer ddpg.py ran Apache-2.0 (permissive) · a3c118a9e035f7e4 · report fixture: returned RingBuffer · level recorded 2026-09-22
SequentialMemory ddpg.py ran Apache-2.0 (permissive) · 980051699184bfdd · report fixture: returned SequentialMemory · level recorded 2026-09-22
sample_batch_indexes in 5 papers ddpg.py ran · honoured contract fingerprinted Apache-2.0 (permissive) · 6298e4cee53206cd · report fixture: signature low:int/0/int, high:int/0/int, size:int/0/int · returned list · level recorded 2026-09-22
DDPG ddpg.py unverified Apache-2.0 (permissive) · 5145b262fcd6a876 · report
guillaumeboniface/reacher community (archive-listed) 4 samples, 3 ran (0 instrument-failed) · 1 unverified
AgentMemory ddpg_controller.py ran no licence file found · pointer only · 259742c65c2d6559 · report fixture: returned AgentMemory · level recorded 2026-09-22
Critic in 60 papers ddpg_controller.py ran no licence file found · pointer only · e48c1f362301c6a8 · report fixture: returned Critic · level recorded 2026-09-22
Policy in 23 papers ddpg_controller.py ran fingerprinted no licence file found · pointer only · 4e16ab1aa52fc01f · report fixture: returned Policy · level recorded 2026-09-22
DDPGController ddpg_controller.py unverified no licence file found · pointer only · 078c84de4438f91b · report
halajadallah/RL-Quadcopter_project community (archive-listed) 3 samples, 0 ran · 3 unverified
Actor in 68 papers agents/agent_modified.py unverified no licence file found · pointer only · 75b2da574221eee2 · report
Critic in 60 papers agents/agent_modified.py unverified no licence file found · pointer only · c5b393b179d8d497 · report
DDPG agents/agent_modified.py unverified no licence file found · pointer only · 8190363f4546bfd1 · report
hamishs/JAX-RL community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
DDPG src/jax_rl/algorithms/ddpg.py ran fingerprinted MIT (permissive) · cf91990d28ccf56a · report fixture: signature batch_size:int/0/int · returned NoneType · level recorded 2026-09-24
hemilpanchiwala/Hindsight-Experience-Replay community (archive-listed) 4 samples, 3 ran (0 instrument-failed) · 1 unverified
Actor in 68 papers ddpg_with_her/DDPGAgent.py ran no licence file found · pointer only · 00d63e51f73faefb · report fixture: returned Actor · level recorded 2026-09-22
Critic in 60 papers ddpg_with_her/DDPGAgent.py ran no licence file found · pointer only · 55f075a92d493d35 · report fixture: returned Critic · level recorded 2026-09-22
OrnsteinUhlenbeckActionNoise ddpg_with_her/DDPGAgent.py ran no licence file found · pointer only · 642df90cf8f1851a · report fixture: returned OrnsteinUhlenbeckActionNoise · level recorded 2026-09-22
DDPGAgent in 5 papers ddpg_with_her/DDPGAgent.py unverified no licence file found · pointer only · 76a41f814d76f5c0 · report
iDataist/Continuous-Control-with-Deep-Deterministic-Policy-Gradient community (archive-listed) 5 samples, 4 ran (0 instrument-failed) · 1 unverified
Actor in 68 papers ddpg_agent.py ran · metamorphic tier: deterministic fingerprinted MIT (permissive) · 64db7b42a6e83850 · report fixture: returned Actor · level recorded 2026-09-22
Critic in 60 papers ddpg_agent.py ran · metamorphic tier: deterministic MIT (permissive) · b6d3efae859b7b5b · report fixture: returned Critic · level recorded 2026-09-22
OUNoise in 6 papers ddpg_agent.py ran MIT (permissive) · f0163af304a40792 · report fixture: returned OUNoise · level recorded 2026-09-22
ReplayBuffer in 33 papers ddpg_agent.py ran MIT (permissive) · 6258582b31c25005 · report fixture: returned ReplayBuffer · level recorded 2026-09-22
Agent in 42 papers ddpg_agent.py unverified MIT (permissive) · beb77bbddb9714ae · report
iDataist/Tennis-With-Multi-Agent-Reinforcement community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
Actor in 68 papers model.py ran · metamorphic tier: invariant fingerprinted MIT (permissive) · d96d6110c00ab9d4 · report fixture: signature state:Tensor/2/float · returned Tensor · level recorded 2026-09-22
krasing/DRLearningCollaboration community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
Actor in 68 papers model.py ran fingerprinted no licence file found · pointer only · b0866a4da4a62415 · report fixture: returned Actor · level recorded 2026-09-22
krasing/DRLearningContinuousControl community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
Actor in 68 papers ddpg_agent.py ran fingerprinted no licence file found · pointer only · dc8d86e2dc6fd389 · report fixture: returned Actor · level recorded 2026-09-22
Agents ddpg_agent.py unverified no licence file found · pointer only · dcf4d6df3ff30ac0 · report
liampetti/DDPG community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
ReplayBuffer in 33 papers ddpg.py ran no licence file found · pointer only · 532a74ad7f880104 · report fixture: returned ReplayBuffer · level recorded 2026-09-22
train in 522 papers ddpg.py unverified no licence file found · pointer only · 7f073c276baecc11 · report
madhur-tandon/RL-Project community (archive-listed) 5 samples, 4 ran (0 instrument-failed) · 1 unverified
Actor in 68 papers agent.py ran no licence file found · pointer only · c3081f2569beb64e · report fixture: returned Actor · level recorded 2026-09-22
Critic in 60 papers agent.py ran no licence file found · pointer only · 6e1fded857f54d7a · report fixture: returned Critic · level recorded 2026-09-22
OUNoise in 6 papers agent.py ran no licence file found · pointer only · 7e2a8290108cb3ea · report fixture: returned OUNoise · level recorded 2026-09-22
ReplayBuffer in 33 papers agent.py ran no licence file found · pointer only · 87674610395558bb · report fixture: returned ReplayBuffer · level recorded 2026-09-22
Agent in 42 papers agent.py unverified no licence file found · pointer only · 661322009d0d9169 · report
madvn/DDPG community (archive-listed) 3 samples, 0 ran · 3 unverified
Actor in 68 papers ddpg/ddpg.py unverified no licence file found · pointer only · b9b27fa7acc7c73f · report
Critic in 60 papers ddpg/ddpg.py unverified no licence file found · pointer only · d5cb870eb8408c73 · report
DDPG ddpg/ddpg.py unverified no licence file found · pointer only · 397b92de9510f2f3 · report
majercakdavid/gym-virtual-quant-trading community (archive-listed) 6 samples, 3 ran (0 instrument-failed) · 3 unverified
DDPGActor agents/DDPG.py ran · metamorphic tier: invariant licence not identified · pointer only · a5d631b897e1acb6 · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22
DDPGCritic agents/DDPG.py ran · metamorphic tier: invariant licence not identified · pointer only · 7869f0d6349f369b · report fixture: signature x:Tensor/2/float, actions:Tensor/2/float · returned Tensor · level recorded 2026-09-22
LinearLN agents/DDPG.py ran · metamorphic tier: invariant licence not identified · pointer only · 83a88d1e71ef2df5 · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22
BaseAgent in 20 papers agents/DDPG.py unverified licence not identified · pointer only · ddcc51cfeb97e2a4 · report
DDPG agents/DDPG.py unverified licence not identified · pointer only · 3355949c0d857a6e · report
fan_in_uniform_init agents/DDPG.py unverified licence not identified · pointer only · af08b37858b1dd07 · report
marload/DeepRL-TensorFlow2 community (archive-listed) 4 samples, 1 ran (0 instrument-failed) · 3 unverified
ReplayBuffer in 33 papers DDPG/DDPG_Continuous.py ran Apache-2.0 (permissive) · 031efd28ccd13e08 · report fixture: returned ReplayBuffer · level recorded 2026-09-22
Actor in 68 papers DDPG/DDPG_Continuous.py unverified Apache-2.0 (permissive) · 8f5f60d9f1d5e30f · report
Agent in 42 papers DDPG/DDPG_Continuous.py unverified Apache-2.0 (permissive) · f3ea6018cdcc0b04 · report
Critic in 60 papers DDPG/DDPG_Continuous.py unverified Apache-2.0 (permissive) · 7f050e7ce4583465 · report
massquantity/DBRL community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
DDPG dbrl/models/ddpg.py ran no licence file found · pointer only · 28eeee629d33c0ad · report fixture: returned DDPG · level recorded 2026-09-22
mathformoso/RL-playground---ddpg community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
Memory in 19 papers DDPG.py ran MIT (permissive) · ccb0aa1ef035eb8e · report fixture: returned Memory · level recorded 2026-09-22
Ddpg DDPG.py unverified MIT (permissive) · 95b0927e10c3dd78 · report
parilo/rl-server community (archive-listed) 1 sample, 0 ran · 1 unverified
ContinuousDeepQ tf_rl/controller/continuous_deepq.py unverified no licence file found · pointer only · 749aa0dd2a4c1d09 · report
samuelmat19/DDPG-tf2 community (archive-listed) 5 samples, 2 ran (1 instrument-failed) · 3 unverified
ActorNetwork src/model.py ran · our draft was wrong MIT (permissive) · dff03781c5d0b378 · report fixture: signature num_states:int/0/int, num_actions:int/0/int, action_high:int/0/int · returned Functional · level recorded 2026-09-22
OUActionNoise src/model.py ran · metamorphic tier: well formed MIT (permissive) · 35d7e5f360ca6981 · report fixture: returned ndarray · level recorded 2026-09-22
Brain src/model.py unverified MIT (permissive) · 5fe982c3dc2394d3 · report
CriticNetwork in 5 papers src/model.py unverified MIT (permissive) · 6bb81ff3c30fb32a · report
ReplayBuffer in 33 papers src/model.py unverified MIT (permissive) · 0d2b4efe0274fc66 · report
saoudh/Reinforcement-Learning community (archive-listed) 1 sample, 0 ran · 1 unverified
DDPG DDPG-master/rllab/DDPG.py unverified no licence file found · pointer only · eb9e7e016a76b1f8 · report
shahabi8/Deep-Reinforcement-Learning community (archive-listed) 3 samples, 0 ran · 3 unverified
Actor in 68 papers DDGP.py unverified no licence file found · pointer only · ef0c12a6692597db · report
Critic in 60 papers DDGP.py unverified no licence file found · pointer only · 0872133cc6e7eee2 · report
DDPG DDGP.py unverified no licence file found · pointer only · 499a19e5cb3d719d · report
shehrum/RL_Continous-Control community (archive-listed) 1 sample, 0 ran · 1 unverified
Agent in 42 papers ddpg_agent.py unverified no licence file found · pointer only · 2216995588e06169 · report
sliao-mi-luku/DeepRL-multiple-agents-tennis-udacity-drlnd-p3 community (archive-listed) 3 samples, 2 ran (0 instrument-failed) · 1 unverified
ActorNetwork maddpgAgent.py ran · metamorphic tier: deterministic no licence file found · pointer only · 5869ee9ef41338a4 · report fixture: returned ActorNetwork · level recorded 2026-09-22
CriticNetwork in 5 papers maddpgAgent.py ran · metamorphic tier: deterministic no licence file found · pointer only · b796e48c52beebc5 · report fixture: returned CriticNetwork · level recorded 2026-09-22
MADDPG_Agent maddpgAgent.py unverified no licence file found · pointer only · ed80a9cbb590756d · report
soumik12345/DDPG community (archive-listed) 1 sample, 0 ran · 1 unverified
DDPGAgent in 5 papers src/agents.py unverified no licence file found · pointer only · fb2a2e6b4cc0d551 · report
stevenpjg/ddpg-aigym community (archive-listed) 4 samples, 0 ran · 4 unverified
ActorNet ddpg.py unverified MIT (permissive) · 0d7cb0b9cab3eb74 · report
CriticNet ddpg.py unverified MIT (permissive) · b616451b9c41d0be · report
DDPG ddpg.py unverified MIT (permissive) · a6abf3bfff439ec4 · report
grad_inverter ddpg.py unverified MIT (permissive) · 88db7be53206704c · report
susan-amin/SparseBaseline1 community (archive-listed) 1 sample, 0 ran · 1 unverified
DDPG engine/algorithms/DDPG/ddpg.py unverified no licence file found · pointer only · 752f0cadbbfe89a3 · report
tegg89/DLCamp_Jeju2018 community (archive-listed) 7 samples, 1 ran (0 instrument-failed) · 6 unverified
init_list_of_vertex env_processing/shaping.py ran Apache-2.0 (permissive) · d108d1b5ff426750 · report fixture: signature board:ndarray/2/int · returned tuple · level recorded 2026-09-25
batch_norm in 46 papers models/action_execution/actor_critic_nn.py unverified Apache-2.0 (permissive) · 930b524d6b021ed1 · report
check_next_to_bomb env_processing/shaping.py unverified Apache-2.0 (permissive) · c04864a6841339e7 · report
discretize in 13 papers models/action_execution/actor_critic_nn.py unverified Apache-2.0 (permissive) · e95e6dd3a35646ba · report
model_NN1 models/graph_construction/NN1.py unverified Apache-2.0 (permissive) · 8e9ed77aca673ea4 · report
model_NN2 models/action_execution/NN2.py unverified Apache-2.0 (permissive) · 13e0cdee9d418dbc · report
reward_shaping env_processing/shaping.py unverified Apache-2.0 (permissive) · 093c23bdbb785c8a · report
tegg89/mann community (archive-listed) 1 sample, 0 ran · 1 unverified
ActorNetwork models/action_execution/actor_critic_nn.py unverified Apache-2.0 (permissive) · abffeadabe12af6b · report
tensorlayer/RLzoo community (archive-listed) 1 sample, 0 ran · 1 unverified
DDPG rlzoo/algorithms/ddpg/ddpg.py unverified Apache-2.0 (permissive) · c328a2f2ee939de2 · report
thainv0212/re-ddpg community (archive-listed) 1 sample, 0 ran · 1 unverified
DDPG ddpg.py unverified MIT (permissive) · d09f9c9f2dc485f8 · report
tilkb/thermoai community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
DDPG controller/RL/DDPG.py ran no licence file found · pointer only · a8bd327c1c912a9d · report fixture: signature dataset:_TensorSliceDataset/0/?, epoch:int/0/int, objective:str/0/str · returned NoneType · level recorded 2026-09-24
ReplayMemory in 11 papers controller/RL/DDPG.py unverified no licence file found · pointer only · 9d5ea952455199bc · report
wassname/rl-portfolio-management community (archive-listed) 4 samples, 2 ran (0 instrument-failed) · 2 unverified
MDD rl_portfolio_management/util.py ran fingerprinted MIT (permissive) · b2a68c19e99020f6 · report fixture: signature X:list/1/float · returned float · level recorded 2026-09-26
concat_states rl_portfolio_management/wrappers/concat_states.py ran MIT (permissive) · 5a5eafa2c20fcefe · report fixture: signature state:dict/0/? · returned ndarray · level recorded 2026-09-26
sharpe rl_portfolio_management/util.py unverified MIT (permissive) · af1d4d0c4d0351c5 · report
wpiszlogin/driver_critic community (archive-listed) 1 sample, 0 ran · 1 unverified
BaseSolution base_solution.py unverified MIT (permissive) · 746b1c49c2b69b79 · report
wwydmanski/rl_tennis community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
Actor in 68 papers brain/model.py ran fingerprinted no licence file found · pointer only · 462527aca7c44cd5 · report fixture: returned Actor · level recorded 2026-09-22
xtma/simple-pytorch-rl community (archive-listed) 4 samples, 4 ran (0 instrument-failed) · 0 unverified
ActorNet ddpg.py ran · metamorphic tier: deterministic no licence file found · pointer only · 1e7906d3e94a41ce · report fixture: returned ActorNet · level recorded 2026-09-22
Agent in 42 papers ddpg.py ran no licence file found · pointer only · 7167793e1651d552 · report fixture: returned Agent · level recorded 2026-09-22
CriticNet ddpg.py ran no licence file found · pointer only · fa4e45cc6c3c6500 · report fixture: signature s:Tensor/2/float, a:Tensor/2/float · returned Tensor · level recorded 2026-09-24
Memory in 19 papers ddpg.py ran no licence file found · pointer only · dc27eb092679d1d2 · report fixture: returned Memory · level recorded 2026-09-22
xyshadow/baseline_ddpg community (archive-listed) 1 sample, 0 ran · 1 unverified
DDPG_agent ddpg.py unverified Apache-2.0 (permissive) · af8a78d9208cc109 · report
yukezhu/tensorflow-reinforce community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
ReplayBuffer in 33 papers rl/pg_ddpg.py ran MIT (permissive) · 3c7178cf937ba425 · report fixture: returned ReplayBuffer · level recorded 2026-09-22
DeepDeterministicPolicyGradient rl/pg_ddpg.py unverified MIT (permissive) · ff673a112b0d8acd · report
JorgeA-RD/Reinforcement-Learning-Agents community (archive-listed) 3 samples, 3 ran (0 instrument-failed) · 0 unverified
DDPG_Agent DDPG/DDPG_Agent.py ran no licence file found · pointer only · 61958a4594b078dd · report fixture: returned DDPG_Agent · level recorded 2026-09-22
actor_netw DDPG/DDPG_Agent.py ran no licence file found · pointer only · 417fff584ab90a11 · report fixture: returned actor_netw · level recorded 2026-09-22
critic_netw DDPG/DDPG_Agent.py ran no licence file found · pointer only · 90cab8ba8631c2f8 · report fixture: returned critic_netw · level recorded 2026-09-22
arnomoonens/yarll community (archive-listed) 3 samples, 3 ran (0 instrument-failed) · 0 unverified
ActorCriticNetwork in 5 papers yarll/agents/tf2/actorcritic/actor_critic.py ran MIT (permissive) · 491a0ea3930828b7 · report fixture: returned ActorCriticNetwork · level recorded 2026-09-22
ActorCriticNetworkContinuous yarll/agents/tf2/actorcritic/actor_critic.py ran MIT (permissive) · 5223341b731ed4cb · report fixture: returned ActorCriticNetworkContinuous · level recorded 2026-09-22
NormalDistrLayer yarll/agents/tf2/actorcritic/actor_critic.py ran MIT (permissive) · 4fcd027380e5ca56 · report fixture: returned NormalDistrLayer · level recorded 2026-09-22
Repository not located 1 sample, 1 ran (1 instrument-failed) · 0 unverified
1 sample is identical to code Syntology harvested from another paper's repository; this paper's own copy was not located, so no repository is named and no licence is recorded.
fanin_init in 12 papers repository not located ran; the contract check could not run (RAISES) · metamorphic tier: well formed fingerprinted licence of this copy not recorded · 825ecb6732e9fc31 · report fixture: signature size:tuple/1/int, fanin:int/0/int · returned Tensor · level recorded 2026-09-22

Method as code Syntology

What Syntology's graph records as this paper's claimed method, lifted into code: each assembly names its bricks (functions and classes), each with its own role and its own verification level. An assembly is not a check that the code implements the method correctly or reproduces the paper's results. Levels are each brick's own verification level in Syntology's graph (level 0: no recorded run), listed brick by brick and never combined into one level; “ran” means the brick executed on a synthesized input, not that its output is correct, and the instrument figure counts failures of Syntology's instrument, not of the code. Where a model read the code against the paper's claim, each assembly's label verdict is one model's judgement, kept in this page's JSON twin; it is not calibrated, so no card prints it. Siblings are assemblies lifted from this paper in the same batch for the same method: alternative readings kept side by side; none replaces or supersedes another.

84 assemblies on this paper: 84 harvested, 0 generated, listed in 1 groups (siblings lifted in one batch form one group).

84 sibling assemblies for actor-critic, model-free algorithm based on the deterministic policy gradient (harvested), lifted in the same batch on 2026-09-09: alternative readings kept side by side; none replaces or supersedes another. Bricks printed for 12 of 84 sibling assemblies; the other 72 are listed with their counts; every brick is in this page's JSON twin.

harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 1 brick; individually on a fixture: 0 ran · 1 unverified. The assembly has not been run end-to-end.

one of 84 siblings

  1. BaseSolution entry · level 0 · unverified · 746b1c49c2b69b79

harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 7 bricks; individually on a fixture: 0 ran · 7 unverified. The assembly has not been run end-to-end.

one of 84 siblings

  1. DDPG entry · level 0 · unverified · 9f83c78d8022ed75
  2. ActorNet model · level 0 · unverified · 36fb14c831b75e4f
  3. ActorNet_bn model · level 0 · unverified · 883fbd58c181e487
  4. CriticNet model · level 0 · unverified · 42be45cafdda9bc6
  5. CriticNet_bn helper · level 0 · unverified · 2961cc94350daaae
  6. grad_inverter helper · level 0 · unverified · ff560a45eef0d026
  7. batch_norm helper · level 0 · unverified · 7484fd6def5722c7

harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 2 bricks; individually on a fixture: 0 ran · 2 unverified. The assembly has not been run end-to-end.

one of 84 siblings

  1. ContinuousActorCritic entry · level 0 · unverified · 53c5f2f2df73a0e0
  2. ActorCritic model · level 0 · unverified · 26052e22d5d45a91

harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 84 siblings

  1. DeepDeterministicPolicyGradient entry · level 0 · unverified · ff673a112b0d8acd
  2. ReplayBuffer helper · level 1 · ran · 3c7178cf937ba425

harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 13 bricks; individually on a fixture: 10 ran (of which 8 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified. The assembly has not been run end-to-end.

one of 84 siblings

  1. RDPG entry · level 0 · unverified · 66f422ab00f28663
  2. Agent helper · level 0 · unverified · f21df3758ed39418
  3. EpisodicMemory helper · level 1 · ran · 07b241d4ab8ac0cb
  4. Evaluator helper · level 1 · ran · ff0baff75d5cb615
  5. Actor model · level 0 · unverified · 958765de0feeec56
  6. Critic model · level 1 · ran · 060c46e5cc508cc5
  7. OrnsteinUhlenbeckProcess helper · level 1 · ran · 37ebaf510f179bf4
  8. Memory helper · level 1 · ran · a5e014313403ae12
  9. RingBuffer helper · level 1 · ran · 3f3476b061f68f18
  10. fanin_init helper · level 1 · ran; the contract check could not run (RAISES) · 0d0842514b1844a1
  11. AnnealedGaussianProcess helper · level 1 · ran · 3ad5029d3ca03531
  12. zeroed_observation helper · level 1 · ran · honoured contract · b5cc72675b688b00
  13. RandomProcess helper · level 1 · ran · ab1c58fa8208bfec

harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 4 bricks; individually on a fixture: 4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified. The assembly has not been run end-to-end.

one of 84 siblings

  1. Agent entry · level 1 · ran · 7167793e1651d552
  2. ActorNet model · level 1 · ran · 1e7906d3e94a41ce
  3. CriticNet model · level 1 · ran · fa4e45cc6c3c6500
  4. Memory sampler · level 1 · ran · dc27eb092679d1d2

harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 4 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 4 samples that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 84 siblings

  1. DDPGAgent entry · level 1 · ran · 037ce510df007080
  2. Critic model · level 1 · ran · 4210d97aa24222d8
  3. OUNoise helper · level 1 · ran · e47034c4a39da307
  4. ReplayBuffer helper · level 1 · ran · 1a3c5297309ff7b3

harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 5 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 84 siblings

  1. DDPG entry · level 0 · unverified · ced83557bfb5a383
  2. ActorNetwork model · level 0 · unverified · 18c75ab6a06581a4
  3. CriticNetwork model · level 0 · unverified · ebdd58004bdf82fd
  4. OUNoise helper · level 1 · ran · 85896c6b57d5891f
  5. ReplayBuffer helper · level 1 · ran · cbd6d4cba3c8f7b0

harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 12 bricks; individually on a fixture: 11 ran (of which 8 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified. The assembly has not been run end-to-end.

one of 84 siblings

  1. DDPG entry · level 0 · unverified · 5145b262fcd6a876
  2. Actor model · level 1 · ran · fb986aef8cb19dcb
  3. Critic model · level 1 · ran · f93619eb32cfaf3d
  4. OrnsteinUhlenbeckProcess helper · level 1 · ran · 37ebaf510f179bf4
  5. SequentialMemory helper · level 1 · ran · 980051699184bfdd
  6. fanin_init helper · level 1 · ran; the contract check could not run (RAISES) · 0d0842514b1844a1
  7. AnnealedGaussianProcess helper · level 1 · ran · 3ad5029d3ca03531
  8. Memory helper · level 1 · ran · a5e014313403ae12
  9. RingBuffer helper · level 1 · ran · a3c118a9e035f7e4
  10. sample_batch_indexes helper · level 1 · ran · honoured contract · 6298e4cee53206cd
  11. zeroed_observation helper · level 1 · ran · honoured contract · b5cc72675b688b00
  12. RandomProcess helper · level 1 · ran · ab1c58fa8208bfec

harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 7 bricks; individually on a fixture: 0 ran · 7 unverified. The assembly has not been run end-to-end.

one of 84 siblings

  1. DDPG entry · level 0 · unverified · a6abf3bfff439ec4
  2. ActorNet model · level 0 · unverified · 0d7cb0b9cab3eb74
  3. ActorNet_bn model · level 0 · unverified · 883fbd58c181e487
  4. CriticNet model · level 0 · unverified · b616451b9c41d0be
  5. CriticNet_bn helper · level 0 · unverified · 2961cc94350daaae
  6. grad_inverter helper · level 0 · unverified · 88db7be53206704c
  7. batch_norm helper · level 0 · unverified · 7484fd6def5722c7

harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 84 siblings

  1. train entry · level 0 · unverified · 7f073c276baecc11
  2. ReplayBuffer sampler · level 1 · ran · 532a74ad7f880104

harvested Assembly for actor-critic, model-free algorithm based on the deterministic policy gradient (graph method: actor-critic, model-free algorithm based on the deterministic policy gradient). 2 bricks; individually on a fixture: 0 ran · 2 unverified. The assembly has not been run end-to-end.

one of 84 siblings

  1. Agent entry · level 0 · unverified · 40c191818d46c0c5
  2. normal_dist sampler · level 0 · unverified · 54074d019aff0495
  1. DDPG · 2c8427e0e63a41d1 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[12] in the JSON twin
  2. Ddpg · 2f139426e32a47a5 · 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[13] in the JSON twin
  3. MADDPG_Agent · 3744f25c31de7afe · 3 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[14] in the JSON twin
  4. Agent · 3dee32cadc45408f · 6 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[15] in the JSON twin
  5. DDPG · 3e06a8c7ab5e471e · 3 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[16] in the JSON twin
  6. DDPG · 3f652ce5d4326917 · 7 bricks; individually on a fixture: 0 ran · 7 unverified · The assembly has not been run end-to-end · assemblies[17] in the JSON twin
  7. DDPG · 3f776ca0f59565ee · 12 bricks; individually on a fixture: 11 ran (of which 8 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[18] in the JSON twin
  8. DDPGAgent · 4324d10d32827a86 · 6 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[19] in the JSON twin
  9. DDPG · 4846ad338fbde244 · 5 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[20] in the JSON twin
  10. run_ddpg · 4b601e5f92f24f81 · 10 bricks; individually on a fixture: 6 ran (of which 5 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 4 unverified · The assembly has not been run end-to-end · assemblies[21] in the JSON twin
  11. Agent · 4d632ac3c373957c · 6 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[22] in the JSON twin
  12. NAF · 52dbca10bd4dd1b5 · 7 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 4 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[23] in the JSON twin
  13. AC_Off_POC_DDPG · 56e4aae9562efa8c · 3 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[24] in the JSON twin
  14. DDPG · 5858e61727190ae7 · 5 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[25] in the JSON twin
  15. DDPG · 5a98dbf6b7df4dab · 2 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[26] in the JSON twin
  16. Agent · 5df767b245e70484 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[27] in the JSON twin
  17. DDPGAgent · 619824e8214c2b89 · 4 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[28] in the JSON twin
  18. DDPG · 6a36d557787ed8fb · 5 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 4 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[29] in the JSON twin
  19. DDPG · 6a4d238888f8f3fa · 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[30] in the JSON twin
  20. Agent · 6c13343efa1f8ffd · 7 bricks; individually on a fixture: 7 ran (of which 6 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[31] in the JSON twin
  21. Actor · 7467f26bf299b48f · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[32] in the JSON twin
  22. DDPG · 75b425e7455741dc · 3 bricks; individually on a fixture: 0 ran · 3 unverified · The assembly has not been run end-to-end · assemblies[33] in the JSON twin
  23. DDPG · 773437a2fdc4169a · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[34] in the JSON twin
  24. ActorCriticNetworkContinuous · 782c1a473cb79310 · 3 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[35] in the JSON twin
  25. Agent · 7a29d8f92c8e0151 · 6 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[36] in the JSON twin
  26. DDPG · 7c28372ca99ab535 · 5 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[37] in the JSON twin
  27. ddpg_trainer · 7db9923735b49314 · 11 bricks; individually on a fixture: 9 ran (of which 6 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[38] in the JSON twin
  28. DDPG · 7dc40ea6e071b1ad · 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[39] in the JSON twin
  29. Agent · 7f99fd231fb9ce40 · 6 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[40] in the JSON twin
  30. Agent · 825277bfb421a534 · 6 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[41] in the JSON twin
  31. Agents · 829120e2e772e992 · 6 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[42] in the JSON twin
  32. DDPG · 83325fcb0085d203 · 3 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[43] in the JSON twin
  33. SAC · 83fe5afc7604b5ca · 15 bricks; individually on a fixture: 11 ran (of which 8 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified · The assembly has not been run end-to-end · assemblies[44] in the JSON twin
  34. MLPActor · 86052d13d9afa404 · 2 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[45] in the JSON twin
  35. policy · 86d8f385621f0bce · 2 bricks; individually on a fixture: 0 ran · 2 unverified · The assembly has not been run end-to-end · assemblies[46] in the JSON twin
  36. Actor · 935f276f542f0be0 · 2 bricks; individually on a fixture: 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[47] in the JSON twin
  37. ActorCriticDeterministic · 94002b2f6ce6ae77 · 3 bricks; individually on a fixture: 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[48] in the JSON twin
  38. DDPGAgent · 94194bb75c843d8f · 5 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 4 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[49] in the JSON twin
  39. Agent · 99316fac409eb89b · 5 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 4 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[50] in the JSON twin
  40. DDPGController · 9aace1eddd6d2474 · 4 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[51] in the JSON twin
  41. Actor · 9d08d08e65db0120 · 2 bricks; individually on a fixture: 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[52] in the JSON twin
  42. DDPG · 9d9628b94754b8fb · 5 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[53] in the JSON twin
  43. Agent · 9fb996564f47be5d · 5 bricks; individually on a fixture: 5 ran (of which 5 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 5 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[54] in the JSON twin
  44. DDPGAgent · a4abcc678a41282d · 3 bricks; individually on a fixture: 0 ran · 3 unverified · The assembly has not been run end-to-end · assemblies[55] in the JSON twin
  45. DDPG · a6b0c01430274b83 · 5 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[56] in the JSON twin
  46. ContinuousDeepQ · a7eb3fe8dadcce7f · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[57] in the JSON twin
  47. DDPG_Agent · ab3d4becf5043afe · 3 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[58] in the JSON twin
  48. Actor · ad26f00e02136613 · 2 bricks; individually on a fixture: 2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[59] in the JSON twin
  49. Agent · b15fe936990cb2cb · 4 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[60] in the JSON twin
  50. DDPGAgent · b1c6a909072dc8f5 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[61] in the JSON twin
  51. DDPG · b258d6ccfb363b8e · 3 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[62] in the JSON twin
  52. DDPG · b297b68b54988f2b · 5 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[63] in the JSON twin
  53. DDPGAgent · b5827c6082d2d907 · 5 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 4 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[64] in the JSON twin
  54. DDPG_agent · b65359aff4f7ea73 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[65] in the JSON twin
  55. ActorNetwork · baa02ded8155d9e6 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[66] in the JSON twin
  56. DDPG · bbd849fd1c40fc30 · 5 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[67] in the JSON twin
  57. DDPG · bf6e355f91e80d55 · 8 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified · The assembly has not been run end-to-end · assemblies[68] in the JSON twin
  58. Agent · c051f003e5e54ca9 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[69] in the JSON twin
  59. Brain · c46e5f0ceb121cf3 · 5 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified · The assembly has not been run end-to-end · assemblies[70] in the JSON twin
  60. DDPG · cd3c0f24c5b6f2ee · 8 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified · The assembly has not been run end-to-end · assemblies[71] in the JSON twin
  61. DDPG · cfad4b4472ed9dcb · 4 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[72] in the JSON twin
  62. DDPG · d68837aaed5c6dca · 5 bricks; individually on a fixture: 3 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[73] in the JSON twin
  63. DDPG · d72a8e9b303a30cb · 2 bricks; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[74] in the JSON twin
  64. DDPG · d75ebed945db5b3a · 6 bricks; individually on a fixture: 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified · The assembly has not been run end-to-end · assemblies[75] in the JSON twin
  65. DDPG_model · df8ea20614f74358 · 3 bricks; individually on a fixture: 0 ran · 3 unverified · The assembly has not been run end-to-end · assemblies[76] in the JSON twin
  66. Actor · e05dd8378b51e5ad · 2 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[77] in the JSON twin
  67. DDPG · e0db7cd24aba773c · 3 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[78] in the JSON twin
  68. ActorNetwork · e2985836f7078e60 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[79] in the JSON twin
  69. Actor · e9a07a0089b67d54 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[80] in the JSON twin
  70. DDPG · ebc550f5cc7160fb · 4 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[81] in the JSON twin
  71. SACModel · f0c588b70084933d · 10 bricks; individually on a fixture: 0 ran · 10 unverified · The assembly has not been run end-to-end · assemblies[82] in the JSON twin
  72. DDPG · f397dc4ab99713eb · 3 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[83] in the JSON twin

Each brick ends with its code_sha256, Syntology's identity for that exact code; click one to copy the get_code call that returns it. For agents, on Syntology's MCP service: assembly(arxiv_id="1509.02971") returns these assemblies with each brick's role and wiring (how to connect).

Tasks

Action DetectionContinuous ControlDeep Reinforcement LearningOpenAI GymQ-LearningReinforcement LearningReinforcement Learning (RL)Speech Emotion Recognitioncontinuous-control

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Continuous Control Lunar Lander (OpenAI Gym) DDPG Score 256.98±14.38 #3 of 5 Archive leaderboard report
OpenAI Gym Ant-v4 DDPG Average Return 1712.12 #4 of 5 Archive leaderboard report
OpenAI Gym HalfCheetah-v4 DDPG Average Return 14934.86 #2 of 5 Archive leaderboard report
OpenAI Gym Hopper-v4 DDPG Average Return 1290.24 #4 of 5 Archive leaderboard report
OpenAI Gym Humanoid-v4 DDPG Average Return 139.14 #5 of 5 Archive leaderboard report
OpenAI Gym Walker2d-v4 DDPG Average Return 2994.54 #3 of 5 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: DDPG

AdamBatch NormalizationConvolutionDDPGDense ConnectionsExperience ReplayQ-LearningReLUWeight Decay

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections