Papers › Comparing Observation and Action Representations for Deep Reinforcement Learning in μRTS

Comparing Observation and Action Representations for Deep Reinforcement Learning in μRTS

26 Oct 2019arXiv:1910.12134archive 2025-07-28

Shengyi Huang, Santiago Ontañón

This paper presents a preliminary study comparing different observation and action space representations for Deep Reinforcement Learning (DRL) in the context of Real-time Strategy (RTS) games. Specifically, we compare two representations: (1) a global representation where the observation represents the whole game state, and the RL agent needs to choose which unit to issue actions to, and which actions to execute; and (2) a local representation where the observation is represented from the point of view of an individual unit, and the RL agent picks actions for each unit independently. We evaluate these representations in μRTS showing that the local representation seems to outperform the global representation when training agents with the task of harvesting resources.

PaperPDFCode

Syntology This paper's arXiv id is not in Syntology's Atlas id list (549,449 ids, as this build read them; the read time is in the build record), so this page links to no Syntology page for it. The list is not the whole graph; Syntology's feed shows papers as they enter the graph.

Code

vwxyzjn/gym-microrts officialmentioned in papermentioned on GitHubpytorchSyntology: not harvested report
changpowei/MicroRTS mentioned on GitHubpytorchSyntology: not harvested report
farama-foundation/microrts-py mentioned on GitHubpytorchSyntology: not harvested report
kered9/gym-microrts mentioned on GitHubpytorchSyntology: not harvested report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Deep Reinforcement LearningReinforcement LearningReinforcement Learning (RL)reinforcement-learning

Results from the paper archive 2025-07-28

No leaderboard rows for this paper in the archive.

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections