Papers › SimAug: Learning Robust Representations from Simulation for Trajectory Prediction

SimAug: Learning Robust Representations from Simulation for Trajectory Prediction

1 Aug 2020ECCV 2020 8archive 2025-07-28

Junwei Liang, Lu Jiang, Alexander Hauptmann

This paper studies the problem of predicting future trajectories of people in unseen cameras of novel scenarios and views. We approach this problem through the real-data-free setting in which the model is trained only on 3D simulation data and applied out-of-the-box to a wide variety of real cameras. We propose a novel approach to learn robust representation through augmenting the simulation training data such that the representation can better generalize to unseen real-world test data. The key idea is to mix the feature of the hardest camera view with the adversarial feature of the original view. We refer to our method as extitSimAug. We show that extitSimAug achieves promising results on three real-world benchmarks using zero real training data, and state-of-the-art performance in the Stanford Drone and the VIRAT/ActEV dataset when using in-domain training data. Code and models are released at https://next.cs.cmu.edu/simaug

PaperPDFCode

Syntology This paper has no arXiv id in the archive, and this site joins papers to Syntology's graph by arXiv id, so this page does not say whether the graph holds it.

Code

JunweiLiang/Multiverse officialtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to The Garden of Forking Paths: Towards Multi-Future Trajectory Prediction (arXiv:1912.06445; that paper's own run record: 2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

Not run by Syntology. Nothing on this page verifies that the listed code works.

Tasks

Adversarial AttackAdversarial DefensePedestrian Trajectory PredictionTrajectory ForecastingTrajectory Prediction

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Trajectory Forecasting ActEV SimAug ADE-8/12 17.96 #1 of 2 Archive leaderboard report
Trajectory Forecasting Stanford Drone SimAug ADE-8/12 @K = 20 10.27 #1 of 1 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

SimAug

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections