{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/entropy-regularization","slug":"entropy-regularization","name":"Entropy Regularization","full_name":"Entropy Regularization","full_name_withheld":false,"description_markdown":"**Entropy Regularization** is a type of regularization used in [reinforcement learning](https://paperswithcode.com/methods/area/reinforcement-learning). For on-policy policy gradient based methods like [A3C](https://paperswithcode.com/method/a3c), the same mutual  reinforcement behaviour leads to a highly-peaked $\\pi\\left(a\\mid{s}\\right)$ towards a few actions or action sequences, since it is easier for the actor and critic to overoptimise to a small portion of the environment. To reduce this problem, entropy regularization adds an entropy term to the loss to promote action diversity:\r\n\r\n$$H(X) = -\\sum\\pi\\left(x\\right)\\log\\left(\\pi\\left(x\\right)\\right) $$\r\n\r\nImage Credit: Wikipedia","description_state":"present","introduced_year":null,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":"http://arxiv.org/abs/1602.01783v2","title":"Asynchronous Methods for Deep Reinforcement Learning","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/ikostrikov/pytorch-a3c/blob/48d95844755e2c3e2c7e48bbd1a7141f7212b63f/train.py#L100","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Regularization","url":"/methods/category/regularization","pwc_aliases":[]}],"n_papers_tagged":1128,"archive_num_papers":null,"papers_newest_first":[{"paper":"/paper/viability-of-future-actions-robust-safety-in","slug":"viability-of-future-actions-robust-safety-in","title":"Viability of Future Actions: Robust Safety in Reinforcement Learning via Entropy Regularization","date":"2025-06-12","arxiv_id":"2506.10871","n_code_links":1,"syntology":null},{"paper":null,"slug":"2506-08149","title":"Ego-centric Learning of Communicative World Models for Autonomous Driving","date":"2025-06-09","arxiv_id":"2506.08149","n_code_links":0,"syntology":null},{"paper":null,"slug":"autonomous-vehicle-lateral-control-using-deep","title":"Autonomous Vehicle Lateral Control Using Deep Reinforcement Learning with MPC-PID Demonstration","date":"2025-06-04","arxiv_id":"2506.04040","n_code_links":0,"syntology":null},{"paper":null,"slug":"ppo-in-the-fisher-rao-geometry","title":"PPO in the Fisher-Rao geometry","date":"2025-06-04","arxiv_id":"2506.03757","n_code_links":0,"syntology":null},{"paper":"/paper/redrft-a-light-weight-benchmark-for","slug":"redrft-a-light-weight-benchmark-for","title":"RedRFT: A Light-Weight Benchmark for Reinforcement Fine-Tuning-Based Red Teaming","date":"2025-06-04","arxiv_id":"2506.04302","n_code_links":1,"syntology":null},{"paper":null,"slug":"response-level-rewards-are-all-you-need-for","title":"Response-Level Rewards Are All You Need for Online Reinforcement Learning in LLMs: A Mathematical Perspective","date":"2025-06-03","arxiv_id":"2506.02553","n_code_links":0,"syntology":null},{"paper":null,"slug":"rewarding-the-unlikely-lifting-grpo-beyond","title":"Rewarding the Unlikely: Lifting GRPO Beyond Distribution Sharpening","date":"2025-06-03","arxiv_id":"2506.02355","n_code_links":0,"syntology":null},{"paper":"/paper/the-surprising-effectiveness-of-negative","slug":"the-surprising-effectiveness-of-negative","title":"The Surprising Effectiveness of Negative Reinforcement in LLM Reasoning","date":"2025-06-02","arxiv_id":"2506.01347","n_code_links":1,"syntology":{"ran":3,"of":3,"n_ran_checked":1,"n_instrument":2,"unverified":0,"pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","official":{"repos":["tianhongzxy/rlvr-decomposed"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"drivemind-a-dual-vlm-based-reinforcement","title":"DriveMind: A Dual-VLM based Reinforcement Learning Framework for Autonomous Driving","date":"2025-06-01","arxiv_id":"2506.00819","n_code_links":0,"syntology":null},{"paper":null,"slug":"language-guided-multi-agent-learning-in","title":"Language-Guided Multi-Agent Learning in Simulations: A Unified Framework and Evaluation","date":"2025-06-01","arxiv_id":"2506.04251","n_code_links":0,"syntology":null},{"paper":"/paper/using-diffusion-ensembles-to-estimate","slug":"using-diffusion-ensembles-to-estimate","title":"Using Diffusion Ensembles to Estimate Uncertainty for End-to-End Autonomous Driving","date":"2025-05-31","arxiv_id":"2506.00560","n_code_links":0,"syntology":null},{"paper":"/paper/areal-a-large-scale-asynchronous","slug":"areal-a-large-scale-asynchronous","title":"AReaL: A Large-Scale Asynchronous Reinforcement Learning System for Language Reasoning","date":"2025-05-30","arxiv_id":"2505.24298","n_code_links":1,"syntology":{"ran":10,"of":13,"n_ran_checked":10,"n_instrument":0,"unverified":3,"pointer_only":0,"phrase":"10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified","official":{"repos":["inclusionai/areal"],"state":"official (archive's flag): 10 ran","n_ran":10,"n_constructed":0,"n_ran_no_instrument_failure":10,"n_unverified":3,"ran_from_kinds":["official"]}}},{"paper":"/paper/composite-reward-design-in-ppo-driven","slug":"composite-reward-design-in-ppo-driven","title":"Composite Reward Design in PPO-Driven Adaptive Filtering","date":"2025-05-29","arxiv_id":"2506.06323","n_code_links":1,"syntology":null},{"paper":"/paper/segment-policy-optimization-effective-segment","slug":"segment-policy-optimization-effective-segment","title":"Segment Policy Optimization: Effective Segment-Level Credit Assignment in RL for Large Language Models","date":"2025-05-29","arxiv_id":"2505.23564","n_code_links":1,"syntology":{"ran":7,"of":9,"n_ran_checked":3,"n_instrument":4,"unverified":2,"pointer_only":0,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified","official":{"repos":["aiframeresearch/spo"],"state":"official (archive's flag): 7 ran","n_ran":7,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"tsenor-highly-efficient-algorithm-for-finding","title":"TSENOR: Highly-Efficient Algorithm for Finding Transposable N:M Sparse Masks","date":"2025-05-29","arxiv_id":"2505.23949","n_code_links":0,"syntology":null},{"paper":"/paper/r1-code-interpreter-training-llms-to-reason","slug":"r1-code-interpreter-training-llms-to-reason","title":"R1-Code-Interpreter: Training LLMs to Reason with Code via Supervised and Reinforcement Learning","date":"2025-05-27","arxiv_id":"2505.21668","n_code_links":1,"syntology":null},{"paper":null,"slug":"what-can-rl-bring-to-vla-generalization-an","title":"What Can RL Bring to VLA Generalization? An Empirical Study","date":"2025-05-26","arxiv_id":"2505.19789","n_code_links":0,"syntology":null},{"paper":"/paper/improving-value-estimation-critically","slug":"improving-value-estimation-critically","title":"Improving Value Estimation Critically Enhances Vanilla Policy Gradient","date":"2025-05-25","arxiv_id":"2505.19247","n_code_links":1,"syntology":null},{"paper":null,"slug":"genpo-generative-diffusion-models-meet-on","title":"GenPO: Generative Diffusion Models Meet On-Policy Reinforcement Learning","date":"2025-05-24","arxiv_id":"2505.18763","n_code_links":0,"syntology":null},{"paper":"/paper/a-robust-ppo-optimized-tabular-transformer","slug":"a-robust-ppo-optimized-tabular-transformer","title":"A Robust PPO-optimized Tabular Transformer Framework for Intrusion Detection in Industrial IoT Systems","date":"2025-05-23","arxiv_id":"2505.18234","n_code_links":1,"syntology":null},{"paper":"/paper/shioenv-a-cli-behavior-capturing-environment","slug":"shioenv-a-cli-behavior-capturing-environment","title":"ShIOEnv: A CLI Behavior-Capturing Environment Enabling Grammar-Guided Command Synthesis for Dataset Curation","date":"2025-05-23","arxiv_id":"2505.18374","n_code_links":1,"syntology":null},{"paper":"/paper/the-cell-must-go-on-agar-io-for-continual","slug":"the-cell-must-go-on-agar-io-for-continual","title":"The Cell Must Go On: Agar.io for Continual Reinforcement Learning","date":"2025-05-23","arxiv_id":"2505.18347","n_code_links":1,"syntology":null},{"paper":"/paper/raw2drive-reinforcement-learning-with-aligned","slug":"raw2drive-reinforcement-learning-with-aligned","title":"Raw2Drive: Reinforcement Learning with Aligned World Models for End-to-End Autonomous Driving (in CARLA v2)","date":"2025-05-22","arxiv_id":"2505.16394","n_code_links":0,"syntology":null},{"paper":null,"slug":"am-ppo-advantage-alpha-modulation-with","title":"AM-PPO: (Advantage) Alpha-Modulation with Proximal Policy Optimization","date":"2025-05-21","arxiv_id":"2505.15514","n_code_links":0,"syntology":null},{"paper":null,"slug":"hcrmp-a-llm-hinted-contextual-reinforcement","title":"HCRMP: A LLM-Hinted Contextual Reinforcement Learning Framework for Autonomous Driving","date":"2025-05-21","arxiv_id":"2505.15793","n_code_links":0,"syntology":null},{"paper":"/paper/ipad-iterative-proposal-centric-end-to-end","slug":"ipad-iterative-proposal-centric-end-to-end","title":"iPad: Iterative Proposal-centric End-to-End Autonomous Driving","date":"2025-05-21","arxiv_id":"2505.15111","n_code_links":1,"syntology":null},{"paper":"/paper/trajectory-bellman-residual-minimization-a","slug":"trajectory-bellman-residual-minimization-a","title":"Trajectory Bellman Residual Minimization: A Simple Value-Based Method for LLM Reasoning","date":"2025-05-21","arxiv_id":"2505.15311","n_code_links":0,"syntology":{"ran":2,"of":2,"n_ran_checked":0,"n_instrument":2,"unverified":0,"pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","official":null}},{"paper":null,"slug":"interpretable-reinforcement-learning-for-load","title":"Interpretable Reinforcement Learning for Load Balancing using Kolmogorov-Arnold Networks","date":"2025-05-20","arxiv_id":"2505.14459","n_code_links":0,"syntology":null},{"paper":null,"slug":"kippo-koopman-inspired-proximal-policy","title":"KIPPO: Koopman-Inspired Proximal Policy Optimization","date":"2025-05-20","arxiv_id":"2505.14566","n_code_links":0,"syntology":null},{"paper":null,"slug":"peer-pressure-model-to-model-regularization","title":"PEER pressure: Model-to-Model Regularization for Single Source Domain Generalization","date":"2025-05-19","arxiv_id":"2505.12745","n_code_links":0,"syntology":null},{"paper":null,"slug":"power-allocation-for-delay-optimization-in","title":"Power Allocation for Delay Optimization in Device-to-Device Networks: A Graph Reinforcement Learning Approach","date":"2025-05-19","arxiv_id":"2505.12902","n_code_links":0,"syntology":null},{"paper":null,"slug":"bi-level-policy-optimization-with-nystrom","title":"Bi-Level Policy Optimization with Nyström Hypergradients","date":"2025-05-16","arxiv_id":"2505.11714","n_code_links":0,"syntology":null},{"paper":"/paper/reinforcement-learning-finetunes-small","slug":"reinforcement-learning-finetunes-small","title":"Reinforcement Learning Finetunes Small Subnetworks in Large Language Models","date":"2025-05-16","arxiv_id":"2505.11711","n_code_links":0,"syntology":{"ran":2,"of":2,"n_ran_checked":0,"n_instrument":2,"unverified":0,"pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","official":null}},{"paper":null,"slug":"fine-tuning-diffusion-policies-with","title":"Fine-tuning Diffusion Policies with Backpropagation Through Diffusion Timesteps","date":"2025-05-15","arxiv_id":"2505.10482","n_code_links":0,"syntology":null},{"paper":"/paper/stable-and-convexified-information-bottleneck","slug":"stable-and-convexified-information-bottleneck","title":"Stable and Convexified Information Bottleneck Optimization via Symbolic Continuation and Entropy-Regularized Trajectories","date":"2025-05-14","arxiv_id":"2505.09239","n_code_links":1,"syntology":null},{"paper":null,"slug":"monte-carlo-beam-search-for-actor-critic","title":"Monte Carlo Beam Search for Actor-Critic Reinforcement Learning in Continuous Control","date":"2025-05-13","arxiv_id":"2505.09029","n_code_links":0,"syntology":null},{"paper":null,"slug":"object-detection-in-adverse-weather","title":"Object detection in adverse weather conditions for autonomous vehicles using Instruct Pix2Pix","date":"2025-05-13","arxiv_id":"2505.08228","n_code_links":0,"syntology":null},{"paper":null,"slug":"dialoguereason-rule-based-rl-sparks-dialogue","title":"DialogueReason: Rule-Based RL Sparks Dialogue Reasoning in LLMs","date":"2025-05-11","arxiv_id":"2505.07049","n_code_links":0,"syntology":null},{"paper":"/paper/a-critical-assessment-of-reinforcement","slug":"a-critical-assessment-of-reinforcement","title":"A critical assessment of reinforcement learning methods for microswimmer navigation in complex flows","date":"2025-05-08","arxiv_id":"2505.05525","n_code_links":1,"syntology":null},{"paper":null,"slug":"multi-objective-reinforcement-learning-for-4","title":"Multi-Objective Reinforcement Learning for Adaptive Personalized Autonomous Driving","date":"2025-05-08","arxiv_id":"2505.05223","n_code_links":0,"syntology":null},{"paper":null,"slug":"reinforcement-learning-for-game-theoretic","title":"Reinforcement Learning for Game-Theoretic Resource Allocation on Graphs","date":"2025-05-08","arxiv_id":"2505.06319","n_code_links":0,"syntology":null},{"paper":"/paper/the-city-that-never-settles-simulation-based","slug":"the-city-that-never-settles-simulation-based","title":"The City that Never Settles: Simulation-based LiDAR Dataset for Long-Term Place Recognition Under Extreme Structural Changes","date":"2025-05-08","arxiv_id":"2505.05076","n_code_links":1,"syntology":null},{"paper":"/paper/x-driver-explainable-autonomous-driving-with","slug":"x-driver-explainable-autonomous-driving-with","title":"X-Driver: Explainable Autonomous Driving with Vision-Language Models","date":"2025-05-08","arxiv_id":"2505.05098","n_code_links":0,"syntology":null},{"paper":null,"slug":"energy-efficient-rsma-based-leo-satellite","title":"Energy Efficient RSMA-Based LEO Satellite Communications Assisted by UAV-Mounted BD-Active RIS: A DRL Approach","date":"2025-05-07","arxiv_id":"2505.04148","n_code_links":0,"syntology":null},{"paper":null,"slug":"putting-the-value-back-in-rl-better-test-time","title":"Putting the Value Back in RL: Better Test-Time Scaling by Unifying LLM Reasoners With Verifiers","date":"2025-05-07","arxiv_id":"2505.04842","n_code_links":0,"syntology":null},{"paper":null,"slug":"interpretable-learning-dynamics-in","title":"Interpretable Learning Dynamics in Unsupervised Reinforcement Learning","date":"2025-05-06","arxiv_id":"2505.06279","n_code_links":0,"syntology":null},{"paper":null,"slug":"fedema-federated-exponential-moving-averaging","title":"FedEMA: Federated Exponential Moving Averaging with Negative Entropy Regularizer in Autonomous Driving","date":"2025-05-01","arxiv_id":"2505.00318","n_code_links":0,"syntology":null},{"paper":null,"slug":"intelligent-task-scheduling-for-microservices","title":"Intelligent Task Scheduling for Microservices via A3C-Based Reinforcement Learning","date":"2025-05-01","arxiv_id":"2505.00299","n_code_links":0,"syntology":null},{"paper":"/paper/hypercontroller-a-hyperparameter-controller","slug":"hypercontroller-a-hyperparameter-controller","title":"HyperController: A Hyperparameter Controller for Fast and Stable Training of Reinforcement Learning Neural Networks","date":"2025-04-27","arxiv_id":"2504.19382","n_code_links":1,"syntology":null},{"paper":null,"slug":"federated-learning-based-semantic","title":"Federated Learning-based Semantic Segmentation for Lane and Object Detection in Autonomous Driving","date":"2025-04-26","arxiv_id":"2504.18939","n_code_links":0,"syntology":null},{"paper":null,"slug":"hierarchical-reinforcement-learning-in-multi","title":"Hierarchical Reinforcement Learning in Multi-Goal Spatial Navigation with Autonomous Mobile Robots","date":"2025-04-26","arxiv_id":"2504.18794","n_code_links":0,"syntology":null},{"paper":null,"slug":"training-large-language-models-to-reason-via","title":"Training Large Language Models to Reason via EM Policy Gradient","date":"2025-04-24","arxiv_id":"2504.18587","n_code_links":0,"syntology":null},{"paper":null,"slug":"alphagrad-non-linear-gradient-normalization","title":"AlphaGrad: Non-Linear Gradient Normalization Optimizer","date":"2025-04-22","arxiv_id":"2504.16020","n_code_links":0,"syntology":null},{"paper":"/paper/langcoop-collaborative-driving-with-language","slug":"langcoop-collaborative-driving-with-language","title":"LangCoop: Collaborative Driving with Language","date":"2025-04-18","arxiv_id":"2504.13406","n_code_links":1,"syntology":null},{"paper":null,"slug":"evaluating-the-diversity-and-quality-of-llm","title":"Evaluating the Diversity and Quality of LLM Generated Content","date":"2025-04-16","arxiv_id":"2504.12522","n_code_links":0,"syntology":null},{"paper":"/paper/a-minimalist-approach-to-llm-reasoning-from","slug":"a-minimalist-approach-to-llm-reasoning-from","title":"A Minimalist Approach to LLM Reasoning: from Rejection Sampling to Reinforce","date":"2025-04-15","arxiv_id":"2504.11343","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":0,"n_instrument":1,"unverified":0,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["rlhflow/minimal-rl"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"measures-of-variability-for-risk-averse","title":"Measures of Variability for Risk-averse Policy Gradient","date":"2025-04-15","arxiv_id":"2504.11412","n_code_links":0,"syntology":null},{"paper":null,"slug":"iterative-self-training-for-code-generation","title":"Iterative Self-Training for Code Generation via Reinforced Re-Ranking","date":"2025-04-13","arxiv_id":"2504.09643","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-survey-of-frontiers-in-llm-reasoning","title":"A Survey of Frontiers in LLM Reasoning: Inference Scaling, Learning to Reason, and Agentic Systems","date":"2025-04-12","arxiv_id":"2504.09037","n_code_links":0,"syntology":null},{"paper":null,"slug":"stratified-expert-cloning-with-adaptive","title":"Stratified Expert Cloning with Adaptive Selection for User Retention in Large-Scale Recommender Systems","date":"2025-04-08","arxiv_id":"2504.05628","n_code_links":0,"syntology":null},{"paper":"/paper/a-reinforcement-learning-method-for","slug":"a-reinforcement-learning-method-for","title":"A Reinforcement Learning Method for Environments with Stochastic Variables: Post-Decision Proximal Policy Optimization with Dual Critic Networks","date":"2025-04-07","arxiv_id":"2504.05150","n_code_links":1,"syntology":null},{"paper":"/paper/concise-reasoning-via-reinforcement-learning","slug":"concise-reasoning-via-reinforcement-learning","title":"Concise Reasoning via Reinforcement Learning","date":"2025-04-07","arxiv_id":"2504.05185","n_code_links":1,"syntology":{"ran":12,"of":14,"n_ran_checked":6,"n_instrument":6,"unverified":2,"pointer_only":13,"phrase":"12 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 5 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 2 unverified","official":{"repos":["ai-wand/concise-reasoning"],"state":"official (archive's flag): 11 ran","n_ran":11,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":2,"ran_from_kinds":["official","unlocated"]}}},{"paper":"/paper/deep-reinforcement-learning-algorithms-for-1","slug":"deep-reinforcement-learning-algorithms-for-1","title":"Deep Reinforcement Learning Algorithms for Option Hedging","date":"2025-04-07","arxiv_id":"2504.05521","n_code_links":1,"syntology":null},{"paper":null,"slug":"resource-efficient-beam-prediction-in-mmwave","title":"Resource-Efficient Beam Prediction in mmWave Communications with Multimodal Realistic Simulation Framework","date":"2025-04-07","arxiv_id":"2504.05187","n_code_links":0,"syntology":null},{"paper":null,"slug":"cortex-avd-a-framework-for-corner-case","title":"CORTEX-AVD: A Framework for CORner Case Testing and EXploration in Autonomous Vehicle Development","date":"2025-04-04","arxiv_id":"2504.03989","n_code_links":0,"syntology":null},{"paper":"/paper/end-to-end-driving-with-online-trajectory","slug":"end-to-end-driving-with-online-trajectory","title":"End-to-End Driving with Online Trajectory Evaluation via BEV World Model","date":"2025-04-02","arxiv_id":"2504.01941","n_code_links":1,"syntology":{"ran":7,"of":11,"n_ran_checked":7,"n_instrument":0,"unverified":4,"pointer_only":0,"phrase":"7 ran (of which 7 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 7 samples that ran constructed an object rather than computing a result","official":{"repos":["liyingyanucas/wote"],"state":"official (archive's flag): 7 ran","n_ran":7,"n_constructed":7,"n_ran_no_instrument_failure":7,"n_unverified":4,"ran_from_kinds":["official"]}}},{"paper":"/paper/open-reasoner-zero-an-open-source-approach-to","slug":"open-reasoner-zero-an-open-source-approach-to","title":"Open-Reasoner-Zero: An Open Source Approach to Scaling Up Reinforcement Learning on the Base Model","date":"2025-03-31","arxiv_id":"2503.24290","n_code_links":1,"syntology":{"ran":2,"of":4,"n_ran_checked":1,"n_instrument":1,"unverified":2,"pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified","official":null}},{"paper":"/paper/uniocc-a-unified-benchmark-for-occupancy","slug":"uniocc-a-unified-benchmark-for-occupancy","title":"UniOcc: A Unified Benchmark for Occupancy Forecasting and Prediction in Autonomous Driving","date":"2025-03-31","arxiv_id":"2503.24381","n_code_links":1,"syntology":{"ran":4,"of":6,"n_ran_checked":4,"n_instrument":0,"unverified":2,"pointer_only":0,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","official":{"repos":["tasl-lab/uniocc"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"entropy-guided-sequence-weighting-for","title":"Entropy-guided sequence weighting for efficient exploration in RL-based LLM fine-tuning","date":"2025-03-28","arxiv_id":"2503.22456","n_code_links":0,"syntology":null},{"paper":null,"slug":"on-the-mistaken-assumption-of-interchangeable","title":"On the Mistaken Assumption of Interchangeable Deep Reinforcement Learning Implementations","date":"2025-03-28","arxiv_id":"2503.22575","n_code_links":0,"syntology":null},{"paper":null,"slug":"knowledge-graphs-as-world-models-for-semantic","title":"Knowledge Graphs as World Models for Semantic Material-Aware Obstacle Handling in Autonomous Vehicles","date":"2025-03-27","arxiv_id":"2503.21232","n_code_links":0,"syntology":null},{"paper":"/paper/gapo-learning-preferential-prompt-through","slug":"gapo-learning-preferential-prompt-through","title":"GAPO: Learning Preferential Prompt through Generative Adversarial Policy Optimization","date":"2025-03-26","arxiv_id":"2503.20194","n_code_links":1,"syntology":null},{"paper":"/paper/world-model-agents-with-change-based","slug":"world-model-agents-with-change-based","title":"World Model Agents with Change-Based Intrinsic Motivation","date":"2025-03-26","arxiv_id":"2503.21047","n_code_links":1,"syntology":null},{"paper":null,"slug":"evolutionary-policy-optimization","title":"Evolutionary Policy Optimization","date":"2025-03-24","arxiv_id":"2503.19037","n_code_links":0,"syntology":null},{"paper":"/paper/curriculum-rl-meets-monte-carlo-planning","slug":"curriculum-rl-meets-monte-carlo-planning","title":"Curriculum RL meets Monte Carlo Planning: Optimization of a Real World Container Management Problem","date":"2025-03-21","arxiv_id":"2503.17194","n_code_links":1,"syntology":null},{"paper":null,"slug":"optimizing-2d-1-packing-in-constrained","title":"Optimizing 2D+1 Packing in Constrained Environments Using Deep Reinforcement Learning","date":"2025-03-21","arxiv_id":"2503.17573","n_code_links":0,"syntology":null},{"paper":null,"slug":"resfl-an-uncertainty-aware-framework-for","title":"RESFL: An Uncertainty-Aware Framework for Responsible Federated Learning by Balancing Privacy, Fairness and Utility in Autonomous Vehicles","date":"2025-03-20","arxiv_id":"2503.16251","n_code_links":0,"syntology":null},{"paper":null,"slug":"good-actions-succeed-bad-actions-generalize-a","title":"Good Actions Succeed, Bad Actions Generalize: A Case Study on Why RL Generalizes Better","date":"2025-03-19","arxiv_id":"2503.15693","n_code_links":0,"syntology":null},{"paper":"/paper/diffad-a-unified-diffusion-modeling-approach","slug":"diffad-a-unified-diffusion-modeling-approach","title":"DiffAD: A Unified Diffusion Modeling Approach for Autonomous Driving","date":"2025-03-15","arxiv_id":"2503.12170","n_code_links":0,"syntology":null},{"paper":null,"slug":"exploring-competitive-and-collusive-behaviors","title":"Exploring Competitive and Collusive Behaviors in Algorithmic Pricing with Deep Reinforcement Learning","date":"2025-03-14","arxiv_id":"2503.11270","n_code_links":0,"syntology":null},{"paper":"/paper/an-real-sim-real-rsr-loop-framework-for","slug":"an-real-sim-real-rsr-loop-framework-for","title":"An Real-Sim-Real (RSR) Loop Framework for Generalizable Robotic Policy Transfer with Differentiable Simulation","date":"2025-03-13","arxiv_id":"2503.10118","n_code_links":1,"syntology":null},{"paper":null,"slug":"edge-ai-powered-real-time-decision-making-for","title":"Edge AI-Powered Real-Time Decision-Making for Autonomous Vehicles in Adverse Weather Conditions","date":"2025-03-12","arxiv_id":"2503.09638","n_code_links":0,"syntology":null},{"paper":null,"slug":"fast-computation-of-the-tgospa-metric-for","title":"Fast computation of the TGOSPA metric for multiple target tracking via unbalanced optimal transport","date":"2025-03-12","arxiv_id":"2503.09449","n_code_links":0,"syntology":null},{"paper":"/paper/maneuvergpt-agentic-control-for-safe","slug":"maneuvergpt-agentic-control-for-safe","title":"ManeuverGPT Agentic Control for Safe Autonomous Stunt Maneuvers","date":"2025-03-12","arxiv_id":"2503.09035","n_code_links":1,"syntology":null},{"paper":"/paper/simlingo-vision-only-closed-loop-autonomous","slug":"simlingo-vision-only-closed-loop-autonomous","title":"SimLingo: Vision-Only Closed-Loop Autonomous Driving with Language-Action Alignment","date":"2025-03-12","arxiv_id":"2503.09594","n_code_links":1,"syntology":{"ran":11,"of":14,"n_ran_checked":8,"n_instrument":3,"unverified":3,"pointer_only":0,"phrase":"11 ran (of which 8 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 0 violated, 8 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified","official":null}},{"paper":null,"slug":"jisam-alleviate-labeling-burden-and-corner","title":"JiSAM: Alleviate Labeling Burden and Corner Case Problems in Autonomous Driving via Minimal Real-World Data","date":"2025-03-11","arxiv_id":"2503.08422","n_code_links":0,"syntology":null},{"paper":null,"slug":"task-oriented-co-design-of-communication","title":"Task-Oriented Co-Design of Communication, Computing, and Control for Edge-Enabled Industrial Cyber-Physical Systems","date":"2025-03-11","arxiv_id":"2503.08661","n_code_links":0,"syntology":null},{"paper":null,"slug":"combating-partial-perception-deficit-in","title":"Combating Partial Perception Deficit in Autonomous Driving with Multimodal LLM Commonsense","date":"2025-03-10","arxiv_id":"2503.07020","n_code_links":0,"syntology":null},{"paper":null,"slug":"using-a-single-actor-to-output-personalized","title":"Using a single actor to output personalized policy for different intersections","date":"2025-03-10","arxiv_id":"2503.07678","n_code_links":0,"syntology":null},{"paper":null,"slug":"gflowvlm-enhancing-multi-step-reasoning-in","title":"GFlowVLM: Enhancing Multi-step Reasoning in Vision-Language Models with Generative Flow Networks","date":"2025-03-09","arxiv_id":"2503.06514","n_code_links":0,"syntology":null},{"paper":"/paper/a-comprehensive-llm-powered-framework-for","slug":"a-comprehensive-llm-powered-framework-for","title":"A Comprehensive LLM-powered Framework for Driving Intelligence Evaluation","date":"2025-03-07","arxiv_id":"2503.05164","n_code_links":2,"syntology":null},{"paper":"/paper/bevdriver-leveraging-bev-maps-in-llms-for","slug":"bevdriver-leveraging-bev-maps-in-llms-for","title":"BEVDriver: Leveraging BEV Maps in LLMs for Robust Closed-Loop Driving","date":"2025-03-05","arxiv_id":"2503.03074","n_code_links":1,"syntology":null},{"paper":"/paper/temporal-separation-with-entropy","slug":"temporal-separation-with-entropy","title":"Temporal Separation with Entropy Regularization for Knowledge Distillation in Spiking Neural Networks","date":"2025-03-05","arxiv_id":"2503.03144","n_code_links":0,"syntology":{"ran":3,"of":4,"n_ran_checked":1,"n_instrument":2,"unverified":1,"pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","official":null}},{"paper":null,"slug":"2503-01676","title":"Perceptual Motor Learning with Active Inference Framework for Robust Lateral Control","date":"2025-03-03","arxiv_id":"2503.01676","n_code_links":0,"syntology":null},{"paper":null,"slug":"caps-context-aware-priority-sampling-for","title":"CAPS: Context-Aware Priority Sampling for Enhanced Imitation Learning in Autonomous Driving","date":"2025-03-03","arxiv_id":"2503.01650","n_code_links":0,"syntology":null},{"paper":null,"slug":"what-s-behind-ppo-s-collapse-in-long-cot","title":"What's Behind PPO's Collapse in Long-CoT? Value Optimization Holds the Secret","date":"2025-03-03","arxiv_id":"2503.01491","n_code_links":0,"syntology":null},{"paper":"/paper/caril-confidence-aware-regression-in","slug":"caril-confidence-aware-regression-in","title":"CARIL: Confidence-Aware Regression in Imitation Learning for Autonomous Driving","date":"2025-03-02","arxiv_id":"2503.00783","n_code_links":1,"syntology":null},{"paper":null,"slug":"multimodal-dreaming-a-global-workspace","title":"Multimodal Dreaming: A Global Workspace Approach to World Model-Based Reinforcement Learning","date":"2025-02-28","arxiv_id":"2502.21142","n_code_links":0,"syntology":null},{"paper":null,"slug":"shared-autonomy-for-proximal-teaching","title":"Shared Autonomy for Proximal Teaching","date":"2025-02-27","arxiv_id":"2502.19899","n_code_links":0,"syntology":null},{"paper":null,"slug":"sorft-issue-resolving-with-subtask-oriented","title":"SoRFT: Issue Resolving with Subtask-oriented Reinforced Fine-Tuning","date":"2025-02-27","arxiv_id":"2502.20127","n_code_links":0,"syntology":null}],"papers_shown":100,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":1128,"with_a_code_link":451,"where_syntology_ran_a_sample":156,"not_listed_spam_title":0,"listed":1128,"listed_where_code_ran":156,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":126,"every_run_a_failure_of_syntologys_instrument":30,"listed_with_a_run_with_no_instrument_failure":126,"listed_every_run_a_failure_of_syntologys_instrument":30,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":156,"papers_where_code_ran_first_page":"/method/entropy-regularization/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"archive","page":2,"of":12,"url":"/method/entropy-regularization/papers/2","json":"/method/entropy-regularization/papers/2.json","rows":100},{"order":"archive","page":3,"of":12,"url":"/method/entropy-regularization/papers/3","json":"/method/entropy-regularization/papers/3.json","rows":100},{"order":"archive","page":4,"of":12,"url":"/method/entropy-regularization/papers/4","json":"/method/entropy-regularization/papers/4.json","rows":100},{"order":"archive","page":5,"of":12,"url":"/method/entropy-regularization/papers/5","json":"/method/entropy-regularization/papers/5.json","rows":100},{"order":"archive","page":6,"of":12,"url":"/method/entropy-regularization/papers/6","json":"/method/entropy-regularization/papers/6.json","rows":100},{"order":"archive","page":7,"of":12,"url":"/method/entropy-regularization/papers/7","json":"/method/entropy-regularization/papers/7.json","rows":100},{"order":"archive","page":8,"of":12,"url":"/method/entropy-regularization/papers/8","json":"/method/entropy-regularization/papers/8.json","rows":100},{"order":"archive","page":9,"of":12,"url":"/method/entropy-regularization/papers/9","json":"/method/entropy-regularization/papers/9.json","rows":100},{"order":"archive","page":10,"of":12,"url":"/method/entropy-regularization/papers/10","json":"/method/entropy-regularization/papers/10.json","rows":100},{"order":"archive","page":11,"of":12,"url":"/method/entropy-regularization/papers/11","json":"/method/entropy-regularization/papers/11.json","rows":100},{"order":"archive","page":12,"of":12,"url":"/method/entropy-regularization/papers/12","json":"/method/entropy-regularization/papers/12.json","rows":28},{"order":"ran","page":1,"of":2,"url":"/method/entropy-regularization/papers/ran/1","json":"/method/entropy-regularization/papers/ran/1.json","rows":100},{"order":"ran","page":2,"of":2,"url":"/method/entropy-regularization/papers/ran/2","json":"/method/entropy-regularization/papers/ran/2.json","rows":56}],"tasks":[{"task":"/task/reinforcement-learning-1","name":"Reinforcement Learning (RL)","papers":376},{"task":"/task/reinforcement-learning-2","name":"reinforcement-learning","papers":328},{"task":"/task/reinforcement-learning","name":"Reinforcement Learning","papers":301},{"task":"/task/autonomous-driving","name":"Autonomous Driving","papers":248},{"task":"/task/deep-reinforcement-learning","name":"Deep Reinforcement Learning","papers":183},{"task":"/task/autonomous-vehicles","name":"Autonomous Vehicles","papers":80},{"task":"/task/decision-making","name":"Decision Making","papers":70},{"task":"/task/imitation-learning","name":"Imitation Learning","papers":60},{"task":"/task/object-detection","name":"Object Detection","papers":54},{"task":"/task/object-detection-1","name":"object-detection","papers":50},{"task":"/task/continuous-control","name":"Continuous Control","papers":47},{"task":"/task/mujoco","name":"MuJoCo","papers":44},{"task":"/task/continuous-control","name":"continuous-control","papers":43},{"task":"/task/semantic-segmentation","name":"Semantic Segmentation","papers":40},{"task":"/task/q-learning","name":"Q-Learning","papers":38},{"task":"/task/language-modelling","name":"Language Modelling","papers":34},{"task":"/task/atari-games","name":"Atari Games","papers":31},{"task":"/task/multi-agent-reinforcement-learning","name":"Multi-agent Reinforcement Learning","papers":30},{"task":"/task/openai-gym","name":"OpenAI Gym","papers":26},{"task":"/task/language-modeling","name":"Language Modeling","papers":25}],"tasks_shown":20,"n_tasks":404,"usage_by_year":[{"year":"2016","papers":4},{"year":"2017","papers":17},{"year":"2018","papers":34},{"year":"2019","papers":72},{"year":"2020","papers":123},{"year":"2021","papers":133},{"year":"2022","papers":168},{"year":"2023","papers":174},{"year":"2024","papers":260},{"year":"2025","papers":143}],"row_source":"embedded","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/entropy-regularization"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=Entropy%20Regularization","read_at":"2026-10-05T00:55:39+00:00","query":"Entropy Regularization","kind":"paper","have":"no_code","tier":"paper_only","verified_implementation":false,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"arxiv_id":"2609.30572"},"resolution":"paper","resolved_name_differs":false,"absence_asserted":"for_this_paper_only","absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"unknown","archive_paper_arxiv_id":null,"repositories":{"listed":null,"in_graph":0,"list_truncated":null,"strongest_link":null},"retrieve_with":null,"name_competition":{"verdict":"sole_bearer","may_be_wrong_sense":false,"bearers_found":1,"served":{"arxiv_id":"2609.30572","citations":null},"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing else in this corpus is named 'Entropy Regularization'. That is a statement about this corpus and not about the field: short names are reused, and a sense we never collected cannot show up here. Confirm `served.arxiv_id` if you had a specific paper in mind."},"name_competition_text":null,"near_matches":null,"code_nearby":[],"code_nearby_caption":null,"origin_paper":{"arxiv_id":"2609.30572","page":null,"syntology_url":null,"in_graph_layer":false,"samples":0},"line":"the paper matched by title, arXiv:2609.30572, held, no code (no_code; paper_only). The lookup matched a paper by its title, arXiv:2609.30572, not a method entry. The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:2609.30572) is about this method is not checked; it does not say whether this method has code.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"17a5f8fa31219e45afa4ceb3f8d26d3d0e44885b6dc5ecfdad207c8bfe918c98","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}