{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/sac","slug":"sac","name":"SAC","full_name":"Switchable Atrous Convolution","full_name_withheld":false,"description_markdown":"**Switchable Atrous Convolution (SAC)** softly switches the convolutional computation between different atrous rates and gathers the results using switch functions. The switch functions are spatially dependent, i.e., each location of the feature map might have different switches to control the outputs of SAC. To use SAC in a detector, we convert all the standard 3x3 convolutional layers in the bottom-up backbone to SAC.","description_state":"present","introduced_year":null,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":"https://arxiv.org/abs/2006.02334v2","title":"DetectoRS: Detecting Objects with Recursive Feature Pyramid and Switchable Atrous Convolution","url_on_a_paper_host":true},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"Computer Vision","area_id":"computer-vision","collection":"Convolutions","url":"/methods/category/convolutions","pwc_aliases":[]}],"n_papers_tagged":168,"archive_num_papers":null,"papers_newest_first":[{"paper":"/paper/gradual-transition-from-bellman-optimality","slug":"gradual-transition-from-bellman-optimality","title":"Gradual Transition from Bellman Optimality Operator to Bellman Operator in Online Reinforcement Learning","date":"2025-06-06","arxiv_id":"2506.05968","n_code_links":1,"syntology":{"ran":1,"of":4,"n_ran_checked":1,"n_instrument":0,"unverified":3,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified","official":{"repos":["motokiomura/annealed-q-learning"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":3,"ran_from_kinds":["official"]}}},{"paper":"/paper/the-cell-must-go-on-agar-io-for-continual","slug":"the-cell-must-go-on-agar-io-for-continual","title":"The Cell Must Go On: Agar.io for Continual Reinforcement Learning","date":"2025-05-23","arxiv_id":"2505.18347","n_code_links":1,"syntology":null},{"paper":null,"slug":"deep-reinforcement-learning-based-4","title":"Deep reinforcement learning-based longitudinal control strategy for automated vehicles at signalised intersections","date":"2025-05-13","arxiv_id":"2505.08896","n_code_links":0,"syntology":null},{"paper":null,"slug":"monte-carlo-beam-search-for-actor-critic","title":"Monte Carlo Beam Search for Actor-Critic Reinforcement Learning in Continuous Control","date":"2025-05-13","arxiv_id":"2505.09029","n_code_links":0,"syntology":null},{"paper":null,"slug":"the-exploratory-multi-asset-mean-variance","title":"The Exploratory Multi-Asset Mean-Variance Portfolio Selection using Reinforcement Learning","date":"2025-05-12","arxiv_id":"2505.07537","n_code_links":0,"syntology":null},{"paper":null,"slug":"moderate-actor-critic-methods-controlling","title":"Moderate Actor-Critic Methods: Controlling Overestimation Bias via Expectile Loss","date":"2025-04-14","arxiv_id":"2504.09929","n_code_links":0,"syntology":null},{"paper":null,"slug":"hemodynamic-markers-cfd-based-prediction-of","title":"Hemodynamic Markers: CFD-Based Prediction of Cerebral Aneurysm Rupture Risk","date":"2025-04-11","arxiv_id":"2504.10524","n_code_links":0,"syntology":null},{"paper":null,"slug":"kea-keeping-exploration-alive-by-proactively","title":"KEA: Keeping Exploration Alive by Proactively Coordinating Exploration Strategies","date":"2025-03-23","arxiv_id":"2503.18234","n_code_links":0,"syntology":null},{"paper":null,"slug":"chunking-the-critic-a-transformer-based-soft","title":"Chunking the Critic: A Transformer-based Soft Actor-Critic with N-Step Returns","date":"2025-03-05","arxiv_id":"2503.03660","n_code_links":0,"syntology":null},{"paper":null,"slug":"ensemble-rl-through-classifier-models","title":"Ensemble RL through Classifier Models: Enhancing Risk-Return Trade-offs in Trading Strategies","date":"2025-02-23","arxiv_id":"2502.17518","n_code_links":0,"syntology":null},{"paper":null,"slug":"value-based-deep-rl-scales-predictably","title":"Value-Based Deep RL Scales Predictably","date":"2025-02-06","arxiv_id":"2502.04327","n_code_links":0,"syntology":null},{"paper":null,"slug":"decorrelated-soft-actor-critic-for-efficient","title":"Decorrelated Soft Actor-Critic for Efficient Deep Reinforcement Learning","date":"2025-01-31","arxiv_id":"2501.19133","n_code_links":0,"syntology":null},{"paper":"/paper/neural-operator-based-reinforcement-learning","slug":"neural-operator-based-reinforcement-learning","title":"Neural Operator based Reinforcement Learning for Control of first-order PDEs with Spatially-Varying State Delay","date":"2025-01-30","arxiv_id":"2501.18201","n_code_links":1,"syntology":null},{"paper":"/paper/foundation-for-unbiased-cross-validation-of","slug":"foundation-for-unbiased-cross-validation-of","title":"Foundation for unbiased cross-validation of spatio-temporal models for species distribution modeling","date":"2025-01-27","arxiv_id":"2502.03480","n_code_links":1,"syntology":null},{"paper":null,"slug":"fundamental-mmse-rate-performance-limits-of","title":"Fundamental MMSE-Rate Performance Limits of Integrated Sensing and Communication Systems","date":"2025-01-02","arxiv_id":"2501.01053","n_code_links":0,"syntology":null},{"paper":"/paper/sample-correlation-for-fingerprinting-deep","slug":"sample-correlation-for-fingerprinting-deep","title":"Sample Correlation for Fingerprinting Deep Face Recognition","date":"2024-12-30","arxiv_id":"2412.20768","n_code_links":2,"syntology":null},{"paper":null,"slug":"policy-agnostic-rl-offline-rl-and-online-rl","title":"Policy Agnostic RL: Offline RL and Online RL Fine-Tuning of Any Class and Backbone","date":"2024-12-09","arxiv_id":"2412.06685","n_code_links":0,"syntology":null},{"paper":null,"slug":"movable-antenna-equipped-uav-for-data","title":"Movable Antenna-Equipped UAV for Data Collection in Backscatter Sensor Networks: A Deep Reinforcement Learning-based Approach","date":"2024-11-21","arxiv_id":"2411.13970","n_code_links":0,"syntology":null},{"paper":null,"slug":"segment-any-class-sac-multi-class-few-shot","title":"Segment Any Class (SAC): Multi-Class Few-Shot Semantic Segmentation via Class Region Proposals","date":"2024-11-21","arxiv_id":"2411.13774","n_code_links":0,"syntology":null},{"paper":null,"slug":"adaptive-soft-actor-critic-framework-for-ris","title":"Adaptive Soft Actor-Critic Framework for RIS-Assisted and UAV-Aided Communication","date":"2024-11-16","arxiv_id":"2411.10882","n_code_links":0,"syntology":null},{"paper":"/paper/cale-continuous-arcade-learning-environment","slug":"cale-continuous-arcade-learning-environment","title":"CALE: Continuous Arcade Learning Environment","date":"2024-10-31","arxiv_id":"2410.23810","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":0,"n_instrument":1,"unverified":0,"pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["farama-foundation/arcade-learning-environment"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"corrected-soft-actor-critic-for-continuous","title":"Corrected Soft Actor Critic for Continuous Control","date":"2024-10-22","arxiv_id":"2410.16739","n_code_links":0,"syntology":null},{"paper":null,"slug":"reinforcement-learning-in-non-markov-market","title":"Reinforcement Learning in Non-Markov Market-Making","date":"2024-10-18","arxiv_id":"2410.14504","n_code_links":0,"syntology":null},{"paper":"/paper/simba-simplicity-bias-for-scaling-up","slug":"simba-simplicity-bias-for-scaling-up","title":"SimBa: Simplicity Bias for Scaling Up Parameters in Deep Reinforcement Learning","date":"2024-10-13","arxiv_id":"2410.09754","n_code_links":4,"syntology":{"ran":6,"of":6,"n_ran_checked":6,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"6 ran (of which 2 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["sonyresearch/simba"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":1,"n_ran_no_instrument_failure":2,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"paper":null,"slug":"a-visual-analytical-approach-for-automatic","title":"A Visual-Analytical Approach for Automatic Detection of Cyclonic Events in Satellite Observations","date":"2024-09-25","arxiv_id":"2410.08218","n_code_links":0,"syntology":null},{"paper":"/paper/offline-reinforcement-learning-for-learning","slug":"offline-reinforcement-learning-for-learning","title":"Offline Reinforcement Learning for Learning to Dispatch for Job Shop Scheduling","date":"2024-09-16","arxiv_id":"2409.10589","n_code_links":1,"syntology":null},{"paper":"/paper/soft-actor-critic-with-beta-policy-via","slug":"soft-actor-critic-with-beta-policy-via","title":"Soft Actor-Critic with Beta Policy via Implicit Reparameterization Gradients","date":"2024-09-08","arxiv_id":"2409.04971","n_code_links":1,"syntology":null},{"paper":null,"slug":"stacked-universal-successor-feature","title":"Stacked Universal Successor Feature Approximators for Safety in Reinforcement Learning","date":"2024-09-06","arxiv_id":"2409.04641","n_code_links":0,"syntology":null},{"paper":null,"slug":"adaptive-bess-and-grid-setpoints-optimization","title":"Adaptive BESS and Grid Setpoints Optimization: A Model-Free Framework for Efficient Battery Management under Dynamic Tariff Pricing","date":"2024-08-19","arxiv_id":"2408.09989","n_code_links":0,"syntology":null},{"paper":null,"slug":"enhancing-hardware-fault-tolerance-in","title":"Enhancing Hardware Fault Tolerance in Machines with Reinforcement Learning Policy Gradient Algorithms","date":"2024-07-21","arxiv_id":"2407.15283","n_code_links":0,"syntology":null},{"paper":null,"slug":"real-time-system-optimal-traffic-routing","title":"Real-time system optimal traffic routing under uncertainties -- Can physics models boost reinforcement learning?","date":"2024-07-10","arxiv_id":"2407.07364","n_code_links":0,"syntology":null},{"paper":null,"slug":"deep-reinforcement-learning-strategies-in","title":"Deep Reinforcement Learning Strategies in Finance: Insights into Asset Holding, Trading Behavior, and Purchase Diversity","date":"2024-06-29","arxiv_id":"2407.09557","n_code_links":0,"syntology":null},{"paper":null,"slug":"performance-comparison-of-deep-rl-algorithms-1","title":"Performance Comparison of Deep RL Algorithms for Mixed Traffic Cooperative Lane-Changing","date":"2024-06-25","arxiv_id":"2407.02521","n_code_links":0,"syntology":null},{"paper":"/paper/deep-reinforcement-learning-based-aoi-aware","slug":"deep-reinforcement-learning-based-aoi-aware","title":"Deep-Reinforcement-Learning-Based AoI-Aware Resource Allocation for RIS-Aided IoV Networks","date":"2024-06-17","arxiv_id":"2406.11245","n_code_links":1,"syntology":null},{"paper":null,"slug":"optimizing-deep-reinforcement-learning-for-1","title":"Optimizing Deep Reinforcement Learning for Adaptive Robotic Arm Control","date":"2024-06-12","arxiv_id":"2407.02503","n_code_links":0,"syntology":null},{"paper":"/paper/semantic-aware-spectrum-sharing-in-internet","slug":"semantic-aware-spectrum-sharing-in-internet","title":"Semantic-Aware Spectrum Sharing in Internet of Vehicles Based on Deep Reinforcement Learning","date":"2024-06-11","arxiv_id":"2406.07213","n_code_links":1,"syntology":null},{"paper":null,"slug":"meta-reinforcement-learning-for-resource-2","title":"On the Performance of Unmanned Aerial Vehicles with MIMO VLC","date":"2024-05-18","arxiv_id":"2405.11161","n_code_links":0,"syntology":null},{"paper":"/paper/s-2-ac-energy-based-reinforcement-learning","slug":"s-2-ac-energy-based-reinforcement-learning","title":"S$^2$AC: Energy-Based Reinforcement Learning with Stein Soft Actor Critic","date":"2024-05-02","arxiv_id":"2405.00987","n_code_links":1,"syntology":{"ran":3,"of":4,"n_ran_checked":3,"n_instrument":0,"unverified":1,"pointer_only":4,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":{"repos":["safamessaoud/s2ac-energy-based-rl-with-stein-soft-actor-critic"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/a-fast-balance-optimization-approach-for","slug":"a-fast-balance-optimization-approach-for","title":"A fast balance optimization approach for charging enhancement of lithium-ion battery packs through deep reinforcement learning","date":"2024-04-24","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/afu-actor-free-critic-updates-in-off-policy","slug":"afu-actor-free-critic-updates-in-off-policy","title":"AFU: Actor-Free critic Updates in off-policy RL for continuous control","date":"2024-04-24","arxiv_id":"2404.16159","n_code_links":1,"syntology":null},{"paper":"/paper/clip-gs-clip-informed-gaussian-splatting-for","slug":"clip-gs-clip-informed-gaussian-splatting-for","title":"CLIP-GS: CLIP-Informed Gaussian Splatting for Real-time and View-consistent 3D Semantic Understanding","date":"2024-04-22","arxiv_id":"2404.14249","n_code_links":1,"syntology":null},{"paper":"/paper/cooperative-sentiment-agents-for-multimodal","slug":"cooperative-sentiment-agents-for-multimodal","title":"Cooperative Sentiment Agents for Multimodal Sentiment Analysis","date":"2024-04-19","arxiv_id":"2404.12642","n_code_links":1,"syntology":null},{"paper":null,"slug":"tuning-for-the-unknown-revisiting-evaluation","title":"K-percent Evaluation for Lifelong RL","date":"2024-04-02","arxiv_id":"2404.02113","n_code_links":0,"syntology":null},{"paper":null,"slug":"information-theory-and-direction-selectivity","title":"Information Theory and Direction Selectivity","date":"2024-03-26","arxiv_id":"2404.02915","n_code_links":0,"syntology":null},{"paper":"/paper/rethinking-adversarial-inverse-reinforcement","slug":"rethinking-adversarial-inverse-reinforcement","title":"Rethinking Adversarial Inverse Reinforcement Learning: Policy Imitation, Transferable Reward Recovery and Algebraic Equilibrium Proof","date":"2024-03-21","arxiv_id":"2403.14593","n_code_links":1,"syntology":null},{"paper":null,"slug":"fill-and-spill-deep-reinforcement-learning","title":"Fill-and-Spill: Deep Reinforcement Learning Policy Gradient Methods for Reservoir Operation Decision and Control","date":"2024-03-07","arxiv_id":"2403.04195","n_code_links":0,"syntology":null},{"paper":null,"slug":"koopman-assisted-reinforcement-learning","title":"Koopman-Assisted Reinforcement Learning","date":"2024-03-04","arxiv_id":"2403.02290","n_code_links":0,"syntology":null},{"paper":"/paper/snapshot-reinforcement-learning-leveraging","slug":"snapshot-reinforcement-learning-leveraging","title":"Snapshot Reinforcement Learning: Leveraging Prior Trajectories for Efficiency","date":"2024-03-01","arxiv_id":"2403.00673","n_code_links":1,"syntology":null},{"paper":null,"slug":"reinforcement-learning-with-elastic-time","title":"Reinforcement Learning with Elastic Time Steps","date":"2024-02-22","arxiv_id":"2402.14961","n_code_links":0,"syntology":null},{"paper":null,"slug":"spectral-efficiency-maximization-for-active","title":"Spectral Efficiency Maximization for Active RIS-aided Cell-Free Massive MIMO Systems with Imperfect CSI","date":"2024-02-11","arxiv_id":"2402.14025","n_code_links":0,"syntology":null},{"paper":null,"slug":"deep-learning-channel-estimation-for-irs","title":"Deep-Learning Channel Estimation for IRS-Assisted Integrated Sensing and Communication System","date":"2024-01-29","arxiv_id":"2402.09441","n_code_links":0,"syntology":null},{"paper":null,"slug":"extreme-learning-machine-based-channel","title":"Extreme Learning Machine-based Channel Estimation in IRS-Assisted Multi-User ISAC System","date":"2024-01-29","arxiv_id":"2402.09440","n_code_links":0,"syntology":null},{"paper":null,"slug":"multi-agent-deep-reinforcement-learning-for-15","title":"Tacit algorithmic collusion in deep reinforcement learning guided price competition: A study using EV charge pricing game","date":"2024-01-25","arxiv_id":"2401.15108","n_code_links":0,"syntology":null},{"paper":null,"slug":"segment-any-cell-a-sam-based-auto-prompting","title":"Segment Any Cell: A SAM-based Auto-prompting Fine-tuning Framework for Nuclei Segmentation","date":"2024-01-24","arxiv_id":"2401.13220","n_code_links":0,"syntology":null},{"paper":null,"slug":"an-open-dataset-for-the-evolution-of-oracle","title":"An open dataset for the evolution of oracle bone characters: EVOBC","date":"2024-01-23","arxiv_id":"2401.12467","n_code_links":0,"syntology":null},{"paper":"/paper/an-experimental-evaluation-of-deep","slug":"an-experimental-evaluation-of-deep","title":"An experimental evaluation of Deep Reinforcement Learning algorithms for HVAC control","date":"2024-01-11","arxiv_id":"2401.05737","n_code_links":1,"syntology":null},{"paper":null,"slug":"enhancing-sensing-assisted-communications-in","title":"Enhancing Sensing-Assisted Communications in Cluttered Indoor Environments through Background Subtraction","date":"2024-01-11","arxiv_id":"2401.05763","n_code_links":0,"syntology":null},{"paper":null,"slug":"on-designing-multi-uav-aided-wireless-powered","title":"On Designing Multi-UAV aided Wireless Powered Dynamic Communication via Hierarchical Deep Reinforcement Learning","date":"2023-12-13","arxiv_id":"2312.07917","n_code_links":0,"syntology":null},{"paper":"/paper/pre-trained-universal-medical-image","slug":"pre-trained-universal-medical-image","title":"Building Universal Foundation Models for Medical Image Analysis with Spatially Adaptive Networks","date":"2023-12-12","arxiv_id":"2312.07630","n_code_links":1,"syntology":null},{"paper":null,"slug":"deep-reinforcement-learning-for-community","title":"Deep Reinforcement Learning for Community Battery Scheduling under Uncertainties of Load, PV Generation, and Energy Prices","date":"2023-12-04","arxiv_id":"2312.03008","n_code_links":0,"syntology":null},{"paper":null,"slug":"data-efficient-deep-reinforcement-learning-2","title":"Data-efficient Deep Reinforcement Learning for Vehicle Trajectory Control","date":"2023-11-30","arxiv_id":"2311.18393","n_code_links":0,"syntology":null},{"paper":null,"slug":"tactile-active-inference-reinforcement","title":"Tactile Active Inference Reinforcement Learning for Efficient Robotic Manipulation Skill Acquisition","date":"2023-11-19","arxiv_id":"2311.11287","n_code_links":0,"syntology":null},{"paper":null,"slug":"joint-location-sensing-and-channel-estimation","title":"Joint Location Sensing and Channel Estimation for IRS-Aided mmWave ISAC Systems","date":"2023-11-14","arxiv_id":"2311.08201","n_code_links":0,"syntology":null},{"paper":null,"slug":"mitigating-estimation-errors-by-twin-td","title":"Mitigating Estimation Errors by Twin TD-Regularized Actor and Critic for Deep Reinforcement Learning","date":"2023-11-07","arxiv_id":"2311.03711","n_code_links":0,"syntology":null},{"paper":null,"slug":"decoupled-actor-critic","title":"On the Theory of Risk-Aware Agents: Bridging Actor-Critic and Economics","date":"2023-10-30","arxiv_id":"2310.19527","n_code_links":0,"syntology":null},{"paper":null,"slug":"dsac-c-constrained-maximum-entropy-for-robust","title":"DSAC-C: Constrained Maximum Entropy for Robust Discrete Soft-Actor Critic","date":"2023-10-26","arxiv_id":"2310.17173","n_code_links":0,"syntology":null},{"paper":"/paper/dsac-t-distributional-soft-actor-critic-with","slug":"dsac-t-distributional-soft-actor-critic-with","title":"Distributional Soft Actor-Critic with Three Refinements","date":"2023-10-09","arxiv_id":"2310.05858","n_code_links":2,"syntology":{"ran":5,"of":5,"n_ran_checked":4,"n_instrument":1,"unverified":0,"pointer_only":5,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["jingliang-duan/dsac-t","jingliang-duan/dsac-v2"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/enhancing-data-efficiency-in-reinforcement","slug":"enhancing-data-efficiency-in-reinforcement","title":"Enhancing data efficiency in reinforcement learning: a novel imagination mechanism based on mesh information propagation","date":"2023-09-25","arxiv_id":"2309.14243","n_code_links":2,"syntology":null},{"paper":"/paper/double-gumbel-q-learning","slug":"double-gumbel-q-learning","title":"Double Gumbel Q-Learning","date":"2023-09-21","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"theoretically-guaranteed-policy-improvement","title":"Theoretically Guaranteed Policy Improvement Distilled from Model-Based Planning","date":"2023-07-24","arxiv_id":"2307.12933","n_code_links":0,"syntology":null},{"paper":"/paper/sarc-soft-actor-retrospective-critic","slug":"sarc-soft-actor-retrospective-critic","title":"SARC: Soft Actor Retrospective Critic","date":"2023-06-28","arxiv_id":"2306.16503","n_code_links":1,"syntology":null},{"paper":"/paper/relu-to-the-rescue-improve-your-on-policy","slug":"relu-to-the-rescue-improve-your-on-policy","title":"ReLU to the Rescue: Improve Your On-Policy Actor-Critic with Positive Advantages","date":"2023-06-02","arxiv_id":"2306.01460","n_code_links":1,"syntology":null},{"paper":"/paper/reducing-the-cost-of-cycle-time-tuning-for","slug":"reducing-the-cost-of-cycle-time-tuning-for","title":"Reducing the Cost of Cycle-Time Tuning for Real-World Policy Optimization","date":"2023-05-09","arxiv_id":"2305.05760","n_code_links":1,"syntology":{"ran":3,"of":3,"n_ran_checked":2,"n_instrument":1,"unverified":0,"pointer_only":2,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["homayoonfarrahi/cycle-time-study"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/open-information-extraction-via-chunks","slug":"open-information-extraction-via-chunks","title":"Open Information Extraction via Chunks","date":"2023-05-05","arxiv_id":"2305.03299","n_code_links":1,"syntology":null},{"paper":null,"slug":"can-agents-run-relay-race-with-strangers","title":"Can Agents Run Relay Race with Strangers? Generalization of RL to Out-of-Distribution Trajectories","date":"2023-04-26","arxiv_id":"2304.13424","n_code_links":0,"syntology":null},{"paper":null,"slug":"soft-actor-critic-algorithm-with-truly","title":"Soft Actor-Critic Algorithm with Truly-satisfied Inequality Constraint","date":"2023-03-08","arxiv_id":"2303.04356","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-strategy-oriented-bayesian-soft-actor","title":"A Strategy-Oriented Bayesian Soft Actor-Critic Model","date":"2023-03-07","arxiv_id":"2303.04193","n_code_links":0,"syntology":null},{"paper":"/paper/ls-iq-implicit-reward-regularization-for","slug":"ls-iq-implicit-reward-regularization-for","title":"LS-IQ: Implicit Reward Regularization for Inverse Reinforcement Learning","date":"2023-03-01","arxiv_id":"2303.00599","n_code_links":1,"syntology":null},{"paper":"/paper/potential-based-reward-shaping-for-learning","slug":"potential-based-reward-shaping-for-learning","title":"Learning to Play Text-based Adventure Games with Maximum Entropy Reinforcement Learning","date":"2023-02-21","arxiv_id":"2302.10720","n_code_links":1,"syntology":null},{"paper":"/paper/automatic-noise-filtering-with-dynamic-sparse","slug":"automatic-noise-filtering-with-dynamic-sparse","title":"Automatic Noise Filtering with Dynamic Sparse Training in Deep Reinforcement Learning","date":"2023-02-13","arxiv_id":"2302.06548","n_code_links":1,"syntology":{"ran":4,"of":4,"n_ran_checked":4,"n_instrument":0,"unverified":0,"pointer_only":1,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["bramgrooten/automatic-noise-filtering"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"automated-deep-reinforcement-learning-for","title":"Automated deep reinforcement learning for real-time scheduling strategy of multi-energy system integrated with post-carbon and direct-air carbon captured system","date":"2023-01-18","arxiv_id":"2301.07768","n_code_links":0,"syntology":null},{"paper":"/paper/extreme-q-learning-maxent-rl-without-entropy","slug":"extreme-q-learning-maxent-rl-without-entropy","title":"Extreme Q-Learning: MaxEnt RL without Entropy","date":"2023-01-05","arxiv_id":"2301.02328","n_code_links":4,"syntology":{"ran":8,"of":13,"n_ran_checked":5,"n_instrument":3,"unverified":5,"pointer_only":7,"phrase":"8 ran (of which 5 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 5 unverified","official":null}},{"paper":null,"slug":"towards-automating-codenames-spymasters-with","title":"Towards automating Codenames spymasters with deep reinforcement learning","date":"2022-12-28","arxiv_id":"2212.14104","n_code_links":0,"syntology":null},{"paper":null,"slug":"off-policy-deep-reinforcement-learning-1","title":"Off-Policy Deep Reinforcement Learning Algorithms for Handling Various Robotic Manipulator Tasks","date":"2022-12-11","arxiv_id":"2212.05572","n_code_links":0,"syntology":null},{"paper":null,"slug":"towards-automatic-prediction-of-outcome-in","title":"Towards Automatic Prediction of Outcome in Treatment of Cerebral Aneurysms","date":"2022-11-18","arxiv_id":"2211.11749","n_code_links":0,"syntology":null},{"paper":null,"slug":"c3po-learning-to-achieve-arbitrary-goals-via","title":"On the importance of data collection for training general goal-reaching policies","date":"2022-11-07","arxiv_id":"2211.03521","n_code_links":0,"syntology":null},{"paper":"/paper/synthesis-of-separation-processes-with","slug":"synthesis-of-separation-processes-with","title":"Synthesis of separation processes with reinforcement learning","date":"2022-11-03","arxiv_id":"2211.04327","n_code_links":1,"syntology":null},{"paper":"/paper/are-you-stealing-my-model-sample-correlation","slug":"are-you-stealing-my-model-sample-correlation","title":"Are You Stealing My Model? Sample Correlation for Fingerprinting Deep Neural Networks","date":"2022-10-21","arxiv_id":"2210.15427","n_code_links":1,"syntology":null},{"paper":"/paper/real-time-reinforcement-learning-for-vision","slug":"real-time-reinforcement-learning-for-vision","title":"Real-Time Reinforcement Learning for Vision-Based Robotics Utilizing Local and Remote Computers","date":"2022-10-05","arxiv_id":"2210.02317","n_code_links":2,"syntology":{"ran":4,"of":4,"n_ran_checked":2,"n_instrument":2,"unverified":0,"pointer_only":0,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","official":{"repos":["rlai-lab/relod","rlai-lab/remote-onboard-agent"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"disentangling-transfer-in-continual","title":"Disentangling Transfer in Continual Reinforcement Learning","date":"2022-09-28","arxiv_id":"2209.13900","n_code_links":0,"syntology":null},{"paper":null,"slug":"on-the-generalization-of-deep-reinforcement","title":"Generalization in Deep Reinforcement Learning for Robotic Navigation by Reward Shaping","date":"2022-09-28","arxiv_id":"2209.14271","n_code_links":0,"syntology":null},{"paper":null,"slug":"model-free-reinforcement-learning-for-asset","title":"Model-Free Reinforcement Learning for Asset Allocation","date":"2022-09-21","arxiv_id":"2209.10458","n_code_links":0,"syntology":null},{"paper":"/paper/revisiting-discrete-soft-actor-critic","slug":"revisiting-discrete-soft-actor-critic","title":"Revisiting Discrete Soft Actor-Critic","date":"2022-09-21","arxiv_id":"2209.10081","n_code_links":1,"syntology":null},{"paper":null,"slug":"simplifying-model-based-rl-learning","title":"Simplifying Model-based RL: Learning Representations, Latent-space Models, and Policies with One Objective","date":"2022-09-18","arxiv_id":"2209.08466","n_code_links":0,"syntology":null},{"paper":"/paper/partial-observability-during-drl-for-robot","slug":"partial-observability-during-drl-for-robot","title":"Experimental Study on The Effect of Multi-step Deep Reinforcement Learning in POMDPs","date":"2022-09-12","arxiv_id":"2209.04999","n_code_links":1,"syntology":null},{"paper":null,"slug":"exploiting-deep-reinforcement-learning-for","title":"Exploiting Deep Reinforcement Learning for Edge Caching in Cell-Free Massive MIMO Systems","date":"2022-08-26","arxiv_id":"2208.12453","n_code_links":0,"syntology":null},{"paper":null,"slug":"some-supervision-required-incorporating","title":"Some Supervision Required: Incorporating Oracle Policies in Reinforcement Learning via Epistemic Uncertainty Metrics","date":"2022-08-22","arxiv_id":"2208.10533","n_code_links":0,"syntology":null},{"paper":null,"slug":"entropy-augmented-reinforcement-learning","title":"Entropy Augmented Reinforcement Learning","date":"2022-08-19","arxiv_id":"2208.09322","n_code_links":0,"syntology":null},{"paper":null,"slug":"unified-policy-optimization-for-continuous","title":"Unified Policy Optimization for Continuous-action Reinforcement Learning in Non-stationary Tasks and Games","date":"2022-08-19","arxiv_id":"2208.09452","n_code_links":0,"syntology":null},{"paper":"/paper/bsac-bayesian-strategy-network-based-soft","slug":"bsac-bayesian-strategy-network-based-soft","title":"Bayesian Soft Actor-Critic: A Directed Acyclic Strategy Graph Based Deep Reinforcement Learning","date":"2022-08-11","arxiv_id":"2208.06033","n_code_links":2,"syntology":null}],"papers_shown":100,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":168,"with_a_code_link":69,"where_syntology_ran_a_sample":20,"not_listed_spam_title":0,"listed":168,"listed_where_code_ran":20,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":16,"every_run_a_failure_of_syntologys_instrument":4,"listed_with_a_run_with_no_instrument_failure":16,"listed_every_run_a_failure_of_syntologys_instrument":4,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":20,"papers_where_code_ran_first_page":"/method/sac/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"archive","page":2,"of":2,"url":"/method/sac/papers/2","json":"/method/sac/papers/2.json","rows":68},{"order":"ran","page":1,"of":1,"url":"/method/sac/papers/ran/1","json":"/method/sac/papers/ran/1.json","rows":20}],"tasks":[{"task":"/task/reinforcement-learning-1","name":"Reinforcement Learning (RL)","papers":86},{"task":"/task/reinforcement-learning-2","name":"reinforcement-learning","papers":65},{"task":"/task/deep-reinforcement-learning","name":"Deep Reinforcement Learning","papers":59},{"task":"/task/reinforcement-learning","name":"Reinforcement Learning","papers":50},{"task":"/task/continuous-control","name":"Continuous Control","papers":29},{"task":"/task/continuous-control","name":"continuous-control","papers":28},{"task":"/task/mujoco","name":"MuJoCo","papers":21},{"task":"/task/q-learning","name":"Q-Learning","papers":12},{"task":"/task/openai-gym","name":"OpenAI Gym","papers":9},{"task":"/task/atari-games","name":"Atari Games","papers":8},{"task":"/task/decision-making","name":"Decision Making","papers":8},{"task":"/task/autonomous-driving","name":"Autonomous Driving","papers":5},{"task":"/task/isac","name":"ISAC","papers":5},{"task":"/task/imitation-learning","name":"Imitation Learning","papers":5},{"task":"/task/scheduling","name":"Scheduling","papers":5},{"task":"/task/integrated-sensing-and-communication","name":"Integrated sensing and communication","papers":4},{"task":"/task/adversarial-defense","name":"Adversarial Defense","papers":3},{"task":"/task/benchmarking","name":"Benchmarking","papers":3},{"task":"/task/computational-efficiency","name":"Computational Efficiency","papers":3},{"task":"/task/continual-learning","name":"Continual Learning","papers":3}],"tasks_shown":20,"n_tasks":117,"usage_by_year":[{"year":"2020","papers":17},{"year":"2021","papers":41},{"year":"2022","papers":28},{"year":"2023","papers":25},{"year":"2024","papers":42},{"year":"2025","papers":15}],"row_source":"embedded","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/sac"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=SAC","read_at":"2026-10-05T01:01:29+00:00","query":"SAC","kind":"method","have":"declared_code","tier":"repo_known","verified_implementation":false,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"method":"SAC","origin_arxiv_id":"2601.14039"},"resolution":"exact","resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"unknown","archive_paper_arxiv_id":null,"repositories":{"listed":1,"in_graph":1,"list_truncated":false,"strongest_link":"listed_only"},"retrieve_with":null,"name_competition":{"verdict":"outranked","may_be_wrong_sense":true,"bearers_found":8,"served":{"arxiv_id":"2601.14039","citations":0},"leading_other_bearer":{"arxiv_id":"2009.01485","title":"SAC: Semantic Attention Composition for Text-Conditioned Image Retrieval","citations":58,"named_by":["title_prefix"],"bearer_name":"SAC: Semantic Attention Composition for Text-Conditioned Image Retrieval","ask_with":"have('2009.01485')"},"n_other_bearers_listed":5,"note":"'SAC' is ALSO the name of the paper 'SAC: Semantic Attention Composition for Text-Conditioned Image Retrieval' (arXiv:2009.01485, 58 citations), which is cited FAR more than the paper this answer is about (0). This answer may be about the wrong SAC. If you meant the better-known one, ask again with that entry of `also_named`."},"name_competition_text":"The same name also belongs to the paper “SAC: Semantic Attention Composition for Text-Conditioned Image Retrieval” (arXiv:2009.01485, 58 citations), which the lookup finds cited far more than the paper this answer is about (0 citations), so this answer may be about a different sense of the name.","near_matches":null,"code_nearby":[{"name":"ClonEx-SAC","relation":"shares_name_tokens","relation_means":"shares name tokens with this name; a different method","level":2,"retrieve_with":"get_reference_implementation(name='ClonEx-SAC')","origin_arxiv_id":"2209.13900"},{"name":"Predictive Information SAC (PI-SAC)","relation":"shares_name_tokens","relation_means":"shares name tokens with this name; a different method","level":3,"retrieve_with":"get_reference_implementation(name='Predictive Information SAC (PI-SAC)')","origin_arxiv_id":"2007.12401"}],"code_nearby_caption":"Code Syntology holds under other names, as the lookup lists them (code_nearby); not a complete list, and none of them is this method.","origin_paper":{"arxiv_id":"2601.14039","page":"/paper/arxiv-2601-14039","syntology_url":"https://syntology.ai/paper/2601.14039","in_graph_layer":true,"samples":8,"ran":5,"n_ran_checked":1,"n_instrument":4,"unverified":3,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 3 unverified","instrument_means":"failures of Syntology's instrument, not of the code"},"line":"repository known, no verified implementation (declared_code; repositories: 1 listed of 1 in the graph, strongest link: listed only). The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:2601.14039) is about this method is not checked.","level_legend":{"state":"quoted","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","card_sha256":"479785a84658dd682a11b10237b3620d651d7f87799f5dc7add970aaa83f6d39","note":"Syntology's served verification levels, quoted verbatim from its MCP server card; a row is split where the card separates clauses with a double hyphen, and the separator is not reproduced","levels":[{"level":"V0","quoted":["imports"]},{"level":"V1","quoted":["executes against a synthesized fixture and returns a value of the recorded type"]},{"level":"V2","quoted":["two implementations GENERATED from the paper's signature and spec agree numerically (1e-6) on fixture inputs","neither of the two ever read the authors' own code, so V2 measures how unambiguously the paper specifies the method, not fidelity to the authors' implementation (measured 2026-09-11, commit 75eaa77: cross_checked_by is a second LLM on 2,628 of 2,831 served samples)"]},{"level":"V3","quoted":["paper-derived property tests pass on both of those same two generations."]}],"no_rung":"No rung on this ladder compares the served code against the authors' implementation, so treat every level as evidence about runnability and internal agreement, not about matching the paper's results."}},"syntology_have_state":"loaded","record_sha256":"f3c7bb5676f3b4e6a7768da036e6d338352221b83b2c9ff8c5f2a0a970772f8e","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}