{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/radam","slug":"radam","name":"RAdam","full_name":"RAdam","full_name_withheld":false,"description_markdown":"**Rectified Adam**, or **RAdam**, is a variant of the [Adam](https://paperswithcode.com/method/adam) stochastic optimizer that introduces a term to rectify the variance of the adaptive learning rate. It seeks to tackle the bad convergence problem suffered by Adam. The authors argue that the root cause of this behaviour is that the adaptive learning rate has undesirably large variance in the early stage of model training, due to the limited amount of training samples being used. Thus, to reduce such variance, it is better to use smaller learning rates in the first few epochs of training - which justifies the warmup heuristic. This heuristic motivates RAdam which rectifies the variance problem:\r\n\r\n$$g\\_{t} = \\nabla\\_{\\theta}f\\_{t}\\left(\\theta\\_{t-1}\\right) $$\r\n\r\n$$v\\_{t} = 1/\\beta\\_{2}v\\_{t-1} + \\left(1-\\beta\\_{2}\\right)g^{2}\\_{t} $$\r\n\r\n$$m\\_{t} = \\beta\\_{1}m\\_{t-1} + \\left(1-\\beta\\_{1}\\right)g\\_{t} $$\r\n\r\n$$ \\hat{m\\_{t}} = m\\_{t} / \\left(1-\\beta^{t}\\_{1}\\right) $$\r\n\r\n$$ \\rho\\_{t} = \\rho\\_{\\infty} - 2t\\beta^{t}\\_{2}/\\left(1-\\beta^{t}\\_{2}\\right) $$\r\n\r\n$$\\rho_{\\infty} = \\frac{2}{1-\\beta_2} - 1$$ \r\n\r\nIf the variance is tractable - $\\rho\\_{t} > 4$ then:\r\n\r\n...the adaptive learning rate is computed as:\r\n\r\n$$ l\\_{t} = \\sqrt{\\left(1-\\beta^{t}\\_{2}\\right)/v\\_{t}}$$\r\n\r\n...the variance rectification term is calculated as:\r\n\r\n$$ r\\_{t} = \\sqrt{\\frac{(\\rho\\_{t}-4)(\\rho\\_{t}-2)\\rho\\_{\\infty}}{(\\rho\\_{\\infty}-4)(\\rho\\_{\\infty}-2)\\rho\\_{t}}}$$\r\n\r\n...and we update parameters with adaptive momentum:\r\n\r\n$$ \\theta\\_{t} = \\theta\\_{t-1} - \\alpha\\_{t}r\\_{t}\\hat{m}\\_{t}l\\_{t} $$\r\n\r\nIf the variance isn't tractable we update instead with:\r\n\r\n$$ \\theta\\_{t} = \\theta\\_{t-1} - \\alpha\\_{t}\\hat{m}\\_{t} $$","description_state":"present","introduced_year":null,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":"https://arxiv.org/abs/1908.03265v4","title":"On the Variance of the Adaptive Learning Rate and Beyond","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/pytorch/pytorch/blob/d05c1ec007ae75de5f6df7b05de7cca59751dea5/torch/optim/radam.py#L6","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Stochastic Optimization","url":"/methods/category/stochastic-optimization","pwc_aliases":[]}],"n_papers_tagged":65,"archive_num_papers":null,"papers_newest_first":[{"paper":null,"slug":"the-hype-index-an-nlp-driven-measure-of","title":"The Hype Index: an NLP-driven Measure of Market News Attention","date":"2025-05-30","arxiv_id":"2506.06329","n_code_links":0,"syntology":null},{"paper":null,"slug":"model-editing-with-graph-based-external","title":"Model Editing with Graph-Based External Memory","date":"2025-05-23","arxiv_id":"2505.18343","n_code_links":0,"syntology":null},{"paper":null,"slug":"exploring-the-innovation-opportunities-for","title":"Exploring the Innovation Opportunities for Pre-trained Models","date":"2025-05-21","arxiv_id":"2505.15790","n_code_links":0,"syntology":null},{"paper":null,"slug":"rl-in-name-only-analyzing-the-structural","title":"RL in Name Only? Analyzing the Structural Assumptions in RL post-training for LLMs","date":"2025-05-19","arxiv_id":"2505.13697","n_code_links":0,"syntology":null},{"paper":null,"slug":"comparative-analysis-of-evolutionary-1","title":"Comparative Analysis of Evolutionary Algorithms for Energy-Aware Production Scheduling","date":"2025-04-22","arxiv_id":"2504.15672","n_code_links":0,"syntology":null},{"paper":null,"slug":"beyond-the-hype-embeddings-vs-prompting-for","title":"Beyond the Hype: Embeddings vs. Prompting for Multiclass Classification Tasks","date":"2025-04-05","arxiv_id":"2504.04277","n_code_links":0,"syntology":null},{"paper":null,"slug":"what-the-f-ck-is-artificial-general","title":"What the F*ck Is Artificial General Intelligence?","date":"2025-03-31","arxiv_id":"2503.23923","n_code_links":0,"syntology":null},{"paper":"/paper/bridging-evolutionary-multiobjective","slug":"bridging-evolutionary-multiobjective","title":"Bridging Evolutionary Multiobjective Optimization and GPU Acceleration via Tensorization","date":"2025-03-26","arxiv_id":"2503.20286","n_code_links":2,"syntology":null},{"paper":"/paper/guidelines-for-the-choice-of-the-baseline-in","slug":"guidelines-for-the-choice-of-the-baseline-in","title":"Guidelines For The Choice Of The Baseline in XAI Attribution Methods","date":"2025-03-25","arxiv_id":"2503.19813","n_code_links":1,"syntology":null},{"paper":null,"slug":"the-imitation-game-according-to-turing","title":"The Imitation Game According To Turing","date":"2025-01-29","arxiv_id":"2501.17629","n_code_links":0,"syntology":null},{"paper":"/paper/why-these-documents-explainable-generative","slug":"why-these-documents-explainable-generative","title":"Why These Documents? Explainable Generative Retrieval with Hierarchical Category Paths","date":"2024-11-08","arxiv_id":"2411.05572","n_code_links":1,"syntology":null},{"paper":null,"slug":"danoliteracy-of-generative-large-language","title":"Danoliteracy of Generative, Large Language Models","date":"2024-10-30","arxiv_id":"2410.22839","n_code_links":0,"syntology":null},{"paper":null,"slug":"misrepresented-technological-solutions-in","title":"Misrepresented Technological Solutions in Imagined Futures: The Origins and Dangers of AI Hype in the Research Community","date":"2024-08-08","arxiv_id":"2408.15244","n_code_links":0,"syntology":null},{"paper":null,"slug":"decoding-knowledge-claims-the-evaluation-of","title":"Decoding Knowledge Claims: The Evaluation of Scientific Publication Contributions through Semantic Analysis","date":"2024-07-26","arxiv_id":"2407.18646","n_code_links":0,"syntology":null},{"paper":null,"slug":"continuous-fake-media-detection-adapting","title":"Continuous fake media detection: adapting deepfake detectors to new generative techniques","date":"2024-06-12","arxiv_id":"2406.08171","n_code_links":0,"syntology":null},{"paper":"/paper/hype-hyperbolic-entailment-filtering-for","slug":"hype-hyperbolic-entailment-filtering-for","title":"HYPE: Hyperbolic Entailment Filtering for Underspecified Images and Texts","date":"2024-04-26","arxiv_id":"2404.17507","n_code_links":1,"syntology":null},{"paper":null,"slug":"ai-safety-necessary-but-insufficient-and","title":"AI Safety: Necessary, but insufficient and possibly problematic","date":"2024-03-26","arxiv_id":"2403.17419","n_code_links":0,"syntology":null},{"paper":null,"slug":"the-interplay-of-learning-analytics-and","title":"The Interplay of Learning, Analytics, and Artificial Intelligence in Education: A Vision for Hybrid Intelligence","date":"2024-03-24","arxiv_id":"2403.16081","n_code_links":0,"syntology":null},{"paper":null,"slug":"are-you-a-robot-detecting-autonomous-vehicles","title":"Are you a robot? Detecting Autonomous Vehicles from Behavior Analysis","date":"2024-03-14","arxiv_id":"2403.09571","n_code_links":0,"syntology":null},{"paper":null,"slug":"assessing-the-reasoning-abilities-of-chatgpt","title":"Assessing the Reasoning Abilities of ChatGPT in the Context of Claim Verification","date":"2024-02-16","arxiv_id":"2402.10735","n_code_links":0,"syntology":null},{"paper":null,"slug":"neither-hype-nor-gloom-do-dnns-justice","title":"Neither hype nor gloom do DNNs justice","date":"2023-12-08","arxiv_id":"2312.05355","n_code_links":0,"syntology":null},{"paper":null,"slug":"hypothesis-network-planned-exploration-for","title":"Hypothesis Network Planned Exploration for Rapid Meta-Reinforcement Learning Adaptation","date":"2023-11-07","arxiv_id":"2311.03701","n_code_links":0,"syntology":null},{"paper":null,"slug":"hype-attention-with-hyperbolic-biases-for","title":"HyPE: Attention with Hyperbolic Biases for Relative Positional Encoding","date":"2023-10-30","arxiv_id":"2310.19676","n_code_links":0,"syntology":null},{"paper":null,"slug":"web3-meets-ai-marketplace-exploring","title":"Web3 Meets AI Marketplace: Exploring Opportunities, Analyzing Challenges, and Suggesting Solutions","date":"2023-10-29","arxiv_id":"2310.19099","n_code_links":0,"syntology":null},{"paper":null,"slug":"does-artificial-intelligence-benefit-uk","title":"Does Artificial Intelligence benefit UK businesses? An empirical study of the impact of AI on productivity","date":"2023-10-06","arxiv_id":"2310.05985","n_code_links":0,"syntology":null},{"paper":null,"slug":"wisdom-of-the-crowds-or-ignorance-of-the","title":"Wisdom of the Crowds or Ignorance of the Masses? A data-driven guide to WSB","date":"2023-08-18","arxiv_id":"2308.09485","n_code_links":0,"syntology":null},{"paper":null,"slug":"proposing-a-conceptual-framework-social-media","title":"Proposing a conceptual framework: social media listening for public health behavior","date":"2023-07-30","arxiv_id":"2308.02037","n_code_links":0,"syntology":null},{"paper":null,"slug":"amplifying-limitations-harms-and-risks-of","title":"Amplifying Limitations, Harms and Risks of Large Language Models","date":"2023-07-06","arxiv_id":"2307.04821","n_code_links":0,"syntology":null},{"paper":null,"slug":"learning-to-prompt-in-the-classroom-to","title":"Learning to Prompt in the Classroom to Understand AI Limits: A pilot study","date":"2023-07-04","arxiv_id":"2307.01540","n_code_links":0,"syntology":null},{"paper":null,"slug":"unbiased-pain-assessment-through-wearables","title":"Wearable-based Fair and Accurate Pain Assessment Using Multi-Attribute Fairness Loss in Convolutional Neural Networks","date":"2023-07-03","arxiv_id":"2307.05333","n_code_links":0,"syntology":null},{"paper":"/paper/bidirectional-looking-with-a-novel-double","slug":"bidirectional-looking-with-a-novel-double","title":"Bidirectional Looking with A Novel Double Exponential Moving Average to Adaptive and Non-adaptive Momentum Optimizers","date":"2023-07-02","arxiv_id":"2307.00631","n_code_links":1,"syntology":{"ran":5,"of":6,"n_ran_checked":5,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":{"repos":["chernyn/admeta-optimizer"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"social-media-emotions-and-ipo-returns","title":"Social Media Emotions and IPO Returns","date":"2023-06-21","arxiv_id":"2306.12602","n_code_links":0,"syntology":null},{"paper":"/paper/conversational-process-modelling-state-of-the","slug":"conversational-process-modelling-state-of-the","title":"Conversational Process Modeling: Can Generative AI Empower Domain Experts in Creating and Redesigning Process Models?","date":"2023-04-19","arxiv_id":"2304.11065","n_code_links":1,"syntology":null},{"paper":"/paper/the-shaky-foundations-of-clinical-foundation","slug":"the-shaky-foundations-of-clinical-foundation","title":"The Shaky Foundations of Clinical Foundation Models: A Survey of Large Language Models and Foundation Models for EMRs","date":"2023-03-22","arxiv_id":"2303.12961","n_code_links":2,"syntology":null},{"paper":null,"slug":"transformer-models-for-type-inference-in-the","title":"Transformer Models for Type Inference in the Simply Typed Lambda Calculus: A Case Study in Deep Learning for Code","date":"2023-03-15","arxiv_id":"2304.10500","n_code_links":0,"syntology":null},{"paper":"/paper/chatgpt-may-pass-the-bar-exam-soon-but-has-a","slug":"chatgpt-may-pass-the-bar-exam-soon-but-has-a","title":"ChatGPT may Pass the Bar Exam soon, but has a Long Way to Go for the LexGLUE benchmark","date":"2023-03-09","arxiv_id":"2304.12202","n_code_links":1,"syntology":null},{"paper":"/paper/radam-texture-recognition-through-randomized-1","slug":"radam-texture-recognition-through-randomized-1","title":"RADAM: Texture Recognition through Randomized Aggregated Encoding of Deep Activation Maps","date":"2023-03-08","arxiv_id":"2303.04554","n_code_links":1,"syntology":null},{"paper":null,"slug":"judging-adam-studying-the-performance-of","title":"Judging Adam: Studying the Performance of Optimization Methods on ML4SE Tasks","date":"2023-03-06","arxiv_id":"2303.03540","n_code_links":0,"syntology":null},{"paper":"/paper/read-the-signs-towards-invariance-to-gradient","slug":"read-the-signs-towards-invariance-to-gradient","title":"Read the Signs: Towards Invariance to Gradient Descent's Hyperparameter Initialization","date":"2023-01-24","arxiv_id":"2301.10133","n_code_links":1,"syntology":null},{"paper":null,"slug":"democratization-of-retail-trading-can-reddit","title":"Democratization of Retail Trading: Can Reddit's WallStreetBets Outperform Investment Bank Analysts?","date":"2022-12-31","arxiv_id":"2301.00170","n_code_links":0,"syntology":null},{"paper":"/paper/hype-better-pre-trained-language-model-fine","slug":"hype-better-pre-trained-language-model-fine","title":"HyPe: Better Pre-trained Language Model Fine-tuning with Hidden Representation Perturbation","date":"2022-12-17","arxiv_id":"2212.08853","n_code_links":1,"syntology":null},{"paper":"/paper/adanorm-adaptive-gradient-norm-correction","slug":"adanorm-adaptive-gradient-norm-correction","title":"AdaNorm: Adaptive Gradient Norm Correction based Optimizer for CNNs","date":"2022-10-12","arxiv_id":"2210.06364","n_code_links":1,"syntology":null},{"paper":null,"slug":"when-not-to-use-machine-learning-a","title":"When not to use machine learning: a perspective on potential and limitations","date":"2022-10-06","arxiv_id":"2210.02666","n_code_links":0,"syntology":null},{"paper":null,"slug":"is-it-possible-not-to-cheat-on-the-turing","title":"Not Cheating on the Turing Test: Towards Grounded Language Learning in Artificial Intelligence","date":"2022-06-29","arxiv_id":"2206.14672","n_code_links":0,"syntology":null},{"paper":"/paper/covid-19-chest-x-ray-image-generation-using","slug":"covid-19-chest-x-ray-image-generation-using","title":"Covid-19 chest x-ray image generation using resnet-dcgan model","date":"2022-05-17","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/distilprotbert-a-distilled-protein-language","slug":"distilprotbert-a-distilled-protein-language","title":"DistilProtBert: A distilled protein language model used to distinguish between real proteins and their randomly shuffled counterparts","date":"2022-05-10","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"landing-ai-on-networks-an-equipment-vendor","title":"Landing AI on Networks: An equipment vendor viewpoint on Autonomous Driving Networks","date":"2022-04-26","arxiv_id":"2205.08347","n_code_links":0,"syntology":null},{"paper":null,"slug":"the-6-ds-of-creating-ai-enabled-systems","title":"The 6-Ds of Creating AI-Enabled Systems","date":"2022-02-04","arxiv_id":"2202.03172","n_code_links":0,"syntology":null},{"paper":null,"slug":"digital-twin-from-concept-to-practice","title":"Digital Twin: From Concept to Practice","date":"2022-01-14","arxiv_id":"2201.06912","n_code_links":0,"syntology":null},{"paper":null,"slug":"challenges-of-artificial-intelligence-from","title":"Challenges of Artificial Intelligence -- From Machine Learning and Computer Vision to Emotional Intelligence","date":"2022-01-05","arxiv_id":"2201.01466","n_code_links":0,"syntology":null},{"paper":null,"slug":"machine-learning-for-earth-system-science-ess","title":"Machine learning for Earth System Science (ESS): A survey, status and future directions for South Asia","date":"2021-12-24","arxiv_id":"2112.12966","n_code_links":0,"syntology":null},{"paper":null,"slug":"machine-learning-for-computational-science","title":"Machine Learning for Computational Science and Engineering -- a brief introduction and some critical questions","date":"2021-12-22","arxiv_id":"2112.12054","n_code_links":0,"syntology":null},{"paper":null,"slug":"towards-launching-ai-algorithms-for-cellular","title":"Towards Launching AI Algorithms for Cellular Pathology into Clinical & Pharmaceutical Orbits","date":"2021-12-17","arxiv_id":"2112.09496","n_code_links":0,"syntology":null},{"paper":null,"slug":"when-combating-hype-proceed-with-caution","title":"The Dangers of Underclaiming: Reasons for Caution When Reporting How NLP Systems Fail","date":"2021-10-15","arxiv_id":"2110.08300","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-techno-economic-cost-framework-for","title":"A Techno-Economic Cost Framework for Satellite Networks Applied to Low Earth Orbit Constellations: Assessing Starlink, OneWeb and Kuiper","date":"2021-08-24","arxiv_id":"2108.10834","n_code_links":0,"syntology":null},{"paper":null,"slug":"should-you-take-investment-advice-from","title":"Should You Take Investment Advice From WallStreetBets? A Data-Driven Approach","date":"2021-05-06","arxiv_id":"2105.02728","n_code_links":0,"syntology":null},{"paper":null,"slug":"on-the-marginal-regret-bound-minimization-of","title":"On the Marginal Regret Bound Minimization of Adaptive Methods","date":"2021-01-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/self-supervised-hyperboloid-representations","slug":"self-supervised-hyperboloid-representations","title":"Self-Supervised Hyperboloid Representations from Logical Queries over Knowledge Graphs","date":"2020-12-23","arxiv_id":"2012.13023","n_code_links":1,"syntology":null},{"paper":null,"slug":"metastatic-cancer-image-classification-based","title":"Metastatic Cancer Image Classification Based On Deep Learning Method","date":"2020-11-13","arxiv_id":"2011.06984","n_code_links":0,"syntology":null},{"paper":"/paper/eadam-optimizer-how-e-impact-adam","slug":"eadam-optimizer-how-e-impact-adam","title":"EAdam Optimizer: How $ε$ Impact Adam","date":"2020-11-04","arxiv_id":"2011.02150","n_code_links":2,"syntology":null},{"paper":"/paper/hmq-hardware-friendly-mixed-precision","slug":"hmq-hardware-friendly-mixed-precision","title":"HMQ: Hardware Friendly Mixed Precision Quantization Block for CNNs","date":"2020-07-20","arxiv_id":"2007.09952","n_code_links":2,"syntology":{"ran":3,"of":4,"n_ran_checked":3,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":{"repos":["sony-si/ai-research"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/semg-gesture-recognition-with-a-simple-model","slug":"semg-gesture-recognition-with-a-simple-model","title":"sEMG Gesture Recognition with a Simple Model of Attention","date":"2020-06-05","arxiv_id":"2006.03645","n_code_links":2,"syntology":{"ran":3,"of":3,"n_ran_checked":2,"n_instrument":1,"unverified":0,"pointer_only":3,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["josephsdavid/semg_repro"],"state":"official: no sample here; runs from other or unrecorded repositories","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["named_in_paper"]}}},{"paper":null,"slug":"end-to-end-deep-diagnosis-of-x-ray-images","title":"End-to-End Deep Diagnosis of X-ray Images","date":"2020-03-19","arxiv_id":"2003.08605","n_code_links":0,"syntology":null},{"paper":"/paper/on-the-adequacy-of-untuned-warmup-for","slug":"on-the-adequacy-of-untuned-warmup-for","title":"On the adequacy of untuned warmup for adaptive optimization","date":"2019-10-09","arxiv_id":"1910.04209","n_code_links":1,"syntology":{"ran":4,"of":4,"n_ran_checked":4,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":null}},{"paper":"/paper/on-the-variance-of-the-adaptive-learning-rate","slug":"on-the-variance-of-the-adaptive-learning-rate","title":"On the Variance of the Adaptive Learning Rate and Beyond","date":"2019-08-08","arxiv_id":"1908.03265","n_code_links":21,"syntology":{"ran":12,"of":13,"n_ran_checked":11,"n_instrument":1,"unverified":1,"pointer_only":1,"phrase":"12 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 2 honoured, 0 violated, 9 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified","official":{"repos":["LiyuanLucasLiu/RAdam"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["listed","official"]}}}],"papers_shown":65,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":65,"with_a_code_link":20,"where_syntology_ran_a_sample":5,"not_listed_spam_title":0,"listed":65,"listed_where_code_ran":5,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":5,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":5,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":5,"papers_where_code_ran_first_page":"/method/radam/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"ran","page":1,"of":1,"url":"/method/radam/papers/ran/1","json":"/method/radam/papers/ran/1.json","rows":5}],"tasks":[{"task":"/task/language-modelling","name":"Language Modelling","papers":4},{"task":"/task/deep-learning","name":"Deep Learning","papers":3},{"task":"/task/image-classification","name":"Image Classification","papers":3},{"task":"/task/language-modeling","name":"Language Modeling","papers":3},{"task":"/task/articles","name":"Articles","papers":2},{"task":"/task/autonomous-driving","name":"Autonomous Driving","papers":2},{"task":"/task/machine-learning","name":"BIG-bench Machine Learning","papers":2},{"task":"/task/classification-1","name":"Classification","papers":2},{"task":"/task/classification","name":"General Classification","papers":2},{"task":"/task/machine-translation","name":"Machine Translation","papers":2},{"task":"/task/translation","name":"Translation","papers":2},{"task":"/task/image-classification","name":"image-classification","papers":2},{"task":"/task/anomaly-detection","name":"Anomaly Detection","papers":1},{"task":"/task/attribute","name":"Attribute","papers":1},{"task":"/task/autonomous-vehicles","name":"Autonomous Vehicles","papers":1},{"task":null,"name":"CPU","papers":1},{"task":"/task/claim-verification","name":"Claim Verification","papers":1},{"task":"/task/continual-learning","name":"Continual Learning","papers":1},{"task":"/task/decoder","name":"Decoder","papers":1},{"task":"/task/deepfake-detection","name":"DeepFake Detection","papers":1}],"tasks_shown":20,"n_tasks":73,"usage_by_year":[{"year":"2019","papers":2},{"year":"2020","papers":6},{"year":"2021","papers":7},{"year":"2022","papers":11},{"year":"2023","papers":19},{"year":"2024","papers":10},{"year":"2025","papers":10}],"row_source":"embedded","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/radam"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=RAdam","read_at":"2026-10-05T01:00:51+00:00","query":"RAdam","kind":"method","have":"unknown_name","tier":null,"verified_implementation":null,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":null,"resolution":null,"resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":null,"archive_paper_arxiv_id":null,"repositories":null,"retrieve_with":null,"name_competition":{"verdict":"none","may_be_wrong_sense":false,"bearers_found":0,"served":null,"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing in this corpus is named 'RAdam' -- no method node, no paper announcing it in its title, no expanded form declaring it as an acronym."},"name_competition_text":null,"near_matches":[],"code_nearby":[],"code_nearby_caption":null,"origin_paper":null,"line":"name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"9a9938c764b690fd405eaef9e5a350d1bd47b6de90edf7d7aa576898206869ee","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}