{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/dra","slug":"dra","name":"DRA","full_name":"Dynamic Range Activator","full_name_withheld":false,"description_markdown":"Recursive functions with **heteroscedasticity, sparse and high-variance** target distributions introduces a huge complexity that makes their accurate modeling with Neural Networks a difficult task. A main property of recursive maps (e.g factorial function), is their dramatic growth and drop. Learning this recursive behavior requires not only fitting high-frequency patterns within a bounded region but also successfully extrapolating those patterns beyond that region. In time series prediction tasks, capturing periodic even behavior is a challenge. Various methods have been employed to model periodic patterns effectively. However, these approaches typically deal with uni-modal data that also exhibit relatively low variance in both In-Distribution (ID) and Out-Of-Distribution (OOD) regions and do not generalize well to recursive problems with the high-variance observed in our context.\r\nThus, to enable Transformers to capture such behavior and perform proper inference for multi-modal recursive problems, we enhance them by introducing the **Dynamic Range Activator (DRA)**. The DRA is designed to handle the recursive and factorial growth properties inherent in enumerative problems with minimal computational overhead and can be integrated into existing neural networks without requiring significant architectural changes. DRA integrates both harmonic and hyperbolic components as follows,\r\n\\begin{equation}\r\n    \\mathrm{DRA}(x) := x + a \\sin^2\\left(\\frac{x}{b}\\right) + c \\cos(bx) + d \\tanh(bx) \\,,\r\n\\end{equation}\r\nwhere $a, b, c, d$ are learnable parameters. It allows the function to simultaneously model periodic data (through sine and cosine) and rapid growth or attenuation (through the hyperbolic tangent) response.","description_state":"present","introduced_year":null,"introduced_by":{"title":"Can Transformers Do Enumerative Geometry?","paper":"/paper/can-transformers-do-enumerative-geometry","first_author":"Baran Hashemi","n_authors":3,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/can-transformers-do-enumerative-geometry"},"source":{"url":"https://arxiv.org/abs/2408.14915v3","title":"Can Transformers Do Enumerative Geometry?","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/Baran-phys/DynamicFormer","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Activation Functions","url":"/methods/category/activation-functions","pwc_aliases":[]}],"n_papers_tagged":4,"archive_num_papers":4,"papers_newest_first":[{"paper":null,"slug":"2505-10942","title":"Nosy Layers, Noisy Fixes: Tackling DRAs in Federated Learning Systems using Explainable AI","date":"2025-05-16","arxiv_id":"2505.10942","n_code_links":0,"syntology":null},{"paper":"/paper/dra-grpo-exploring-diversity-aware-reward","slug":"dra-grpo-exploring-diversity-aware-reward","title":"DRA-GRPO: Exploring Diversity-Aware Reward Adjustment for R1-Zero-Like Training of Large Language Models","date":"2025-05-14","arxiv_id":"2505.09655","n_code_links":1,"syntology":{"ran":8,"of":8,"n_ran_checked":5,"n_instrument":3,"unverified":0,"pointer_only":0,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 1 violated, 3 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","official":{"repos":["xiwenc1/dra-grpo"],"state":"official (archive's flag): 8 ran","n_ran":8,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"optimizing-antenna-activation-for-even-power","title":"Optimizing Antenna Activation for Even Power Distribution in Multi-Beam Satellite Systems Using Genetic Algorithm","date":"2025-02-23","arxiv_id":"2502.16592","n_code_links":0,"syntology":null},{"paper":"/paper/can-transformers-do-enumerative-geometry","slug":"can-transformers-do-enumerative-geometry","title":"Can Transformers Do Enumerative Geometry?","date":"2024-08-27","arxiv_id":"2408.14915","n_code_links":1,"syntology":{"ran":3,"of":3,"n_ran_checked":1,"n_instrument":2,"unverified":0,"pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified","official":{"repos":["Baran-phys/DynamicFormer"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}}],"papers_shown":4,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":4,"with_a_code_link":2,"where_syntology_ran_a_sample":2,"not_listed_spam_title":0,"listed":4,"listed_where_code_ran":2,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":2,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":2,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":2,"papers_where_code_ran_first_page":"/method/dra/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"ran","page":1,"of":1,"url":"/method/dra/papers/ran/1","json":"/method/dra/papers/ran/1.json","rows":2}],"tasks":[{"task":"/task/activation-function-synthesis","name":"Activation Function Synthesis","papers":1},{"task":"/task/causal-inference","name":"Causal Inference","papers":1},{"task":"/task/conformal-prediction","name":"Conformal Prediction","papers":1},{"task":"/task/diversity","name":"Diversity","papers":1},{"task":"/task/federated-learning","name":"Federated Learning","papers":1},{"task":"/task/inductive-bias","name":"Inductive Bias","papers":1},{"task":"/task/mathematical-reasoning","name":"Mathematical Reasoning","papers":1},{"task":"/task/time-series-1","name":"Time Series","papers":1},{"task":"/task/regression-1","name":"regression","papers":1},{"task":"/task/scientific-discovery","name":"scientific discovery","papers":1}],"tasks_shown":10,"n_tasks":10,"usage_by_year":[{"year":"2024","papers":1},{"year":"2025","papers":3}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/dra"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=DRA","read_at":"2026-10-05T00:55:16+00:00","query":"DRA","kind":"method","have":"unknown_name","tier":null,"verified_implementation":null,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":null,"resolution":null,"resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":null,"archive_paper_arxiv_id":"2408.14915","repositories":null,"retrieve_with":null,"name_competition":{"verdict":"unresolved_bearers","may_be_wrong_sense":false,"bearers_found":4,"served":null,"leading_other_bearer":{"arxiv_id":"2408.14915","title":"Can Transformers Do Enumerative Geometry?","citations":14,"named_by":["acronym_expansion"],"bearer_name":"Dynamic Range Activator (DRA)","ask_with":"have('2408.14915')"},"n_other_bearers_listed":4,"note":"Nothing resolved to 'DRA' by name, but 4 thing(s) here DECLARE that name -- most cited: 'Dynamic Range Activator (DRA)', a method in 'Can Transformers Do Enumerative Geometry?' (arXiv:2408.14915, 14 citations). None of them is a well-cited bearer of the name, so this is still a coverage gap for any better-known sense -- they are listed so you can judge, not as a substitute."},"name_competition_text":"Nothing resolved to this name, but 4 entries in Syntology's graph carry it; the most cited is “Dynamic Range Activator (DRA)”, a method in the paper “Can Transformers Do Enumerative Geometry?” (arXiv:2408.14915, 14 citations). None of them is well cited, so for any better known sense of the name this is still a gap in coverage; they are listed so you can judge, not as a substitute.","near_matches":[],"code_nearby":[],"code_nearby_caption":null,"origin_paper":null,"line":"name not resolved (unknown_name). Other entries in Syntology's graph carry this name; the lookup's note below says what that means for this name.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"4edf98d94f22f17c83d2709969a71d1ccd673e6d3d99eb1889c806468bd6674f","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}