{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/nest","slug":"nest","name":"NesT","full_name":"NesT","full_name_withheld":false,"description_markdown":"**NesT** stacks canonical transformer layers to conduct local self-attention on every image block independently, and then \"nests\" them hierarchically. Coupling of processed information between spatially adjacent blocks is achieved through a proposed block aggregation between every two hierarchies. The overall hierarchical structure can be determined by two key hyper-parameters: patch size $S × S$ and number of block hierarchies $T_d$. All blocks inside each hierarchy share one set of parameters. Given input of image, each image is linearly projected to an embedding. All embeddings are partitioned to blocks and flattened to generate final input. Each transformer layers is composed of a multi-head self attention (MSA) layer followed by a feed-forward fully-connected network (FFN) with skip-connection and Layer normalization. Positional embeddings are added to encode spatial information before feeding into the block. Lastly, a nested hierarchy with block aggregation is built -- every four spatially connected blocks are merged into one.","description_state":"present","introduced_year":null,"introduced_by":{"title":"Nested Hierarchical Transformer: Towards Accurate, Data-Efficient and Interpretable Visual Understanding","paper":"/paper/aggregating-nested-transformers","first_author":"Zizhao Zhang","n_authors":6,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/aggregating-nested-transformers"},"source":{"url":"https://arxiv.org/abs/2105.12723v4","title":"Nested Hierarchical Transformer: Towards Accurate, Data-Efficient and Interpretable Visual Understanding","url_on_a_paper_host":true},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"Computer Vision","area_id":"computer-vision","collection":"Vision Transformers","url":"/methods/category/vision-transformers","pwc_aliases":["vision-transformer"]}],"n_papers_tagged":37,"archive_num_papers":37,"papers_newest_first":[{"paper":"/paper/nestquant-post-training-integer-nesting","slug":"nestquant-post-training-integer-nesting","title":"NestQuant: Post-Training Integer-Nesting Quantization for On-Device DNN","date":"2025-06-22","arxiv_id":"2506.17870","n_code_links":1,"syntology":null},{"paper":null,"slug":"mixed-feedback-oscillations-in-the-foraging","title":"Mixed-feedback oscillations in the foraging dynamics of arboreal turtle ants","date":"2025-04-15","arxiv_id":"2504.11551","n_code_links":0,"syntology":null},{"paper":null,"slug":"experimental-validation-of-distributed","title":"Experimental Validation of Distributed Dispatching of Multiple Active Distribution Networks Using the ADMM","date":"2025-03-19","arxiv_id":"2503.15356","n_code_links":0,"syntology":null},{"paper":null,"slug":"ant-nest-detection-using-underground-p-band","title":"Ant Nest Detection Using Underground P-Band TomoSAR","date":"2024-12-16","arxiv_id":"2412.11865","n_code_links":0,"syntology":null},{"paper":null,"slug":"nest-a-neuromodulated-small-world-hypergraph","title":"NEST: A Neuromodulated Small-world Hypergraph Trajectory Prediction Model for Autonomous Driving","date":"2024-12-16","arxiv_id":"2412.11682","n_code_links":0,"syntology":null},{"paper":null,"slug":"argentine-ants-regulate-traffic-flow-with","title":"Argentine ants regulate traffic flow with stopped individuals","date":"2024-12-09","arxiv_id":"2412.06587","n_code_links":0,"syntology":null},{"paper":null,"slug":"revisiting-the-many-instruments-problem-using","title":"Revisiting the Many Instruments Problem using Random Matrix Theory","date":"2024-08-16","arxiv_id":"2408.08580","n_code_links":0,"syntology":null},{"paper":null,"slug":"performance-prediction-of-hub-based-swarms","title":"Performance Prediction of Hub-Based Swarms","date":"2024-08-09","arxiv_id":"2408.04822","n_code_links":0,"syntology":null},{"paper":null,"slug":"soli-enabled-noncontact-heart-rate-detection","title":"Soli-enabled Noncontact Heart Rate Detection for Sleep and Meditation Tracking","date":"2024-07-08","arxiv_id":"2407.06458","n_code_links":0,"syntology":null},{"paper":null,"slug":"nest-neural-stress-tensor-tomography-by","title":"NeST: Neural Stress Tensor Tomography by leveraging 3D Photoelasticity","date":"2024-06-14","arxiv_id":"2406.10212","n_code_links":0,"syntology":null},{"paper":null,"slug":"nearest-neighbor-speculative-decoding-for-llm","title":"Nearest Neighbor Speculative Decoding for LLM Generation and Attribution","date":"2024-05-29","arxiv_id":"2405.19325","n_code_links":0,"syntology":null},{"paper":null,"slug":"direct-learning-of-home-vector-direction-for","title":"Direct learning of home vector direction for insect-inspired robot navigation","date":"2024-05-06","arxiv_id":"2405.03827","n_code_links":0,"syntology":null},{"paper":"/paper/looper-a-learned-automatic-code-optimizer-for","slug":"looper-a-learned-automatic-code-optimizer-for","title":"LOOPer: A Learned Automatic Code Optimizer For Polyhedral Compilers","date":"2024-03-18","arxiv_id":"2403.11522","n_code_links":1,"syntology":null},{"paper":"/paper/drattack-prompt-decomposition-and","slug":"drattack-prompt-decomposition-and","title":"DrAttack: Prompt Decomposition and Reconstruction Makes Powerful LLM Jailbreakers","date":"2024-02-25","arxiv_id":"2402.16914","n_code_links":1,"syntology":{"ran":4,"of":7,"n_ran_checked":1,"n_instrument":3,"unverified":3,"pointer_only":0,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified","official":{"repos":["xirui-li/drattack"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":3,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"norm-enforcement-with-a-soft-touch-faster","title":"Norm Enforcement with a Soft Touch: Faster Emergence, Happier Agents","date":"2024-01-29","arxiv_id":"2401.16461","n_code_links":0,"syntology":null},{"paper":null,"slug":"timing-decisions-as-the-next-frontier-for","title":"Timing decisions as the next frontier for collective intelligence","date":"2023-12-01","arxiv_id":"2312.02187","n_code_links":0,"syntology":null},{"paper":"/paper/insplad-a-dataset-and-benchmark-for-power","slug":"insplad-a-dataset-and-benchmark-for-power","title":"InsPLAD: A Dataset and Benchmark for Power Line Asset Inspection in UAV Images","date":"2023-11-02","arxiv_id":"2311.01619","n_code_links":1,"syntology":null},{"paper":null,"slug":"bounds-on-treatment-effects-under-stochastic","title":"Robustify and Tighten the Lee Bounds: A Sample Selection Model under Stochastic Monotonicity and Symmetry Assumptions","date":"2023-11-01","arxiv_id":"2311.00439","n_code_links":0,"syntology":null},{"paper":null,"slug":"interpreting-iv-estimators-in-information","title":"Interpreting TSLS Estimators in Information Provision Experiments","date":"2023-09-09","arxiv_id":"2309.04793","n_code_links":0,"syntology":null},{"paper":null,"slug":"finite-population-effects-on-optimal","title":"Finite population effects on optimal communication for social foragers","date":"2023-08-01","arxiv_id":"2308.00298","n_code_links":0,"syntology":null},{"paper":"/paper/inference-for-relative-sparsity","slug":"inference-for-relative-sparsity","title":"Inference for relative sparsity","date":"2023-06-25","arxiv_id":"2306.14297","n_code_links":1,"syntology":null},{"paper":null,"slug":"deep-huber-quantile-regression-networks","title":"Deep Huber quantile regression networks","date":"2023-06-17","arxiv_id":"2306.10306","n_code_links":0,"syntology":null},{"paper":"/paper/superneuro-a-fast-and-scalable-simulator-for","slug":"superneuro-a-fast-and-scalable-simulator-for","title":"SuperNeuro: A Fast and Scalable Simulator for Neuromorphic Computing","date":"2023-05-04","arxiv_id":"2305.02510","n_code_links":1,"syntology":null},{"paper":null,"slug":"physics-symbolic-learner-for-discovering","title":"Physics Symbolic Learner for Discovering Ground-Motion Models Via NGA-West2 Database","date":"2023-03-23","arxiv_id":"2303.14179","n_code_links":0,"syntology":null},{"paper":"/paper/neuron-structure-modeling-for-generalizable","slug":"neuron-structure-modeling-for-generalizable","title":"Neuron Structure Modeling for Generalizable Remote Physiological Measurement","date":"2023-03-10","arxiv_id":"2303.05955","n_code_links":1,"syntology":{"ran":2,"of":2,"n_ran_checked":2,"n_instrument":0,"unverified":0,"pointer_only":2,"phrase":"2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["lupaopao/nest"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":1,"n_ran_no_instrument_failure":2,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/emergent-communication-enhances-foraging","slug":"emergent-communication-enhances-foraging","title":"Emergent communication enhances foraging behaviour in evolved swarms controlled by Spiking Neural Networks","date":"2022-12-16","arxiv_id":"2212.08484","n_code_links":1,"syntology":null},{"paper":"/paper/uncovering-the-dynamics-of-the-wealth","slug":"uncovering-the-dynamics-of-the-wealth","title":"Uncovering the Dynamics of the Wealth Distribution","date":"2022-11-24","arxiv_id":"2211.15509","n_code_links":1,"syntology":null},{"paper":null,"slug":"interpreting-instrumental-variable-estimands","title":"Interpreting Instrumental Variable Estimands with Unobserved Treatment Heterogeneity: The Effects of College Education","date":"2022-11-23","arxiv_id":"2211.13132","n_code_links":0,"syntology":null},{"paper":null,"slug":"self-organizing-nest-migration-dynamics","title":"Self-organizing nest migration dynamics synthesis for ant colony systems","date":"2022-10-08","arxiv_id":"2210.03975","n_code_links":0,"syntology":null},{"paper":"/paper/tensorir-an-abstraction-for-automatic","slug":"tensorir-an-abstraction-for-automatic","title":"TensorIR: An Abstraction for Automatic Tensorized Program Optimization","date":"2022-07-09","arxiv_id":"2207.04296","n_code_links":2,"syntology":null},{"paper":null,"slug":"efficiently-evolving-swarm-behaviors-using","title":"Efficiently Evolving Swarm Behaviors Using Grammatical Evolution With PPA-style Behavior Trees","date":"2022-03-29","arxiv_id":"2203.15776","n_code_links":0,"syntology":null},{"paper":"/paper/end-to-end-optimization-of-metasurfaces-for","slug":"end-to-end-optimization-of-metasurfaces-for","title":"End-to-End Optimization of Metasurfaces for Imaging with Compressed Sensing","date":"2022-01-28","arxiv_id":"2201.12348","n_code_links":1,"syntology":null},{"paper":"/paper/a-modular-workflow-for-performance","slug":"a-modular-workflow-for-performance","title":"A Modular Workflow for Performance Benchmarking of Neuronal Network Simulations","date":"2021-12-16","arxiv_id":"2112.09018","n_code_links":1,"syntology":null},{"paper":null,"slug":"behavioral-foundations-of-nested-stochastic","title":"Behavioral Foundations of Nested Stochastic Choice and Nested Logit","date":"2021-12-14","arxiv_id":"2112.07155","n_code_links":0,"syntology":null},{"paper":null,"slug":"anatomy-of-a-superorganism-structure-and","title":"Anatomy of a superorganism -- structure and growth dynamics of army ant bivouacs","date":"2021-10-18","arxiv_id":"2110.09017","n_code_links":0,"syntology":null},{"paper":null,"slug":"audio-attacks-and-defenses-against-aed","title":"Audio Attacks and Defenses against AED Systems -- A Practical Study","date":"2021-06-14","arxiv_id":"2106.07428","n_code_links":0,"syntology":null},{"paper":"/paper/aggregating-nested-transformers","slug":"aggregating-nested-transformers","title":"Nested Hierarchical Transformer: Towards Accurate, Data-Efficient and Interpretable Visual Understanding","date":"2021-05-26","arxiv_id":"2105.12723","n_code_links":6,"syntology":{"ran":19,"of":26,"n_ran_checked":16,"n_instrument":3,"unverified":7,"pointer_only":6,"phrase":"19 ran (of which 0 constructed an object rather than computing a result; 16 with no instrument failure: 3 honoured, 1 violated, 12 with no contract checked; 3 where Syntology's instrument failed) · 7 unverified","official":{"repos":["google-research/nested-transformer"],"state":"official (archive's flag): 9 ran","n_ran":9,"n_constructed":0,"n_ran_no_instrument_failure":9,"n_unverified":3,"ran_from_kinds":["listed","official"]}}}],"papers_shown":37,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":37,"with_a_code_link":13,"where_syntology_ran_a_sample":3,"not_listed_spam_title":0,"listed":37,"listed_where_code_ran":3,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":3,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":3,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":3,"papers_where_code_ran_first_page":"/method/nest/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"ran","page":1,"of":1,"url":"/method/nest/papers/ran/1","json":"/method/nest/papers/ran/1.json","rows":3}],"tasks":[{"task":"/task/regression-1","name":"regression","papers":3},{"task":"/task/image-classification","name":"Image Classification","papers":2},{"task":"/task/object","name":"Object","papers":2},{"task":"/task/prediction","name":"Prediction","papers":2},{"task":"/task/anatomy","name":"Anatomy","papers":1},{"task":"/task/anomaly-detection","name":"Anomaly Detection","papers":1},{"task":"/task/audio-denoising","name":"Audio Denoising","papers":1},{"task":"/task/autonomous-driving","name":"Autonomous Driving","papers":1},{"task":"/task/machine-learning","name":"BIG-bench Machine Learning","papers":1},{"task":"/task/benchmarking","name":"Benchmarking","papers":1},{"task":"/task/decision-making","name":"Decision Making","papers":1},{"task":"/task/decoder","name":"Decoder","papers":1},{"task":"/task/deep-learning","name":"Deep Learning","papers":1},{"task":"/task/denoising","name":"Denoising","papers":1},{"task":"/task/domain-generalization","name":"Domain Generalization","papers":1},{"task":"/task/event-detection","name":"Event Detection","papers":1},{"task":"/task/evolutionary-algorithms","name":"Evolutionary Algorithms","papers":1},{"task":null,"name":"GPU","papers":1},{"task":"/task/image-generation","name":"Image Generation","papers":1},{"task":"/task/in-context-learning","name":"In-Context Learning","papers":1}],"tasks_shown":20,"n_tasks":35,"usage_by_year":[{"year":"2021","papers":5},{"year":"2022","papers":7},{"year":"2023","papers":10},{"year":"2024","papers":12},{"year":"2025","papers":3}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/nest"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=NesT","read_at":"2026-10-05T00:59:33+00:00","query":"NesT","kind":"method","have":"declared_code","tier":"repo_known","verified_implementation":false,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"method":"NEST","origin_arxiv_id":"2303.05955"},"resolution":"case_insensitive","resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"different_paper","archive_paper_arxiv_id":"2105.12723","repositories":{"listed":5,"in_graph":5,"list_truncated":false,"strongest_link":"official"},"retrieve_with":null,"name_competition":{"verdict":"outranked","may_be_wrong_sense":true,"bearers_found":8,"served":{"arxiv_id":"2303.05955","citations":69},"leading_other_bearer":{"arxiv_id":"1711.02017","title":"NeST: A Neural Network Synthesis Tool Based on a Grow-and-Prune Paradigm","citations":258,"named_by":["title_prefix"],"bearer_name":"NeST: A Neural Network Synthesis Tool Based on a Grow-and-Prune Paradigm","ask_with":"have('1711.02017')"},"n_other_bearers_listed":5,"note":"'NesT' is ALSO the name of the paper 'NeST: A Neural Network Synthesis Tool Based on a Grow-and-Prune Paradigm' (arXiv:1711.02017, 258 citations), which is cited FAR more than the paper this answer is about (69). This answer may be about the wrong NesT. If you meant the better-known one, ask again with that entry of `also_named`."},"name_competition_text":"The same name also belongs to the paper “NeST: A Neural Network Synthesis Tool Based on a Grow-and-Prune Paradigm” (arXiv:1711.02017, 258 citations), which the lookup finds cited far more than the paper this answer is about (69 citations), so this answer may be about a different sense of the name.","near_matches":null,"code_nearby":[],"code_nearby_caption":null,"origin_paper":{"arxiv_id":"2303.05955","page":"/paper/neuron-structure-modeling-for-generalizable","syntology_url":"https://syntology.ai/paper/2303.05955","in_graph_layer":true,"samples":2,"ran":2,"n_ran_checked":2,"n_instrument":0,"unverified":0,"phrase":"2 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","instrument_means":"failures of Syntology's instrument, not of the code"},"line":"about another paper, arXiv:2303.05955: repository known, no verified implementation (declared_code; repositories: 5 listed of 5 in the graph, strongest link: official). The lookup matched 'NEST' ignoring case. About another paper: this answer is about arXiv:2303.05955, while the archive credits arXiv:2105.12723.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"c30b5d90cb2618edf4dc8b2d472bce1c58d9ce5254075a2e6aa1aaba6560a153","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}