{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/span-based-dynamic-convolution","slug":"span-based-dynamic-convolution","name":"Span-Based Dynamic Convolution","full_name":"Span-Based Dynamic Convolution","full_name_withheld":false,"description_markdown":"**Span-Based Dynamic Convolution** is a type of convolution used in the [ConvBERT](https://paperswithcode.com/method/convbert) architecture to capture local dependencies between tokens.  Kernels are generated by taking in a local span of current token, which better utilizes local dependency and discriminates different meanings of the same token (e.g., if “a” is in front of “can” in the input sentence, “can” is apparently a noun not a verb).\r\n\r\nSpecifically, with [classic convolution](https://paperswithcode.com/method/convolution), we would have fixed parameters shared for all input tokens. [Dynamic convolution](https://paperswithcode.com/method/dynamicconv) is therefore preferable because it has  higher flexibility in capturing local dependencies of different tokens. Dynamic convolution uses a kernel generator to produce different kernels for different input tokens. However, such dynamic convolution cannot differentiate the same tokens within different context and\r\ngenerate the same kernels (e.g., the three “can” in Figure (b)).\r\n\r\nTherefore the span-based dynamic convolution is developed to produce more adaptive convolution kernels by receiving an input span instead of only a single token, which enables discrimination of generated kernels for the same tokens within different context. For example, as shown in Figure (c), span-based dynamic convolution produces different kernels for different “can” tokens.","description_state":"present","introduced_year":null,"introduced_by":{"title":"ConvBERT: Improving BERT with Span-based Dynamic Convolution","paper":"/paper/convbert-improving-bert-with-span-based","first_author":"Zi-Hang Jiang","n_authors":6,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/convbert-improving-bert-with-span-based"},"source":{"url":"https://arxiv.org/abs/2008.02496v3","title":"ConvBERT: Improving BERT with Span-based Dynamic Convolution","url_on_a_paper_host":true},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"Sequential","area_id":"sequential","collection":"Temporal Convolutions","url":"/methods/category/temporal-convolutions","pwc_aliases":[]},{"area":"Computer Vision","area_id":"computer-vision","collection":"Convolutions","url":"/methods/category/convolutions","pwc_aliases":[]}],"n_papers_tagged":6,"archive_num_papers":6,"papers_newest_first":[{"paper":null,"slug":"beyond-simple-concatenation-fairly-assessing","title":"Beyond Simple Concatenation: Fairly Assessing PLM Architectures for Multi-Chain Protein-Protein Interactions Prediction","date":"2025-05-26","arxiv_id":"2505.20036","n_code_links":0,"syntology":null},{"paper":"/paper/navigating-nuance-in-quest-for-political","slug":"navigating-nuance-in-quest-for-political","title":"Navigating Nuance: In Quest for Political Truth","date":"2025-01-01","arxiv_id":"2501.00782","n_code_links":1,"syntology":null},{"paper":null,"slug":"chatgpt-v-s-media-bias-a-comparative-study-of","title":"ChatGPT v.s. Media Bias: A Comparative Study of GPT-3.5 and Fine-tuned Language Models","date":"2024-03-29","arxiv_id":"2403.20158","n_code_links":0,"syntology":null},{"paper":"/paper/m-3-net-multilevel-mixed-and-multistage","slug":"m-3-net-multilevel-mixed-and-multistage","title":"M$^3$Net: Multilevel, Mixed and Multistage Attention Network for Salient Object Detection","date":"2023-09-15","arxiv_id":"2309.08365","n_code_links":1,"syntology":null},{"paper":"/paper/transformer-based-punctuation-restoration-for","slug":"transformer-based-punctuation-restoration-for","title":"Transformer Based Punctuation Restoration for Turkish","date":"2023-09-15","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/convbert-improving-bert-with-span-based","slug":"convbert-improving-bert-with-span-based","title":"ConvBERT: Improving BERT with Span-based Dynamic Convolution","date":"2020-08-06","arxiv_id":"2008.02496","n_code_links":8,"syntology":null}],"papers_shown":6,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":6,"with_a_code_link":4,"where_syntology_ran_a_sample":0,"not_listed_spam_title":0,"listed":6,"listed_where_code_ran":0,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":0,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":0,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":0,"papers_where_code_ran_first_page":null,"papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[],"tasks":[{"task":"/task/automatic-speech-recognition-2","name":"Automatic Speech Recognition","papers":1},{"task":"/task/automatic-speech-recognition","name":"Automatic Speech Recognition (ASR)","papers":1},{"task":"/task/bias-detection","name":"Bias Detection","papers":1},{"task":"/task/drug-discovery","name":"Drug Discovery","papers":1},{"task":"/task/language-modeling","name":"Language Modeling","papers":1},{"task":"/task/language-modelling","name":"Language Modelling","papers":1},{"task":"/task/misinformation","name":"Misinformation","papers":1},{"task":"/task/natural-language-understanding","name":"Natural Language Understanding","papers":1},{"task":"/task/object-detection","name":"Object Detection","papers":1},{"task":"/task/punctuation-restoration","name":"Punctuation Restoration","papers":1},{"task":"/task/salient-object-detection","name":"RGB Salient Object Detection","papers":1},{"task":"/task/salient-object-detection-1","name":"Salient Object Detection","papers":1},{"task":"/task/speech-recognition","name":"Speech Recognition","papers":1},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":1},{"task":"/task/object-detection-1","name":"object-detection","papers":1},{"task":"/task/speech-recognition-1","name":"speech-recognition","papers":1}],"tasks_shown":16,"n_tasks":16,"usage_by_year":[{"year":"2020","papers":1},{"year":"2023","papers":2},{"year":"2024","papers":1},{"year":"2025","papers":2}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/span-based-dynamic-convolution"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=Span-Based%20Dynamic%20Convolution","read_at":"2026-10-05T01:02:17+00:00","query":"Span-Based Dynamic Convolution","kind":"method","have":"unknown_name","tier":null,"verified_implementation":null,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":null,"resolution":null,"resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":null,"archive_paper_arxiv_id":"2008.02496","repositories":null,"retrieve_with":null,"name_competition":{"verdict":"none","may_be_wrong_sense":false,"bearers_found":0,"served":null,"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing in this corpus is named 'Span-Based Dynamic Convolution' -- no method node, no paper announcing it in its title, no expanded form declaring it as an acronym."},"name_competition_text":null,"near_matches":["dynamic split convolution","dynamic short convolutions","Frequency Dynamic Convolution (FDConv)","Convolutional Dynamic Alignment Networks","Dynamic High-frequency Convolution (DHiF)","Consensus-aware Dynamic Convolution model","Dynamic Prototype Convolution Network (DPCN)","Omni-dimensional Dynamic Convolution (ODConv)"],"code_nearby":[],"code_nearby_caption":null,"origin_paper":null,"line":"name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"91ff9555859ce4bf8abdbd107ac2d63763878ee972752607ca607ba0aaa5feef","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}