{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/codebert","slug":"codebert","name":"CodeBERT","full_name":"CodeBERT","full_name_withheld":false,"description_markdown":"**CodeBERT** is a bimodal pre-trained model for programming language (PL) and natural language (NL). CodeBERT learns general-purpose representations that support downstream NL-PL applications such as natural language code search, code documentation generation, etc. CodeBERT is developed with a [Transformer](https://paperswithcode.com/method/transformer)-based neural architecture, and is trained with a hybrid objective function that incorporates the pre-training task of replaced token detection, which is to detect plausible alternatives sampled from generators. This enables the utilization of both bimodal data of NL-PL pairs and unimodal data, where the former provides input tokens for model training while the latter helps to learn better generators.","description_state":"present","introduced_year":null,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":"https://arxiv.org/abs/2002.08155v4","title":"CodeBERT: A Pre-Trained Model for Programming and Natural Languages","url_on_a_paper_host":true},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"Natural Language Processing","area_id":"natural-language-processing","collection":"Transformers","url":"/methods/category/transformers","pwc_aliases":[]}],"n_papers_tagged":66,"archive_num_papers":null,"papers_newest_first":[{"paper":null,"slug":"a-multi-dataset-evaluation-of-models-for","title":"A Multi-Dataset Evaluation of Models for Automated Vulnerability Repair","date":"2025-06-05","arxiv_id":"2506.04987","n_code_links":0,"syntology":null},{"paper":null,"slug":"loracode-lora-adapters-for-code-embeddings","title":"LoRACode: LoRA Adapters for Code Embeddings","date":"2025-03-07","arxiv_id":"2503.05315","n_code_links":0,"syntology":null},{"paper":"/paper/poster-long-php-webshell-files-detection","slug":"poster-long-php-webshell-files-detection","title":"Poster: Long PHP webshell files detection based on sliding window attention","date":"2025-02-26","arxiv_id":"2502.19257","n_code_links":1,"syntology":null},{"paper":null,"slug":"less-is-more-on-the-importance-of-data","title":"Less is More: On the Importance of Data Quality for Unit Test Generation","date":"2025-02-20","arxiv_id":"2502.14212","n_code_links":0,"syntology":null},{"paper":null,"slug":"large-language-models-in-software-security-a","title":"LLMs in Software Security: A Survey of Vulnerability Detection Techniques and Insights","date":"2025-02-10","arxiv_id":"2502.07049","n_code_links":0,"syntology":null},{"paper":"/paper/repository-level-code-search-with-neural","slug":"repository-level-code-search-with-neural","title":"Repository-level Code Search with Neural Retrieval Methods","date":"2025-02-10","arxiv_id":"2502.07067","n_code_links":1,"syntology":null},{"paper":"/paper/how-to-select-pre-trained-code-models-for","slug":"how-to-select-pre-trained-code-models-for","title":"How to Select Pre-Trained Code Models for Reuse? A Learning Perspective","date":"2025-01-07","arxiv_id":"2501.03783","n_code_links":1,"syntology":null},{"paper":null,"slug":"enstack-an-ensemble-stacking-framework-of","title":"EnStack: An Ensemble Stacking Framework of Large Language Models for Enhanced Vulnerability Detection in Source Code","date":"2024-11-25","arxiv_id":"2411.16561","n_code_links":0,"syntology":null},{"paper":"/paper/codesam-source-code-representation-learning","slug":"codesam-source-code-representation-learning","title":"CodeSAM: Source Code Representation Learning by Infusing Self-Attention with Multi-Code-View Graphs","date":"2024-11-21","arxiv_id":"2411.14611","n_code_links":1,"syntology":null},{"paper":null,"slug":"automated-vulnerability-detection-using-deep","title":"Automated Vulnerability Detection Using Deep Learning Technique","date":"2024-10-29","arxiv_id":"2410.21968","n_code_links":0,"syntology":null},{"paper":null,"slug":"lecprompt-a-prompt-based-approach-for-logical","title":"LecPrompt: A Prompt-based Approach for Logical Error Correction with CodeBERT","date":"2024-10-10","arxiv_id":"2410.08241","n_code_links":0,"syntology":null},{"paper":null,"slug":"clnx-bridging-code-and-natural-language-for-c","title":"CLNX: Bridging Code and Natural Language for C/C++ Vulnerability-Contributing Commits Identification","date":"2024-09-11","arxiv_id":"2409.07407","n_code_links":0,"syntology":null},{"paper":null,"slug":"unlearning-trojans-in-large-language-models-a","title":"Unlearning Trojans in Large Language Models: A Comparison Between Natural Language and Source Code","date":"2024-08-22","arxiv_id":"2408.12416","n_code_links":0,"syntology":null},{"paper":null,"slug":"codemirage-hallucinations-in-code-generated","title":"CodeMirage: Hallucinations in Code Generated by Large Language Models","date":"2024-08-14","arxiv_id":"2408.08333","n_code_links":0,"syntology":null},{"paper":null,"slug":"enhancing-code-translation-in-language-models","title":"Enhancing Code Translation in Language Models with Few-Shot Learning via Retrieval-Augmented Generation","date":"2024-07-29","arxiv_id":"2407.19619","n_code_links":0,"syntology":null},{"paper":"/paper/advanced-detection-of-source-code-clones-via","slug":"advanced-detection-of-source-code-clones-via","title":"Advanced Detection of Source Code Clones via an Ensemble of Unsupervised Similarity Measures","date":"2024-05-03","arxiv_id":"2405.02095","n_code_links":1,"syntology":null},{"paper":"/paper/software-vulnerability-prediction-in-low","slug":"software-vulnerability-prediction-in-low","title":"Software Vulnerability Prediction in Low-Resource Languages: An Empirical Study of CodeBERT and ChatGPT","date":"2024-04-26","arxiv_id":"2404.17110","n_code_links":1,"syntology":null},{"paper":"/paper/codeprompt-improving-source-code-related","slug":"codeprompt-improving-source-code-related","title":"Enhancing Source Code Classification Effectiveness via Prompt Learning Incorporating Knowledge Features","date":"2024-01-10","arxiv_id":"2401.05544","n_code_links":1,"syntology":null},{"paper":null,"slug":"source-code-is-a-graph-not-a-sequence-a-cross","title":"Source Code is a Graph, Not a Sequence: A Cross-Lingual Perspective on Code Clone Detection","date":"2023-12-27","arxiv_id":"2312.16488","n_code_links":0,"syntology":null},{"paper":null,"slug":"naturalness-of-attention-revisiting-attention","title":"Naturalness of Attention: Revisiting Attention in Code Language Models","date":"2023-11-22","arxiv_id":"2311.13508","n_code_links":0,"syntology":null},{"paper":null,"slug":"learning-defect-prediction-from-unrealistic","title":"Learning Defect Prediction from Unrealistic Data","date":"2023-11-02","arxiv_id":"2311.00931","n_code_links":0,"syntology":null},{"paper":"/paper/gem5pred-predictive-approaches-for-gem5","slug":"gem5pred-predictive-approaches-for-gem5","title":"Gem5Pred: Predictive Approaches For Gem5 Simulation Time","date":"2023-10-10","arxiv_id":"2310.06290","n_code_links":0,"syntology":null},{"paper":null,"slug":"auto-grading-c-programming-assignments-with","title":"A Comparative Study of Filters and Deep Learning Models to predict Diabetic Retinopathy","date":"2023-09-26","arxiv_id":"2309.15216","n_code_links":0,"syntology":null},{"paper":null,"slug":"xgv-bert-leveraging-contextualized-language","title":"XGV-BERT: Leveraging Contextualized Language Model and Graph Neural Network for Efficient Software Vulnerability Detection","date":"2023-09-26","arxiv_id":"2309.14677","n_code_links":0,"syntology":null},{"paper":null,"slug":"code-quality-assessment-using-transformers","title":"Code quality assessment using transformers","date":"2023-09-17","arxiv_id":"2309.09264","n_code_links":0,"syntology":null},{"paper":null,"slug":"pop-quiz-do-pre-trained-code-models-possess","title":"Pop Quiz! Do Pre-trained Code Models Possess Knowledge of Correct API Names?","date":"2023-09-14","arxiv_id":"2309.07804","n_code_links":0,"syntology":null},{"paper":"/paper/chatgpt-for-software-security-exploring-the","slug":"chatgpt-for-software-security-exploring-the","title":"How Does Naming Affect LLMs on Code Analysis Tasks?","date":"2023-07-24","arxiv_id":"2307.12488","n_code_links":0,"syntology":null},{"paper":null,"slug":"securefalcon-the-next-cyber-reasoning-system","title":"SecureFalcon: Are We There Yet in Automated Software Vulnerability Detection with LLMs?","date":"2023-07-13","arxiv_id":"2307.06616","n_code_links":0,"syntology":null},{"paper":null,"slug":"black-box-prediction-of-flaky-test-fix","title":"FlakyFix: Using Large Language Models for Predicting Flaky Test Fix Categories and Test Code Repair","date":"2023-06-21","arxiv_id":"2307.00012","n_code_links":0,"syntology":null},{"paper":null,"slug":"automatic-code-summarization-via-chatgpt-how","title":"Automatic Code Summarization via ChatGPT: How Far Are We?","date":"2023-05-22","arxiv_id":"2305.12865","n_code_links":0,"syntology":null},{"paper":null,"slug":"rnns-representation-nearest-neighbor-search","title":"A Black-Box Attack on Code Models via Representation Nearest Neighbor Search","date":"2023-05-10","arxiv_id":"2305.05896","n_code_links":0,"syntology":null},{"paper":"/paper/the-earlybird-catches-the-bug-on-exploiting","slug":"the-earlybird-catches-the-bug-on-exploiting","title":"The EarlyBIRD Catches the Bug: On Exploiting Early Layers of Encoder Models for More Efficient Code Classification","date":"2023-05-08","arxiv_id":"2305.04940","n_code_links":1,"syntology":null},{"paper":"/paper/towards-efficient-fine-tuning-of-pre-trained","slug":"towards-efficient-fine-tuning-of-pre-trained","title":"Towards Efficient Fine-tuning of Pre-trained Code Models: An Experimental Study and Beyond","date":"2023-04-11","arxiv_id":"2304.05216","n_code_links":1,"syntology":null},{"paper":"/paper/better-language-models-of-code-through-self","slug":"better-language-models-of-code-through-self","title":"Better Language Models of Code through Self-Improvement","date":"2023-04-02","arxiv_id":"2304.01228","n_code_links":1,"syntology":null},{"paper":"/paper/codebertscore-evaluating-code-generation-with","slug":"codebertscore-evaluating-code-generation-with","title":"CodeBERTScore: Evaluating Code Generation with Pretrained Models of Code","date":"2023-02-10","arxiv_id":"2302.05527","n_code_links":1,"syntology":null},{"paper":null,"slug":"flame-a-small-language-model-for-spreadsheet","title":"FLAME: A small language model for spreadsheet formulas","date":"2023-01-31","arxiv_id":"2301.13779","n_code_links":0,"syntology":null},{"paper":null,"slug":"is-self-attention-powerful-to-learn-code","title":"Unveiling Code Pre-Trained Models: Investigating Syntax and Semantics Capacities","date":"2022-12-20","arxiv_id":"2212.10017","n_code_links":0,"syntology":null},{"paper":"/paper/enhancing-code-classification-by-mixup-based","slug":"enhancing-code-classification-by-mixup-based","title":"MIXCODE: Enhancing Code Classification by Mixup-Based Data Augmentation","date":"2022-10-06","arxiv_id":"2210.03003","n_code_links":1,"syntology":null},{"paper":null,"slug":"t5ql-taming-language-models-for-sql","title":"T5QL: Taming language models for SQL generation","date":"2022-09-21","arxiv_id":"2209.10254","n_code_links":0,"syntology":null},{"paper":null,"slug":"code-compliance-assessment-as-a-learning","title":"Code Compliance Assessment as a Learning Problem","date":"2022-09-10","arxiv_id":"2209.04602","n_code_links":0,"syntology":null},{"paper":null,"slug":"generalizability-of-code-clone-detection-on","title":"Generalizability of Code Clone Detection on CodeBERT","date":"2022-08-26","arxiv_id":"2208.12588","n_code_links":0,"syntology":null},{"paper":"/paper/no-more-fine-tuning-an-experimental","slug":"no-more-fine-tuning-an-experimental","title":"No More Fine-Tuning? An Experimental Evaluation of Prompt Tuning in Code Intelligence","date":"2022-07-24","arxiv_id":"2207.11680","n_code_links":1,"syntology":{"ran":7,"of":14,"n_ran_checked":3,"n_instrument":4,"unverified":7,"pointer_only":2,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified","official":{"repos":["adf1178/pt4code"],"state":"official (archive's flag): 7 ran","n_ran":7,"n_constructed":0,"n_ran_no_instrument_failure":3,"n_unverified":7,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"probing-semantic-grounding-in-language-models","title":"Probing Semantic Grounding in Language Models of Code with Representational Similarity Analysis","date":"2022-07-15","arxiv_id":"2207.07706","n_code_links":0,"syntology":null},{"paper":null,"slug":"learning-code-summarization-from-a-small-and","title":"Learning code summarization from a small and local dataset","date":"2022-06-02","arxiv_id":"2206.00804","n_code_links":0,"syntology":null},{"paper":"/paper/codeattack-code-based-adversarial-attacks-for","slug":"codeattack-code-based-adversarial-attacks-for","title":"CodeAttack: Code-Based Adversarial Attacks for Pre-trained Programming Language Models","date":"2022-05-31","arxiv_id":"2206.00052","n_code_links":2,"syntology":null},{"paper":"/paper/understanding-long-programming-languages-with","slug":"understanding-long-programming-languages-with","title":"Understanding Long Programming Languages with Structure-Aware Sparse Attention","date":"2022-05-27","arxiv_id":"2205.13730","n_code_links":1,"syntology":null},{"paper":"/paper/on-the-cross-modal-transfer-from-natural","slug":"on-the-cross-modal-transfer-from-natural","title":"On The Cross-Modal Transfer from Natural Language to Code through Adapter Modules","date":"2022-04-19","arxiv_id":"2204.08653","n_code_links":1,"syntology":null},{"paper":null,"slug":"enhancing-semantic-code-search-with","title":"CoCoSoDa: Effective Contrastive Learning for Code Search","date":"2022-04-07","arxiv_id":"2204.03293","n_code_links":0,"syntology":null},{"paper":null,"slug":"an-exploratory-study-on-code-attention-in","title":"An Exploratory Study on Code Attention in BERT","date":"2022-04-05","arxiv_id":"2204.10200","n_code_links":0,"syntology":null},{"paper":"/paper/probing-pretrained-models-of-source-code","slug":"probing-pretrained-models-of-source-code","title":"Probing Pretrained Models of Source Code","date":"2022-02-16","arxiv_id":"2202.08975","n_code_links":1,"syntology":null},{"paper":"/paper/what-do-they-capture-a-structural-analysis-of","slug":"what-do-they-capture-a-structural-analysis-of","title":"What Do They Capture? -- A Structural Analysis of Pre-Trained Language Models for Source Code","date":"2022-02-14","arxiv_id":"2202.06840","n_code_links":1,"syntology":null},{"paper":null,"slug":"analyzing-codebert-s-performance-on-natural","title":"Analyzing CodeBERT's Performance on Natural Language Code Search","date":"2022-01-16","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/assemble-foundation-models-for-automatic-code","slug":"assemble-foundation-models-for-automatic-code","title":"Assemble Foundation Models for Automatic Code Summarization","date":"2022-01-13","arxiv_id":"2201.05222","n_code_links":1,"syntology":null},{"paper":"/paper/bridging-pre-trained-models-and-downstream","slug":"bridging-pre-trained-models-and-downstream","title":"Bridging Pre-trained Models and Downstream Tasks for Source Code Understanding","date":"2021-12-04","arxiv_id":"2112.02268","n_code_links":1,"syntology":{"ran":12,"of":13,"n_ran_checked":12,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"12 ran (of which 0 constructed an object rather than computing a result; 12 with no instrument failure: 0 honoured, 0 violated, 12 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":{"repos":["wangdeze18/DACL"],"state":"official (archive's flag): 12 ran","n_ran":12,"n_constructed":0,"n_ran_no_instrument_failure":12,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"a-new-search-paradigm-for-natural-language","title":"A New Search Paradigm for Natural Language Code Search","date":"2021-11-16","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"repo4qa-answering-complex-coding-questions","title":"Repo4QA: Answering Complex Coding Questions via Dense Retrieval on GitHub Repositories","date":"2021-11-16","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"facos-finding-api-relevant-contents-on-stack","title":"FACOS: Finding API Relevant Contents on Stack Overflow with Semantic and Syntactic Analysis","date":"2021-11-14","arxiv_id":"2111.07238","n_code_links":0,"syntology":null},{"paper":"/paper/augmentedcode-examining-the-effects-of","slug":"augmentedcode-examining-the-effects-of","title":"AugmentedCode: Examining the Effects of Natural Language Resources in Code Retrieval Models","date":"2021-10-16","arxiv_id":"2110.08512","n_code_links":1,"syntology":null},{"paper":"/paper/regvd-revisiting-graph-neural-networks-for-1","slug":"regvd-revisiting-graph-neural-networks-for-1","title":"ReGVD: Revisiting Graph Neural Networks for Vulnerability Detection","date":"2021-10-14","arxiv_id":"2110.07317","n_code_links":1,"syntology":null},{"paper":null,"slug":"graphix-a-pre-trained-graph-edit-model-for","title":"GRAPHIX: A Pre-trained Graph Edit Model for Automated Program Repair","date":"2021-09-29","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/improving-stack-overflow-question-title","slug":"improving-stack-overflow-question-title","title":"Improving Stack Overflow question title generation with copying enhanced CodeBERT model and bi-modal information","date":"2021-09-27","arxiv_id":"2109.13073","n_code_links":1,"syntology":null},{"paper":"/paper/what-do-pre-trained-code-models-know-about","slug":"what-do-pre-trained-code-models-know-about","title":"What do pre-trained code models know about code?","date":"2021-08-25","arxiv_id":"2108.11308","n_code_links":1,"syntology":null},{"paper":"/paper/memorization-and-generalization-in-neural","slug":"memorization-and-generalization-in-neural","title":"Memorization and Generalization in Neural Code Intelligence Models","date":"2021-06-16","arxiv_id":"2106.08704","n_code_links":2,"syntology":null},{"paper":"/paper/cosqa-20000-web-queries-for-code-search-and","slug":"cosqa-20000-web-queries-for-code-search-and","title":"CoSQA: 20,000+ Web Queries for Code Search and Question Answering","date":"2021-05-27","arxiv_id":"2105.13239","n_code_links":1,"syntology":{"ran":0,"of":1,"n_ran_checked":0,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"0 ran · 1 unverified","official":{"repos":["Jun-jie-Huang/CoCLR"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":[]}}},{"paper":null,"slug":"literature-review-on-vulnerability-detection","title":"Literature review on vulnerability detection using NLP technology","date":"2021-04-23","arxiv_id":"2104.11230","n_code_links":0,"syntology":null},{"paper":"/paper/codebert-a-pre-trained-model-for-programming","slug":"codebert-a-pre-trained-model-for-programming","title":"CodeBERT: A Pre-Trained Model for Programming and Natural Languages","date":"2020-02-19","arxiv_id":"2002.08155","n_code_links":9,"syntology":{"ran":14,"of":20,"n_ran_checked":14,"n_instrument":0,"unverified":6,"pointer_only":4,"phrase":"14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified","official":{"repos":["microsoft/CodeBERT"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":1,"ran_from_kinds":["found_in_text","listed"]}}}],"papers_shown":66,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":66,"with_a_code_link":27,"where_syntology_ran_a_sample":3,"not_listed_spam_title":0,"listed":66,"listed_where_code_ran":3,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":3,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":3,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":3,"papers_where_code_ran_first_page":"/method/codebert/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"ran","page":1,"of":1,"url":"/method/codebert/papers/ran/1","json":"/method/codebert/papers/ran/1.json","rows":3}],"tasks":[{"task":"/task/code-search","name":"Code Search","papers":12},{"task":"/task/vulnerability-detection","name":"Vulnerability Detection","papers":10},{"task":"/task/clone-detection","name":"Clone Detection","papers":8},{"task":"/task/code-summarization-1","name":"Code Summarization","papers":8},{"task":"/task/code-generation","name":"Code Generation","papers":7},{"task":"/task/language-modelling","name":"Language Modelling","papers":7},{"task":"/task/retrieval","name":"Retrieval","papers":6},{"task":"/task/bug-fixing","name":"Bug fixing","papers":3},{"task":"/task/classification-1","name":"Classification","papers":3},{"task":"/task/code-classification","name":"Code Classification","papers":3},{"task":"/task/code-completion","name":"Code Completion","papers":3},{"task":"/task/code-documentation-generation","name":"Code Documentation Generation","papers":3},{"task":"/task/code-translation","name":"Code Translation","papers":3},{"task":"/task/contrastive-learning","name":"Contrastive Learning","papers":3},{"task":"/task/data-augmentation","name":"Data Augmentation","papers":3},{"task":"/task/language-modeling","name":"Language Modeling","papers":3},{"task":"/task/large-language-model","name":"Large Language Model","papers":3},{"task":"/task/representation-learning","name":"Representation Learning","papers":3},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":3},{"task":"/task/decoder","name":"Decoder","papers":2}],"tasks_shown":20,"n_tasks":80,"usage_by_year":[{"year":"2020","papers":1},{"year":"2021","papers":12},{"year":"2022","papers":17},{"year":"2023","papers":18},{"year":"2024","papers":11},{"year":"2025","papers":7}],"row_source":"embedded","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/codebert"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=CodeBERT","read_at":"2026-10-05T00:53:49+00:00","query":"CodeBERT","kind":"method","have":"declared_code","tier":"repo_known","verified_implementation":false,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"method":"CodeBERT","origin_arxiv_id":"2002.08155"},"resolution":"exact","resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"unknown","archive_paper_arxiv_id":null,"repositories":{"listed":5,"in_graph":10,"list_truncated":true,"strongest_link":"official"},"retrieve_with":null,"name_competition":{"verdict":"sole_bearer","may_be_wrong_sense":false,"bearers_found":1,"served":{"arxiv_id":"2002.08155","citations":4249},"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing else in this corpus is named 'CodeBERT'. That is a statement about this corpus and not about the field: short names are reused, and a sense we never collected cannot show up here. Confirm `served.arxiv_id` if you had a specific paper in mind."},"name_competition_text":null,"near_matches":null,"code_nearby":[],"code_nearby_caption":null,"origin_paper":{"arxiv_id":"2002.08155","page":"/paper/codebert-a-pre-trained-model-for-programming","syntology_url":"https://syntology.ai/paper/2002.08155","in_graph_layer":true,"samples":20,"ran":14,"n_ran_checked":14,"n_instrument":0,"unverified":6,"phrase":"14 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified","instrument_means":"failures of Syntology's instrument, not of the code"},"line":"repository known, no verified implementation (declared_code; repositories: 5 listed of 10 in the graph, strongest link: official). The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:2002.08155) is about this method is not checked.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"ee6d154b92a202b3c67492bb0714f6f4402509555a307b55de1595f5dfe733b9","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}