{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/xlnet","slug":"xlnet","name":"XLNet","full_name":"XLNet","full_name_withheld":false,"description_markdown":"**XLNet** is an autoregressive [Transformer](https://paperswithcode.com/method/transformer) that leverages the best of both autoregressive language modeling and autoencoding while attempting to avoid their limitations. Instead of using a fixed forward or backward factorization order as in conventional autoregressive models, XLNet maximizes the expected log likelihood of a sequence w.r.t. all possible permutations of the factorization order. Thanks to the permutation operation, the context for each position can consist of tokens from both left and right. In expectation, each position learns to utilize contextual information from all positions, i.e., capturing bidirectional context.\r\n\r\nAdditionally, inspired by the latest advancements in autogressive language modeling, XLNet integrates the segment recurrence mechanism and relative encoding scheme of [Transformer-XL](https://paperswithcode.com/method/transformer-xl) into pretraining, which empirically improves the performance especially for tasks involving a longer text sequence.","description_state":"present","introduced_year":null,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":"https://arxiv.org/abs/1906.08237v2","title":"XLNet: Generalized Autoregressive Pretraining for Language Understanding","url_on_a_paper_host":true},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"Natural Language Processing","area_id":"natural-language-processing","collection":"Transformers","url":"/methods/category/transformers","pwc_aliases":[]}],"n_papers_tagged":167,"archive_num_papers":null,"papers_newest_first":[{"paper":null,"slug":"comparative-sentiment-analysis-of-public","title":"Comparative sentiment analysis of public perception: Monkeypox vs. COVID-19 behavioral insights","date":"2025-05-12","arxiv_id":"2505.07430","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-character-based-diffusion-embedding","title":"A Character-based Diffusion Embedding Algorithm for Enhancing the Generation Quality of Generative Linguistic Steganographic Texts","date":"2025-05-02","arxiv_id":"2505.00977","n_code_links":0,"syntology":null},{"paper":null,"slug":"explainable-ai-for-sentiment-analysis-of","title":"Explainable AI for Sentiment Analysis of Human Metapneumovirus (HMPV) Using XLNet","date":"2025-02-01","arxiv_id":"2502.01663","n_code_links":0,"syntology":null},{"paper":null,"slug":"assessing-text-classification-methods-for","title":"Assessing Text Classification Methods for Cyberbullying Detection on Social Media Platforms","date":"2024-12-27","arxiv_id":"2412.19928","n_code_links":0,"syntology":null},{"paper":null,"slug":"feature-alignment-based-knowledge","title":"Feature Alignment-Based Knowledge Distillation for Efficient Compression of Large Language Models","date":"2024-12-27","arxiv_id":"2412.19449","n_code_links":0,"syntology":null},{"paper":null,"slug":"enhancing-multi-class-disease-classification","title":"Enhancing Multi-Class Disease Classification: Neoplasms, Cardiovascular, Nervous System, and Digestive Disorders Using Advanced LLMs","date":"2024-11-19","arxiv_id":"2411.12712","n_code_links":0,"syntology":null},{"paper":"/paper/rethinking-legal-judgement-prediction-in-a","slug":"rethinking-legal-judgement-prediction-in-a","title":"Rethinking Legal Judgement Prediction in a Realistic Scenario in the Era of Large Language Models","date":"2024-10-14","arxiv_id":"2410.10542","n_code_links":1,"syntology":null},{"paper":null,"slug":"2407-21056","title":"What Matters in Explanations: Towards Explainable Fake Review Detection Focusing on Transformers","date":"2024-07-24","arxiv_id":"2407.21056","n_code_links":0,"syntology":null},{"paper":"/paper/why-do-you-cite-an-investigation-on-citation","slug":"why-do-you-cite-an-investigation-on-citation","title":"Why do you cite? An investigation on citation intents and decision-making classification processes","date":"2024-07-18","arxiv_id":"2407.13329","n_code_links":0,"syntology":null},{"paper":null,"slug":"ensemble-model-with-bert-roberta-and-xlnet","title":"Ensemble Model With Bert,Roberta and Xlnet For Molecular property prediction","date":"2024-05-30","arxiv_id":"2406.06553","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-hybrid-deep-learning-framework-for-stock","title":"A Hybrid Deep Learning Framework for Stock Price Prediction Considering the Investor Sentiment of Online Forum Enhanced by Popularity","date":"2024-05-17","arxiv_id":"2405.10584","n_code_links":0,"syntology":null},{"paper":null,"slug":"eliciting-big-five-personality-traits-in","title":"Eliciting Personality Traits in Large Language Models","date":"2024-02-13","arxiv_id":"2402.08341","n_code_links":0,"syntology":null},{"paper":"/paper/breaking-free-transformer-models-task","slug":"breaking-free-transformer-models-task","title":"Breaking Free Transformer Models: Task-specific Context Attribution Promises Improved Generalizability Without Fine-tuning Pre-trained LLMs","date":"2024-01-30","arxiv_id":"2401.16638","n_code_links":1,"syntology":null},{"paper":null,"slug":"an-assessment-on-comprehending-mental-health","title":"An Assessment on Comprehending Mental Health through Large Language Models","date":"2024-01-09","arxiv_id":"2401.04592","n_code_links":0,"syntology":null},{"paper":null,"slug":"argumentation-element-annotation-modeling","title":"Argumentation Element Annotation Modeling using XLNet","date":"2023-11-10","arxiv_id":"2311.06239","n_code_links":0,"syntology":null},{"paper":"/paper/modelling-sentiment-analysis-llms-and-data","slug":"modelling-sentiment-analysis-llms-and-data","title":"Modelling Sentiment Analysis: LLMs and data augmentation techniques","date":"2023-11-07","arxiv_id":"2311.04139","n_code_links":1,"syntology":null},{"paper":null,"slug":"an-ensemble-method-based-on-the-combination","title":"An Ensemble Method Based on the Combination of Transformers with Convolutional Neural Networks to Detect Artificially Generated Text","date":"2023-10-26","arxiv_id":"2310.17312","n_code_links":0,"syntology":null},{"paper":null,"slug":"exploring-graph-neural-networks-for-indian","title":"Exploring Graph Neural Networks for Indian Legal Judgment Prediction","date":"2023-10-19","arxiv_id":"2310.12800","n_code_links":0,"syntology":null},{"paper":"/paper/lexical-squad-multimodal-hate-speech-event","slug":"lexical-squad-multimodal-hate-speech-event","title":"Lexical Squad@Multimodal Hate Speech Event Detection 2023: Multimodal Hate Speech Detection using Fused Ensemble Approach","date":"2023-09-23","arxiv_id":"2309.13354","n_code_links":1,"syntology":null},{"paper":null,"slug":"simple-is-better-and-large-is-not-enough","title":"Simple is Better and Large is Not Enough: Towards Ensembling of Foundational Language Models","date":"2023-08-23","arxiv_id":"2308.12272","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-hybrid-machine-learning-model-for","title":"A Hybrid Machine Learning Model for Classifying Gene Mutations in Cancer using LSTM, BiLSTM, CNN, GRU, and GloVe","date":"2023-07-24","arxiv_id":"2307.14361","n_code_links":0,"syntology":null},{"paper":null,"slug":"resume-information-extraction-via-post-ocr","title":"Resume Information Extraction via Post-OCR Text Processing","date":"2023-06-23","arxiv_id":"2306.13775","n_code_links":0,"syntology":null},{"paper":null,"slug":"research-on-named-entity-recognition-in","title":"Research on Named Entity Recognition in Improved transformer with R-Drop structure","date":"2023-06-14","arxiv_id":"2306.08315","n_code_links":0,"syntology":null},{"paper":null,"slug":"domain-specific-continued-pretraining-of","title":"Domain-specific Continued Pretraining of Language Models for Capturing Long Context in Mental Health","date":"2023-04-20","arxiv_id":"2304.10447","n_code_links":0,"syntology":null},{"paper":null,"slug":"deep-learning-for-opinion-mining-and-topic","title":"Deep Learning for Opinion Mining and Topic Classification of Course Reviews","date":"2023-04-06","arxiv_id":"2304.03394","n_code_links":0,"syntology":null},{"paper":"/paper/trojtext-test-time-invisible-textual-trojan","slug":"trojtext-test-time-invisible-textual-trojan","title":"TrojText: Test-time Invisible Textual Trojan Insertion","date":"2023-03-03","arxiv_id":"2303.02242","n_code_links":1,"syntology":{"ran":3,"of":4,"n_ran_checked":1,"n_instrument":2,"unverified":1,"pointer_only":4,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","official":{"repos":["ucf-ml-research/trojtext"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/hulat-at-semeval-2023-task-10-data","slug":"hulat-at-semeval-2023-task-10-data","title":"HULAT at SemEval-2023 Task 10: Data augmentation for pre-trained transformers applied to the detection of sexism in social media","date":"2023-02-24","arxiv_id":"2302.12840","n_code_links":1,"syntology":null},{"paper":"/paper/a-benchmark-for-toxic-comment-classification","slug":"a-benchmark-for-toxic-comment-classification","title":"A benchmark for toxic comment classification on Civil Comments dataset","date":"2023-01-26","arxiv_id":"2301.11125","n_code_links":1,"syntology":null},{"paper":"/paper/analyzing-semantic-faithfulness-of-language","slug":"analyzing-semantic-faithfulness-of-language","title":"Analyzing Semantic Faithfulness of Language Models via Input Intervention on Question Answering","date":"2022-12-21","arxiv_id":"2212.10696","n_code_links":1,"syntology":null},{"paper":null,"slug":"learning-to-embed-adopting-transformer-based","title":"Learning-To-Embed: Adopting Transformer based models for E-commerce Products Representation Learning","date":"2022-12-07","arxiv_id":"2212.03725","n_code_links":0,"syntology":null},{"paper":"/paper/dark-patterns-in-e-commerce-a-dataset-and-its","slug":"dark-patterns-in-e-commerce-a-dataset-and-its","title":"Dark patterns in e-commerce: a dataset and its baseline evaluations","date":"2022-11-12","arxiv_id":"2211.06543","n_code_links":1,"syntology":null},{"paper":"/paper/probing-for-targeted-syntactic-knowledge","slug":"probing-for-targeted-syntactic-knowledge","title":"Probing for targeted syntactic knowledge through grammatical error detection","date":"2022-10-28","arxiv_id":"2210.16228","n_code_links":1,"syntology":null},{"paper":null,"slug":"characterization-of-effects-of-transfer","title":"The (In)Effectiveness of Intermediate Task Training For Domain Adaptation and Cross-Lingual Transfer Learning","date":"2022-10-03","arxiv_id":"2210.01091","n_code_links":0,"syntology":null},{"paper":null,"slug":"can-transformer-models-effectively-detect","title":"Can Transformer Models Effectively Detect Software Aspects in StackOverflow Discussion?","date":"2022-09-24","arxiv_id":"2209.12065","n_code_links":0,"syntology":null},{"paper":"/paper/adaptation-of-domain-specific-transformer","slug":"adaptation-of-domain-specific-transformer","title":"Adaptation of domain-specific transformer models with text oversampling for sentiment analysis of social media posts on Covid-19 vaccines","date":"2022-09-22","arxiv_id":"2209.10966","n_code_links":1,"syntology":null},{"paper":null,"slug":"deep-learning-reveals-patterns-of-diverse-and","title":"Deep Learning Reveals Patterns of Diverse and Changing Sentiments Towards COVID-19 Vaccines Based on 11 Million Tweets","date":"2022-07-05","arxiv_id":"2207.10641","n_code_links":0,"syntology":null},{"paper":"/paper/always-keep-your-target-in-mind-studying-1","slug":"always-keep-your-target-in-mind-studying-1","title":"Always Keep your Target in Mind: Studying Semantics and Improving Performance of Neural Lexical Substitution","date":"2022-06-07","arxiv_id":"2206.11815","n_code_links":1,"syntology":null},{"paper":"/paper/training-and-inference-on-any-order","slug":"training-and-inference-on-any-order","title":"Training and Inference on Any-Order Autoregressive Models the Right Way","date":"2022-05-26","arxiv_id":"2205.13554","n_code_links":1,"syntology":null},{"paper":null,"slug":"tangobert-reducing-inference-cost-by-using","title":"TangoBERT: Reducing Inference Cost by using Cascaded Architecture","date":"2022-04-13","arxiv_id":"2204.06271","n_code_links":0,"syntology":null},{"paper":null,"slug":"anna-enhanced-language-representation-for-1","title":"ANNA: Enhanced Language Representation for Question Answering","date":"2022-03-28","arxiv_id":"2203.14507","n_code_links":0,"syntology":null},{"paper":"/paper/scinli-a-corpus-for-natural-language","slug":"scinli-a-corpus-for-natural-language","title":"SciNLI: A Corpus for Natural Language Inference on Scientific Text","date":"2022-03-13","arxiv_id":"2203.06728","n_code_links":1,"syntology":null},{"paper":"/paper/regression-transformer-concurrent-conditional","slug":"regression-transformer-concurrent-conditional","title":"Regression Transformer: Concurrent sequence regression and generation for molecular language modeling","date":"2022-02-01","arxiv_id":"2202.01338","n_code_links":1,"syntology":{"ran":7,"of":8,"n_ran_checked":7,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"7 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":{"repos":["ibm/regression-transformer"],"state":"official (archive's flag): 7 ran","n_ran":7,"n_constructed":0,"n_ran_no_instrument_failure":7,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/named-entity-recognition-architecture","slug":"named-entity-recognition-architecture","title":"Named entity recognition architecture combining contextual and global features","date":"2021-12-15","arxiv_id":"2112.08033","n_code_links":1,"syntology":null},{"paper":null,"slug":"a-comparative-study-of-transformers-on-word","title":"A Comparative Study of Transformers on Word Sense Disambiguation","date":"2021-11-30","arxiv_id":"2111.15417","n_code_links":0,"syntology":null},{"paper":null,"slug":"anna-enhanced-language-representation-for","title":"ANNA: Enhanced Language Representation for Question Answering","date":"2021-11-16","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"interpreting-the-robustness-of-neural-nlp","title":"Interpreting the Robustness of Neural NLP Models to Textual Perturbations","date":"2021-11-16","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"ibert-idiom-cloze-style-reading-comprehension","title":"IBERT: Idiom Cloze-style reading comprehension with Attention","date":"2021-11-05","arxiv_id":"2112.02994","n_code_links":0,"syntology":null},{"paper":"/paper/backdoor-pre-trained-models-can-transfer-to","slug":"backdoor-pre-trained-models-can-transfer-to","title":"Backdoor Pre-trained Models Can Transfer to All","date":"2021-10-30","arxiv_id":"2111.00197","n_code_links":1,"syntology":null},{"paper":null,"slug":"causally-estimating-the-sensitivity-of-neural-1","title":"Interpreting the Robustness of Neural NLP Models to Textual Perturbations","date":"2021-10-14","arxiv_id":"2110.07159","n_code_links":0,"syntology":null},{"paper":null,"slug":"low-frequency-names-exhibit-bias-and","title":"Low Frequency Names Exhibit Bias and Overfitting in Contextualizing Language Models","date":"2021-10-01","arxiv_id":"2110.00672","n_code_links":0,"syntology":null},{"paper":null,"slug":"what-to-prioritize-natural-language","title":"What to Prioritize? Natural Language Processing for the Development of a Modern Bug Tracking Solution in Hardware Development","date":"2021-09-28","arxiv_id":"2109.13825","n_code_links":0,"syntology":null},{"paper":null,"slug":"not-all-models-localize-linguistic-knowledge","title":"Not All Models Localize Linguistic Knowledge in the Same Place: A Layer-wise Probing on BERToids' Representations","date":"2021-09-13","arxiv_id":"2109.05958","n_code_links":0,"syntology":null},{"paper":"/paper/automated-mining-of-leaderboards-for","slug":"automated-mining-of-leaderboards-for","title":"Automated Mining of Leaderboards for Empirical AI Research","date":"2021-08-31","arxiv_id":"2109.13089","n_code_links":1,"syntology":null},{"paper":"/paper/evaluating-the-robustness-of-neural-language","slug":"evaluating-the-robustness-of-neural-language","title":"Evaluating the Robustness of Neural Language Models to Input Perturbations","date":"2021-08-27","arxiv_id":"2108.12237","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["mmoradi-iut/nlp-perturbation"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/misleading-the-covid-19-vaccination-discourse","slug":"misleading-the-covid-19-vaccination-discourse","title":"Misleading the Covid-19 vaccination discourse on Twitter: An exploratory study of infodemic around the pandemic","date":"2021-08-16","arxiv_id":"2108.10735","n_code_links":1,"syntology":null},{"paper":"/paper/variable-length-music-score-infilling-via","slug":"variable-length-music-score-infilling-via","title":"Variable-Length Music Score Infilling via XLNet and Musically Specialized Positional Encoding","date":"2021-08-11","arxiv_id":"2108.05064","n_code_links":1,"syntology":null},{"paper":"/paper/youngsheldon-at-semeval-2021-task-5-fine","slug":"youngsheldon-at-semeval-2021-task-5-fine","title":"YoungSheldon at SemEval-2021 Task 5: Fine-tuning Pre-trained Language Models for Toxic Spans Detection using Token classification Objective","date":"2021-08-01","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/clinical-relation-extraction-using","slug":"clinical-relation-extraction-using","title":"Clinical Relation Extraction Using Transformer-based Models","date":"2021-07-19","arxiv_id":"2107.08957","n_code_links":1,"syntology":null},{"paper":"/paper/transformers-with-multi-modal-features-and","slug":"transformers-with-multi-modal-features-and","title":"Transformers with multi-modal features and post-fusion context for e-commerce session-based recommendation","date":"2021-07-11","arxiv_id":"2107.05124","n_code_links":0,"syntology":null},{"paper":"/paper/what-helps-transformers-recognize","slug":"what-helps-transformers-recognize","title":"What Helps Transformers Recognize Conversational Structure? Importance of Context, Punctuation, and Labels in Dialog Act Recognition","date":"2021-07-05","arxiv_id":"2107.02294","n_code_links":1,"syntology":null},{"paper":"/paper/incorporating-word-sense-disambiguation-in","slug":"incorporating-word-sense-disambiguation-in","title":"Incorporating Word Sense Disambiguation in Neural Language Models","date":"2021-06-15","arxiv_id":"2106.07967","n_code_links":2,"syntology":null},{"paper":null,"slug":"target-model-agnostic-adversarial-attacks","title":"Target Model Agnostic Adversarial Attacks with Query Budgets on Language Understanding Models","date":"2021-06-13","arxiv_id":"2106.07047","n_code_links":0,"syntology":null},{"paper":"/paper/neural-combinatory-constituency-parsing","slug":"neural-combinatory-constituency-parsing","title":"Neural Combinatory Constituency Parsing","date":"2021-06-12","arxiv_id":"2106.06689","n_code_links":1,"syntology":null},{"paper":null,"slug":"contextualized-and-generalized-sentence","title":"Contextualized and Generalized Sentence Representations by Contrastive Self-Supervised Learning: A Case Study on Discourse Relation Analysis","date":"2021-06-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"multi-grained-knowledge-distillation-for","title":"Multi-Grained Knowledge Distillation for Named Entity Recognition","date":"2021-06-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"towards-a-comprehensive-understanding-and","title":"Towards a Comprehensive Understanding and Accurate Evaluation of Societal Biases in Pre-Trained Transformers","date":"2021-06-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"how-transfer-learning-impacts-linguistic","title":"How transfer learning impacts linguistic knowledge in deep NLP models?","date":"2021-05-31","arxiv_id":"2105.15179","n_code_links":0,"syntology":null},{"paper":null,"slug":"killing-two-birds-with-one-stone-stealing","title":"Killing One Bird with Two Stones: Model Extraction and Attribute Inference Attacks against BERT-based APIs","date":"2021-05-23","arxiv_id":"2105.10909","n_code_links":0,"syntology":null},{"paper":"/paper/explainable-tsetlin-machine-framework-for","slug":"explainable-tsetlin-machine-framework-for","title":"Explainable Tsetlin Machine framework for fake news detection with credibility score assessment","date":"2021-05-19","arxiv_id":"2105.09114","n_code_links":6,"syntology":null},{"paper":null,"slug":"bert-busters-outlier-layernorm-dimensions","title":"BERT Busters: Outlier Dimensions that Disrupt Transformers","date":"2021-05-14","arxiv_id":"2105.06990","n_code_links":0,"syntology":null},{"paper":null,"slug":"transformers-the-end-of-history-for-nlp","title":"Transformers: \"The End of History\" for NLP?","date":"2021-04-09","arxiv_id":"2105.00813","n_code_links":0,"syntology":null},{"paper":null,"slug":"exploring-transformers-in-emotion-recognition","title":"Exploring Transformers in Emotion Recognition: a comparison of BERT, DistillBERT, RoBERTa, XLNet and ELECTRA","date":"2021-04-05","arxiv_id":"2104.02041","n_code_links":0,"syntology":null},{"paper":null,"slug":"through-the-looking-glass-learning-to","title":"Through the Looking Glass: Learning to Attribute Synthetic Text Generated by Language Models","date":"2021-04-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"k-xlnet-a-general-method-for-combining","title":"K-XLNet: A General Method for Combining Explicit Knowledge with Language Model Pretraining","date":"2021-03-25","arxiv_id":"2104.10649","n_code_links":0,"syntology":null},{"paper":null,"slug":"comparing-the-performance-of-nlp-toolkits-and","title":"Comparing the Performance of NLP Toolkits and Evaluation measures in Legal Tech","date":"2021-03-12","arxiv_id":"2103.11792","n_code_links":0,"syntology":null},{"paper":null,"slug":"orthogonal-attention-a-cloze-style-approach","title":"Orthogonal Attention: A Cloze-Style Approach to Negation Scope Resolution","date":"2021-03-07","arxiv_id":"2103.04294","n_code_links":0,"syntology":null},{"paper":null,"slug":"nlp-cuet-dravidianlangtech-eacl2021","title":"NLP-CUET@DravidianLangTech-EACL2021: Investigating Visual and Textual Features to Identify Trolls from Multimodal Social Media Memes","date":"2021-02-28","arxiv_id":"2103.00466","n_code_links":0,"syntology":null},{"paper":"/paper/nlp-cuet-lt-edi-eacl2021-multilingual-code","slug":"nlp-cuet-lt-edi-eacl2021-multilingual-code","title":"NLP-CUET@LT-EDI-EACL2021: Multilingual Code-Mixed Hope Speech Detection using Cross-lingual Representation Learner","date":"2021-02-28","arxiv_id":"2103.00464","n_code_links":1,"syntology":null},{"paper":null,"slug":"few-shot-learning-for-information","title":"Few Shot Learning for Information Verification","date":"2021-02-22","arxiv_id":"2102.10956","n_code_links":0,"syntology":null},{"paper":"/paper/exploring-transformers-in-natural-language","slug":"exploring-transformers-in-natural-language","title":"Exploring Transformers in Natural Language Generation: GPT, BERT, and XLNet","date":"2021-02-16","arxiv_id":"2102.08036","n_code_links":1,"syntology":null},{"paper":null,"slug":"fake-news-detection-system-using-xlnet-model","title":"Fake News Detection System using XLNet model with Topic Distributions: CONSTRAINT@AAAI2021 Shared Task","date":"2021-01-12","arxiv_id":"2101.11425","n_code_links":0,"syntology":null},{"paper":"/paper/cisco-at-aaai-cad21-shared-task-predicting","slug":"cisco-at-aaai-cad21-shared-task-predicting","title":"Cisco at AAAI-CAD21 shared task: Predicting Emphasis in Presentation Slides using Contextualized Embeddings","date":"2021-01-10","arxiv_id":"2101.11422","n_code_links":1,"syntology":null},{"paper":"/paper/transformer-based-approach-towards-music","slug":"transformer-based-approach-towards-music","title":"Transformer-based approach towards music emotion recognition from lyrics","date":"2021-01-06","arxiv_id":"2101.02051","n_code_links":1,"syntology":null},{"paper":null,"slug":"syntactic-relevance-xlnet-word-embedding","title":"Syntactic Relevance XLNet Word Embedding Generation in Low-Resource Machine Translation","date":"2021-01-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/earlybert-efficient-bert-training-via-early-1","slug":"earlybert-efficient-bert-training-via-early-1","title":"EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets","date":"2020-12-31","arxiv_id":"2101.00063","n_code_links":1,"syntology":{"ran":2,"of":2,"n_ran_checked":1,"n_instrument":1,"unverified":0,"pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["VITA-Group/EarlyBERT"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official","unlocated"]}}},{"paper":"/paper/dialogxl-all-in-one-xlnet-for-multi-party","slug":"dialogxl-all-in-one-xlnet-for-multi-party","title":"DialogXL: All-in-One XLNet for Multi-Party Conversation Emotion Recognition","date":"2020-12-16","arxiv_id":"2012.08695","n_code_links":4,"syntology":null},{"paper":null,"slug":"discriminative-pre-training-for-low-resource","title":"Discriminative Pre-training for Low Resource Title Compression in Conversational Grocery","date":"2020-12-13","arxiv_id":"2012.06943","n_code_links":0,"syntology":null},{"paper":"/paper/yelp-review-rating-prediction-machine","slug":"yelp-review-rating-prediction-machine","title":"Yelp Review Rating Prediction: Machine Learning and Deep Learning Models","date":"2020-12-12","arxiv_id":"2012.06690","n_code_links":1,"syntology":null},{"paper":null,"slug":"bert-at-semeval-2020-task-8-using-bert-to","title":"BERT at SemEval-2020 Task 8: Using BERT to Analyse Meme Emotions","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"comparing-probabilistic-distributional-and","title":"Comparing Probabilistic, Distributional and Transformer-Based Models on Logical Metonymy Interpretation","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"evaluating-unsupervised-representation","title":"Evaluating Unsupervised Representation Learning for Detecting Stances of Fake News","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"hitachi-at-semeval-2020-task-11-an-empirical","title":"Hitachi at SemEval-2020 Task 11: An Empirical Study of Pre-Trained Transformer Family for Propaganda Detection","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/hy-nli-a-hybrid-system-for-natural-language","slug":"hy-nli-a-hybrid-system-for-natural-language","title":"Hy-NLI: a Hybrid system for Natural Language Inference","date":"2020-12-01","arxiv_id":null,"n_code_links":2,"syntology":null},{"paper":null,"slug":"neural-language-models-for-text","title":"Neural language models for text classification in evidence-based medicine","date":"2020-12-01","arxiv_id":"2012.00584","n_code_links":0,"syntology":null},{"paper":null,"slug":"nlp-just-at-semeval-2020-task-4-ensemble","title":"NLP@JUST at SemEval-2020 Task 4: Ensemble Technique for BERT and Roberta to Evaluate Commonsense Validation","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"sinai-at-semeval-2020-task-12-offensive","title":"SINAI at SemEval-2020 Task 12: Offensive Language Identification Exploring Transfer Learning Models","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"ssn-nlp-at-semeval-2020-task-4-text","title":"SSN-NLP at SemEval-2020 Task 4: Text Classification and Generation on Common Sense Context Using Neural Networks","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/multitask-learning-of-negation-and","slug":"multitask-learning-of-negation-and","title":"Multitask Learning of Negation and Speculation using Transformers","date":"2020-11-20","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/bionerflair-biomedical-named-entity","slug":"bionerflair-biomedical-named-entity","title":"BioNerFlair: biomedical named entity recognition using flair embedding and sequence tagger","date":"2020-11-03","arxiv_id":"2011.01504","n_code_links":1,"syntology":null},{"paper":"/paper/chime-cross-passage-hierarchical-memory","slug":"chime-cross-passage-hierarchical-memory","title":"CHIME: Cross-passage Hierarchical Memory Network for Generative Review Question Answering","date":"2020-11-01","arxiv_id":"2011.00519","n_code_links":1,"syntology":null}],"papers_shown":100,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":167,"with_a_code_link":70,"where_syntology_ran_a_sample":10,"not_listed_spam_title":0,"listed":167,"listed_where_code_ran":10,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":10,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":10,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":10,"papers_where_code_ran_first_page":"/method/xlnet/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"archive","page":2,"of":2,"url":"/method/xlnet/papers/2","json":"/method/xlnet/papers/2.json","rows":67},{"order":"ran","page":1,"of":1,"url":"/method/xlnet/papers/ran/1","json":"/method/xlnet/papers/ran/1.json","rows":10}],"tasks":[{"task":"/task/language-modelling","name":"Language Modelling","papers":23},{"task":"/task/language-modeling","name":"Language Modeling","papers":22},{"task":"/task/sentence","name":"Sentence","papers":20},{"task":"/task/question-answering","name":"Question Answering","papers":17},{"task":"/task/sentiment-analysis","name":"Sentiment Analysis","papers":17},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":14},{"task":"/task/text-classification","name":"Text Classification","papers":13},{"task":"/task/reading-comprehension","name":"Reading Comprehension","papers":11},{"task":"/task/text-classification-1","name":"text-classification","papers":10},{"task":"/task/data-augmentation","name":"Data Augmentation","papers":9},{"task":"/task/classification","name":"General Classification","papers":8},{"task":"/task/natural-language-understanding","name":"Natural Language Understanding","papers":8},{"task":"/task/text-generation","name":"Text Generation","papers":8},{"task":"/task/named-entity-recognition-ner","name":"Named Entity Recognition (NER)","papers":7},{"task":"/task/representation-learning","name":"Representation Learning","papers":7},{"task":"/task/classification-1","name":"Classification","papers":6},{"task":"/task/named-entity-recognition-1","name":"Named Entity Recognition","papers":6},{"task":"/task/sentiment-classification","name":"Sentiment Classification","papers":6},{"task":"/task/translation","name":"Translation","papers":6},{"task":"/task/word-embeddings","name":"Word Embeddings","papers":6}],"tasks_shown":20,"n_tasks":190,"usage_by_year":[{"year":"2019","papers":25},{"year":"2020","papers":58},{"year":"2021","papers":42},{"year":"2022","papers":14},{"year":"2023","papers":14},{"year":"2024","papers":11},{"year":"2025","papers":3}],"row_source":"embedded","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/xlnet"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=XLNet","read_at":"2026-10-05T01:04:01+00:00","query":"XLNet","kind":"method","have":"declared_code","tier":"repo_known","verified_implementation":false,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"method":"XLNet","origin_arxiv_id":"1906.08237"},"resolution":"exact","resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"unknown","archive_paper_arxiv_id":null,"repositories":{"listed":5,"in_graph":26,"list_truncated":true,"strongest_link":"official"},"retrieve_with":null,"name_competition":{"verdict":"sole_bearer","may_be_wrong_sense":false,"bearers_found":1,"served":{"arxiv_id":"1906.08237","citations":null},"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing else in this corpus is named 'XLNet'. That is a statement about this corpus and not about the field: short names are reused, and a sense we never collected cannot show up here. Confirm `served.arxiv_id` if you had a specific paper in mind."},"name_competition_text":null,"near_matches":null,"code_nearby":[],"code_nearby_caption":null,"origin_paper":{"arxiv_id":"1906.08237","page":"/paper/xlnet-generalized-autoregressive-pretraining","syntology_url":"https://syntology.ai/paper/1906.08237","in_graph_layer":true,"samples":24,"ran":15,"n_ran_checked":10,"n_instrument":5,"unverified":9,"phrase":"15 ran (of which 2 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified","instrument_means":"failures of Syntology's instrument, not of the code"},"line":"repository known, no verified implementation (declared_code; repositories: 5 listed of 26 in the graph, strongest link: official). The archive credits no paper with an arXiv id for this method, so whether this answer (about arXiv:1906.08237) is about this method is not checked.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"81c5af0fcc7b33e29528d115fe59602cfdd1631ec464e9c51c429ae27122981a","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}