{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/elmo","slug":"elmo","name":"ELMo","full_name":"ELMo","full_name_withheld":false,"description_markdown":"**Embeddings from Language Models**, or **ELMo**, is a type of deep contextualized word representation that models both (1) complex characteristics of word use (e.g., syntax and semantics), and (2) how these uses vary across linguistic contexts (i.e., to model polysemy). Word vectors are learned functions of the internal states of a deep bidirectional language model (biLM), which is pre-trained on a large text corpus.\r\n\r\nA biLM combines both a forward and backward LM.  ELMo jointly maximizes the log likelihood of the forward and backward directions. To add ELMo to a supervised model, we freeze the weights of the biLM and then concatenate the ELMo vector $\\textbf{ELMO}^{task}_k$ with $\\textbf{x}_k$ and pass the ELMO enhanced representation $[\\textbf{x}_k; \\textbf{ELMO}^{task}_k]$ into the task RNN. Here $\\textbf{x}_k$ is a context-independent token representation for each token position. \r\n\r\nImage Source: [here](https://medium.com/@duyanhnguyen_38925/create-a-strong-text-classification-with-the-help-from-elmo-e90809ba29da)","description_state":"present","introduced_year":null,"introduced_by":{"title":"Deep contextualized word representations","paper":"/paper/deep-contextualized-word-representations","first_author":"Matthew E. Peters","n_authors":7,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/deep-contextualized-word-representations"},"source":{"url":"http://arxiv.org/abs/1802.05365v2","title":"Deep contextualized word representations","url_on_a_paper_host":true},"code_snippet_url":null,"code_snippet_url_on_a_code_host":false,"categories":[{"area":"Natural Language Processing","area_id":"natural-language-processing","collection":"Language Models","url":"/methods/category/language-models","pwc_aliases":[]},{"area":"Natural Language Processing","area_id":"natural-language-processing","collection":"Contextualized Word Embeddings","url":"/methods/category/contextualized-word-embeddings","pwc_aliases":[]},{"area":"Natural Language Processing","area_id":"natural-language-processing","collection":"Word Embeddings","url":"/methods/category/word-embeddings","pwc_aliases":[]}],"n_papers_tagged":234,"archive_num_papers":234,"papers_newest_first":[{"paper":"/paper/a-comparative-analysis-of-static-word","slug":"a-comparative-analysis-of-static-word","title":"A Comparative Analysis of Static Word Embeddings for Hungarian","date":"2025-05-12","arxiv_id":"2505.07809","n_code_links":1,"syntology":null},{"paper":null,"slug":"embedding-based-approaches-to-hyperpartisan","title":"Embedding-based Approaches to Hyperpartisan News Detection","date":"2025-01-02","arxiv_id":"2501.01370","n_code_links":0,"syntology":null},{"paper":"/paper/generative-pretrained-embedding-and","slug":"generative-pretrained-embedding-and","title":"Generative Pretrained Embedding and Hierarchical Irregular Time Series Representation for Daily Living Activity Recognition","date":"2024-12-27","arxiv_id":"2412.19732","n_code_links":1,"syntology":null},{"paper":null,"slug":"llms-are-also-effective-embedding-models-an","title":"LLMs are Also Effective Embedding Models: An In-depth Overview","date":"2024-12-17","arxiv_id":"2412.12591","n_code_links":0,"syntology":null},{"paper":null,"slug":"from-word-vectors-to-multimodal-embeddings","title":"From Word Vectors to Multimodal Embeddings: Techniques, Applications, and Future Directions For Large Language Models","date":"2024-11-06","arxiv_id":"2411.05036","n_code_links":0,"syntology":null},{"paper":null,"slug":"elmo-enhanced-real-time-lidar-motion-capture","title":"ELMO: Enhanced Real-time LiDAR Motion Capture through Upsampling","date":"2024-10-09","arxiv_id":"2410.06963","n_code_links":0,"syntology":null},{"paper":null,"slug":"evaluating-the-efficacy-of-ai-techniques-in","title":"Evaluating the Efficacy of AI Techniques in Textual Anonymization: A Comparative Study","date":"2024-05-09","arxiv_id":"2405.06709","n_code_links":0,"syntology":null},{"paper":null,"slug":"where-exactly-does-contextualization-in-a-plm","title":"Where exactly does contextualization in a PLM happen?","date":"2023-12-11","arxiv_id":"2312.06514","n_code_links":0,"syntology":null},{"paper":"/paper/semantic-change-detection-for-the-romanian","slug":"semantic-change-detection-for-the-romanian","title":"Semantic Change Detection for the Romanian Language","date":"2023-08-23","arxiv_id":"2308.12131","n_code_links":1,"syntology":null},{"paper":"/paper/pevolm-protein-sequence-evolutionary","slug":"pevolm-protein-sequence-evolutionary","title":"PEvoLM: Protein Sequence Evolutionary Information Language Model","date":"2023-08-16","arxiv_id":"2308.08578","n_code_links":1,"syntology":null},{"paper":null,"slug":"on-scientific-debt-in-nlp-a-case-for-more","title":"On \"Scientific Debt\" in NLP: A Case for More Rigour in Language Model Pre-Training Research","date":"2023-06-05","arxiv_id":"2306.02870","n_code_links":0,"syntology":null},{"paper":null,"slug":"analyzing-the-generalizability-of-deep","title":"Analyzing the Generalizability of Deep Contextualized Language Representations For Text Classification","date":"2023-03-22","arxiv_id":"2303.12936","n_code_links":0,"syntology":null},{"paper":null,"slug":"classifying-text-based-conspiracy-tweets","title":"Classifying Text-Based Conspiracy Tweets related to COVID-19 using Contextualized Word Embeddings","date":"2023-03-07","arxiv_id":"2303.03706","n_code_links":0,"syntology":null},{"paper":null,"slug":"ckg-dynamic-representation-based-on-context","title":"CKG: Dynamic Representation Based on Context and Knowledge Graph","date":"2022-12-09","arxiv_id":"2212.04909","n_code_links":0,"syntology":null},{"paper":null,"slug":"troll-tweet-detection-using-contextualized","title":"A Context-Sensitive Word Embedding Approach for The Detection of Troll Tweets","date":"2022-07-17","arxiv_id":"2207.08230","n_code_links":0,"syntology":null},{"paper":"/paper/always-keep-your-target-in-mind-studying-1","slug":"always-keep-your-target-in-mind-studying-1","title":"Always Keep your Target in Mind: Studying Semantics and Improving Performance of Neural Lexical Substitution","date":"2022-06-07","arxiv_id":"2206.11815","n_code_links":1,"syntology":null},{"paper":null,"slug":"parameter-efficient-tuning-by-manipulating","title":"Parameter-Efficient Tuning by Manipulating Hidden States of Pretrained Language Models For Classification Tasks","date":"2022-04-10","arxiv_id":"2204.04596","n_code_links":0,"syntology":null},{"paper":"/paper/bridging-pre-trained-language-models-and-hand","slug":"bridging-pre-trained-language-models-and-hand","title":"Bridging Pre-trained Language Models and Hand-crafted Features for Unsupervised POS Tagging","date":"2022-03-19","arxiv_id":"2203.10315","n_code_links":1,"syntology":null},{"paper":null,"slug":"using-word-embeddings-to-analyze-protests","title":"Using Word Embeddings to Analyze Protests News","date":"2022-03-11","arxiv_id":"2203.05875","n_code_links":0,"syntology":null},{"paper":null,"slug":"assessment-of-contextualised-representations","title":"Assessment of contextualised representations in detecting outcome phrases in clinical trials","date":"2022-02-13","arxiv_id":"2203.03547","n_code_links":0,"syntology":null},{"paper":"/paper/a-passage-to-india-pre-trained-word-1","slug":"a-passage-to-india-pre-trained-word-1","title":"\"A Passage to India\": Pre-trained Word Embeddings for Indian Languages","date":"2021-12-27","arxiv_id":"2112.13800","n_code_links":0,"syntology":null},{"paper":null,"slug":"karl-trans-ner-knowledge-aware-representation","title":"KARL-Trans-NER: Knowledge Aware Representation Learning for Named Entity Recognition using Transformers","date":"2021-11-30","arxiv_id":"2111.15436","n_code_links":0,"syntology":null},{"paper":"/paper/using-language-model-to-bootstrap-human","slug":"using-language-model-to-bootstrap-human","title":"Using Language Model to Bootstrap Human Activity Recognition Ambient Sensors Based in Smart Homes","date":"2021-11-23","arxiv_id":"2111.12158","n_code_links":1,"syntology":null},{"paper":null,"slug":"investigating-the-use-of-bert-anchors-for","title":"Investigating the Use of BERT Anchors for Bilingual Lexicon Induction with Minimal Supervision","date":"2021-11-16","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/fake-news-detection-in-spanish-using-deep","slug":"fake-news-detection-in-spanish-using-deep","title":"Fake News Detection in Spanish Using Deep Learning Techniques","date":"2021-10-13","arxiv_id":"2110.06461","n_code_links":1,"syntology":null},{"paper":"/paper/a-comprehensive-comparison-of-word-embeddings","slug":"a-comprehensive-comparison-of-word-embeddings","title":"A Comprehensive Comparison of Word Embeddings in Event & Entity Coreference Resolution","date":"2021-10-11","arxiv_id":"2110.05115","n_code_links":1,"syntology":null},{"paper":null,"slug":"cross-architecture-distillation-using","title":"Cross-Architecture Distillation Using Bidirectional CMOW Embeddings","date":"2021-09-29","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/new-students-on-sesame-street-what-order","slug":"new-students-on-sesame-street-what-order","title":"General Cross-Architecture Distillation of Pretrained Language Models into Matrix Embeddings","date":"2021-09-17","arxiv_id":"2109.08449","n_code_links":1,"syntology":null},{"paper":"/paper/revisiting-tri-training-of-dependency-parsers","slug":"revisiting-tri-training-of-dependency-parsers","title":"Revisiting Tri-training of Dependency Parsers","date":"2021-09-16","arxiv_id":"2109.08122","n_code_links":2,"syntology":null},{"paper":null,"slug":"sense-representations-for-portuguese","title":"Sense representations for Portuguese: experiments with sense embeddings and deep neural language models","date":"2021-08-31","arxiv_id":"2109.00025","n_code_links":0,"syntology":null},{"paper":"/paper/evaluating-the-robustness-of-neural-language","slug":"evaluating-the-robustness-of-neural-language","title":"Evaluating the Robustness of Neural Language Models to Input Perturbations","date":"2021-08-27","arxiv_id":"2108.12237","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["mmoradi-iut/nlp-perturbation"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/curriculum-learning-for-language-modeling","slug":"curriculum-learning-for-language-modeling","title":"Curriculum learning for language modeling","date":"2021-08-04","arxiv_id":"2108.02170","n_code_links":1,"syntology":{"ran":2,"of":2,"n_ran_checked":1,"n_instrument":1,"unverified":0,"pointer_only":1,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["spacemanidol/CurriculumLearningForLanguageModels"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"raw-c-relatedness-of-ambiguous-words-in-1","title":"RAW-C: Relatedness of Ambiguous Words in Context (A New Lexical Resource for English)","date":"2021-08-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/contextnet-a-click-through-rate-prediction","slug":"contextnet-a-click-through-rate-prediction","title":"ContextNet: A Click-Through Rate Prediction Framework Using Contextual information to Refine Feature Embedding","date":"2021-07-26","arxiv_id":"2107.12025","n_code_links":4,"syntology":null},{"paper":null,"slug":"evaluation-of-contextual-embeddings-on-less","title":"Evaluation of contextual embeddings on less-resourced languages","date":"2021-07-22","arxiv_id":"2107.10614","n_code_links":0,"syntology":null},{"paper":null,"slug":"unsupervised-spoken-utterance-classification","title":"Unsupervised Spoken Utterance Classification","date":"2021-07-02","arxiv_id":"2107.01068","n_code_links":0,"syntology":null},{"paper":null,"slug":"cross-lingual-alignments-of-elmo-contextual","title":"Cross-lingual alignments of ELMo contextual embeddings","date":"2021-06-30","arxiv_id":"2106.15986","n_code_links":0,"syntology":null},{"paper":null,"slug":"clinical-named-entity-recognition-using","title":"Clinical Named Entity Recognition using Contextualized Token Representations","date":"2021-06-23","arxiv_id":"2106.12608","n_code_links":0,"syntology":null},{"paper":"/paper/raw-c-relatedness-of-ambiguous-words-in","slug":"raw-c-relatedness-of-ambiguous-words-in","title":"RAW-C: Relatedness of Ambiguous Words--in Context (A New Lexical Resource for English)","date":"2021-05-27","arxiv_id":"2105.13266","n_code_links":1,"syntology":null},{"paper":null,"slug":"the-low-dimensional-linear-geometry-of","title":"The Low-Dimensional Linear Geometry of Contextualized Word Representations","date":"2021-05-15","arxiv_id":"2105.07109","n_code_links":0,"syntology":null},{"paper":null,"slug":"role-of-artificial-intelligence-in-detection","title":"Role of Artificial Intelligence in Detection of Hateful Speech for Hinglish Data on Social Media","date":"2021-05-11","arxiv_id":"2105.04913","n_code_links":0,"syntology":null},{"paper":null,"slug":"towards-trustworthy-deception-detection","title":"Towards Trustworthy Deception Detection: Benchmarking Model Robustness across Domains, Modalities, and Languages","date":"2021-04-23","arxiv_id":"2104.11761","n_code_links":0,"syntology":null},{"paper":"/paper/large-scale-contextualised-language-modelling","slug":"large-scale-contextualised-language-modelling","title":"Large-Scale Contextualised Language Modelling for Norwegian","date":"2021-04-13","arxiv_id":"2104.06546","n_code_links":2,"syntology":{"ran":1,"of":3,"n_ran_checked":1,"n_instrument":0,"unverified":2,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified","official":{"repos":["ltgoslo/NorBERT","ltgoslo/norec_sentence"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"combining-pre-trained-word-embeddings-and","title":"Combining Pre-trained Word Embeddings and Linguistic Features for Sequential Metaphor Identification","date":"2021-04-07","arxiv_id":"2104.03285","n_code_links":0,"syntology":null},{"paper":null,"slug":"evaluating-neural-model-robustness-for","title":"Evaluating Neural Model Robustness for Machine Comprehension","date":"2021-04-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/probing-for-idiomaticity-in-vector-space","slug":"probing-for-idiomaticity-in-vector-space","title":"Probing for idiomaticity in vector space models","date":"2021-04-01","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"representing-elmo-embeddings-as-two","title":"Representing ELMo embeddings as two-dimensional text online","date":"2021-03-30","arxiv_id":"2103.16414","n_code_links":0,"syntology":null},{"paper":"/paper/towards-multi-sense-cross-lingual-alignment-1","slug":"towards-multi-sense-cross-lingual-alignment-1","title":"Towards Multi-Sense Cross-Lingual Alignment of Contextual Embeddings","date":"2021-03-11","arxiv_id":"2103.06459","n_code_links":1,"syntology":null},{"paper":null,"slug":"ceqe-contextualized-embeddings-for-query","title":"CEQE: Contextualized Embeddings for Query Expansion","date":"2021-03-09","arxiv_id":"2103.05256","n_code_links":0,"syntology":null},{"paper":null,"slug":"few-shot-learning-for-slot-tagging-with","title":"Few-shot Learning for Slot Tagging with Attentive Relational Network","date":"2021-03-03","arxiv_id":"2103.02333","n_code_links":0,"syntology":null},{"paper":null,"slug":"from-universal-language-model-to-downstream","title":"From Universal Language Model to Downstream Task: Improving RoBERTa-Based Vietnamese Hate Speech Detection","date":"2021-02-24","arxiv_id":"2102.12162","n_code_links":0,"syntology":null},{"paper":null,"slug":"coloring-the-black-box-what-synesthesia-tells","title":"Coloring the Black Box: What Synesthesia Tells Us about Character Embeddings","date":"2021-01-26","arxiv_id":"2101.10565","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-hybrid-approach-to-measure-semantic","title":"A Hybrid Approach to Measure Semantic Relatedness in Biomedical Concepts","date":"2021-01-25","arxiv_id":"2101.10196","n_code_links":0,"syntology":null},{"paper":"/paper/stereotype-and-skew-quantifying-gender-bias","slug":"stereotype-and-skew-quantifying-gender-bias","title":"Stereotype and Skew: Quantifying Gender Bias in Pre-trained and Fine-tuned Language Models","date":"2021-01-24","arxiv_id":"2101.09688","n_code_links":1,"syntology":null},{"paper":null,"slug":"neural-contract-element-extraction-revisited","title":"Neural Contract Element Extraction Revisited: Letters from Sesame Street","date":"2021-01-12","arxiv_id":"2101.04355","n_code_links":0,"syntology":null},{"paper":null,"slug":"learning-better-sentence-representation-with","title":"Learning Better Sentence Representation with Syntax Information","date":"2021-01-09","arxiv_id":"2101.03343","n_code_links":0,"syntology":null},{"paper":"/paper/presenting-a-dataset-for-collaborator","slug":"presenting-a-dataset-for-collaborator","title":"Presenting a Dataset for Collaborator Recommending Systems in Academic Social Network: a Case Study on ReseachGate","date":"2020-12-29","arxiv_id":"2101.01141","n_code_links":0,"syntology":null},{"paper":"/paper/improved-biomedical-word-embeddings-in-the","slug":"improved-biomedical-word-embeddings-in-the","title":"Improved Biomedical Word Embeddings in the Transformer Era","date":"2020-12-22","arxiv_id":"2012.11808","n_code_links":1,"syntology":null},{"paper":"/paper/classifier-probes-may-just-learn-from-linear","slug":"classifier-probes-may-just-learn-from-linear","title":"Classifier Probes May Just Learn from Linear Context Features","date":"2020-12-01","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/cross-lingual-annotation-projection-in-legal","slug":"cross-lingual-annotation-projection-in-legal","title":"Cross-lingual Annotation Projection in Legal Texts","date":"2020-12-01","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"deftpunk-at-semeval-2020-task-6-using-rnn","title":"DeftPunk at SemEval-2020 Task 6: Using RNN-ensemble for the Sentence Classification.","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"embeddings-in-natural-language-processing","title":"Embeddings in Natural Language Processing","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/grubert-a-gru-based-method-to-fuse-bert","slug":"grubert-a-gru-based-method-to-fuse-bert","title":"GRUBERT: A GRU-Based Method to Fuse BERT Hidden Layers for Twitter Sentiment Analysis","date":"2020-12-01","arxiv_id":null,"n_code_links":2,"syntology":null},{"paper":null,"slug":"last-at-semeval-2020-task-10-finding-tokens","title":"LAST at SemEval-2020 Task 10: Finding Tokens to Emphasise in Short Written Texts with Precomputed Embedding Models and LightGBM","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"mineriaunam-at-semeval-2020-task-3-predicting","title":"MineriaUNAM at SemEval-2020 Task 3: Predicting Contextual WordSimilarity Using a Centroid Based Approach and Word Embeddings","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"ntuaails-at-semeval-2020-task-11-propaganda","title":"NTUAAILS at SemEval-2020 Task 11: Propaganda Detection and Classification with biLSTMs and ELMo","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"tue-at-semeval-2020-task-1-detecting-semantic","title":"TUE at SemEval-2020 Task 1: Detecting Semantic Change by Clustering Contextual Word Embeddings","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"unituebingencl-at-semeval-2020-task-7-humor","title":"UniTuebingenCL at SemEval-2020 Task 7: Humor Detection in News Headlines","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"bi-isca-bidirectional-inter-sentence","title":"Bi-ISCA: Bidirectional Inter-Sentence Contextual Attention Mechanism for Detecting Sarcasm in User Generated Noisy Short Text","date":"2020-11-23","arxiv_id":"2011.11465","n_code_links":0,"syntology":null},{"paper":"/paper/enhance-robustness-of-sequence-labelling-with","slug":"enhance-robustness-of-sequence-labelling-with","title":"Enhance Robustness of Sequence Labelling with Masked Adversarial Training","date":"2020-11-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"the-amazing-world-of-neural-language","title":"The Amazing World of Neural Language Generation","date":"2020-11-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"seq2mol-automatic-design-of-de-novo-molecules","title":"Seq2Mol: Automatic design of de novo molecules conditioned by the target protein sequences through deep neural networks","date":"2020-10-29","arxiv_id":"2010.15900","n_code_links":0,"syntology":null},{"paper":"/paper/improving-compositional-generalization-in","slug":"improving-compositional-generalization-in","title":"Improving Compositional Generalization in Semantic Parsing","date":"2020-10-12","arxiv_id":"2010.05647","n_code_links":1,"syntology":{"ran":2,"of":3,"n_ran_checked":2,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":{"repos":["inbaroren/improving-compgen-in-semparse"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":1,"ran_from_kinds":["official"]}}},{"paper":"/paper/unsupervised-distillation-of-syntactic","slug":"unsupervised-distillation-of-syntactic","title":"Unsupervised Distillation of Syntactic Information from Contextualized Word Representations","date":"2020-10-11","arxiv_id":"2010.05265","n_code_links":1,"syntology":null},{"paper":null,"slug":"masked-elmo-an-evolution-of-elmo-towards","title":"Masked ELMo: An evolution of ELMo towards fully contextual RNN language models","date":"2020-10-08","arxiv_id":"2010.04302","n_code_links":0,"syntology":null},{"paper":null,"slug":"elmo-and-bert-in-semantic-change-detection","title":"ELMo and BERT in semantic change detection for Russian","date":"2020-10-07","arxiv_id":"2010.03481","n_code_links":0,"syntology":null},{"paper":"/paper/where-are-the-facts-searching-for-fact","slug":"where-are-the-facts-searching-for-fact","title":"Where Are the Facts? Searching for Fact-checked Information to Alleviate the Spread of Fake News","date":"2020-10-07","arxiv_id":"2010.03159","n_code_links":2,"syntology":{"ran":5,"of":5,"n_ran_checked":5,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["nguyenvo09/EMNLP2020"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"metaphor-detection-using-deep-contextualized","title":"Metaphor Detection using Deep Contextualized Word Embeddings","date":"2020-09-26","arxiv_id":"2009.12565","n_code_links":0,"syntology":null},{"paper":"/paper/farstail-a-persian-natural-language-inference","slug":"farstail-a-persian-natural-language-inference","title":"FarsTail: A Persian Natural Language Inference Dataset","date":"2020-09-18","arxiv_id":"2009.08820","n_code_links":1,"syntology":null},{"paper":null,"slug":"multi-modal-embeddings-using-multi-task","title":"Multi-modal embeddings using multi-task learning for emotion recognition","date":"2020-09-10","arxiv_id":"2009.05019","n_code_links":0,"syntology":null},{"paper":"/paper/comparative-evaluation-of-pretrained-transfer","slug":"comparative-evaluation-of-pretrained-transfer","title":"Comparative Evaluation of Pretrained Transfer Learning Models on Automatic Short Answer Grading","date":"2020-09-02","arxiv_id":"2009.01303","n_code_links":1,"syntology":null},{"paper":"/paper/mice-mining-idioms-with-contextual-embeddings","slug":"mice-mining-idioms-with-contextual-embeddings","title":"MICE: Mining Idioms with Contextual Embeddings","date":"2020-08-13","arxiv_id":"2008.05759","n_code_links":1,"syntology":null},{"paper":"/paper/assessing-demographic-bias-in-named-entity","slug":"assessing-demographic-bias-in-named-entity","title":"Assessing Demographic Bias in Named Entity Recognition","date":"2020-08-08","arxiv_id":"2008.03415","n_code_links":1,"syntology":null},{"paper":"/paper/towards-debiasing-sentence-representations-1","slug":"towards-debiasing-sentence-representations-1","title":"Towards Debiasing Sentence Representations","date":"2020-07-16","arxiv_id":"2007.08100","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["pliang279/sent_debias"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"clinical-concept-linking-with-contextualized","title":"Clinical Concept Linking with Contextualized Neural Representations","date":"2020-07-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"interpreting-pretrained-contextualized","title":"Interpreting Pretrained Contextualized Representations via Reductions to Static Embeddings","date":"2020-07-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"why-is-penguin-more-similar-to-polar-bear","title":"Why is penguin more similar to polar bear than to sea gull? Analyzing conceptual knowledge in distributional models","date":"2020-07-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"interpreting-hierarchical-linguistic","title":"Building Interpretable Interaction Trees for Deep NLP Models","date":"2020-06-29","arxiv_id":"2007.04298","n_code_links":0,"syntology":null},{"paper":"/paper/a-monolingual-approach-to-contextualized-word","slug":"a-monolingual-approach-to-contextualized-word","title":"A Monolingual Approach to Contextualized Word Embeddings for Mid-Resource Languages","date":"2020-06-11","arxiv_id":"2006.06202","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-comparative-study-of-lexical-substitution","title":"A Comparative Study of Lexical Substitution Approaches based on Neural Language Models","date":"2020-05-29","arxiv_id":"2006.00031","n_code_links":0,"syntology":null},{"paper":"/paper/on-incorporating-structural-information-to","slug":"on-incorporating-structural-information-to","title":"On Incorporating Structural Information to improve Dialogue Response Generation","date":"2020-05-28","arxiv_id":"2005.14315","n_code_links":1,"syntology":null},{"paper":"/paper/mask-a-flexible-framework-to-facilitate-de","slug":"mask-a-flexible-framework-to-facilitate-de","title":"MASK: A flexible framework to facilitate de-identification of clinical texts","date":"2020-05-24","arxiv_id":"2005.11687","n_code_links":1,"syntology":null},{"paper":"/paper/on-the-robustness-of-language-encoders","slug":"on-the-robustness-of-language-encoders","title":"On the Robustness of Language Encoders against Grammatical Errors","date":"2020-05-12","arxiv_id":"2005.05683","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":0,"n_instrument":1,"unverified":0,"pointer_only":0,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["uclanlp/ProbeGrammarRobustness"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/lince-a-centralized-benchmark-for-linguistic","slug":"lince-a-centralized-benchmark-for-linguistic","title":"LinCE: A Centralized Benchmark for Linguistic Code-switching Evaluation","date":"2020-05-09","arxiv_id":"2005.04322","n_code_links":0,"syntology":null},{"paper":"/paper/spying-on-your-neighbors-fine-grained-probing","slug":"spying-on-your-neighbors-fine-grained-probing","title":"Spying on your neighbors: Fine-grained probing of contextual embeddings for information about surrounding words","date":"2020-05-04","arxiv_id":"2005.01810","n_code_links":0,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":1,"phrase":"1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result","official":null}},{"paper":null,"slug":"a-passage-to-india-pre-trained-word","title":"``A Passage to India'': Pre-trained Word Embeddings for Indian Languages","date":"2020-05-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"aia-bde-a-corpus-of-faqs-in-portuguese-and","title":"AIA-BDE: A Corpus of FAQs in Portuguese and their Variations","date":"2020-05-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"analyzing-elmo-and-distilbert-on-socio","title":"Analyzing ELMo and DistilBERT on Socio-political News Classification","date":"2020-05-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"facilitating-corpus-usage-making-icelandic","title":"Facilitating Corpus Usage: Making Icelandic Corpora More Accessible for Researchers and Language Users","date":"2020-05-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"french-contextualized-word-embeddings-with-a","title":"French Contextualized Word-Embeddings with a sip of CaBeRnet: a New French Balanced Reference Corpus","date":"2020-05-01","arxiv_id":null,"n_code_links":0,"syntology":null}],"papers_shown":100,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":234,"with_a_code_link":90,"where_syntology_ran_a_sample":17,"not_listed_spam_title":0,"listed":234,"listed_where_code_ran":17,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":16,"every_run_a_failure_of_syntologys_instrument":1,"listed_with_a_run_with_no_instrument_failure":16,"listed_every_run_a_failure_of_syntologys_instrument":1,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":17,"papers_where_code_ran_first_page":"/method/elmo/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"archive","page":2,"of":3,"url":"/method/elmo/papers/2","json":"/method/elmo/papers/2.json","rows":100},{"order":"archive","page":3,"of":3,"url":"/method/elmo/papers/3","json":"/method/elmo/papers/3.json","rows":34},{"order":"ran","page":1,"of":1,"url":"/method/elmo/papers/ran/1","json":"/method/elmo/papers/ran/1.json","rows":17}],"tasks":[{"task":"/task/word-embeddings","name":"Word Embeddings","papers":71},{"task":"/task/sentence","name":"Sentence","papers":48},{"task":"/task/language-modelling","name":"Language Modelling","papers":38},{"task":"/task/language-modeling","name":"Language Modeling","papers":33},{"task":"/task/sentiment-analysis","name":"Sentiment Analysis","papers":26},{"task":"/task/named-entity-recognition-ner","name":"Named Entity Recognition (NER)","papers":22},{"task":"/task/cg","name":"NER","papers":20},{"task":"/task/named-entity-recognition-1","name":"Named Entity Recognition","papers":20},{"task":"/task/named-entity-recognition","name":"named-entity-recognition","papers":20},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":18},{"task":"/task/text-classification-1","name":"text-classification","papers":16},{"task":"/task/classification","name":"General Classification","papers":15},{"task":"/task/text-classification","name":"Text Classification","papers":15},{"task":"/task/question-answering","name":"Question Answering","papers":14},{"task":"/task/natural-language-inference","name":"Natural Language Inference","papers":12},{"task":"/task/pos","name":"POS","papers":11},{"task":"/task/word-sense-disambiguation","name":"Word Sense Disambiguation","papers":11},{"task":"/task/natural-language-understanding","name":"Natural Language Understanding","papers":10},{"task":"/task/dependency-parsing","name":"Dependency Parsing","papers":8},{"task":"/task/machine-translation","name":"Machine Translation","papers":8}],"tasks_shown":20,"n_tasks":199,"usage_by_year":[{"year":"2018","papers":25},{"year":"2019","papers":94},{"year":"2020","papers":59},{"year":"2021","papers":36},{"year":"2022","papers":7},{"year":"2023","papers":6},{"year":"2024","papers":5},{"year":"2025","papers":2}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/elmo"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=ELMo","read_at":"2026-10-05T00:55:33+00:00","query":"ELMo","kind":"method","have":"declared_code","tier":"repo_known","verified_implementation":false,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":{"method":"ELMO","origin_arxiv_id":"2510.11168"},"resolution":"case_insensitive","resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":"different_paper","archive_paper_arxiv_id":"1802.05365","repositories":{"listed":2,"in_graph":2,"list_truncated":false,"strongest_link":"listed_only"},"retrieve_with":null,"name_competition":{"verdict":"sole_bearer","may_be_wrong_sense":false,"bearers_found":1,"served":{"arxiv_id":"2510.11168","citations":null},"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing else in this corpus is named 'ELMo'. That is a statement about this corpus and not about the field: short names are reused, and a sense we never collected cannot show up here. Confirm `served.arxiv_id` if you had a specific paper in mind."},"name_competition_text":null,"near_matches":null,"code_nearby":[],"code_nearby_caption":null,"origin_paper":{"arxiv_id":"2510.11168","page":"/paper/arxiv-2510-11168","syntology_url":"https://syntology.ai/paper/2510.11168","in_graph_layer":true,"samples":10,"ran":8,"n_ran_checked":4,"n_instrument":4,"unverified":2,"phrase":"8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 2 unverified","instrument_means":"failures of Syntology's instrument, not of the code"},"line":"about another paper, arXiv:2510.11168: repository known, no verified implementation (declared_code; repositories: 2 listed of 2 in the graph, strongest link: listed only). The lookup matched 'ELMO' ignoring case. About another paper: this answer is about arXiv:2510.11168, while the archive credits arXiv:1802.05365.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"832b3e0a193cd174fb4952821e015dbce78dea30e141f8f2116e1e1894de31b3","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}