Papers › BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding

11 Oct 2018NAACL 2019 6arXiv:1810.04805archive 2025-07-28

Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova

We introduce a new language representation model called BERT, which stands for Bidirectional Encoder Representations from Transformers. Unlike recent language representation models, BERT is designed to pre-train deep bidirectional representations from unlabeled text by jointly conditioning on both left and right context in all layers. As a result, the pre-trained BERT model can be fine-tuned with just one additional output layer to create state-of-the-art models for a wide range of tasks, such as question answering and language inference, without substantial task-specific architecture modifications. BERT is conceptually simple and empirically powerful. It obtains new state-of-the-art results on eleven natural language processing tasks, including pushing the GLUE score to 80.5% (7.7% point absolute improvement), MultiNLI accuracy to 86.7% (4.6% absolute improvement), SQuAD v1.1 question answering Test F1 to 93.2 (1.5 point absolute improvement) and SQuAD v2.0 Test F1 to 83.1 (5.1 point absolute improvement).

PaperPDFConference PDFCodeCode Syntology ranMethod as code

In Syntology View this paper on Syntology, its page in Syntology's graph. That page adds which of its functions are also present in other papers' code Syntology holds, with dates, and its dated run record as JSON and a README badge. It also lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

No sample from the archive's official repository (google-research/bert) is linked to this paper; the 655 samples below come from 170 community repositories, and 4 more are identical to code Syntology harvested from another paper's repository. Syntology harvested code from google-research/bert for another paper.

google-research/bert: Syntology's graph links these samples to NapSS: Paragraph-level Medical Text Simplification via Narrative Prompting and... (arXiv:2302.05574; that paper's own run record: 17 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 1 honoured, 0 violated, 12 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified); nothing checks that they implement this paper's method.

Syntology 659 code samples: 655 from 170 repositories linked to this paper, 4 identical to code harvested from another paper's repository. Across all 659: 300 ran (of which 75 constructed an object rather than computing a result; 234 with no instrument failure: 18 honoured, 5 violated, 211 with no contract checked; 66 where Syntology's instrument failed) · 359 unverified. Where Syntology's instrument failed: 54 where our contract draft was wrong; 12 where the contract check could not run; failures of Syntology's instrument, not of the code.

By repository: community (archive-listed): 655 samples from 170 repositories, 298 ran (232 with no instrument failure; 66 where Syntology's instrument failed); 4 identical to code first harvested elsewhere. The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

No sample is linked to this paper from 62 of its repositories that Syntology harvested for other papers:

Levels written between 2026-09-22 and 2026-09-26 (UTC): the dates Syntology's graph wrote each sample's verification level, not when the code executed. 2 of the 300 samples that ran have no recorded date.

534 repositories listed; official and paper-mentioned ones first.

google-research/bert officialmentioned in papermentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to NapSS: Paragraph-level Medical Text Simplification via Narrative Prompting and... (arXiv:2302.05574; that paper's own run record: 17 ran (of which 0 constructed an object rather than computing a result; 13 with no instrument failure: 1 honoured, 0 violated, 12 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified); nothing checks that they implement this paper's method. report
1wy/bert mentioned on GitHubtfApache-2.0Syntology: 8 samples, 6 ran (2 instrument-failed) · 2 unverified report
2023-MindSpore-1/ms-code-11 mentioned on GitHubmindsporeSyntology: not harvested report
2023-MindSpore-1/ms-code-12 mentioned on GitHubmindsporeSyntology: not harvested report
2023-MindSpore-1/ms-code-56 mentioned on GitHubmindsporeSyntology: not harvested report
2miatran/Natural-Language-Processing mentioned on GitHubSyntology: not harvested report
ABaldrati/MT-BERT mentioned on GitHubpytorchSyntology: 6 samples, 4 ran (0 instrument-failed) · 2 unverified report
AGiannoutsos/COVID19-document-retrieval-with-BERT mentioned on GitHubpytorchSyntology: not harvested report
AbhishekD15/Sentiment-Analysis_BERT mentioned on GitHubSyntology: not harvested report
AdamStein97/Semi-Supervised-BERT-NER mentioned on GitHubtfSyntology: not harvested report
AhmedYounes94/Semi-supervised-BERT-NER mentioned on GitHubtfSyntology: not harvested report
Alihassan7726/Multi-Class-classification-using-BERT- mentioned on GitHubtfSyntology: not harvested report
Arthurizijar/Bert_Airport mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Well-Read Students Learn Better: On the Importance of Pre-training Compact Models (arXiv:1908.08962; that paper's own run record: 21 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 1 honoured, 0 violated, 14 with no contract checked; 6 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
ArvinZhuang/BiTAG mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (arXiv:1910.10683; that paper's own run record: 21 ran (of which 0 constructed an object rather than computing a result; 20 with no instrument failure: 1 honoured, 0 violated, 19 with no contract checked; 1 where Syntology's instrument failed) · 10 unverified); nothing checks that they implement this paper's method. report
AtmaHou/MetaDialog mentioned on GitHubpytorchSyntology: 2 samples, 0 ran · 2 unverified report
AutomatedProgramRepair-2021/dear-auto-fix mentioned on GitHubtfSyntology: not harvested report
BinWang28/BERT_Sentence_Embedding mentioned on GitHubpytorchSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
BinWang28/SBERT-WK-Sentence-Embedding mentioned on GitHubpytorchApache-2.0Syntology: not harvested report
BirgerMoell/bertcastle mentioned on GitHubpytorchSyntology: not harvested report
BroCoLySTyLe/SQLovaReview mentioned on GitHubSyntology: not harvested report
CVxTz/music_genre_classification mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Attention Is All You Need (arXiv:1706.03762; that paper's own run record: 610 ran (of which 293 constructed an object rather than computing a result; 529 with no instrument failure: 45 honoured, 15 violated, 469 with no contract checked; 81 where Syntology's instrument failed) · 336 unverified); nothing checks that they implement this paper's method. report
Caesarzhang/bert-zh mentioned on GitHubtfApache-2.0Syntology: not harvested report
Charliesgithub20221030/BERT mentioned on GitHubtfApache-2.0Syntology: 1 sample, 0 ran · 1 unverified report
Chonwai/Learning_BERT mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Well-Read Students Learn Better: On the Importance of Pre-training Compact Models (arXiv:1908.08962; that paper's own run record: 21 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 1 honoured, 0 violated, 14 with no contract checked; 6 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
Coda-s/BJTU_NLP_Practice mentioned on GitHubpytorchSyntology: not harvested report
Colanim/BERT_STS-B mentioned on GitHubtfApache-2.0Syntology: not harvested report
CyberZHG/keras-bert mentioned on GitHubtfMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Parameter-Efficient Transfer Learning for NLP (arXiv:1902.00751; that paper's own run record: 14 ran (of which 3 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified); nothing checks that they implement this paper's method. report
DataScienceNigeria/Supervised-NLP-from-Facebook-AI-Team mentioned on GitHubSyntology: not harvested report
DeligientSloth/QQsim mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
DeligientSloth/bert-tensorflow mentioned on GitHubtfSyntology: 8 samples, 2 ran (1 instrument-failed) · 6 unverified report
DeokO/bert-excercise-ongoing mentioned on GitHubtfApache-2.0Syntology: not harvested report
DimasDMM/nlp-completer mentioned on GitHubpytorchSyntology: not harvested report
DimasDMM/transformers mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (1 instrument-failed) · 0 unverified report
Doffery/BERT-Sentiment-Analysis-Amazon-Review mentioned on GitHubtfApache-2.0Syntology: 8 samples, 8 ran (0 instrument-failed) · 0 unverified report
Domminique/Deploy-BERT-for-Sentiment-Analysis-with-FastAPI- mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
Dongcf/Pytorch_Bert_Text_Classification mentioned on GitHubpytorchSyntology: not harvested report
DylanCope/Image-Captioning-with-Bimodal-Transformers mentioned on GitHubtfSyntology: not harvested report
Eeun-ju/NLP-study mentioned on GitHubpytorchSyntology: not harvested report
ElizaLo/Question-Answering-based-on-SQuAD mentioned on GitHubpytorchSyntology: not harvested report
EssayKillerBrain/NLP-BERT-Chinese mentioned on GitHubpytorchSyntology: not harvested report
EthanWYB/bert-classification mentioned on GitHubtfApache-2.0Syntology: 2 samples, 0 ran · 2 unverified report
EuphoriaYan/bert_component mentioned on GitHubtfSyntology: 12 samples, 4 ran (2 instrument-failed) · 8 unverified report
Farahn/AES mentioned on GitHubtfSyntology: not harvested report
FaskyCC/TextClassification mentioned on GitHubtfApache-2.0Syntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
FengJiaChunFromSYSU/Bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
Gaozhen0816/BERT_QA_For_AILaw mentioned on GitHubtfApache-2.0Syntology: not harvested report
Gaozhen0816/BERT_QA_for_Chinese mentioned on GitHubtfApache-2.0Syntology: not harvested report
GauthierDmn/question_answering mentioned on GitHubpytorchSyntology: not harvested report
Guowei-Yan/Data mentioned on GitHubpytorchSyntology: not harvested report
Hibb-bb/ALLM mentioned on GitHubpytorchnot reachable when probed 2026-09-18 — repositories for recent papers often appear after camera-readySyntology: not harvested report
Holldean/BERT-Pruning mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Structured Pruning of Large Language Models (arXiv:1910.04732; that paper's own run record: 8 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 4 unverified); nothing checks that they implement this paper's method. report
HuihuiChyan/BJTUNLP_Practice2020 mentioned on GitHubpytorchSyntology: not harvested report
HuihuiChyan/BJTUNLP_Practice2021 mentioned on GitHubpytorchSyntology: not harvested report
IBM/MAX-Question-Answering mentioned on GitHubtfApache-2.0Syntology: 3 samples, 2 ran (0 instrument-failed) · 1 unverified report
IBM/MAX-Text-Sentiment-Classifier mentioned on GitHubtfSyntology: 4 samples, 3 ran (1 instrument-failed) · 1 unverified report
IBM/MAX-Toxic-Comment-Classifier mentioned on GitHubpytorchApache-2.0Syntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
IMPLabUniPr/UniParma-at-semeval-2021-task-5 mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to CharacterBERT: Reconciling ELMo and BERT for Word-Level Open-Vocabulary... (arXiv:2010.10392; that paper's own run record: 6 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 0 violated, 1 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified); nothing checks that they implement this paper's method. report
Impavidity/relogic mentioned on GitHubpytorchSyntology: 14 samples, 5 ran (1 instrument-failed) · 9 unverified report
IndicoDataSolutions/finetune mentioned on GitHubtfMPL-2.0Syntology: not harvested report
JA-Bar/nlp-depression mentioned on GitHubtfSyntology: 3 samples, 2 ran (2 instrument-failed) · 1 unverified report
JMSaindon/NlpSquad mentioned on GitHubpytorchSyntology: not harvested report
JNUpython/bert mentioned on GitHubtfSyntology: 3 samples, 0 ran · 3 unverified report
Jackma3/NER-Bert-BiLstm mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
JeheonPark596/sentimentsurvival mentioned on GitHubSyntology: not harvested report
JohannLee1996/bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
Jun-Zhang-32108/Sentiment-Analysis mentioned on GitHubSyntology: not harvested report
Kanishkparganiha/Named-Entity-Recognition-using-BERT-with-PyTorch mentioned on GitHubpytorchMITSyntology: not harvested report
Karthik-Bhaskar/Context-Based-Question-Answering mentioned on GitHubtfApache-2.0Syntology: not harvested report
Katsumata420/bert_mlm mentioned on GitHubtfApache-2.0Syntology: not harvested report
KeithGalli/pycon2020 mentioned on GitHubSyntology: not harvested report
Kerram/Deephol-Bert-Zpp mentioned on GitHubtfSyntology: not harvested report
Kevin-Vora/bert-embedding-gluonnlp-edit- mentioned on GitHubtfApache-2.0Syntology: not harvested report
KnightZhang625/BERT_TF mentioned on GitHubtfSyntology: 6 samples, 2 ran (1 instrument-failed) · 4 unverified report
KomorebiLHX/Emotion-Recognition-in-Conversations mentioned on GitHubpytorchSyntology: 2 samples, 1 ran (1 instrument-failed) · 1 unverified report
Kosuke-Szk/BERT-NER-ja mentioned on GitHubtfSyntology: not harvested report
Kyubyong/bert-token-embeddings mentioned on GitHubpytorchApache-2.0Syntology: not harvested report
LeoWood/bert-horovod mentioned on GitHubtfApache-2.0Syntology: not harvested report
Linar23/Research_work mentioned on GitHubpytorchSyntology: 3 samples, 3 ran (0 instrument-failed) · 0 unverified report
LorenzoAgnolucci/BERT_for_ABSA mentioned on GitHubpytorchSyntology: not harvested report
LoveYang/bert_test mentioned on GitHubtfApache-2.0Syntology: 3 samples, 0 ran · 3 unverified report
MINGG2333/bert_ms mentioned on GitHubmindsporeSyntology: not harvested report
MLH-Fellowship/Social-BERTerfly mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
MOHAMEDELDAKDOUKY/bert_adjusted mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Well-Read Students Learn Better: On the Importance of Pre-training Compact Models (arXiv:1908.08962; that paper's own run record: 21 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 1 honoured, 0 violated, 14 with no contract checked; 6 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
MaZhiyuanBUAA/bert-tf1.4.0 mentioned on GitHubtfApache-2.0Syntology: 5 samples, 4 ran (0 instrument-failed) · 1 unverified report
MalteHB/-l-ctra mentioned on GitHubtfMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators (arXiv:2003.10555; that paper's own run record: 31 ran (of which 7 constructed an object rather than computing a result; 18 with no instrument failure: 2 honoured, 2 violated, 14 with no contract checked; 13 where Syntology's instrument failed) · 9 unverified); nothing checks that they implement this paper's method. report
ManasRMohanty/DS5500-capstone mentioned on GitHubpytorchSyntology: not harvested report
MansMeg/IntroML mentioned on GitHubSyntology: not harvested report
MarcosGrzeca/drunktweets mentioned on GitHubSyntology: not harvested report
MatthewSwahn/news-headlines-sarcasm-detector mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
Maz101/Bert mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Well-Read Students Learn Better: On the Importance of Pre-training Compact Models (arXiv:1908.08962; that paper's own run record: 21 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 1 honoured, 0 violated, 14 with no contract checked; 6 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
Maz101/pretrainingdataset mentioned on GitHubtfApache-2.0Syntology: not harvested report
MichaelZhouwang/LMlexsub mentioned on GitHubtfSyntology: 2 samples, 0 ran · 2 unverified report
Microsoft/AzureML-BERT mentioned on GitHubpytorchMITSyntology: 13 samples, 10 ran (3 instrument-failed) · 3 unverified report
Misoknisky/Bert-MultiGpu mentioned on GitHubtfApache-2.0Syntology: not harvested report
NehaTamore/TextSimilarity mentioned on GitHubSyntology: not harvested report
Nilanshrajput/Intent_classification mentioned on GitHubpytorchSyntology: not harvested report
Nimesh-Patel/BERT mentioned on GitHubtfApache-2.0Syntology: not harvested report
Nstats/bert_MRC mentioned on GitHubtfSyntology: 2 samples, 0 ran · 2 unverified report
Nstats/bert_senti_analysis_ch mentioned on GitHubtfSyntology: not harvested report
Nstats/my_bert mentioned on GitHubtfSyntology: 2 samples, 0 ran · 2 unverified report
Osobarako/alduswarrensewell mentioned on GitHubtfApache-2.0Syntology: not harvested report
OweysMomenzada/Evergreen-Content-Classifier-for-german-Text mentioned on GitHubSyntology: not harvested report
PaddlePaddle/models mentioned on GitHubpaddleApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to CoKE: Contextualized Knowledge Graph Embedding (arXiv:1911.02168; that paper's own run record: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
Priyanshiguptaaa/CoLA_Sentence_Classification_BERT mentioned on GitHubpytorchSyntology: not harvested report
ProsusAI/finBERT mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to FinBERT: Financial Sentiment Analysis with Pre-trained Language Models (arXiv:1908.10063; that paper's own run record: 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
Qordobacode/fitbert mentioned on GitHubpytorchApache-2.0Syntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
R1j1t/contextualSpellCheck mentioned on GitHubMITSyntology: not harvested report
Raman-Raje/Machine-Reading-Comprehension-Neural-Question-Answer- mentioned on GitHubtfSyntology: not harvested report
RenXiangyuan/tf_bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
RonRaifer/BERT-Ghazali mentioned on GitHubpytorchSyntology: not harvested report
RxstydnR/Stock_BERT mentioned on GitHubSyntology: not harvested report
SAP-samples/acl2019-commonsense mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Contrastive Self-Supervised Learning for Commonsense Reasoning (arXiv:2005.00669; that paper's own run record: 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
SAP-samples/acl2019-commonsense-reasoning mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Contrastive Self-Supervised Learning for Commonsense Reasoning (arXiv:2005.00669; that paper's own run record: 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
SCismycat/bert_code_view mentioned on GitHubtfSyntology: 6 samples, 1 ran (1 instrument-failed) · 5 unverified report
SYangDong/bert-with-frozen-code mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
Sanyuan-Chen/RecAdam mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to ALBERT: A Lite BERT for Self-supervised Learning of Language Representations (arXiv:1909.11942; that paper's own run record: 81 ran (of which 17 constructed an object rather than computing a result; 56 with no instrument failure: 4 honoured, 0 violated, 52 with no contract checked; 25 where Syntology's instrument failed) · 45 unverified); nothing checks that they implement this paper's method. report
Satan012/BERT mentioned on GitHubtfSyntology: 6 samples, 1 ran (1 instrument-failed) · 5 unverified report
SatyamSoni23/Smart-Question-Answering-System-on-Document mentioned on GitHubApache-2.0Syntology: not harvested report
Shinya-Kouda/kgc mentioned on GitHubtfnot reachable when probed 2026-09-18 — repositories for recent papers often appear after camera-readySyntology: not harvested report
ShivamRajSharma/Transformer-Architectures-From-Scratch mentioned on GitHubpytorchSyntology: 4 samples, 4 ran (0 instrument-failed) · 0 unverified report
Sikun/dlam_project mentioned on GitHubtfSyntology: not harvested report
SindhuMadi/FakeNewsDetection mentioned on GitHubSyntology: not harvested report
SkullFang/BERT_NLP_Classification mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
Skumarr53/Attention-is-All-you-Need-PyTorch mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
Soren-Kierkegaard/BERT-for-tweet-Classifcation mentioned on GitHubtfSyntology: not harvested report
SpikeKing/My-Bert mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Well-Read Students Learn Better: On the Importance of Pre-training Compact Models (arXiv:1908.08962; that paper's own run record: 21 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 1 honoured, 0 violated, 14 with no contract checked; 6 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
StoneGH/bert mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Well-Read Students Learn Better: On the Importance of Pre-training Compact Models (arXiv:1908.08962; that paper's own run record: 21 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 1 honoured, 0 violated, 14 with no contract checked; 6 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
StuartCHAN/KARL mentioned on GitHubpytorchSyntology: 2 samples, 0 ran · 2 unverified report
SumitM0432/Quora-Insincere-Questions-Classification mentioned on GitHubtfSyntology: not harvested report
Susheel-1999/Sentence_Similarity mentioned on GitHubMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks (arXiv:1908.10084; that paper's own run record: 33 ran (of which 9 constructed an object rather than computing a result; 30 with no instrument failure: 1 honoured, 0 violated, 29 with no contract checked; 3 where Syntology's instrument failed) · 25 unverified); nothing checks that they implement this paper's method. report
TOSHISTATS/Classification-of-Japanese-news-with-BERT mentioned on GitHubtfSyntology: not harvested report
TSLNIHAOGIT/bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
TSLNIHAOGIT/bert_run mentioned on GitHubtfApache-2.0Syntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
TYTYTYTYTYTYTYTYTY/558-project mentioned on GitHubtfApache-2.0Syntology: not harvested report
TannerFry/CS522-Final-Project mentioned on GitHubSyntology: not harvested report
TeamLab/bert-gcn-for-paper-citation mentioned on GitHubtfSyntology: 13 samples, 3 ran (3 instrument-failed) · 10 unverified report
Tencent/TurboTransformers mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
TheNeuromancer/SentEmb mentioned on GitHubpytorchApache-2.0Syntology: not harvested report
TidalPaladin/neural-summarizer mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Fine-tune BERT for Extractive Summarization (arXiv:1903.10318; that paper's own run record: 5 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
TonyX19/bert_hyperpartisan mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Well-Read Students Learn Better: On the Importance of Pre-training Compact Models (arXiv:1908.08962; that paper's own run record: 21 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 1 honoured, 0 violated, 14 with no contract checked; 6 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
Unbabel/COMET mentioned on GitHubpytorchSyntology: 3 samples, 1 ran (0 instrument-failed) · 2 unverified report
UnknownGenie/altered-BERT-KPE mentioned on GitHubpytorchSyntology: not harvested report
Vladimetr/ASR-Knowledge-Transferring mentioned on GitHubpytorchSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
Walter-B/bert-20-classes mentioned on GitHubtfApache-2.0Syntology: not harvested report
XINZXZHANG/Bert_repo mentioned on GitHubtfApache-2.0Syntology: not harvested report
Xinsen-Zhang/transformer mentioned on GitHubpaddleSyntology: not harvested report
Y1ran/NLP-BERT--ChineseVersion mentioned on GitHubpytorchSyntology: not harvested report
YYGXjpg/BERT_WL mentioned on GitHubtfApache-2.0Syntology: not harvested report
Yipeng91/text_classifier_pub mentioned on GitHubtfApache-2.0Syntology: not harvested report
YongWookHa/BERT-on-Pytorch-Template mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
YuanEric88/bert-nlu mentioned on GitHubtfSyntology: not harvested report
YuehChuan/bert-Agus mentioned on GitHubtfSyntology: not harvested report
Zeeshan75/Bert_Telugu_Ner mentioned on GitHubtfSyntology: not harvested report
Zehui127/SQUAD_BERT mentioned on GitHubtfApache-2.0Syntology: 3 samples, 3 ran (3 instrument-failed) · 0 unverified report
a414351664/Bert_MRC mentioned on GitHubtfApache-2.0Syntology: not harvested report
aaronHuang0121/AI-CUP-2020 mentioned on GitHubSyntology: not harvested report
abhiagg92/bert_sentiment mentioned on GitHubtfSyntology: not harvested report
abhilashreddys/Fake-News-Article mentioned on GitHubpytorchMITSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
abhineet/sentence_classification_pubmed_scibert mentioned on GitHubpytorchSyntology: not harvested report
abmitra84/Language_Modeling mentioned on GitHubSyntology: not harvested report
af-ai-center/bert mentioned on GitHubpytorchSyntology: 4 samples, 3 ran (1 instrument-failed) · 1 unverified report
af-ai-center/nerblackbox mentioned on GitHubApache-2.0Syntology: 7 samples, 7 ran (0 instrument-failed) · 0 unverified report
airsplay/vimpac mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
aleksac99/SQuAD-SR mentioned on GitHubSyntology: not harvested report
algharak/BERTenhance mentioned on GitHubtfSyntology: 2 samples, 0 ran · 2 unverified report
amauriciorr/AubreyBot mentioned on GitHubpytorchSyntology: not harvested report
ambityga/memsem mentioned on GitHubtfSyntology: not harvested report
andi611/Mockingjay-Speech-Representation mentioned on GitHubpytorchSyntology: 11 samples, 4 ran (1 instrument-failed) · 7 unverified report
anton-bushuiev/ppiformer mentioned on GitHubpytorchMITSyntology: 9 samples, 8 ran (2 instrument-failed) · 1 unverified report
anupamsingh610/bert_ner_stride mentioned on GitHubtfSyntology: not harvested report
appcoreopc/berty mentioned on GitHubtfSyntology: 5 samples, 4 ran (3 instrument-failed) · 1 unverified report
arielsho/decomposition-table-reasoning mentioned on GitHubpytorchSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
arkel23/PyTorch-Pretrained-ViT mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Attention Is All You Need (arXiv:1706.03762; that paper's own run record: 610 ran (of which 293 constructed an object rather than computing a result; 529 with no instrument failure: 45 honoured, 15 violated, 469 with no contract checked; 81 where Syntology's instrument failed) · 336 unverified) and An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (arXiv:2010.11929; that paper's own run record: 307 ran (of which 165 constructed an object rather than computing a result; 286 with no instrument failure: 8 honoured, 2 violated, 276 with no contract checked; 21 where Syntology's instrument failed) · 112 unverified); nothing checks that they implement this paper's method. report
asgaardlab/test-case-similarity-technique mentioned on GitHubtfSyntology: not harvested report
athms/learning-from-brains mentioned on GitHubpytorchSyntology: 2 samples, 0 ran · 2 unverified report
autobotasia/vibert mentioned on GitHubtfApache-2.0Syntology: 4 samples, 3 ran (0 instrument-failed) · 1 unverified report
avichaychriqui/HeBERT mentioned on GitHubpytorchMITSyntology: 1 sample, 0 ran · 1 unverified report
avishek-018/single_notebook_projects mentioned on GitHubtfSyntology: not harvested report
aws-samples/amazon-sagemaker-bert-pytorch mentioned on GitHubpytorchMIT-0Syntology: 3 samples, 3 ran (1 instrument-failed) · 0 unverified report
awslabs/mlm-scoring mentioned on GitHubmxnetSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
babelscape/wikineural mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
baotramduong/Sentiment-Analysis-with-Deep-Learning-using-BERT mentioned on GitHubSyntology: not harvested report
bcaitech1/p2-klue-Heeseok-Jeong mentioned on GitHubpytorchSyntology: not harvested report
bentrevett/pytorch-sentiment-analysis mentioned on GitHubpytorchSyntology: not harvested report
benywon/ChiQA mentioned on GitHubpytorchSyntology: not harvested report
benywon/ChineseBert mentioned on GitHubpytorchSyntology: 3 samples, 0 ran · 3 unverified report
benywon/ComQA mentioned on GitHubpytorchApache-2.0Syntology: 7 samples, 2 ran (0 instrument-failed) · 5 unverified report
benywon/ReCO mentioned on GitHubpytorchSyntology: not harvested report
bhavitvyamalik/bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
binhetech/bert-application mentioned on GitHubtfApache-2.0Syntology: 2 samples, 0 ran · 2 unverified report
bino282/bert4news mentioned on GitHubpytorchSyntology: not harvested report
bit-ml/anoshift mentioned on GitHubpytorchBSD-3-ClauseSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to AnoShift: A Distribution Shift Benchmark for Unsupervised Anomaly Detection (arXiv:2206.15476; that paper's own run record: 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
bluejurand/Kaggle_QA_Google_Labeling mentioned on GitHubtfSyntology: not harvested report
brightmart/bert_customized mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
brightmart/bert_original mentioned on GitHubtfSyntology: not harvested report
brightmart/roberta_zh mentioned on GitHubtfSyntology: not harvested report
brightmart/text_classification mentioned on GitHubtfSyntology: 2 samples, 0 ran · 2 unverified report
broccolik/BERT-NER mentioned on GitHubtfSyntology: not harvested report
cedrickchee/pytorch-pretrained-BERT mentioned on GitHubpytorchSyntology: 20 samples, 6 ran (2 instrument-failed) · 14 unverified report
chalothon/BERT_Practice mentioned on GitHubtfApache-2.0Syntology: not harvested report
chandu7077/mybert mentioned on GitHubtfApache-2.0Syntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
charles9n/bert-sklearn mentioned on GitHubpytorchSyntology: 12 samples, 1 ran (0 instrument-failed) · 11 unverified report
chen-xiong-yi/OwnBERT mentioned on GitHubtfApache-2.0Syntology: not harvested report
chiayewken/bert-qa mentioned on GitHubtfSyntology: 2 samples, 0 ran · 2 unverified report
chrisleunglokhin/Capstone-BERT mentioned on GitHubtfApache-2.0Syntology: not harvested report
chujiezheng/ChID-Dataset mentioned on GitHubtfApache-2.0Syntology: not harvested report
chunghyunhee/twitter_disaster_NLP mentioned on GitHubSyntology: not harvested report
circlePi/BERT_Chinese_Text_Class_By_pytorch mentioned on GitHubpytorchSyntology: not harvested report
cmunnis/BERT_vs_Transformer-XL mentioned on GitHubpytorchSyntology: not harvested report
coco60/bert-test mentioned on GitHubtfApache-2.0Syntology: 1 sample, 1 ran (1 instrument-failed) · 0 unverified report
codertimo/BERT-pytorch mentioned on GitHubpytorchSyntology: 5 samples, 3 ran (0 instrument-failed) · 2 unverified report
common-english/bert-all mentioned on GitHubpytorchSyntology: not harvested report
coronazap/bert_client mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Well-Read Students Learn Better: On the Importance of Pre-training Compact Models (arXiv:1908.08962; that paper's own run record: 21 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 1 honoured, 0 violated, 14 with no contract checked; 6 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
cospplay/bert-master mentioned on GitHubtfApache-2.0Syntology: not harvested report
crx934080895/Bert-CRF_New2 mentioned on GitHubtfSyntology: not harvested report
cuber2460/bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
cybertronai/megatron-lm mentioned on GitHubpytorchSyntology: 13 samples, 8 ran (0 instrument-failed) · 5 unverified report
danlim-wz/analysis_of_social_media_data_about_singapore mentioned on GitHubpytorchSyntology: not harvested report
darr/nerbert mentioned on GitHubpytorchSyntology: not harvested report
darr/nlp_work mentioned on GitHubSyntology: not harvested report
davidbellamy/labrador mentioned on GitHubtfMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Labrador: Exploring the Limits of Masked Language Modeling for Laboratory Data (arXiv:2312.11502; that paper's own run record: 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
davidsvaughn/dts-tf mentioned on GitHubtfSyntology: not harvested report
dbmdz/historic-ner mentioned on GitHubMITSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
debnsuma/AmazonSageMaker101 mentioned on GitHubpytorchMIT-0Syntology: not harvested report
debnsuma/Intro-Transformer-BERT mentioned on GitHubpytorchMIT-0Syntology: not harvested report
deepmind/xquad mentioned on GitHubSyntology: not harvested report
deepmipt/Slavic-BERT-NER mentioned on GitHubtfSyntology: not harvested report
deepmipt/bert mentioned on GitHubtfSyntology: 6 samples, 1 ran (1 instrument-failed) · 5 unverified report
deepset-ai/FARM mentioned on GitHubpytorchSyntology: 2 samples, 0 ran · 2 unverified report
deping-1/2019-false-news-detection-challenge mentioned on GitHubpytorchSyntology: not harvested report
derronxu/sparsebert mentioned on GitHubpytorchSyntology: 12 samples, 4 ran (0 instrument-failed) · 8 unverified report
devJWSong/bert-crf-entity-recognition-pytorch mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
dhlee347/pytorchic-bert mentioned on GitHubpytorchSyntology: 6 samples, 6 ran (0 instrument-failed) · 0 unverified report
diabhaque/Sixth-Sense mentioned on GitHubtfSyntology: not harvested report
dispink/xpt mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (arXiv:2010.11929; that paper's own run record: 307 ran (of which 165 constructed an object rather than computing a result; 286 with no instrument failure: 8 honoured, 2 violated, 276 with no contract checked; 21 where Syntology's instrument failed) · 112 unverified); nothing checks that they implement this paper's method. report
dreamgonfly/BERT-pytorch mentioned on GitHubpytorchSyntology: 2 samples, 0 ran · 2 unverified report
duyunshu/bert-sentiment-analysis mentioned on GitHubtfApache-2.0Syntology: 5 samples, 1 ran (0 instrument-failed) · 4 unverified report
dzqjorking/transpose mentioned on GitHubtfSyntology: not harvested report
eagle705/bert mentioned on GitHubtfSyntology: 5 samples, 2 ran (0 instrument-failed) · 3 unverified report
eaishwa/quora-ques-pair-similarity mentioned on GitHubpytorchSyntology: not harvested report
elenalenaelena/machine-learning-viz mentioned on GitHubtfSyntology: not harvested report
enod/arxiv-nlp-notes mentioned on GitHubSyntology: not harvested report
epcpu/deep-nlp-links mentioned on GitHubpytorchSyntology: not harvested report
epfml/collaborative-attention mentioned on GitHubpytorchSyntology: 3 samples, 2 ran (1 instrument-failed) · 1 unverified report
ericperfect/Bert_Position_BiLSTM_Attention_CRF_LSTMDecoder mentioned on GitHubtfApache-2.0Syntology: not harvested report
eunseo1092/Graduation_project mentioned on GitHubSyntology: not harvested report
evtaktasheva/dependency_extraction mentioned on GitHubpytorchSyntology: not harvested report
fabiocorreacordeiro/Elsevier_abstracts-Classification mentioned on GitHubSyntology: not harvested report
facebookresearch/anli mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
faizansuhail89/bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
fanchenyou/transformer-study mentioned on GitHubpytorchSyntology: 10 samples, 9 ran (0 instrument-failed) · 1 unverified report
fancyerii/bert mentioned on GitHubtfApache-2.0Syntology: 1 sample, 0 ran · 1 unverified report
fciannel/bert_fciannel mentioned on GitHubtfApache-2.0Syntology: not harvested report
flxst/nerblackbox mentioned on GitHubApache-2.0Syntology: not harvested report
flyliu2017/bert mentioned on GitHubtfApache-2.0Syntology: 8 samples, 4 ran (0 instrument-failed) · 4 unverified report
flyliu2017/bert_modularized mentioned on GitHubtfApache-2.0Syntology: not harvested report
frankcgq105/BERTCHEN mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
g-eklund/bert_tutorial mentioned on GitHubApache-2.0Syntology: not harvested report
ganeshjawahar/interpret_bert mentioned on GitHubpytorchSyntology: 6 samples, 1 ran (0 instrument-failed) · 5 unverified report
gbcolborne/lang_id mentioned on GitHubpytorchSyntology: 5 samples, 4 ran (2 instrument-failed) · 1 unverified report
gcunhase/embracebert mentioned on GitHubpytorchMITSyntology: not harvested report
geondopark/ckd mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Distilling Linguistic Context for Language Model Compression (arXiv:2109.08359; that paper's own run record: 8 ran (of which 0 constructed an object rather than computing a result; 7 with no instrument failure: 0 honoured, 0 violated, 7 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
gggggeun/DeepLearning_Architecture mentioned on GitHubpytorchSyntology: not harvested report
glassroom/heinsen_routing mentioned on GitHubpytorchMITSyntology: not harvested report
goldenbili/Bert_Test2 mentioned on GitHubtfSyntology: 2 samples, 1 ran (1 instrument-failed) · 1 unverified report
goldenbili/Bert_Test3 mentioned on GitHubtfApache-2.0Syntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
goldenbili/bert_lamb_pretrain mentioned on GitHubtfApache-2.0Syntology: not harvested report
goodluck4s/bert- mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
google-deepmind/xquad mentioned on GitHubSyntology: not harvested report
google-research/bigbird mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
google/seqio mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Scaling Up Models and Data with t5x and seqio (arXiv:2203.17189; that paper's own run record: 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified); nothing checks that they implement this paper's method. report
gouwenrui/cpe-pro-main mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
graykode/nlp-tutorial mentioned on GitHubpytorchSyntology: 7 samples, 1 ran (0 instrument-failed) · 6 unverified report
guoyaohua/BERT-Chinese-Annotation mentioned on GitHubtfApache-2.0Syntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
guoyaohua/BERT-Classifier mentioned on GitHubtfSyntology: 3 samples, 0 ran · 3 unverified report
guzhang480/Google_BERT mentioned on GitHubtfApache-2.0Syntology: not harvested report
h4ste/oscar mentioned on GitHubtfSyntology: 11 samples, 4 ran (3 instrument-failed) · 7 unverified report
habibullah-araphat/BERT-GPU mentioned on GitHubtfSyntology: not harvested report
habibullah-araphat/BERT-NER-TPU mentioned on GitHubtfSyntology: not harvested report
haidershaour/bert mentioned on GitHubtfSyntology: 10 samples, 1 ran (1 instrument-failed) · 9 unverified report
halo090770/bert mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Well-Read Students Learn Better: On the Importance of Pre-training Compact Models (arXiv:1908.08962; that paper's own run record: 21 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 1 honoured, 0 violated, 14 with no contract checked; 6 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
han-shi/SparseBERT mentioned on GitHubpytorchSyntology: 5 samples, 0 ran · 5 unverified report
harenlin/IMDB-Sentiment-Analysis-Using-BERT-Fine-Tuning mentioned on GitHubtfSyntology: not harvested report
hate-alert/indicabusive mentioned on GitHubpytorchSyntology: not harvested report
haydlite/sparse-bert-ner mentioned on GitHubtfMITSyntology: 10 samples, 1 ran (0 instrument-failed) · 9 unverified report
hegebharat/SelfDiscovery mentioned on GitHubpytorchSyntology: not harvested report
hegebharat/sentiment-Analysis-for-German-Datasets mentioned on GitHubpytorchSyntology: not harvested report
helboukkouri/character-bert mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Deep contextualized word representations (arXiv:1802.05365; that paper's own run record: 30 ran (of which 12 constructed an object rather than computing a result; 24 with no instrument failure: 2 honoured, 0 violated, 22 with no contract checked; 6 where Syntology's instrument failed) · 28 unverified); nothing checks that they implement this paper's method. report
heraclex12/vietpunc mentioned on GitHubjaxSyntology: 1 sample, 0 ran · 1 unverified report
hoangtrungchinh/Bert-SQuAD-v2 mentioned on GitHubtfApache-2.0Syntology: not harvested report
hoichunlaw/COVID-BERT mentioned on GitHubSyntology: not harvested report
huanghonggit/Mask-Language-Model mentioned on GitHubpytorchSyntology: 8 samples, 6 ran (0 instrument-failed) · 2 unverified report
huggingface/transformers mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Attention Is All You Need (arXiv:1706.03762; that paper's own run record: 610 ran (of which 293 constructed an object rather than computing a result; 529 with no instrument failure: 45 honoured, 15 violated, 469 with no contract checked; 81 where Syntology's instrument failed) · 336 unverified), HuggingFace's Transformers: State-of-the-art Natural Language Processing (arXiv:1910.03771; that paper's own run record: 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified), DeBERTa: Decoding-enhanced BERT with Disentangled Attention (arXiv:2006.03654; that paper's own run record: 4 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 2 honoured, 1 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 9 unverified) and 1 more (every one in this page's JSON twin); nothing checks that they implement this paper's method. report
icewing1996/bert_dep mentioned on GitHubtfApache-2.0Syntology: 6 samples, 3 ran (1 instrument-failed) · 3 unverified report
idiotprofessorchen/bert.github.io mentioned on GitHubtfApache-2.0Syntology: not harvested report
ilhamfp/indonesian-text-classification-multilingual mentioned on GitHubpytorchSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
imgarylai/bert-embedding mentioned on GitHubmxnetApache-2.0Syntology: not harvested report
itsShnik/adaptively-finetuning-transformers mentioned on GitHubpytorchSyntology: 3 samples, 1 ran (0 instrument-failed) · 2 unverified report
jageshmaharjan/BERT_Service mentioned on GitHubtfSyntology: 4 samples, 1 ran (1 instrument-failed) · 3 unverified report
jangjoongkeon/JK mentioned on GitHubnot reachable when probed 2026-09-18 — repositories for recent papers often appear after camera-readySyntology: not harvested report
jinzhenfan/BERT mentioned on GitHubtfApache-2.0Syntology: not harvested report
jiyuan/ainote mentioned on GitHubtfnot reachable when probed 2026-09-18 — repositories for recent papers often appear after camera-readySyntology: not harvested report
johnr0/TaleBrush-backend mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to GeDi: Generative Discriminator Guided Sequence Generation (arXiv:2009.06367; that paper's own run record: 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified); nothing checks that they implement this paper's method. report
joongbo/tta mentioned on GitHubtfSyntology: 2 samples, 0 ran · 2 unverified report
joytianya/google_bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
jsantoso2/yelp-clone-ml-project mentioned on GitHubpytorchApache-2.0Syntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
jungomi/swiss-language-model mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
junhahyung/bert_finetune mentioned on GitHubtfApache-2.0Syntology: 1 sample, 0 ran · 1 unverified report
junhahyung/bert_transfer mentioned on GitHubtfApache-2.0Syntology: not harvested report
karenacorn99/explore-bert mentioned on GitHubtfSyntology: not harvested report
karta282950/bert-multiclass mentioned on GitHubtfApache-2.0Syntology: not harvested report
kaushaltrivedi/fast-bert mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
keiyamashita111/aaproject mentioned on GitHubtfApache-2.0Syntology: 1 sample, 0 ran · 1 unverified report
kelly2016/multi-label-bert mentioned on GitHubtfApache-2.0Syntology: 1 sample, 0 ran · 1 unverified report
khalidsaifullaah/bertify mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
kiko441500/google_bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
kingcheng2000/bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
kingcong/gpu_albert mentioned on GitHubmindsporenot reachable when probed 2026-09-18 — repositories for recent papers often appear after camera-readySyntology: not harvested report
kinimod23/NMT_Project mentioned on GitHubSyntology: not harvested report
knuddj1/op_text mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter (arXiv:1910.01108; that paper's own run record: 21 ran (of which 5 constructed an object rather than computing a result; 12 with no instrument failure: 3 honoured, 1 violated, 8 with no contract checked; 9 where Syntology's instrument failed) · 6 unverified); nothing checks that they implement this paper's method. report
knuddy/op_text mentioned on GitHubpytorchMITSyntology: not harvested report
kobowon/cs470_project_version2 mentioned on GitHubpytorchSyntology: not harvested report
kpe/bert-for-tf2 mentioned on GitHubtfMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to ALBERT: A Lite BERT for Self-supervised Learning of Language Representations (arXiv:1909.11942; that paper's own run record: 81 ran (of which 17 constructed an object rather than computing a result; 56 with no instrument failure: 4 honoured, 0 violated, 52 with no contract checked; 25 where Syntology's instrument failed) · 45 unverified); nothing checks that they implement this paper's method. report
kpot/keras-transformer mentioned on GitHubtfSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
krantirk/BERT-Pretrained-model mentioned on GitHubtfApache-2.0Syntology: not harvested report
kriesbeck/masked-language-prediction mentioned on GitHubSyntology: not harvested report
kyubyong/bert_ner mentioned on GitHubpytorchSyntology: not harvested report
kyzhouhzau/BERT-NER mentioned on GitHubtfMITSyntology: 1 sample, 0 ran · 1 unverified report
lcs2-iiitd/emotion-flip-reasoning mentioned on GitHubpytorchSyntology: not harvested report
lehoanganh298/BERT-Question-Answering mentioned on GitHubtfApache-2.0Syntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
lemonhu/ner-bert-pytorch mentioned on GitHubpytorchMITSyntology: 6 samples, 6 ran (0 instrument-failed) · 0 unverified report
lennonzurich/lalala mentioned on GitHubtfApache-2.0Syntology: not harvested report
linlei1214/SITS-BERT mentioned on GitHubpytorchSyntology: 6 samples, 2 ran (0 instrument-failed) · 4 unverified report
liuqiangict/lamb_optimizer mentioned on GitHubtfApache-2.0Syntology: not harvested report
lkfo415579/MT-Readling-List mentioned on GitHubtfSyntology: not harvested report
llx666/git_demo mentioned on GitHubtfApache-2.0Syntology: not harvested report
lonePatient/BERT-chinese-text-classification-pytorch mentioned on GitHubpytorchSyntology: not harvested report
lonePatient/Bert-Multi-Label-Text-Classification mentioned on GitHubpytorchMITSyntology: 5 samples, 5 ran (2 instrument-failed) · 0 unverified report
lonePatient/ERNIE-text-classification-pytorch mentioned on GitHubpytorchSyntology: 17 samples, 6 ran (4 instrument-failed) · 11 unverified report
lonePatient/bert-sentence-similarity-pytorch mentioned on GitHubpytorchSyntology: not harvested report
longbowking/bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
louis-udm/ner-bert-crf mentioned on GitHubpytorchMITSyntology: 2 samples, 2 ran (0 instrument-failed) · 0 unverified report
lovedavidsilva/bert_old_version mentioned on GitHubtfApache-2.0Syntology: not harvested report
ltgoslo/assessing_and_probing_sentiment mentioned on GitHubSyntology: not harvested report
luckynozomi/PPI_Bert mentioned on GitHubtfSyntology: not harvested report
lukemelas/PyTorch-Pretrained-ViT mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Attention Is All You Need (arXiv:1706.03762; that paper's own run record: 610 ran (of which 293 constructed an object rather than computing a result; 529 with no instrument failure: 45 honoured, 15 violated, 469 with no contract checked; 81 where Syntology's instrument failed) · 336 unverified) and An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale (arXiv:2010.11929; that paper's own run record: 307 ran (of which 165 constructed an object rather than computing a result; 286 with no instrument failure: 8 honoured, 2 violated, 276 with no contract checked; 21 where Syntology's instrument failed) · 112 unverified); nothing checks that they implement this paper's method. report
luozhilin99/bert mentioned on GitHubmindsporeSyntology: not harvested report
lvyufeng/mindspore-nlp-tutorial mentioned on GitHubmindsporeMITSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
lyccol/CodeBERT-based-webshell-detection mentioned on GitHubpytorchSyntology: not harvested report
madhawav/MML mentioned on GitHubpytorchSyntology: not harvested report
maknotavailable/pytorch-pretrained-bert mentioned on GitHubpytorchSyntology: 12 samples, 6 ran (1 instrument-failed) · 6 unverified report
manideep2510/siamese-BERT-fake-news-detection-LIAR mentioned on GitHubpytorchSyntology: not harvested report
maxudong1993/mybert mentioned on GitHubtfSyntology: not harvested report
mayurnewase/Quora-Bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
meelfy/pytorch_pretrained_bert mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
meizi1114/bert mentioned on GitHubtfApache-2.0Syntology: 3 samples, 1 ran (0 instrument-failed) · 2 unverified report
mhaseeb123/DeepMSim mentioned on GitHubtfGPL-3.0Syntology: not harvested report
mindspore-courses/ABSA-MindSpore mentioned on GitHubmindsporenot reachable when probed 2026-09-17 — repositories for recent papers often appear after camera-readySyntology: not harvested report
mirbostani/QA-KD-AL mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
mithunpaul08/bert_tensorflow mentioned on GitHubtfApache-2.0Syntology: 4 samples, 2 ran (0 instrument-failed) · 2 unverified report
mkavim/finetune_bert mentioned on GitHubtfSyntology: 7 samples, 4 ran (2 instrument-failed) · 3 unverified report
mocherson/aki_bert mentioned on GitHubpytorchSyntology: 3 samples, 2 ran (2 instrument-failed) · 1 unverified report
mohamedateya/bert-fine-tuning-sentence-classification-for-cola mentioned on GitHubSyntology: not harvested report
mtzcorporations/nlp_teamjodka mentioned on GitHubpytorchSyntology: not harvested report
musixmatchresearch/umberto mentioned on GitHubpytorchMITSyntology: not harvested report
myamamoto555/tf-bert mentioned on GitHubtfSyntology: not harvested report
nachiketaa/BERT-pytorch mentioned on GitHubpytorchApache-2.0Syntology: not harvested report
nachiketaa/bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
nageshsinghc4/deepwrap mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
nalbarr/coursera-ai4med-course3 mentioned on GitHubMITSyntology: not harvested report
nerdimite/bert-finetuning-webinar mentioned on GitHubpytorchSyntology: not harvested report
nicholasbao/nlp_job mentioned on GitHubtfApache-2.0Syntology: 2 samples, 1 ran (1 instrument-failed) · 1 unverified report
nicolashernandez/readi-lrec22 mentioned on GitHubSyntology: not harvested report
nmfisher/bert-modified mentioned on GitHubtfApache-2.0Syntology: 3 samples, 2 ran (0 instrument-failed) · 1 unverified report
noelkelias/multitok mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
noise-learning/selfmix mentioned on GitHubpytorchSyntology: 2 samples, 0 ran · 2 unverified report
octanove/grammartagger mentioned on GitHubpytorchApache-2.0Syntology: not harvested report
okanvk/ENELPI---Soru-Cevap-Sistemi mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators (arXiv:2003.10555; that paper's own run record: 31 ran (of which 7 constructed an object rather than computing a result; 18 with no instrument failure: 2 honoured, 2 violated, 14 with no contract checked; 13 where Syntology's instrument failed) · 9 unverified); nothing checks that they implement this paper's method. report
okanvk/Turkish-Reading-Comprehension-Question-Answering-Dataset mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
om00839/machine-suneung mentioned on GitHubpytorchSyntology: not harvested report
overfitter/biobert_embedding mentioned on GitHubtfMITSyntology: 2 samples, 0 ran · 2 unverified report
owainwest/uniprot_bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
paolanu/BERT_epitope mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Well-Read Students Learn Better: On the Importance of Pre-training Compact Models (arXiv:1908.08962; that paper's own run record: 21 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 1 honoured, 0 violated, 14 with no contract checked; 6 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
pengming617/bert_classification mentioned on GitHubtfSyntology: not harvested report
pengshuyuan/Bert mentioned on GitHubtfSyntology: 8 samples, 2 ran (1 instrument-failed) · 6 unverified report
pfecht/bert-exploration mentioned on GitHubpytorchSyntology: not harvested report
phohenecker/pytorch-transformer mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
piegu/language-models mentioned on GitHubpytorchSyntology: not harvested report
pingheng001/Cnn-Bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
pisalore/roberta_results mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to RoBERTa: A Robustly Optimized BERT Pretraining Approach (arXiv:1907.11692; that paper's own run record: 37 ran (of which 11 constructed an object rather than computing a result; 36 with no instrument failure: 2 honoured, 0 violated, 34 with no contract checked; 1 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
polzinben/TensorFlow_NLP mentioned on GitHubtfMITSyntology: not harvested report
ps2811/Bert-Multi-Label-Text-Classification-GitVersion mentioned on GitHubpytorchMITSyntology: not harvested report
pytorch/text mentioned on GitHubpytorchSyntology: 3 samples, 2 ran (0 instrument-failed) · 1 unverified report
qbxlvnf11/BERT mentioned on GitHubpytorchMITSyntology: not harvested report
qbxlvnf11/contextualized-embedding-BERT mentioned on GitHubpytorchMITSyntology: not harvested report
qbxlvnf11/pretrained-language-model-BERT mentioned on GitHubpytorchMITSyntology: not harvested report
qywu/Chinese-GPT mentioned on GitHubpytorchSyntology: 8 samples, 2 ran (0 instrument-failed) · 6 unverified report
rajlm10/Chandler mentioned on GitHubtfSyntology: 5 samples, 5 ran (0 instrument-failed) · 0 unverified report
rasta-nitzsche/Bert-For-Algerian-Dialect-DariBERTo mentioned on GitHubSyntology: not harvested report
re-search/DocProduct mentioned on GitHubtfSyntology: 4 samples, 3 ran (0 instrument-failed) · 1 unverified report
reppy4620/Dialog mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Attention Is All You Need (arXiv:1706.03762; that paper's own run record: 610 ran (of which 293 constructed an object rather than computing a result; 529 with no instrument failure: 45 honoured, 15 violated, 469 with no contract checked; 81 where Syntology's instrument failed) · 336 unverified); nothing checks that they implement this paper's method. report
ricardordb/bert mentioned on GitHubtfSyntology: 5 samples, 1 ran (1 instrument-failed) · 4 unverified report
rickyHong/Google-BERT-repl mentioned on GitHubtfApache-2.0Syntology: not harvested report
rohan400/PepperQA mentioned on GitHubtfApache-2.0Syntology: not harvested report
rohanshad/cmr_transformer mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Multiscale Vision Transformers (arXiv:2104.11227; that paper's own run record: 13 ran (of which 10 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 2 where Syntology's instrument failed) · 13 unverified); nothing checks that they implement this paper's method. report
roshaan7zafar/-MAX-Text-Sentiment-Classifier mentioned on GitHubtfApache-2.0Syntology: not harvested report
rpuiggari/bert2 mentioned on GitHubtfApache-2.0Syntology: not harvested report
sagorbrur/bangla-bert mentioned on GitHubtfMITSyntology: not harvested report
sagorbrur/codeswitch mentioned on GitHubpytorchMITSyntology: not harvested report
sajjjadayobi/ParsBigBird mentioned on GitHubAGPL-3.0Syntology: not harvested report
salesforce/GeDi mentioned on GitHubpytorchBSD-3-ClauseSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to GeDi: Generative Discriminator Guided Sequence Generation (arXiv:2009.06367; that paper's own run record: 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified); nothing checks that they implement this paper's method. report
samirsahoo007/Audio-and-Speech-Processing mentioned on GitHubpytorchMITSyntology: 2 samples, 2 ran (1 instrument-failed) · 0 unverified report
samwisegamjeee/pytorch-transformers mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to XLNet: Generalized Autoregressive Pretraining for Language Understanding (arXiv:1906.08237; that paper's own run record: 15 ran (of which 2 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified); nothing checks that they implement this paper's method. report
saravanakumarjsk/BERT-collection mentioned on GitHubpytorchSyntology: not harvested report
saurabhkulkarni77/BERT_multilabel mentioned on GitHubtfApache-2.0Syntology: not harvested report
saurabhnlp/bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
sberbank-ai/ner-bert mentioned on GitHubpytorchMITSyntology: 13 samples, 12 ran (1 instrument-failed) · 1 unverified report
scotthlee/injury_autocoding mentioned on GitHubtfApache-2.0Syntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
scut-bds/example_repo_from_scutbds mentioned on GitHubpytorchSyntology: 6 samples, 3 ran (0 instrument-failed) · 3 unverified report
semal/bert mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
shaikhzhas/bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
sherinaseri/bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
shreyashankar/gpt3-sandbox mentioned on GitHubMITSyntology: not harvested report
siramatu/brigade-visualizer mentioned on GitHubtfMITSyntology: not harvested report
skoltech-nlp/rudetoxifier mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
smarton-empower/smarton-ai mentioned on GitHubSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to New Interaction Paradigm for Complex EDA Software Leveraging GPT (arXiv:2307.14740; that paper's own run record: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result); nothing checks that they implement this paper's method. report
socc-io/piqaboo mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
somiltg/bert mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Well-Read Students Learn Better: On the Importance of Pre-training Compact Models (arXiv:1908.08962; that paper's own run record: 21 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 1 honoured, 0 violated, 14 with no contract checked; 6 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
somiltg/xquad mentioned on GitHubSyntology: not harvested report
sonalisrijan/Deep-Learning-based-Defect-Prediction-Model-for-Source-Code mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
soutsios/pos-tagger-bert-tensorflow mentioned on GitHubtfSyntology: not harvested report
stefan-it/europeana-bert mentioned on GitHubtfMITSyntology: not harvested report
stefan-it/historic-ner mentioned on GitHubMITSyntology: not harvested report
sunyilgdx/prompts4keras mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Entailment as Few-Shot Learner (arXiv:2104.14690; that paper's own run record: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified); nothing checks that they implement this paper's method. report
surancy/nlp-classification-with-BERT mentioned on GitHubtfSyntology: not harvested report
svakulenk0/response_eval mentioned on GitHubtfApache-2.0Syntology: 4 samples, 0 ran · 4 unverified report
sydney-machine-learning/sentimentanalysis-uselections mentioned on GitHubMITSyntology: not harvested report
tcnguyen/bert mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
tdd-ai/data-collection mentioned on GitHubSyntology: not harvested report
teghub/TurkishNER-BERT mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
tensorflow/models mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift (arXiv:1502.03167; that paper's own run record: 19 ran (of which 5 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified), Deep Residual Learning for Image Recognition (arXiv:1512.03385; that paper's own run record: 254 ran (of which 108 constructed an object rather than computing a result; 163 with no instrument failure: 3 honoured, 1 violated, 159 with no contract checked; 91 where Syntology's instrument failed) · 123 unverified), Wide Residual Networks (arXiv:1605.07146; that paper's own run record: 66 ran (of which 31 constructed an object rather than computing a result; 47 with no instrument failure: 0 honoured, 0 violated, 47 with no contract checked; 19 where Syntology's instrument failed) · 30 unverified) and 1 more (every one in this page's JSON twin); nothing checks that they implement this paper's method. report
thanhlong1997/bert_quora mentioned on GitHubtfApache-2.0Syntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
the-Quert/iNLPfun mentioned on GitHubtfApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Well-Read Students Learn Better: On the Importance of Pre-training Compact Models (arXiv:1908.08962; that paper's own run record: 21 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 1 honoured, 0 violated, 14 with no contract checked; 6 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
theQuert/inlpfun mentioned on GitHubtfApache-2.0Syntology: not harvested report
thecodemasterk/BERT mentioned on GitHubtfSyntology: not harvested report
theneuralbeing/bert-finetuning-webinar mentioned on GitHubpytorchSyntology: not harvested report
thethirdwheel/malumagraph mentioned on GitHubSyntology: not harvested report
thu-keg/omnievent mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to ACL Anthology id 2023.findings-acl.586 (that paper's own run record: 7 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 2 where Syntology's instrument failed) · 6 unverified); nothing checks that they implement this paper's method. report
thunlp/ReInfoSelect mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
tmalbonph/tcbert mentioned on GitHubtfApache-2.0Syntology: not harvested report
tobyatgithub/bert_tutorial mentioned on GitHubpytorchSyntology: not harvested report
tornermarton/bert-keras mentioned on GitHubtfSyntology: not harvested report
tree-park/bert-pretrainer mentioned on GitHubpytorchSyntology: not harvested report
tugstugi/mongolian-bert mentioned on GitHubtfSyntology: 1 sample, 1 ran (1 instrument-failed) · 0 unverified report
tvinith/bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
tyxr/bert mentioned on GitHubtfApache-2.0Syntology: 3 samples, 2 ran (0 instrument-failed) · 1 unverified report
uabinf/nlp-fall-2019-project-shuhui_shuqu mentioned on GitHubtfSyntology: not harvested report
ufal/wembedding_service mentioned on GitHubtfMPL-2.0Syntology: not harvested report
utterworks/fast-bert mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to XLNet: Generalized Autoregressive Pretraining for Language Understanding (arXiv:1906.08237; that paper's own run record: 15 ran (of which 2 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified); nothing checks that they implement this paper's method. report
uva-dsa/ems-pipeline mentioned on GitHubtfSyntology: not harvested report
uygarkurt/BERT-PyTorch mentioned on GitHubpytorchSyntology: 2 samples, 2 ran (0 instrument-failed) · 0 unverified report
vanpersie32/Multigpu-Bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
vanslerry/long_text mentioned on GitHubtfApache-2.0Syntology: not harvested report
venkyr91193/Sentiment-Analysis-with-BERT mentioned on GitHubpytorchSyntology: not harvested report
venkyr91193/Sentiment_Analysis_with_BERT mentioned on GitHubpytorchSyntology: not harvested report
vijay120/bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
viniciusoliveirasd/bert-applications mentioned on GitHubtfSyntology: not harvested report
volcengine/vegiantmodel mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Language Models are Few-Shot Learners (arXiv:2005.14165; that paper's own run record: 45 ran (of which 0 constructed an object rather than computing a result; 37 with no instrument failure: 3 honoured, 2 violated, 32 with no contract checked; 8 where Syntology's instrument failed) · 20 unverified); nothing checks that they implement this paper's method. report
wangcongcong123/ttt mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer (arXiv:1910.10683; that paper's own run record: 21 ran (of which 0 constructed an object rather than computing a result; 20 with no instrument failure: 1 honoured, 0 violated, 19 with no contract checked; 1 where Syntology's instrument failed) · 10 unverified); nothing checks that they implement this paper's method. report
wayalhruhi/gogle_bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
wchh127/yykf mentioned on GitHubtfSyntology: 3 samples, 0 ran · 3 unverified report
weidafeng/NLU2019 mentioned on GitHubpytorchSyntology: not harvested report
wenhuchen/HDSA-Dialog mentioned on GitHubpytorchSyntology: 5 samples, 3 ran (0 instrument-failed) · 2 unverified report
whqwill/seq2seq-keyphrase-bert mentioned on GitHubpytorchSyntology: not harvested report
why2000/DuReader-bert mentioned on GitHubtfSyntology: not harvested report
writerai/fitbert mentioned on GitHubpytorchApache-2.0Syntology: not harvested report
wyf-python/Bert-Pytorch-TextClassification mentioned on GitHubpytorchSyntology: 5 samples, 1 ran (0 instrument-failed) · 4 unverified report
wzzzd/LM_NER mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
wzzzd/Pretrain_Bert_with_MaskLM mentioned on GitHubpytorchSyntology: not harvested report
xbtlin/All-about-Machine-Learning mentioned on GitHubtfMITSyntology: not harvested report
xesdiny/test-bert-master mentioned on GitHubtfApache-2.0Syntology: not harvested report
xiangyue9607/CliniRC mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
xiaopingzhong/bert-finetune-for-classfier mentioned on GitHubtfApache-2.0Syntology: not harvested report
xiaopp123/bert_explain mentioned on GitHubtfApache-2.0Syntology: not harvested report
xitianxiaofeixue/BERT mentioned on GitHubtfApache-2.0Syntology: not harvested report
xuzhezhaozhao/bert_reading mentioned on GitHubtfApache-2.0Syntology: not harvested report
yangyucheng000/ascend_albert mentioned on GitHubmindsporeApache-2.0Syntology: 5 samples, 5 ran (0 instrument-failed) · 0 unverified report
yangyucheng000/bert_Ascend mentioned on GitHubmindsporeApache-2.0Syntology: not harvested report
yanzhitech/bert mentioned on GitHubSyntology: not harvested report
yifding/hetseq mentioned on GitHubpytorchSyntology: 13 samples, 8 ran (4 instrument-failed) · 5 unverified report
yiyc-kor/bert-study mentioned on GitHubtfApache-2.0Syntology: not harvested report
ymcui/LAMB_Optimizer_TF mentioned on GitHubtfApache-2.0Syntology: not harvested report
ypeleg/MinimalIsAllYouNeed mentioned on GitHubSyntology: not harvested report
yuelinan/c3vg mentioned on GitHubpytorchSyntology: not harvested report
yuhangT/tf_bert mentioned on GitHubtfApache-2.0Syntology: not harvested report
yydai/bert_test mentioned on GitHubtfSyntology: 1 sample, 0 ran · 1 unverified report
zaaztt/bert_chinese_example mentioned on GitHubtfSyntology: not harvested report
zapplea/bert mentioned on GitHubtfApache-2.0Syntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
zaradana/Fast_BERT mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to XLNet: Generalized Autoregressive Pretraining for Language Understanding (arXiv:1906.08237; that paper's own run record: 15 ran (of which 2 constructed an object rather than computing a result; 10 with no instrument failure: 2 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified) and RoBERTa: A Robustly Optimized BERT Pretraining Approach (arXiv:1907.11692; that paper's own run record: 37 ran (of which 11 constructed an object rather than computing a result; 36 with no instrument failure: 2 honoured, 0 violated, 34 with no contract checked; 1 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
zhang-huihui/git-repository mentioned on GitHubtfApache-2.0Syntology: not harvested report
zhengcj1/ChID-Dataset mentioned on GitHubtfApache-2.0Syntology: not harvested report
zsweet/BERT_zsw mentioned on GitHubtfSyntology: 5 samples, 0 ran · 5 unverified report
2023-MindSpore-1/ms-code-150 mindsporeSyntology: not harvested report
2023-MindSpore-4/Code12 mindsporeSyntology: not harvested report
2024-MindSpore-1/Code3 mindsporeSyntology: not harvested report
MS-Mind/MS-Code-01 mindsporeSyntology: not harvested report
MS-P3/code5 mindsporeApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Instruct-MusicGen: Unlocking Text-to-Music Editing for Music Language Models via... (arXiv:2405.18386; that paper's own run record: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
Mind23-2/MindCode-133 mindsporeSyntology: not harvested report
Mind23-2/MindCode-144 mindsporeSyntology: not harvested report
MindSpore-paper-code-3/code9 mindsporeSyntology: not harvested report
MindSpore-scientific/code-7 Syntology: not harvested report
PaddlePaddle/PaddleNLP paddleApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to ERNIE 3.0 Tiny: Frustratingly Simple Method to Improve Task-Agnostic Distillation... (arXiv:2301.03416; that paper's own run record: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
abhaskumarsinha/Keras-implementation-of-Transformer-Architecture tfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Attention Is All You Need (arXiv:1706.03762; that paper's own run record: 610 ran (of which 293 constructed an object rather than computing a result; 529 with no instrument failure: 45 honoured, 15 violated, 469 with no contract checked; 81 where Syntology's instrument failed) · 336 unverified); nothing checks that they implement this paper's method. report
abhilash1910/BERTSimilarity pytorchNOASSERTIONSyntology: not harvested report
alibaba/EasyNLP jaxApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Learning Knowledge-Enhanced Contextual Language Representations for Domain Natural... (arXiv:2311.06761; that paper's own run record: 9 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 2 violated, 3 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
chambliss/Multilingual_NER pytorchSyntology: not harvested report
dmlc/gluon-nlp mxnetApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to GluonCV and GluonNLP: Deep Learning in Computer Vision and Natural Language Processing (arXiv:1907.04433; that paper's own run record: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
kamalkraj/BERT-SQuAD pytorchAGPL-3.0Syntology: not harvested report
kamalkraj/BERT_NER pytorchAGPL-3.0Syntology: not harvested report
labmlai/annotated_deep_learning_paper_implementations pytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Playing Atari with Deep Reinforcement Learning (arXiv:1312.5602; that paper's own run record: 64 ran (of which 24 constructed an object rather than computing a result; 46 with no instrument failure: 5 honoured, 0 violated, 41 with no contract checked; 18 where Syntology's instrument failed) · 53 unverified), Adam: A Method for Stochastic Optimization (arXiv:1412.6980; that paper's own run record: 27 ran (of which 7 constructed an object rather than computing a result; 23 with no instrument failure: 4 honoured, 2 violated, 17 with no contract checked; 4 where Syntology's instrument failed) · 10 unverified), Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift (arXiv:1502.03167; that paper's own run record: 19 ran (of which 5 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified) and 12 more (every one in this page's JSON twin); nothing checks that they implement this paper's method. report
lvyufeng/Cybertron mindsporeApache-2.0Syntology: 4 samples, 2 ran (0 instrument-failed) · 2 unverified report
lvyufeng/bert4ms mindsporeApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to RoBERTa: A Robustly Optimized BERT Pretraining Approach (arXiv:1907.11692; that paper's own run record: 37 ran (of which 11 constructed an object rather than computing a result; 36 with no instrument failure: 2 honoured, 0 violated, 34 with no contract checked; 1 where Syntology's instrument failed) · 11 unverified); nothing checks that they implement this paper's method. report
mindspore-ai/models mindsporeSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to AdaBin: Improving Binary Neural Networks with Adaptive Binary Sets (arXiv:2208.08084; that paper's own run record: 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
mindspore-ai/models mindsporeSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to AdaBin: Improving Binary Neural Networks with Adaptive Binary Sets (arXiv:2208.08084; that paper's own run record: 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
mindspore-lab/mindnlp mindsporeSyntology: not harvested report
vmware-labs/bert-pretraining pytorchSyntology: 1 sample, 0 ran · 1 unverified report
xiuyu0000/new_papers_codes mindsporeSyntology: not harvested report
xiuyu0000/tutorials mindsporeApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to YOLOv4: Optimal Speed and Accuracy of Object Detection (arXiv:2004.10934; that paper's own run record: 142 ran (of which 0 constructed an object rather than computing a result; 128 with no instrument failure: 8 honoured, 0 violated, 120 with no contract checked; 14 where Syntology's instrument failed) · 42 unverified); nothing checks that they implement this paper's method. report
yangyucheng000/bert_GPU mindsporeApache-2.0Syntology: not harvested report
yoshitomo-matsubara/torchdistill pytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Distilling the Knowledge in a Neural Network (arXiv:1503.02531; that paper's own run record: 23 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 6 honoured, 0 violated, 8 with no contract checked; 9 where Syntology's instrument failed) · 14 unverified), Deep Residual Learning for Image Recognition (arXiv:1512.03385; that paper's own run record: 254 ran (of which 108 constructed an object rather than computing a result; 163 with no instrument failure: 3 honoured, 1 violated, 159 with no contract checked; 91 where Syntology's instrument failed) · 123 unverified), Wide Residual Networks (arXiv:1605.07146; that paper's own run record: 66 ran (of which 31 constructed an object rather than computing a result; 47 with no instrument failure: 0 honoured, 0 violated, 47 with no contract checked; 19 where Syntology's instrument failed) · 30 unverified) and 3 more (every one in this page's JSON twin); nothing checks that they implement this paper's method. report
zer0sh0t/artificial_intelligence pytorchSyntology: not harvested report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

659 samples harvested: 300 ran (of which 75 constructed an object rather than computing a result; 234 with no instrument failure: 18 honoured, 5 violated, 211 with no contract checked; 66 where Syntology's instrument failed) · 359 unverified. “Where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. That date is not when the samples ran.

18ran · honoured contract
5ran · violated contract
54ran · our draft was wrong
12ran; the contract check could not run
211ran
359unverified

Licence: 164 of the 659 samples are pointer only, meaning Syntology does not serve that copy's text. For 15 of them, this paper's copy is under a permissive licence and cleared, but the stored copy of the same code that Syntology serves is not; the licence label's tooltip gives Syntology's recorded reason. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 170 repositories linked to this paper, official or community; the list below is grouped by repository, each group headed by its name and what it is to the paper. 2 samples whose link to this paper records no repository are listed under one of this paper's own repositories, because identical code was harvested from it for another paper. 4 samples are listed last, in a group without a repository. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. A line beginning “fixture:” under a sample that ran gives the arguments Syntology's fixture called the sample with, each as name:type/rank/element kind (? where none was recorded), and the type of what the fixture's run returned, exactly as the harness recorded them; the arguments and the returned type were recorded by two separate runs of the same fixture. No output value is shown, and a returned type says nothing about whether the output was right. “Level recorded” gives the UTC date when Syntology's graph wrote the sample's verification level, not when the code executed; where the level was written before Syntology's graph kept that date, the row says “level recorded, date not recorded”. For 24 samples that ran, the graph records a signature this page does not show: for a class the fixture built without calling, the harness called the object with inputs it made up itself, so the recorded signature is the harness's probe, not the fixture's arguments. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself. “Our draft was wrong” and “the contract check could not run” are failures of Syntology's instrument, not of the code: the sample ran on Syntology's synthesized input, and then the drafted contract did not describe it, or the check itself raised an error (RAISES), lacked a dependency (DEP_MISSING) or ran out of time (TIMEOUT); hover the label for which. A metamorphic tier, where shown, is evidence of the output's shape, not that the sample implements the method.

Each sample ends with its code_sha256. A sample's code_sha256 is Syntology's identity for that exact code. It is printed in full (16 hexadecimal characters for every sample in this build), and get_code(code_sha256="…") takes it exactly as printed. An agent calls it on Syntology's MCP service (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples are grouped by repository: a repository marked official first, then by how directly the repository is tied to the paper, then in the archive's order; never by how many ran. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of six reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar); this paper's copy was not located, so its licence is not recorded; or this paper's copy is cleared, but the stored copy of the same code that Syntology serves is not. Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

A function or class name links to its page when the name occurs in the harvested code of at least 5 papers; the name is a string, not an identity. A census tag appears when Syntology's census ran implementations with that name on one shared input per bucket: it gives how many were compared, from how many papers, and how many distinct outputs they produced, and names this sample's bucket when this sample was one of them.

1wy/bert community (archive-listed) 8 samples, 6 ran (2 instrument-failed) · 2 unverified
convert_to_unicode in 40 papers tokenization.py ran · our draft was wrong fingerprinted Apache-2.0 (permissive) here; the stored copy is pointer only · 1923fc05163d207d · report fixture: signature text:str/0/str · returned str · level recorded 2026-09-22
create_float_feature in 11 papers create_pretraining_data.py ran Apache-2.0 (permissive) · b24b3b9c700da839 · report fixture: signature values:list/1/float · returned Feature · level recorded 2026-09-25
create_int_feature in 14 papers create_pretraining_data.py ran Apache-2.0 (permissive) · dd3ef48a15aec0cd · report fixture: signature values:list/1/int · returned Feature · level recorded 2026-09-25
input_fn_builder in 13 papers extract_features.py ran Apache-2.0 (permissive) · 47a3c792cebb6603 · report fixture: signature features:list/1/Feature, seq_length:int/0/int · returned function · level recorded 2026-09-25
printable_text in 36 papers tokenization.py ran · our draft was wrong Apache-2.0 (permissive) · 0e5615f8994003cf · report fixture: signature text:str/0/str · returned str · level recorded 2026-09-26
train_valid_test_split divide_data.py ran Apache-2.0 (permissive) · d265475b00a0bd2a · report fixture: signature x_data:ndarray/2/float, y_data:ndarray/1/int, validation_size:float/0/float, test_size:float/0/float, shuffle:bool/0/bool · returned tuple · level recorded 2026-09-26
get_assignment_map_from_checkpoint in 32 papers modeling.py unverified Apache-2.0 (permissive) here; the stored copy is pointer only · 50958618b65e514e · report
load_vocab in 107 papers tokenization.py unverified Apache-2.0 (permissive) · ff83ccc8b0b6462d · report
ABaldrati/MT-BERT community (archive-listed) 6 samples, 4 ran (0 instrument-failed) · 2 unverified
PRModule model.py ran · metamorphic tier: deterministic no licence file found · pointer only · 11c6fa170176d70c · report fixture: returned PRModule · level recorded 2026-09-22
PTSModule model.py ran · metamorphic tier: deterministic no licence file found · pointer only · 946cb85549525f87 · report fixture: returned PTSModule · level recorded 2026-09-22
SSCModule model.py ran · metamorphic tier: deterministic no licence file found · pointer only · 8dc5a87ccb14f5a3 · report fixture: returned SSCModule · level recorded 2026-09-22
Task in 17 papers model.py ran no licence file found · pointer only · 539b7f6e38fc9786 · report fixture: returned int · level recorded 2026-09-24
MT_BERT model.py unverified no licence file found · pointer only · 136b57a707254fc8 · report
PTCModule model.py unverified no licence file found · pointer only · 606c2437121bae8c · report
AtmaHou/MetaDialog community (archive-listed) 2 samples, 0 ran · 2 unverified
BertContextEmbedder models/modules/context_embedder_base.py unverified Apache-2.0 (permissive) · cc62602c7903b248 · report
ContextEmbedderBase models/modules/context_embedder_base.py unverified Apache-2.0 (permissive) · 800be52d2ae3bfbf · report
BinWang28/BERT_Sentence_Embedding community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
generate_embedding SBERT_WK.py ran Apache-2.0 (permissive) · 37763f7651473aeb · report fixture: returned generate_embedding · level recorded 2026-09-22
batcher in 15 papers SBERT_WK.py unverified Apache-2.0 (permissive) · 41ef4758bed26d28 · report
Charliesgithub20221030/BERT community (archive-listed) 1 sample, 0 ran · 1 unverified
file_based_input_fn_builder in 16 papers run_classifier.py unverified Apache-2.0 (permissive) · 1b46c9ce24fc6db3 · report
DeligientSloth/QQsim community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · f7810bd4cfcb3f72 · report
DeligientSloth/bert-tensorflow community (archive-listed) 8 samples, 2 ran (1 instrument-failed) · 6 unverified
gelu in 308 papers
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input
modeling.py ran · honoured contract fingerprinted Apache-2.0 (permissive) · d08f324f950148de · report fixture: signature x:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-22
get_activation in 218 papers modeling.py ran · our draft was wrong Apache-2.0 (permissive) · 5842ee67106321d6 · report fixture: signature activation_string:str/0/str · returned function · level recorded 2026-09-22
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · b84a7e54141c42d4 · report
attention_layer in 9 papers modeling.py unverified Apache-2.0 (permissive) · d16dcfaecf4647ad · report
create_attention_mask_from_input_mask in 8 papers modeling.py unverified Apache-2.0 (permissive) · ecf19688a7eb0d04 · report
embedding_lookup in 9 papers modeling.py unverified Apache-2.0 (permissive) · fe0428bc0b127744 · report
embedding_postprocessor in 7 papers modeling.py unverified Apache-2.0 (permissive) · 9c69503daf39b4c9 · report
transformer_model in 7 papers modeling.py unverified Apache-2.0 (permissive) · e353d671edbdf34f · report
DimasDMM/transformers community (archive-listed) 1 sample, 1 ran (1 instrument-failed) · 0 unverified
get_topk_predictions code/bert_infer.py ran · our draft was wrong no licence file found · pointer only · a3faf4d662ac37da · report fixture: signature model:callable/0/?, tokenizer:callable/0/?, text:str/0/str, topk:int/0/int · returned list · level recorded 2026-09-22
Doffery/BERT-Sentiment-Analysis-Amazon-Review community (archive-listed) 8 samples, 8 ran (0 instrument-failed) · 0 unverified
build_vocab in 36 papers ngram_baseline.py ran Apache-2.0 (permissive) · 5da4c1bd74744fd0 · report fixture: signature all_tokens:list/1/str, max_vocab_size:int/0/int · returned tuple · level recorded 2026-09-26
genSentenceEmbedding computeBERTSentenceEmbedding.py ran Apache-2.0 (permissive) · 280790eecc52aeb7 · report fixture: signature data:dict/0/?, embMode:str/0/str, numLayers:int/0/int · returned tuple · level recorded 2026-09-26
handleNumLayers local_bert.py ran Apache-2.0 (permissive) · 1cd84ed3b71e0fe9 · report fixture: signature numLayers:int/0/int, jsonObject:dict/0/? · returned list · level recorded 2026-09-26
reviewToX fcnn_baseline.py ran fingerprinted Apache-2.0 (permissive) · 084c2d3f750ce4a3 · report fixture: signature review:str/0/str · returned str · level recorded 2026-09-26
reviewToY fcnn_baseline.py ran fingerprinted Apache-2.0 (permissive) · 9acaf439c305b756 · report fixture: signature review:str/0/str · returned list · level recorded 2026-09-26
splitReviewsLabels fcnn_baseline.py ran Apache-2.0 (permissive) · 50bbc8332a5c0e0b · report fixture: signature lines:list/1/str · returned tuple · level recorded 2026-09-26
token2index_dataset ngram_baseline.py ran Apache-2.0 (permissive) · 99722032c6491d59 · report fixture: signature tokens_data:list/1/list, token2id:dict/0/? · returned list · level recorded 2026-09-26
tokens2index ngram_baseline.py ran Apache-2.0 (permissive) · 42584320d6d813de · report fixture: signature tokens:list/1/str, token2id:dict/0/? · returned list · level recorded 2026-09-26
Domminique/Deploy-BERT-for-Sentiment-Analysis-with-FastAPI- community (archive-listed) 1 sample, 0 ran · 1 unverified
SentimentClassifier app/classifier/sentiment_classifier.py unverified MIT (permissive) · c3c638ac738a7ecf · report
EthanWYB/bert-classification community (archive-listed) 2 samples, 0 ran · 2 unverified
file_based_input_fn_builder in 16 papers _run_classifier_gpu_estimator.py unverified Apache-2.0 (permissive) · 05b9987e3ccdec7e · report
get_data in 223 papers _feature_based_classifier.py unverified Apache-2.0 (permissive) · 7c9cfa7d3338fc45 · report
EuphoriaYan/bert_component community (archive-listed) 12 samples, 4 ran (2 instrument-failed) · 8 unverified
BertConfig in 14 papers layers/bert_basic_model.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · 0f2b876d0df17a8b · report fixture: returned BertConfig · level recorded 2026-09-22
BertIntermediate in 15 papers layers/bert_basic_model.py ran · metamorphic tier: deterministic fingerprinted Apache-2.0 (permissive) · fe52ecd17f753018 · report fixture: returned BertIntermediate · level recorded 2026-09-22
cached_path in 47 papers layers/bert_basic_model.py ran · our draft was wrong Apache-2.0 (permissive) · 8a705a46d62ae2db · report fixture: signature url_or_filename:str/0/str, cache_dir:str/0/str · returned str · level recorded 2026-09-22
s3_request layers/bert_basic_model.py ran · our draft was wrong Apache-2.0 (permissive) · dade35e703d97ab9 · report fixture: signature func:callable/0/? · returned function · level recorded 2026-09-22
BertEncoder in 20 papers layers/bert_basic_model.py unverified Apache-2.0 (permissive) · 7bbb022fe9e684b4 · report
BertLayer in 23 papers layers/bert_basic_model.py unverified Apache-2.0 (permissive) · b4ad6a57351fa7ba · report
BertModel in 16 papers layers/bert_basic_model.py unverified Apache-2.0 (permissive) · c499a33e67b2478d · report
PreTrainedBertModel layers/bert_basic_model.py unverified Apache-2.0 (permissive) · f664b844f4d571db · report
get_from_cache layers/bert_basic_model.py unverified Apache-2.0 (permissive) · 8a6cfedeee721825 · report
http_get layers/bert_basic_model.py unverified Apache-2.0 (permissive) · 731026f4755670e0 · report
s3_etag layers/bert_basic_model.py unverified Apache-2.0 (permissive) · 3e02f055b65154da · report
s3_get layers/bert_basic_model.py unverified Apache-2.0 (permissive) · ca62379571db82aa · report
FaskyCC/TextClassification community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
read_tsv in 13 papers data_process/evalute.py ran Apache-2.0 (permissive) · dd8b7fc41b86abb6 · report fixture: signature file:str/0/str · returned list · level recorded 2026-09-26
IBM/MAX-Question-Answering community (archive-listed) 3 samples, 2 ran (0 instrument-failed) · 1 unverified
convert_to_unicode in 40 papers core/tokenization.py ran fingerprinted Apache-2.0 (permissive) · ef47b227c080ca7a · report fixture: signature text:str/0/str · returned str · level recorded 2026-09-26
printable_text in 36 papers core/tokenization.py ran fingerprinted Apache-2.0 (permissive) · b6aaa4f7c73f3d7e · report fixture: signature text:str/0/str · returned str · level recorded 2026-09-26
load_vocab in 107 papers core/tokenization.py unverified Apache-2.0 (permissive) · 97438b663cee62b4 · report
IBM/MAX-Text-Sentiment-Classifier community (archive-listed) 4 samples, 3 ran (1 instrument-failed) · 1 unverified
BasicTokenizer core/bert/tokenization.py ran Apache-2.0 (permissive) · a64f2359d969d7c9 · report fixture: returned BasicTokenizer · level recorded 2026-09-22
WordpieceTokenizer core/bert/tokenization.py ran Apache-2.0 (permissive) · e8e1b2b21151ac96 · report fixture: returned WordpieceTokenizer · level recorded 2026-09-22
load_vocab in 107 papers core/bert/tokenization.py ran · our draft was wrong Apache-2.0 (permissive) · d0e80220bcbf4ae0 · report fixture: signature vocab_file:str/0/str · returned OrderedDict · level recorded 2026-09-22
FullTokenizer core/bert/tokenization.py unverified Apache-2.0 (permissive) · 337e4831268a4465 · report
IBM/MAX-Toxic-Comment-Classifier community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
convert_examples_to_features in 134 papers core/bert_pytorch.py ran Apache-2.0 (permissive) · 18cae5cbe3552c86 · report fixture: signature examples:list/1/Example, max_seq_length:int/0/int, tokenizer:SimpleTokenizer/0/? · returned list · level recorded 2026-09-26
Impavidity/relogic community (archive-listed) 14 samples, 5 ran (1 instrument-failed) · 9 unverified
BertConfig in 14 papers relogic/logickit/inference/modeling.py ran · metamorphic tier: deterministic MIT (permissive) · 63b06d1b6c72a14c · report fixture: returned BertConfig · level recorded 2026-09-22
BertIntermediate in 15 papers relogic/logickit/inference/modeling.py ran · metamorphic tier: deterministic fingerprinted MIT (permissive) · 622c5fc2c7a23655 · report fixture: returned BertIntermediate · level recorded 2026-09-22
BertSelfAttention in 29 papers relogic/logickit/inference/modeling.py ran · metamorphic tier: deterministic MIT (permissive) · b62d4fe9e831d295 · report fixture: returned BertSelfAttention · level recorded 2026-09-22
gelu in 308 papers
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32
relogic/logickit/inference/modeling.py ran · honoured contract fingerprinted MIT (permissive) · 90e5e96897d48ebb · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22
prune_linear_layer in 40 papers relogic/logickit/inference/modeling.py ran · our draft was wrong MIT (permissive) · f4f4879066931500 · report fixture: signature layer:callable/0/?, index:Tensor/1/int, dim:int/0/int · returned Linear · level recorded 2026-09-22
BertAttention in 28 papers relogic/logickit/inference/modeling.py unverified MIT (permissive) · f5bafea439ee7a6d · report
BertEmbeddings in 21 papers relogic/logickit/inference/modeling.py unverified MIT (permissive) · 83ba0b7e85109bc1 · report
BertEncoder in 20 papers relogic/logickit/inference/modeling.py unverified MIT (permissive) · 6592c17758687a36 · report
BertLayer in 23 papers relogic/logickit/inference/modeling.py unverified MIT (permissive) · aca0ed0d9602bae6 · report
BertModel in 16 papers relogic/logickit/inference/modeling.py unverified MIT (permissive) · dc676111545d7cd3 · report
BertPreTrainedModel in 7 papers relogic/logickit/inference/modeling.py unverified MIT (permissive) · 79c6bbbf312efc13 · report
cached_path in 47 papers relogic/logickit/inference/modeling.py unverified MIT (permissive) · acbbe819a7927233 · report
get_from_cache relogic/logickit/inference/modeling.py unverified MIT (permissive) · da24676d8c44235e · report
load_tf_weights_in_bert in 135 papers relogic/logickit/inference/modeling.py unverified MIT (permissive) · 5a70204480cee7ee · report
JA-Bar/nlp-depression community (archive-listed) 3 samples, 2 ran (2 instrument-failed) · 1 unverified
predictions src/glove_fastext_bert/prediction_suicidal.py ran · our draft was wrong no licence file found · pointer only · 0024def7e853c898 · report fixture: signature word2pred:ndarray/2/int, glove_model:MockGloveModel/0/?, fasttext_model:MockFastTextModel/0/?, bert_sucidal:callable/0/?, bert_sadness:callable/0/? · returned list · level recorded 2026-09-22
preprocess_text in 26 papers src/glove_fastext_bert/prediction_suicidal.py ran · our draft was wrong fingerprinted no licence file found · pointer only · 68e228e1a25b69ed · report fixture: signature sen:str/0/str · returned str · level recorded 2026-09-22
convert2embeding src/glove_fastext_bert/prediction_suicidal.py unverified no licence file found · pointer only · bd4a102f50a58c35 · report
JNUpython/bert community (archive-listed) 3 samples, 0 ran · 3 unverified
BertModel in 16 papers bert_base/modeling.py unverified no licence file found · pointer only · d48289b49ea0e641 · report
embedding_lookup in 9 papers bert_base/modeling.py unverified no licence file found · pointer only · 136139e549db31e2 · report
embedding_postprocessor in 7 papers bert_base/modeling.py unverified no licence file found · pointer only · a3ac6c28547f1753 · report
Jackma3/NER-Bert-BiLstm community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
Bertencoder model/Bert_lstm.py ran no licence file found · pointer only · 40a5ea739723045e · report fixture: signature x:Tensor/2/int, y:Tensor/2/int, seg_ids:Tensor/2/int, mask:Tensor/2/int · returned Tensor · level recorded 2026-09-24
KnightZhang625/BERT_TF community (archive-listed) 6 samples, 2 ran (1 instrument-failed) · 4 unverified
NoNewAttrs model_official.py ran Apache-2.0 (permissive) · d40960e250106082 · report fixture: returned NoNewAttrs · level recorded 2026-09-22
forbid_new_attributes model_official.py ran · our draft was wrong Apache-2.0 (permissive) · 3ef7972a27b2f8fa · report fixture: signature wrapped_setatrr:callable/0/? · returned function · level recorded 2026-09-22
BertConfig in 14 papers model_official.py unverified Apache-2.0 (permissive) · 3d815ae093b291de · report
BertModel in 16 papers model_official.py unverified Apache-2.0 (permissive) · 6d2298e39819682c · report
embedding_lookup in 9 papers model_official.py unverified Apache-2.0 (permissive) · bd9da314f50f70c6 · report
transformer_model in 7 papers model_official.py unverified Apache-2.0 (permissive) · 4525f9e4207ffc06 · report
KomorebiLHX/Emotion-Recognition-in-Conversations community (archive-listed) 2 samples, 1 ran (1 instrument-failed) · 1 unverified
get_attention_mask in 11 papers bert/model.py ran; the contract check could not run (RAISES) · metamorphic tier: invariant fingerprinted no licence file found · pointer only · 19a78bec56a43e0b · report fixture: signature t:Tensor/2/float, device:str/0/str · returned Tensor · level recorded 2026-09-22
Bert_base bert/model.py unverified no licence file found · pointer only · bbe0cc3f9ced2088 · report
Linar23/Research_work community (archive-listed) 3 samples, 3 ran (0 instrument-failed) · 0 unverified
BERTEmbedding nn/embedding/bert.py ran no licence file found · pointer only · b8e9909c4cffb4a3 · report fixture: returned BERTEmbedding · level recorded 2026-09-22
SegmentEmbedding nn/embedding/bert.py ran no licence file found · pointer only · 25583325a9dc3221 · report fixture: returned SegmentEmbedding · level recorded 2026-09-22
TokenEmbedding in 11 papers nn/embedding/bert.py ran no licence file found · pointer only · 19ed76f032cfa56a · report fixture: returned TokenEmbedding · level recorded 2026-09-22
LoveYang/bert_test community (archive-listed) 3 samples, 0 ran · 3 unverified
file_based_input_fn_builder in 16 papers run_classifier.py unverified Apache-2.0 (permissive) · f105653fd006d566 · report
file_based_input_fn_builder in 16 papers sentiment_generate.py unverified Apache-2.0 (permissive) · add3130b56c2aaa7 · report
get_assignment_map_from_checkpoint in 32 papers modeling.py unverified Apache-2.0 (permissive) · 0fc04590521d0f1c · report
MLH-Fellowship/Social-BERTerfly community (archive-listed) 1 sample, 0 ran · 1 unverified
recreate_model server/predict_types.py unverified MIT (permissive) · 1f5490fe8c02d974 · report
MaZhiyuanBUAA/bert-tf1.4.0 community (archive-listed) 5 samples, 4 ran (0 instrument-failed) · 1 unverified
convert_to_unicode in 40 papers tokenization.py ran fingerprinted Apache-2.0 (permissive) · 4874ae2953f3aeab · report fixture: signature text:str/0/str · returned str · level recorded 2026-09-26
parse_input_fn_result comp_utils.py ran Apache-2.0 (permissive) · 4636d480c5444328 · report fixture: signature result:MockDataset/0/? · returned tuple · level recorded 2026-09-26
parse_iterator_result comp_utils.py ran fingerprinted Apache-2.0 (permissive) · 641f3758575965e6 · report fixture: signature result:tuple/1/Tensor · returned tuple · level recorded 2026-09-26
printable_text in 36 papers tokenization.py ran fingerprinted Apache-2.0 (permissive) · e4dbe9646176983b · report fixture: signature text:str/0/str · returned str · level recorded 2026-09-24
load_vocab in 107 papers tokenization.py unverified Apache-2.0 (permissive) · 85608a0993acae75 · report
MatthewSwahn/news-headlines-sarcasm-detector community (archive-listed) 1 sample, 0 ran · 1 unverified
BERTGRUSentiment classifier.py unverified MIT (permissive) · e72e9af8cbe399de · report
MichaelZhouwang/LMlexsub community (archive-listed) 2 samples, 0 ran · 2 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 3ade46b481d63b92 · report
embedding_lookup in 9 papers modeling.py unverified Apache-2.0 (permissive) · d4c7c4553bc6c06f · report
Microsoft/AzureML-BERT community (archive-listed) 13 samples, 10 ran (3 instrument-failed) · 3 unverified
acc_and_f1 in 39 papers finetune/run_classifier_azureml.py ran; the contract check could not run (RAISES) · metamorphic tier: deterministic MIT (permissive) here; the stored copy is pointer only · cac113ca87b9d9f3 · report fixture: signature preds:ndarray/1/int, labels:ndarray/1/int · returned dict · level recorded 2026-09-22
accuracy in 872 papers
census: 8 implementations from 7 papers, 7 distinct outputs across 6 buckets, one shared input per bucket
finetune/PyTorch/run_classifier_azureml.py ran · honoured contract fingerprinted MIT (permissive) · eb725d5794b15f6b · report fixture: signature out:ndarray/2/float, labels:ndarray/1/int · returned int64 · level recorded 2026-09-22
adjust_gradient_accumulation_steps finetune/PyTorch/azureml_bert_util.py ran fingerprinted MIT (permissive) · d18ca5cc79f6a030 · report fixture: signature x:int/0/int, initial_steps:int/0/int, target_steps:int/0/int, warmup:int/0/int · returned int · level recorded 2026-09-26
convert_examples_to_features in 134 papers finetune/PyTorch/run_classifier_azureml.py ran · our draft was wrong MIT (permissive) here; the stored copy is pointer only · 94379d9b86286b17 · report fixture: signature examples:list/1/Example, label_list:list/1/str, max_seq_length:int/0/int, tokenizer:SimpleTokenizer/0/? · returned list · level recorded 2026-09-22
exact_match_score in 82 papers finetune/evaluate_squad.py ran · violated contract fingerprinted MIT (permissive) · f6c275d6a18330a9 · report fixture: signature prediction:str/0/str, ground_truth:str/0/str · returned bool · level recorded 2026-09-22
f1_score in 121 papers finetune/evaluate_squad.py ran · honoured contract fingerprinted MIT (permissive) · 2112c433b9c6d343 · report fixture: signature prediction:str/0/str, ground_truth:str/0/str · returned float · level recorded 2026-09-22
get_timestamp in 7 papers pretrain/PyTorch/benchmark.py ran MIT (permissive) · e0c5130b8a1fcaa9 · report fixture: signature text:str/0/str · returned datetime · level recorded 2026-09-26
normalize_answer in 304 papers finetune/evaluate_squad.py ran · our draft was wrong fingerprinted MIT (permissive) · c6a80c065d2e4851 · report fixture: signature s:str/0/str · returned str · level recorded 2026-09-22
set_optimizer_params_grad in 5 papers finetune/PyTorch/run_classifier_azureml.py ran · violated contract MIT (permissive) here; the stored copy is pointer only · 7c152858416dd138 · report fixture: signature named_params_optimizer:list/1/tuple, named_params_model:list/1/tuple, test_nan:bool/0/bool · returned bool · level recorded 2026-09-22
warmup_linear in 45 papers finetune/PyTorch/azureml_bert_util.py ran · honoured contract fingerprinted MIT (permissive) · c58d57224530d17e · report fixture: signature x:float/0/float, warmup:float/0/float · returned float · level recorded 2026-09-22
convert_examples_to_features in 134 papers finetune/run_squad_azureml.py unverified MIT (permissive) · f07d0d8833d15b7b · report
load_checkpoint in 277 papers pretrain/PyTorch/checkpoint.py unverified MIT (permissive) · f4c553806059cc5c · report
simple_accuracy in 66 papers finetune/run_classifier_azureml.py unverified MIT (permissive) · 3c241ecfe3749a6d · report
Nstats/bert_MRC community (archive-listed) 2 samples, 0 ran · 2 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 730874f4bd9c228f · report
embedding_lookup in 9 papers modeling.py unverified Apache-2.0 (permissive) · 3733dd581eb74a68 · report
Nstats/my_bert community (archive-listed) 2 samples, 0 ran · 2 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 18d72628a65b6b75 · report
embedding_lookup in 9 papers modeling.py unverified Apache-2.0 (permissive) · 64296a59e688d4dd · report
Qordobacode/fitbert community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
mask in 19 papers fitbert/utils.py ran Apache-2.0 (permissive) · 5e4f948271236a41 · report fixture: signature s:str/0/str, span:tuple/1/int, mask_token:str/0/str · returned tuple · level recorded 2026-09-26
SCismycat/bert_code_view community (archive-listed) 6 samples, 1 ran (1 instrument-failed) · 5 unverified
get_activation in 218 papers modeling.py ran · our draft was wrong Apache-2.0 (permissive) · 126fb5715f78751b · report fixture: signature activation_string:str/0/str · returned function · level recorded 2026-09-22
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · ecfe55dea456ed37 · report
create_attention_mask_from_input_mask in 8 papers modeling.py unverified Apache-2.0 (permissive) · f79554c02fe8a46e · report
embedding_lookup in 9 papers modeling.py unverified Apache-2.0 (permissive) · b37500395497efb4 · report
embedding_postprocessor in 7 papers modeling.py unverified Apache-2.0 (permissive) · ac6226dbdba0f5e3 · report
layer_norm_and_dropout in 6 papers modeling.py unverified Apache-2.0 (permissive) · 92ef7ef36a321f62 · report
SYangDong/bert-with-frozen-code community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 03e35473217340bd · report
Satan012/BERT community (archive-listed) 6 samples, 1 ran (1 instrument-failed) · 5 unverified
get_activation in 218 papers modeling.py ran · our draft was wrong Apache-2.0 (permissive) · 5681f7dd9b6e3679 · report fixture: signature activation_string:str/0/str · returned function · level recorded 2026-09-22
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 1c8f5d63388f5841 · report
attention_layer in 9 papers modeling.py unverified Apache-2.0 (permissive) · f648a4567745fd52 · report
embedding_lookup in 9 papers modeling.py unverified Apache-2.0 (permissive) · a8b0e78302dc02d4 · report
gelu in 308 papers
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input
modeling.py unverified Apache-2.0 (permissive) · ecab128238ebf253 · report
transformer_model in 7 papers modeling.py unverified Apache-2.0 (permissive) · 4f87a173bcbfc6e5 · report
ShivamRajSharma/Transformer-Architectures-From-Scratch community (archive-listed) 4 samples, 4 ran (0 instrument-failed) · 0 unverified
BERT BERT.py ran MIT (permissive) · a3937a3e9b656cb7 · report fixture: signature x:Tensor/2/int, segment_x:Tensor/2/int, mask:Tensor/2/int · returned Tensor · level recorded 2026-09-24
BertBlock BERT.py ran · metamorphic tier: invariant fingerprinted MIT (permissive) · f2365adf361472b0 · report fixture: signature x:Tensor/3/float, mask:Tensor/4/float · returned Tensor · level recorded 2026-09-22
Embeddings in 15 papers BERT.py ran · metamorphic tier: invariant MIT (permissive) · da28e8ad6c6750a6 · report fixture: signature x:Tensor/2/int, segment_x:Tensor/2/int · returned Tensor · level recorded 2026-09-22
SelfAttention in 66 papers BERT.py ran · metamorphic tier: invariant fingerprinted MIT (permissive) · 64910f05f8cd9c7d · report fixture: signature query:Tensor/3/float, key:Tensor/3/float, value:Tensor/3/float, mask:NoneType/0/? · returned Tensor · level recorded 2026-09-22
SkullFang/BERT_NLP_Classification community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers modeling.py unverified no licence file found · pointer only · ef1cb1634a1b5c69 · report
Skumarr53/Attention-is-All-you-Need-PyTorch community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers transformer/model.py unverified no licence file found · pointer only · fa0ddb048557dd4a · report
StuartCHAN/KARL community (archive-listed) 2 samples, 0 ran · 2 unverified
BertModel in 16 papers bert/modeling.py unverified MIT (permissive) · 6f4396a03cbaf31e · report
BertPreTrainedModel in 7 papers bert/modeling.py unverified MIT (permissive) · a058c7071e411484 · report
TSLNIHAOGIT/bert_run community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
get_pred_label data_processed/eval_module.py ran Apache-2.0 (permissive) · 7bd54c667a7fb54d · report fixture: signature input_string:str/0/str · returned int64 · level recorded 2026-09-26
TeamLab/bert-gcn-for-paper-citation community (archive-listed) 13 samples, 3 ran (3 instrument-failed) · 10 unverified
dropout in 34 papers modeling.py ran; the contract check could not run (RAISES) · metamorphic tier: invariant fingerprinted no licence file found · pointer only · fb518a8fa5849d2f · report fixture: signature input_tensor:EagerTensor/2/float, dropout_prob:float/0/float · returned EagerTensor · level recorded 2026-09-22
get_activation in 218 papers modeling.py ran · our draft was wrong no licence file found · pointer only · 61de2f8dfc7d014a · report fixture: signature activation_string:str/0/str · returned function · level recorded 2026-09-22
get_shape_list in 9 papers modeling.py ran · our draft was wrong fingerprinted no licence file found · pointer only · 4c33136de32333c9 · report fixture: signature tensor:EagerTensor/2/float, expected_rank:int/0/int, name:str/0/str · returned list · level recorded 2026-09-22
BertModel in 16 papers modeling.py unverified no licence file found · pointer only · c1c5de65dfedcf88 · report
assert_rank in 6 papers modeling.py unverified no licence file found · pointer only · 01e4a365b28cda00 · report
attention_layer in 9 papers modeling.py unverified no licence file found · pointer only · 62ba879682ced155 · report
create_attention_mask_from_input_mask in 8 papers modeling.py unverified no licence file found · pointer only · a019ca35d0434118 · report
embedding_lookup in 9 papers modeling.py unverified no licence file found · pointer only · 194a6562b994a2e1 · report
embedding_postprocessor in 7 papers modeling.py unverified no licence file found · pointer only · 277b18bc7acee12c · report
gelu in 308 papers
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input
modeling.py unverified no licence file found · pointer only · 71e7e82f26b8d902 · report
layer_norm_and_dropout in 6 papers modeling.py unverified no licence file found · pointer only · 61cb05022cc82f2b · report
reshape_from_matrix in 7 papers modeling.py unverified no licence file found · pointer only · 3cfa2e7b4d67e9ee · report
transformer_model in 7 papers modeling.py unverified no licence file found · pointer only · dbc9628a5ca3b1f5 · report
Unbabel/COMET community (archive-listed) 3 samples, 1 ran (0 instrument-failed) · 2 unverified
LabelSet comet/encoders/bert.py ran Apache-2.0 (permissive) · fc8285a0c6ac6166 · report fixture: returned LabelSet · level recorded 2026-09-22
BERTEncoder comet/encoders/bert.py unverified Apache-2.0 (permissive) · b171be6bb3d6ee64 · report
Encoder in 278 papers comet/encoders/bert.py unverified Apache-2.0 (permissive) · 3d02134ab73b6e7b · report
Vladimetr/ASR-Knowledge-Transferring community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
Bert in 8 papers kt_module/lm.py ran no licence file found · pointer only · e3eb406d12cc6ada · report fixture: returned Bert · level recorded 2026-09-22
LanguageModel kt_module/lm.py unverified no licence file found · pointer only · bb96b67490720a42 · report
YongWookHa/BERT-on-Pytorch-Template community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel4Pretrain graphs/models/bert.py unverified no licence file found · pointer only · f1d7e9fdcb42955e · report
Zehui127/SQUAD_BERT community (archive-listed) 3 samples, 3 ran (3 instrument-failed) · 0 unverified
get_tokens in 40 papers SQUAD/evaluate-v2.0.py ran · our draft was wrong fingerprinted Apache-2.0 (permissive) here; the stored copy is pointer only · aa6bc32d9c17a2f1 · report fixture: signature s:str/0/str · returned list · level recorded 2026-09-22
make_qid_to_has_ans in 14 papers SQUAD/evaluate-v2.0.py ran · our draft was wrong Apache-2.0 (permissive) · e91c44f5680827e2 · report fixture: signature dataset:list/1/dict · returned dict · level recorded 2026-09-22
normalize_answer in 304 papers SQUAD/evaluate-v2.0.py ran · our draft was wrong fingerprinted Apache-2.0 (permissive) here; the stored copy is pointer only · 6a96435eba311b08 · report fixture: signature s:str/0/str · returned str · level recorded 2026-09-22
abhilashreddys/Fake-News-Article community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
Punctuation inference.py ran fingerprinted MIT (permissive) · 36fb38c1b2c56c3e · report fixture: signature string:str/0/str · returned str · level recorded 2026-09-26
af-ai-center/bert community (archive-listed) 4 samples, 3 ran (1 instrument-failed) · 1 unverified
BertDataset utils/processors.py ran Apache-2.0 (permissive) · 3429784883ed49da · report fixture: returned BertDataset · level recorded 2026-09-22
InputFeatures utils/processors.py ran Apache-2.0 (permissive) · a8d8657df9ba7457 · report fixture: returned InputFeatures · level recorded 2026-09-22
convert_examples_to_features in 134 papers utils/processors.py ran · our draft was wrong Apache-2.0 (permissive) · e23a0e9f62822bae · report fixture: signature examples:list/1/SimpleExample, label_list:list/1/str, max_seq_length:int/0/int, tokenizer:SimpleTokenizer/0/? · returned list · level recorded 2026-09-22
_truncate_seq_pair utils/processors.py unverified Apache-2.0 (permissive) · 894f421d39f125cd · report
af-ai-center/nerblackbox community (archive-listed) 7 samples, 7 ran (0 instrument-failed) · 0 unverified
derive_annotation_scheme nerblackbox/api/model.py ran Apache-2.0 (permissive) · 9d3541f3279b9ee3 · report fixture: signature _id2label:dict/0/? · returned str · level recorded 2026-09-26
get_label_color nerblackbox/modules/annotation/colors.py ran fingerprinted Apache-2.0 (permissive) · 2f215e3ae75e7690 · report fixture: signature index:int/0/int · returned str · level recorded 2026-09-26
labelstudio2nerblackbox nerblackbox/modules/annotation/file_conversion.py ran Apache-2.0 (permissive) · 6b299f9e659c4f93 · report fixture: signature _input_lines:list/1/dict · returned list · level recorded 2026-09-26
nerblackbox2doccano nerblackbox/modules/annotation/file_conversion.py ran Apache-2.0 (permissive) · 84fe5ed188ad2616 · report fixture: signature _input_lines:list/1/dict, _max_lines:NoneType/0/? · returned list · level recorded 2026-09-26
nerblackbox2labelstudio nerblackbox/modules/annotation/file_conversion.py ran Apache-2.0 (permissive) · 4715de39d0859675 · report fixture: signature _input_lines:list/1/dict, _max_lines:NoneType/0/? · returned list · level recorded 2026-09-26
round_evaluation_dict nerblackbox/api/model.py ran Apache-2.0 (permissive) · ac2ac4bdbe1b8269 · report fixture: signature _evaluation_dict:dict/0/?, _rounded_decimals:int/0/int · returned dict · level recorded 2026-09-26
turn_tensors_into_tag_probability_distributions nerblackbox/api/model.py ran Apache-2.0 (permissive) · 358e0635a43eb484 · report fixture: signature annotation_classes:list/1/str, outputs:Tensor/3/float · returned list · level recorded 2026-09-26
airsplay/vimpac community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
BertSelfAttention in 29 papers vimpac/modeling.py ran no licence file found · pointer only · 8396c5967c3a2df6 · report fixture: returned BertSelfAttention · level recorded 2026-09-22
algharak/BERTenhance community (archive-listed) 2 samples, 0 ran · 2 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 7e08ad549a7e13fb · report
embedding_lookup_insertion modeling.py unverified Apache-2.0 (permissive) · 1b86f515e6b9c99d · report
andi611/Mockingjay-Speech-Representation community (archive-listed) 11 samples, 4 ran (1 instrument-failed) · 7 unverified
MockingjayInitModel mockingjay/model.py ran MIT (permissive) · 357e659d771ec7d5 · report fixture: signature module:callable/0/? · returned NoneType · level recorded 2026-09-24
MockingjayIntermediate mockingjay/model.py ran · metamorphic tier: invariant fingerprinted MIT (permissive) · 6f042d066efe5345 · report fixture: signature hidden_states:Tensor/2/float · returned Tensor · level recorded 2026-09-22
MockingjaySelfAttention mockingjay/model.py ran MIT (permissive) · 27f67a2f1e787c71 · report fixture: signature hidden_states:Tensor/3/float, attention_mask:Tensor/4/float, head_mask:NoneType/0/? · returned Tensor · level recorded 2026-09-24
prune_linear_layer in 40 papers mockingjay/model.py ran · our draft was wrong MIT (permissive) · d30d6c3098df2c42 · report fixture: signature layer:callable/0/?, index:Tensor/1/int, dim:int/0/int · returned Linear · level recorded 2026-09-22
MockingjayAttention mockingjay/model.py unverified MIT (permissive) · 63b8f8f4c22bdb56 · report
MockingjayEncoder mockingjay/model.py unverified MIT (permissive) · 2d4f6f6bdb97a5e5 · report
MockingjayInputRepresentations mockingjay/model.py unverified MIT (permissive) · 9316b55d6dd78563 · report
MockingjayLayer mockingjay/model.py unverified MIT (permissive) · 2026c83caf3e84c7 · report
MockingjayModel mockingjay/model.py unverified MIT (permissive) · 65dd10e96a7e1de3 · report
MockingjayOutput mockingjay/model.py unverified MIT (permissive) · 56d4177ab429aba8 · report
MockingjaySelfOutput mockingjay/model.py unverified MIT (permissive) · b5642407583be292 · report
anton-bushuiev/ppiformer community (archive-listed) 9 samples, 8 ran (2 instrument-failed) · 1 unverified
get_edges in 20 papers ppiformer/model/egnn_clean.py ran · honoured contract fingerprinted MIT (permissive) · c2f9c401f5379aac · report fixture: signature n_nodes:int/0/int · returned list · level recorded 2026-09-24
get_n_params in 21 papers ppiformer/utils/torch.py ran MIT (permissive) · c3c2cfe92ff4533d · report fixture: signature model:callable/0/? · returned int · level recorded 2026-09-26
is_iterable_and_not_str ppiformer/utils/typing.py ran fingerprinted MIT (permissive) · e8e6d419331bbeb9 · report fixture: signature obj:list/1/int · returned bool · level recorded 2026-09-26
pad_fixed_length ppiformer/utils/torch.py ran MIT (permissive) · b2c96d966ff1fff8 · report fixture: signature seqs:list/1/Tensor, length:int/0/int, padding_value:float/0/float · returned Tensor · level recorded 2026-09-26
task_to_ddg_inference_type ppiformer/utils/typing.py ran MIT (permissive) · 0ae008bce547361e · report fixture: signature task:str/0/str · returned str · level recorded 2026-09-26
unpad_sequence ppiformer/utils/torch.py ran MIT (permissive) · 92a75761ce94b769 · report fixture: signature padded_sequences:Tensor/3/float, lengths:Tensor/1/int, batch_first:bool/0/bool · returned list · level recorded 2026-09-26
unsorted_segment_mean in 27 papers ppiformer/model/egnn_clean.py ran; the contract check could not run (RAISES) · metamorphic tier: invariant MIT (permissive) · bc66f19be57720e7 · report fixture: signature data:Tensor/2/float, segment_ids:Tensor/1/int, num_segments:int/0/int · returned Tensor · level recorded 2026-09-22
unsorted_segment_sum in 33 papers ppiformer/model/egnn_clean.py ran · our draft was wrong MIT (permissive) here; the stored copy is pointer only · 5fb62a78eb65d3d7 · report fixture: signature data:Tensor/2/float, segment_ids:Tensor/1/int, num_segments:int/0/int · returned Tensor · level recorded 2026-09-22
none_or_str in 23 papers ppiformer/utils/typing.py unverified MIT (permissive) · c44e3a6568479588 · report
appcoreopc/berty community (archive-listed) 5 samples, 4 ran (3 instrument-failed) · 1 unverified
create_attention_mask_from_input_mask in 8 papers modeling.py ran · our draft was wrong Apache-2.0 (permissive) · 5b284cfc6cef732f · report fixture: signature from_tensor:SymbolicTensor/3/float, to_mask:SymbolicTensor/2/int · returned SymbolicTensor · level recorded 2026-09-22
embedding_lookup in 9 papers modeling.py ran · our draft was wrong Apache-2.0 (permissive) · 0d0b605c64dee09c · report fixture: signature input_ids:SymbolicTensor/2/int, vocab_size:int/0/int, embedding_size:int/0/int, initializer_range:float/0/float, word_embedding_name:str/0/str, use_one_hot_embeddings:bool/0/bool · returned tuple · level recorded 2026-09-22
embedding_postprocessor in 7 papers modeling.py ran · our draft was wrong Apache-2.0 (permissive) · 6588e020bee50b10 · report fixture: signature input_tensor:SymbolicTensor/3/float, use_token_type:bool/0/bool, token_type_ids:SymbolicTensor/2/int, token_type_vocab_size:int/0/int, token_type_embedding_name:str/0/str, use_position_embeddings:bool/0/bool, position_embedding_name:str/0/str, initializer_range:float/0/float, max_position_embeddings:int/0/int, dropout_prob:float/0/float · returned SymbolicTensor · level recorded 2026-09-22
layer_norm_and_dropout in 6 papers modeling.py ran · honoured contract Apache-2.0 (permissive) · 80bc5181b671b9a1 · report fixture: signature input_tensor:SymbolicTensor/2/float, dropout_prob:float/0/float, name:str/0/str · returned EagerTensor · level recorded 2026-09-22
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 4cbce5db2a203a79 · report
arielsho/decomposition-table-reasoning community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
AttentionLayer_sigmoid Code/models.py ran no licence file found · pointer only · 3f9027bb95cbe5b2 · report fixture: returned AttentionLayer_sigmoid · level recorded 2026-09-22
DoubleBERT Code/models.py unverified no licence file found · pointer only · 9a71f87435326354 · report
athms/learning-from-brains community (archive-listed) 2 samples, 0 ran · 2 unverified
BERTModel src/decoder/bert.py unverified no licence file found · pointer only · 3ade056bbe9a9e44 · report
GPTModel src/decoder/bert.py unverified no licence file found · pointer only · ddb6510e4033acd8 · report
autobotasia/vibert community (archive-listed) 4 samples, 3 ran (0 instrument-failed) · 1 unverified
count_lines in 23 papers pre-training-vibert.py ran Apache-2.0 (permissive) · 30699d853dda45e5 · report fixture: signature filename:str/0/str · returned int · level recorded 2026-09-26
normalize_text in 60 papers pre-training-vibert.py ran fingerprinted Apache-2.0 (permissive) · b4d10db840d16868 · report fixture: signature text:str/0/str · returned str · level recorded 2026-09-26
parse_sentencepiece_token build_vocabulary.py ran fingerprinted Apache-2.0 (permissive) · b7ff454612b5dc62 · report fixture: signature token:str/0/str · returned str · level recorded 2026-09-25
read_sentencepiece_vocab pre-training-vibert.py unverified Apache-2.0 (permissive) · 15ee33a6a02b924c · report
avichaychriqui/HeBERT community (archive-listed) 1 sample, 0 ran · 1 unverified
spider_plot src/spider_plot.py unverified MIT (permissive) · ccb753322427af10 · report
aws-samples/amazon-sagemaker-bert-pytorch community (archive-listed) 3 samples, 3 ran (1 instrument-failed) · 0 unverified
flat_accuracy in 5 papers code/train_deploy.py ran; the contract check could not run (RAISES) · metamorphic tier: invariant fingerprinted MIT-0 (permissive) · f3e68336634b8642 · report fixture: signature preds:ndarray/2/float, labels:ndarray/1/int · returned float64 · level recorded 2026-09-22
model_fn in 10 papers code/deploy_ei.py ran MIT-0 (permissive) · eb140e13be89b1b9 · report fixture: signature model_dir:str/0/str · returned RecursiveScriptModule · level recorded 2026-09-26
predict_fn code/deploy_ei.py ran MIT-0 (permissive) · 872b8d88173c74fb · report fixture: signature input_data:tuple/1/Tensor, model:callable/0/? · returned Tensor · level recorded 2026-09-26
awslabs/mlm-scoring community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
BertForMaskedLMOptimized src/mlm/models/bert.py ran Apache-2.0 (permissive) · cfa5d6dc60bf1dba · report fixture: signature input_ids:Tensor/2/int, attention_mask:Tensor/2/int, token_type_ids:Tensor/2/int, labels:Tensor/2/int, return_dict:bool/0/bool · returned MaskedLMOutput · level recorded 2026-09-24
benywon/ChineseBert community (archive-listed) 3 samples, 0 ran · 3 unverified
BertModel in 16 papers model.py unverified no licence file found · pointer only · cff5f4809af22623 · report
MultiHeadBlock model.py unverified no licence file found · pointer only · c82df0e0cf33038d · report
SelfAttention in 66 papers model.py unverified no licence file found · pointer only · 2fac2c94f3edf404 · report
benywon/ComQA community (archive-listed) 7 samples, 2 ran (0 instrument-failed) · 5 unverified
DBC2SBC utils.py ran fingerprinted Apache-2.0 (permissive) · b6d60d79c776054e · report fixture: signature ustring:str/0/str · returned str · level recorded 2026-09-26
load_file in 52 papers utils.py ran Apache-2.0 (permissive) · 30636ab752ebf9b0 · report fixture: signature filename:str/0/str · returned dict · level recorded 2026-09-26
get_file_charset utils.py unverified Apache-2.0 (permissive) · 51781cacf3bcb9d5 · report
get_train_data in 6 papers evaluation/evaluate_qanet.py unverified Apache-2.0 (permissive) · 1292768711b338b2 · report
get_train_data in 6 papers train/qanet.py unverified Apache-2.0 (permissive) · 056a394881f205d9 · report
metric_mean train/qanet.py unverified Apache-2.0 (permissive) · 5e7623283a833707 · report
metric_sum train/qanet.py unverified Apache-2.0 (permissive) · 18e0ec7a8c51c3e8 · report
binhetech/bert-application community (archive-listed) 2 samples, 0 ran · 2 unverified
create_optimizer in 37 papers custom_optimization.py unverified Apache-2.0 (permissive) · 546200b8426ef8b2 · report
get_examples_class_weight run_classifier_imbalance.py unverified Apache-2.0 (permissive) · 286bc59709ec2901 · report
brightmart/bert_customized community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers modeling.py unverified no licence file found · pointer only · 5e83fb6cbfb3f5a1 · report
brightmart/text_classification community (archive-listed) 2 samples, 0 ran · 2 unverified
BertModel in 16 papers a00_Bert/bert_modeling.py unverified MIT (permissive) · d550d4124042659c · report
embedding_postprocessor in 7 papers a00_Bert/bert_modeling.py unverified MIT (permissive) · 04868eaf79d84eb8 · report
cedrickchee/pytorch-pretrained-BERT community (archive-listed) 20 samples, 6 ran (2 instrument-failed) · 14 unverified
BertConfig in 14 papers pytorch_pretrained_bert/modeling.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · 96be08a7a7030f60 · report fixture: returned BertConfig · level recorded 2026-09-22
BertIntermediate in 15 papers pytorch_pretrained_bert/modeling.py ran · metamorphic tier: deterministic fingerprinted Apache-2.0 (permissive) · c7123d4962da3767 · report fixture: returned BertIntermediate · level recorded 2026-09-22
BertPooler in 6 papers pytorch_pretrained_bert/modeling.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · 8f1a0b9437ccc562 · report fixture: returned BertPooler · level recorded 2026-09-22
BertSelfAttention in 29 papers pytorch_pretrained_bert/modeling.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · d7fe09a1ec2f4f0d · report fixture: returned BertSelfAttention · level recorded 2026-09-22
s3_request pytorch_pretrained_bert/modeling.py ran · our draft was wrong Apache-2.0 (permissive) · 7661139be003d514 · report fixture: signature func:callable/0/? · returned function · level recorded 2026-09-22
url_to_filename in 73 papers pytorch_pretrained_bert/modeling.py ran · our draft was wrong fingerprinted Apache-2.0 (permissive) · 5eff22fa0a651276 · report fixture: signature url:str/0/str, etag:str/0/str · returned str · level recorded 2026-09-22
BertAttention in 28 papers pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 330e30e5ccfcc515 · report
BertEmbeddings in 21 papers pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 77df05a2a5d00853 · report
BertEncoder in 20 papers pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 0be65efc892d53b9 · report
BertLayer in 23 papers pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 89e0fd61eb3504eb · report
BertModel in 16 papers pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · d94fb1043848be78 · report
BertOutput in 13 papers pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · aea48c66c585eea7 · report
BertPreTrainedModel in 7 papers pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · fdd3d4990bea9d9c · report
BertSelfOutput in 14 papers pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 5a3875e5bed5964b · report
cached_path in 47 papers pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · ea4ad38c9db984c5 · report
get_from_cache pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 317c17bb5ff9da3f · report
http_get pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 18f49ada16168f38 · report
s3_etag pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 51dd06ec77c8a8d1 · report
s3_get pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 1079045e75efbf23 · report
split_s3_path pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · d3852f416bfe86c3 · report
chandu7077/mybert community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
convert_single_example in 5 papers run_classifier.py ran Apache-2.0 (permissive) · ac776e46fc1084e7 · report fixture: signature ex_index:int/0/int, example:InputExample/0/?, label_list:list/1/str, max_seq_length:int/0/int, tokenizer:SimpleTokenizer/0/? · returned InputFeatures · level recorded 2026-09-26
file_based_convert_examples_to_features run_classifier.py unverified Apache-2.0 (permissive) · 54f786e4f28fa4a7 · report
charles9n/bert-sklearn community (archive-listed) 12 samples, 1 ran (0 instrument-failed) · 11 unverified
BertSelfAttention in 29 papers bert_sklearn/model/pytorch_pretrained/modeling.py ran Apache-2.0 (permissive) · 79f120e0db5db99e · report fixture: signature hidden_states:Tensor/3/float, attention_mask:Tensor/4/float, head_mask:NoneType/0/? · returned Tensor · level recorded 2026-09-24
BertAttention in 28 papers bert_sklearn/model/pytorch_pretrained/modeling.py unverified Apache-2.0 (permissive) · b05a22e3a42e7e59 · report
BertEncoder in 20 papers bert_sklearn/model/pytorch_pretrained/modeling.py unverified Apache-2.0 (permissive) · b47ae2a32bd23a1c · report
BertLayer in 23 papers bert_sklearn/model/pytorch_pretrained/modeling.py unverified Apache-2.0 (permissive) · 3a44fb25423d4564 · report
BertModel in 16 papers bert_sklearn/model/pytorch_pretrained/modeling.py unverified Apache-2.0 (permissive) · a9444eeb146ebd10 · report
BertPreTrainedModel in 7 papers bert_sklearn/model/pytorch_pretrained/modeling.py unverified Apache-2.0 (permissive) · 894b867bfd628865 · report
bert_from_archive bert_sklearn/model/pytorch_pretrained/modeling.py unverified Apache-2.0 (permissive) · bd849e6c4737612e · report
biobert_from_archive bert_sklearn/model/pytorch_pretrained/modeling.py unverified Apache-2.0 (permissive) · 855a80fcef9ad814 · report
cached_path in 47 papers bert_sklearn/model/pytorch_pretrained/modeling.py unverified Apache-2.0 (permissive) · 351989ddc71c6405 · report
get_from_cache bert_sklearn/model/pytorch_pretrained/modeling.py unverified Apache-2.0 (permissive) · 5de5474f1c41a96c · report
load_tf_weights_in_bert in 135 papers bert_sklearn/model/pytorch_pretrained/modeling.py unverified Apache-2.0 (permissive) · 4b95ca6b1e45f55d · report
scibert_from_archive bert_sklearn/model/pytorch_pretrained/modeling.py unverified Apache-2.0 (permissive) · 6ef8ca83e070ecc2 · report
chiayewken/bert-qa community (archive-listed) 2 samples, 0 ran · 2 unverified
BertModel in 16 papers modeling.py unverified MIT (permissive) · 73c88a124156227a · report
transformer_model in 7 papers modeling.py unverified MIT (permissive) · 5e82334665dedf36 · report
coco60/bert-test community (archive-listed) 1 sample, 1 ran (1 instrument-failed) · 0 unverified
get_tasks in 21 papers download_glue_data.py ran · our draft was wrong Apache-2.0 (permissive) here; the stored copy is pointer only · 18962b43885bc12f · report fixture: signature task_names:str/0/str · returned list · level recorded 2026-09-22
codertimo/BERT-pytorch community (archive-listed) 5 samples, 3 ran (0 instrument-failed) · 2 unverified
BERTEmbedding bert_pytorch/model/bert.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · f350435fecb66573 · report fixture: returned BERTEmbedding · level recorded 2026-09-22
SegmentEmbedding bert_pytorch/model/bert.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · cba7955abe17fc7a · report fixture: returned SegmentEmbedding · level recorded 2026-09-22
TokenEmbedding in 11 papers bert_pytorch/model/bert.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · 5f83a220fada640e · report fixture: returned TokenEmbedding · level recorded 2026-09-22
BERT bert_pytorch/model/bert.py unverified Apache-2.0 (permissive) · 9fe5b71f33bed224 · report
TransformerBlock in 73 papers bert_pytorch/model/bert.py unverified Apache-2.0 (permissive) · 81af9c02ca090c06 · report
cybertronai/megatron-lm community (archive-listed) 13 samples, 8 ran (0 instrument-failed) · 5 unverified
BertAttention in 28 papers model/modeling.py ran fingerprinted licence not identified · pointer only · e84e69f096395645 · report fixture: signature input_tensor:Tensor/3/float, attention_mask:Tensor/4/float · returned Tensor · level recorded 2026-09-24
BertConfig in 14 papers model/modeling.py ran licence not identified · pointer only · afc98bcdd9563e99 · report fixture: returned BertConfig · level recorded 2026-09-22
BertEmbeddings in 21 papers model/modeling.py ran licence not identified · pointer only · 0bc4f9d5bf271d61 · report fixture: returned BertEmbeddings · level recorded 2026-09-22
BertLayer in 23 papers model/modeling.py ran fingerprinted licence not identified · pointer only · b667cf8a44831efb · report fixture: signature hidden_states:Tensor/3/float, attention_mask:Tensor/4/float · returned Tensor · level recorded 2026-09-24
BertLayerNorm model/modeling.py ran licence not identified · pointer only · 822283b50e726811 · report fixture: signature x:Tensor/3/float · returned Tensor · level recorded 2026-09-24
BertOutput in 13 papers model/modeling.py ran licence not identified · pointer only · 8a5a74db0d87b031 · report fixture: returned BertOutput · level recorded 2026-09-22
BertSelfAttention in 29 papers model/modeling.py ran fingerprinted licence not identified · pointer only · e4d01ce175b1609c · report fixture: signature hidden_states:Tensor/3/float, attention_mask:Tensor/4/float · returned Tensor · level recorded 2026-09-24
BertSelfOutput in 14 papers model/modeling.py ran licence not identified · pointer only · 5d2d7e3a1b6801df · report fixture: signature hidden_states:Tensor/3/float, input_tensor:Tensor/3/float · returned Tensor · level recorded 2026-09-24
BertEncoder in 20 papers model/modeling.py unverified licence not identified · pointer only · 4c39e580d926b422 · report
BertModel in 16 papers model/modeling.py unverified licence not identified · pointer only · 7014de3eb8095b4c · report
PreTrainedBertModel model/modeling.py unverified licence not identified · pointer only · c56f29d49ac9ace5 · report
cached_path in 47 papers model/modeling.py unverified licence not identified · pointer only · 52ed11d585de58d4 · report
get_from_cache model/modeling.py unverified licence not identified · pointer only · 8165991d6f015e57 · report
dbmdz/historic-ner community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
iobes_to_iob predict.py ran fingerprinted MIT (permissive) · 024d457ec53d2bb4 · report fixture: signature tag:str/0/str · returned str · level recorded 2026-09-26
deepmipt/bert community (archive-listed) 6 samples, 1 ran (1 instrument-failed) · 5 unverified
dropout in 34 papers bert_dp/modeling.py ran; the contract check could not run (RAISES) fingerprinted Apache-2.0 (permissive) · 780899d457cb7f07 · report fixture: signature input_tensor:EagerTensor/2/float, dropout_prob:float/0/float · returned EagerTensor · level recorded 2026-09-22
BertModel in 16 papers bert_dp/modeling.py unverified Apache-2.0 (permissive) · 558426bb4445df9f · report
attention_layer in 9 papers bert_dp/modeling.py unverified Apache-2.0 (permissive) · 0003cab2e9992161 · report
embedding_postprocessor in 7 papers bert_dp/modeling.py unverified Apache-2.0 (permissive) · d3ccd60a5001eb36 · report
layer_norm_and_dropout in 6 papers bert_dp/modeling.py unverified Apache-2.0 (permissive) · cf1f91679b130b04 · report
transformer_model in 7 papers bert_dp/modeling.py unverified Apache-2.0 (permissive) · b9f693772b62b1de · report
deepset-ai/FARM community (archive-listed) 2 samples, 0 ran · 2 unverified
Bert in 8 papers farm/modeling/language_model.py unverified Apache-2.0 (permissive) · 36da368f07acddb7 · report
s3e_pooling farm/modeling/language_model.py unverified Apache-2.0 (permissive) · 55ce9c59feb542e9 · report
derronxu/sparsebert community (archive-listed) 12 samples, 4 ran (0 instrument-failed) · 8 unverified
BertConfig in 14 papers SparseBERT/main_functions/transformer/modeling.py ran · metamorphic tier: deterministic no licence file found · pointer only · 8a8e46e7b74bcec6 · report fixture: returned BertConfig · level recorded 2026-09-22
BertIntermediate in 15 papers SparseBERT/main_functions/transformer/modeling.py ran · metamorphic tier: deterministic fingerprinted no licence file found · pointer only · f27f0935fbe1b62b · report fixture: returned BertIntermediate · level recorded 2026-09-22
BertPooler in 6 papers SparseBERT/main_functions/transformer/modeling.py ran · metamorphic tier: deterministic fingerprinted no licence file found · pointer only · 1ffe5589b401ff00 · report fixture: returned BertPooler · level recorded 2026-09-22
BertSelfAttention in 29 papers SparseBERT/main_functions/transformer/modeling.py ran · metamorphic tier: deterministic no licence file found · pointer only · 72415b9f7aa76ac9 · report fixture: returned BertSelfAttention · level recorded 2026-09-22
BertAttention in 28 papers SparseBERT/main_functions/transformer/modeling.py unverified no licence file found · pointer only · 5416853a8be3a2d7 · report
BertEmbeddings in 21 papers SparseBERT/main_functions/transformer/modeling.py unverified no licence file found · pointer only · 822402eb726689f9 · report
BertEncoder in 20 papers SparseBERT/main_functions/transformer/modeling.py unverified no licence file found · pointer only · b824da45c7d85285 · report
BertLayer in 23 papers SparseBERT/main_functions/transformer/modeling.py unverified no licence file found · pointer only · 39b12df168592d79 · report
BertModel in 16 papers SparseBERT/main_functions/transformer/modeling.py unverified no licence file found · pointer only · 57ddc6f7b4914314 · report
BertOutput in 13 papers SparseBERT/main_functions/transformer/modeling.py unverified no licence file found · pointer only · a0407d4bf4593206 · report
BertPreTrainedModel in 7 papers SparseBERT/main_functions/transformer/modeling.py unverified no licence file found · pointer only · 39f5d68d67913dc7 · report
BertSelfOutput in 14 papers SparseBERT/main_functions/transformer/modeling.py unverified no licence file found · pointer only · 178a7c8f563f0beb · report
devJWSong/bert-crf-entity-recognition-pytorch community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
MultiheadAttention in 44 papers src/layers.py ran fingerprinted MIT (permissive) · af47ebae6c05725a · report fixture: signature q:Tensor/3/float, k:Tensor/3/float, v:Tensor/3/float, mask:NoneType/0/? · returned Tensor · level recorded 2026-09-24
dhlee347/pytorchic-bert community (archive-listed) 6 samples, 6 ran (0 instrument-failed) · 0 unverified
Block in 252 papers
census: 5 implementations from 5 papers, 3 distinct outputs across 2 buckets, one shared input per bucket
models.py ran Apache-2.0 (permissive) · 2dcf1b4f0aa2fa9a · report fixture: returned Block · level recorded 2026-09-22
Embeddings in 15 papers models.py ran Apache-2.0 (permissive) · b036f3e72b73df3d · report fixture: returned Embeddings · level recorded 2026-09-22
LayerNorm in 121 papers
census: 5 implementations from 5 papers, 5 distinct outputs across 3 buckets, one shared input per bucket
models.py ran fingerprinted Apache-2.0 (permissive) · b0f94b02a9a6c057 · report fixture: returned LayerNorm · level recorded 2026-09-22
MultiHeadedSelfAttention in 5 papers models.py ran fingerprinted Apache-2.0 (permissive) · 05a7a0d5018b97f8 · report fixture: signature x:Tensor/3/float, mask:Tensor/2/float · returned Tensor · level recorded 2026-09-24
PositionWiseFeedForward in 7 papers models.py ran fingerprinted Apache-2.0 (permissive) · a10a2edb3945c395 · report fixture: returned PositionWiseFeedForward · level recorded 2026-09-22
Transformer in 173 papers models.py ran Apache-2.0 (permissive) · 4076b007bcd248ae · report fixture: signature x:Tensor/2/int, seg:Tensor/2/int, mask:Tensor/2/float · returned Tensor · level recorded 2026-09-24
dreamgonfly/BERT-pytorch community (archive-listed) 2 samples, 0 ran · 2 unverified
BERT bert/train/model/bert.py unverified Unlicense (permissive) · edcd44a1ee5665b9 · report
pad_masking bert/train/model/bert.py unverified Unlicense (permissive) · 7ea11e3a72954760 · report
duyunshu/bert-sentiment-analysis community (archive-listed) 5 samples, 1 ran (0 instrument-failed) · 4 unverified
train_svm get_embedding.py ran Apache-2.0 (permissive) · c76f46654250fbc5 · report fixture: signature X:ndarray/2/float, Y:ndarray/1/int, key:str/0/str, results:dict/0/? · returned defaultdict · level recorded 2026-09-26
clean in 39 papers read_data.py unverified Apache-2.0 (permissive) · 850a17e45e007d3f · report
getDF read_data.py unverified Apache-2.0 (permissive) · 2d319eeddf2f1a44 · report
get_child read_data.py unverified Apache-2.0 (permissive) · 7caeef5bbe4d9048 · report
read_tsv in 13 papers get_embedding.py unverified Apache-2.0 (permissive) · 0087d8f08b1cc939 · report
eagle705/bert community (archive-listed) 5 samples, 2 ran (0 instrument-failed) · 3 unverified
MultiHeadAttention in 124 papers
census: 9 implementations from 7 papers, 9 distinct outputs across 3 buckets, one shared input per bucket
model/bert.py ran no licence file found · pointer only · 3c706b7d1522d9c1 · report fixture: signature Q:EagerTensor/3/float, K:EagerTensor/3/float, V:EagerTensor/3/float, mask:NoneType/0/? · returned tuple · level recorded 2026-09-24
gelu in 308 papers
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input
model/bert.py ran · honoured contract fingerprinted no licence file found · pointer only · b7b8c4039090713d · report fixture: signature x:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-22
BERT model/bert.py unverified no licence file found · pointer only · 603d3e87c1311f84 · report
BERTEmbedding model/bert.py unverified no licence file found · pointer only · 2b635d82c194b84b · report
TransformerBlock in 73 papers model/bert.py unverified no licence file found · pointer only · daa550ff0552c158 · report
epfml/collaborative-attention community (archive-listed) 3 samples, 2 ran (1 instrument-failed) · 1 unverified
CollaborativeLayerAdapter src/collaborative_attention/adapter_bert.py ran Apache-2.0 (permissive) · e6c28dfaa7ebc812 · report fixture: returned CollaborativeLayerAdapter · level recorded 2026-09-22
bert_layers src/collaborative_attention/adapter_bert.py ran · our draft was wrong Apache-2.0 (permissive) · b2185f41548996b8 · report fixture: signature model:callable/0/? · returned ModuleList · level recorded 2026-09-22
BERTCollaborativeAdapter src/collaborative_attention/adapter_bert.py unverified Apache-2.0 (permissive) · a7cc9ef1d10bc14b · report
fanchenyou/transformer-study community (archive-listed) 10 samples, 9 ran (0 instrument-failed) · 1 unverified
Attention in 344 papers
census: 13 implementations from 12 papers, 10 distinct outputs across 4 buckets, one shared input per bucket
transformer_bert_from_scratch_5.py ran · metamorphic tier: deterministic no licence file found · pointer only · fa24061b6aade569 · report fixture: signature query:Tensor/3/float, key:Tensor/3/float, value:Tensor/3/float, mask:NoneType/0/?, dropout:NoneType/0/? · returned tuple · level recorded 2026-09-22
BERTEmbedding transformer_bert_from_scratch_5.py ran · metamorphic tier: deterministic no licence file found · pointer only · a42a5dbeebdf39e3 · report fixture: returned BERTEmbedding · level recorded 2026-09-22
MultiHeadedAttention in 38 papers transformer_bert_from_scratch_5.py ran · metamorphic tier: deterministic no licence file found · pointer only · 8708bfceac69760b · report fixture: returned MultiHeadedAttention · level recorded 2026-09-22
PositionalEmbedding in 43 papers
census: 6 implementations from 6 papers, 4 distinct outputs across 3 buckets, one shared input per bucket
transformer_bert_from_scratch_5.py ran · metamorphic tier: deterministic fingerprinted no licence file found · pointer only · d16f303823d8ee5a · report fixture: returned PositionalEmbedding · level recorded 2026-09-22
PositionwiseFeedForward in 36 papers transformer_bert_from_scratch_5.py ran · metamorphic tier: deterministic no licence file found · pointer only · 708bd2d8037a185a · report fixture: returned PositionwiseFeedForward · level recorded 2026-09-22
SegmentEmbedding transformer_bert_from_scratch_5.py ran · metamorphic tier: deterministic no licence file found · pointer only · ec4cc2e0c00b6449 · report fixture: returned SegmentEmbedding · level recorded 2026-09-22
SublayerConnection in 16 papers transformer_bert_from_scratch_5.py ran · metamorphic tier: invariant no licence file found · pointer only · 740ab852bb4af958 · report fixture: signature x:Tensor/2/float, sublayer:callable/0/? · returned Tensor · level recorded 2026-09-22
TokenEmbedding in 11 papers transformer_bert_from_scratch_5.py ran · metamorphic tier: deterministic no licence file found · pointer only · 6ac09cf3d33d9991 · report fixture: returned TokenEmbedding · level recorded 2026-09-22
TransformerBlock in 73 papers transformer_bert_from_scratch_5.py ran · metamorphic tier: deterministic no licence file found · pointer only · 7e19140b483ea0b1 · report fixture: returned TransformerBlock · level recorded 2026-09-22
BERT transformer_bert_from_scratch_5.py unverified no licence file found · pointer only · 6674cc6102e96505 · report
fancyerii/bert community (archive-listed) 1 sample, 0 ran · 1 unverified
file_based_input_fn_builder in 16 papers run_reg.py unverified Apache-2.0 (permissive) · f5690f33c176596b · report
flyliu2017/bert community (archive-listed) 8 samples, 4 ran (0 instrument-failed) · 4 unverified
editDistance convert_tag.py ran fingerprinted Apache-2.0 (permissive) · 82671c1f2dd13961 · report fixture: signature s1:str/0/str, s2:str/0/str · returned int · level recorded 2026-09-26
input_fn_builder in 13 papers data_processor.py ran Apache-2.0 (permissive) · 58dd0d69e82ebdc9 · report fixture: signature features:list/1/Feature, seq_length:int/0/int, is_training:bool/0/bool, drop_remainder:bool/0/bool · returned function · level recorded 2026-09-26
padding in 37 papers cal_scores.py ran Apache-2.0 (permissive) · bc4091a4f3a214d8 · report fixture: signature tokens_list:list/1/list, max_len:int/0/int · returned list · level recorded 2026-09-26
read_vocab in 7 papers cal_scores.py ran Apache-2.0 (permissive) · 9b5d82a07fa47ec4 · report fixture: signature vocab_filepath:str/0/str · returned dict · level recorded 2026-09-26
file_based_input_fn_builder in 16 papers run_multilabels_classifier_sequence_layer.py unverified Apache-2.0 (permissive) · f3ed5b8073c1b457 · report
list_variables checkpoint_utils.py unverified Apache-2.0 (permissive) · 0b2242628c96eed8 · report
load_checkpoint in 277 papers checkpoint_utils.py unverified Apache-2.0 (permissive) · 45edc5b78739e5e7 · report
load_variable checkpoint_utils.py unverified Apache-2.0 (permissive) · 2b41c443c5531f23 · report
frankcgq105/BERTCHEN community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 0ee385ced53dea5b · report
ganeshjawahar/interpret_bert community (archive-listed) 6 samples, 1 ran (0 instrument-failed) · 5 unverified
BertSelfAttention in 29 papers tpdn/unsuptree_modeler.py ran fingerprinted GPL-3.0 (copyleft) · pointer only · 47914b62d30c89d7 · report fixture: signature hidden_states:Tensor/3/float, attention_mask:Tensor/4/float · returned tuple · level recorded 2026-09-24
BertAttention in 28 papers tpdn/unsuptree_modeler.py unverified GPL-3.0 (copyleft) · pointer only · 236bedbe3bb10ca4 · report
BertEncoder in 20 papers tpdn/unsuptree_modeler.py unverified GPL-3.0 (copyleft) · pointer only · e23a8af897f865c5 · report
BertLayer in 23 papers tpdn/unsuptree_modeler.py unverified GPL-3.0 (copyleft) · pointer only · 3ab022fca9e1c155 · report
BertModel in 16 papers tpdn/unsuptree_modeler.py unverified GPL-3.0 (copyleft) · pointer only · 1cf3945c98c6c2f3 · report
PreTrainedBertModel tpdn/unsuptree_modeler.py unverified GPL-3.0 (copyleft) · pointer only · 6b54995ba252a2ac · report
gbcolborne/lang_id community (archive-listed) 5 samples, 4 ran (2 instrument-failed) · 1 unverified
InputExample pretrain_BERT_on_2_tasks.py ran no licence file found · pointer only · 432d01bfadb6127b · report fixture: returned InputExample · level recorded 2026-09-22
InputFeatures pretrain_BERT_on_2_tasks.py ran no licence file found · pointer only · deb446a77b1fa33a · report fixture: returned InputFeatures · level recorded 2026-09-22
convert_example_to_features in 10 papers pretrain_BERT_on_2_tasks.py ran · our draft was wrong no licence file found · pointer only · 75c0c7f18ff966cd · report fixture: signature example:InputExample/0/?, max_seq_length:int/0/int, tokenizer:MockTokenizer/0/? · returned InputFeatures · level recorded 2026-09-22
random_word in 5 papers pretrain_BERT_on_2_tasks.py ran · our draft was wrong no licence file found · pointer only · 248a56618edd3caa · report fixture: signature tokens:list/1/str, tokenizer:MockTokenizer/0/? · returned tuple · level recorded 2026-09-22
BERTDataset pretrain_BERT_on_2_tasks.py unverified no licence file found · pointer only · 024276ac7a13ca21 · report
goldenbili/Bert_Test2 community (archive-listed) 2 samples, 1 ran (1 instrument-failed) · 1 unverified
get_activation in 218 papers modeling.py ran · our draft was wrong Apache-2.0 (permissive) · 0e2c9d9757a88fbb · report fixture: signature activation_string:str/0/str · returned function · level recorded 2026-09-22
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · eebd62f1e724cbb4 · report
goldenbili/Bert_Test3 community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
weighted_avg drqa/reader/layers.py ran fingerprinted Apache-2.0 (permissive) · 880a4e01d58b0591 · report fixture: signature x:Tensor/3/float, weights:Tensor/2/float · returned Tensor · level recorded 2026-09-25
uniform_weights in 5 papers drqa/reader/layers.py unverified Apache-2.0 (permissive) · 9f1455d03e97305c · report
goodluck4s/bert- community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 1dc5a90b12f37329 · report
google-research/bigbird community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers bigbird/core/modeling.py unverified Apache-2.0 (permissive) · 3625fdaae4382d86 · report
gouwenrui/cpe-pro-main community (archive-listed) 1 sample, 0 ran · 1 unverified
PLMEncoder src/plm.py unverified MIT (permissive) · 3dbd5a92caea19f0 · report
graykode/nlp-tutorial community (archive-listed) 7 samples, 1 ran (0 instrument-failed) · 6 unverified
get_attn_pad_mask in 7 papers 5-2.BERT/BERT.py ran · violated contract fingerprinted MIT (permissive) · fae58f94f84bd6c2 · report fixture: signature seq_q:Tensor/2/int, seq_k:Tensor/2/int · returned Tensor · level recorded 2026-09-22
BERT 5-2.BERT/BERT.py unverified MIT (permissive) · 70af42b4fed0b18c · report
Embedding in 90 papers 5-2.BERT/BERT.py unverified MIT (permissive) · fa869a3c0b590d54 · report
EncoderLayer in 73 papers 5-2.BERT/BERT.py unverified MIT (permissive) · 0fa1d625645ff06d · report
PoswiseFeedForwardNet 5-2.BERT/BERT.py unverified MIT (permissive) · ba60b890cbc73454 · report
ScaledDotProductAttention in 46 papers 5-2.BERT/BERT.py unverified MIT (permissive) · 5f28d0d9dbdfbe97 · report
guoyaohua/BERT-Chinese-Annotation community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
convert_to_unicode in 40 papers tokenization.py ran fingerprinted Apache-2.0 (permissive) · 0953802ea4dc83a7 · report fixture: signature text:str/0/str · returned str · level recorded 2026-09-26
load_vocab in 107 papers tokenization.py unverified Apache-2.0 (permissive) · cfdf5fac37771edf · report
guoyaohua/BERT-Classifier community (archive-listed) 3 samples, 0 ran · 3 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · a3b61b2a031736be · report
attention_layer in 9 papers modeling.py unverified Apache-2.0 (permissive) · 3962b885663c0edd · report
transformer_model in 7 papers modeling.py unverified Apache-2.0 (permissive) · 60bfa1dabc7ab848 · report
h4ste/oscar community (archive-listed) 11 samples, 4 ran (3 instrument-failed) · 7 unverified
float32_variable_storage_getter modeling.py ran; the contract check could not run (RAISES) · metamorphic tier: well formed Apache-2.0 (permissive) · 21770a12e09aba7f · report fixture: signature getter:callable/0/?, name:str/0/str, shape:tuple/1/int, dtype:DType/0/?, initializer:callable/0/?, regularizer:NoneType/0/?, trainable:bool/0/bool, args:tuple/1/empty, kwargs:dict/0/? · returned EagerTensor · level recorded 2026-09-22
gelu in 308 papers
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input
modeling.py ran · honoured contract fingerprinted Apache-2.0 (permissive) · a9f91ae77954f959 · report fixture: signature x:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-22
get_activation in 218 papers modeling.py ran · our draft was wrong Apache-2.0 (permissive) · fe35dab7a35b3957 · report fixture: signature activation_string:str/0/str · returned function · level recorded 2026-09-22
get_custom_getter modeling.py ran · our draft was wrong Apache-2.0 (permissive) · d46b96cda962e830 · report fixture: signature compute_type:DType/0/? · returned function · level recorded 2026-09-22
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 4d900dd3364ebe60 · report
attention_layer in 9 papers modeling.py unverified Apache-2.0 (permissive) · e2b4886c5ce3dcec · report
create_attention_mask_from_input_mask in 8 papers modeling.py unverified Apache-2.0 (permissive) · a9740dd2f1c01a4f · report
embedding_lookup in 9 papers modeling.py unverified Apache-2.0 (permissive) · 599deae552ebf869 · report
embedding_postprocessor in 7 papers modeling.py unverified Apache-2.0 (permissive) · 08131d4e8c12f7b0 · report
layer_norm_and_dropout in 6 papers modeling.py unverified Apache-2.0 (permissive) · 82dc008a899111c5 · report
transformer_model in 7 papers modeling.py unverified Apache-2.0 (permissive) · f0fc6275fce8ef79 · report
haidershaour/bert community (archive-listed) 10 samples, 1 ran (1 instrument-failed) · 9 unverified
reshape_from_matrix in 7 papers modeling.py ran · our draft was wrong Apache-2.0 (permissive) · ebe9bbd024b8363d · report fixture: returned SymbolicTensor · level recorded 2026-09-22
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 8817d532f8aedb47 · report
assert_rank in 6 papers modeling.py unverified Apache-2.0 (permissive) · d81c54f86ae5696c · report
attention_layer in 9 papers modeling.py unverified Apache-2.0 (permissive) · 6e650585e8d0a755 · report
create_attention_mask_from_input_mask in 8 papers modeling.py unverified Apache-2.0 (permissive) · 135eb61e78abc50e · report
embedding_lookup in 9 papers modeling.py unverified Apache-2.0 (permissive) · 1c992b32418ba384 · report
embedding_postprocessor in 7 papers modeling.py unverified Apache-2.0 (permissive) · 0ecc5ad60cd279ca · report
get_activation in 218 papers modeling.py unverified Apache-2.0 (permissive) · e1076e465b586052 · report
get_shape_list in 9 papers modeling.py unverified Apache-2.0 (permissive) · 7b6fa879bb8d0363 · report
transformer_model in 7 papers modeling.py unverified Apache-2.0 (permissive) · ea7da1391dc2610d · report
han-shi/SparseBERT community (archive-listed) 5 samples, 0 ran · 5 unverified
BertAttention in 28 papers modeling.py unverified Apache-2.0 (permissive) · e12264c69d5f6ed1 · report
BertEncoder in 20 papers modeling.py unverified Apache-2.0 (permissive) · 3b780454a1b795ae · report
BertLayer in 23 papers modeling.py unverified Apache-2.0 (permissive) · 1d5bc576a32a71e5 · report
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · b012d23ee83351a2 · report
BertPreTrainedModel in 7 papers modeling.py unverified Apache-2.0 (permissive) · a8dd78eaed472e6c · report
haydlite/sparse-bert-ner community (archive-listed) 10 samples, 1 ran (0 instrument-failed) · 9 unverified
shape_list in 9 papers bert_sparse/utils.py ran MIT (permissive) · cd763e47e29c808f · report fixture: signature x:EagerTensor/3/float · returned list · level recorded 2026-09-26
calculate in 13 papers metrics.py unverified MIT (permissive) · 8cbcf76f3222a300 · report
f1 in 57 papers old_version/tf_metrics.py unverified MIT (permissive) · 68aa9e92f48080b5 · report
file_based_input_fn_builder in 16 papers BERT-NER-Sparse.py unverified MIT (permissive) · 0899aefad9866244 · report
file_based_input_fn_builder in 16 papers old_version/BERT_NER.py unverified MIT (permissive) · a1fd823bb2bb995b · report
get_attn_mask in 8 papers bert_sparse/attention.py unverified MIT (permissive) · b87767b29ecb8027 · report
metric_variable metrics.py unverified MIT (permissive) · c93b20fa2bf55fe9 · report
precision in 25 papers old_version/tf_metrics.py unverified MIT (permissive) · 46fcc6e1de355e47 · report
recall in 38 papers old_version/tf_metrics.py unverified MIT (permissive) · edc87736fbab8af0 · report
streaming_confusion_matrix metrics.py unverified MIT (permissive) · 33afb91d63cfddca · report
heraclex12/vietpunc community (archive-listed) 1 sample, 0 ran · 1 unverified
PuncBERTModel models/bert.py unverified no licence file found · pointer only · d6b3e8c4cfdf7880 · report
huanghonggit/Mask-Language-Model community (archive-listed) 8 samples, 6 ran (0 instrument-failed) · 2 unverified
Conv in 30 papers
census: 8 implementations from 8 papers, 8 distinct outputs across 2 buckets, one shared input per bucket
model/bert.py ran fingerprinted Apache-2.0 (permissive) · c777d006e1c7692c · report fixture: returned Conv · level recorded 2026-09-22
EncoderPrenet model/bert.py ran Apache-2.0 (permissive) · 4edee1c7737c7b5e · report fixture: returned EncoderPrenet · level recorded 2026-09-22
FFN in 37 papers model/bert.py ran Apache-2.0 (permissive) · eec394cb9b99cf20 · report fixture: returned FFN · level recorded 2026-09-22
Linear in 127 papers model/bert.py ran Apache-2.0 (permissive) · 6f92bd1259c76a64 · report fixture: returned Linear · level recorded 2026-09-22
MultiheadAttention in 44 papers model/bert.py ran Apache-2.0 (permissive) · 0d4d097ae7a7f1de · report fixture: signature key:Tensor/3/float, value:Tensor/3/float, query:Tensor/3/float, mask:NoneType/0/?, query_mask:NoneType/0/? · returned tuple · level recorded 2026-09-24
get_sinusoid_encoding_table in 51 papers model/bert.py ran · honoured contract fingerprinted Apache-2.0 (permissive) · dcca3917b85d56dc · report fixture: signature n_position:int/0/int, d_hid:int/0/int, padding_idx:NoneType/0/? · returned Tensor · level recorded 2026-09-22
BERT model/bert.py unverified Apache-2.0 (permissive) · 35cb8b1ce1125591 · report
icewing1996/bert_dep community (archive-listed) 6 samples, 3 ran (1 instrument-failed) · 3 unverified
dropout in 34 papers lstm_crf_layer.py ran; the contract check could not run (RAISES) · metamorphic tier: invariant fingerprinted Apache-2.0 (permissive) here; the stored copy is pointer only · 873e08c3f15eb1e4 · report fixture: signature input_tensor:EagerTensor/2/float, dropout_prob:float/0/float · returned EagerTensor · level recorded 2026-09-22
sigmoid in 216 papers
census: 36 implementations from 56 papers, 7 distinct outputs across 3 buckets, one shared input per bucket
linalg.py ran fingerprinted Apache-2.0 (permissive) · 5ee5f3de417ac23d · report fixture: signature x:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-26
tanh in 21 papers
census: 6 implementations from 7 papers, 2 distinct outputs across 2 buckets, one shared input per bucket
linalg.py ran fingerprinted Apache-2.0 (permissive) · 00edc2dc619cd019 · report fixture: signature x:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-26
file_based_input_fn_builder in 16 papers ccg.py unverified Apache-2.0 (permissive) · 47e15bf7d3423516 · report
file_based_input_fn_builder in 16 papers run_classifier.py unverified Apache-2.0 (permissive) · d376d356370dc438 · report
orthonormal_initializer linalg.py unverified Apache-2.0 (permissive) · 2e71814e529d090b · report
ilhamfp/indonesian-text-classification-multilingual community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
f1 in 57 papers src/model-full.py ran · honoured contract no licence file found · pointer only · bee3340c9aa9a937 · report fixture: signature y_true:EagerTensor/2/float, y_pred:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-22
build_model in 469 papers src/model-full.py unverified no licence file found · pointer only · 2e7b60e9f5611167 · report
itsShnik/adaptively-finetuning-transformers community (archive-listed) 3 samples, 1 ran (0 instrument-failed) · 2 unverified
BertAttention in 28 papers lxmert/src/lxrt/modeling.py ran no licence file found · pointer only · 4d9cbea89cdaecc9 · report fixture: signature hidden_states:Tensor/3/float, context:Tensor/3/float, attention_mask:Tensor/4/float, policy:Tensor/2/int, current_index:int/0/int · returned tuple · level recorded 2026-09-24
BertLayer in 23 papers lxmert/src/lxrt/modeling.py unverified no licence file found · pointer only · f2559f88f4286ee8 · report
BertSelfattLayer lxmert/src/lxrt/modeling.py unverified no licence file found · pointer only · abcb694edfecc416 · report
jageshmaharjan/BERT_Service community (archive-listed) 4 samples, 1 ran (1 instrument-failed) · 3 unverified
get_activation in 218 papers bert/modeling.py ran · our draft was wrong MIT (permissive) · 2dc172f4dc0c745c · report fixture: signature activation_string:str/0/str · returned function · level recorded 2026-09-22
BertModel in 16 papers bert/modeling.py unverified MIT (permissive) · 59d9d9684a5da4c8 · report
embedding_lookup in 9 papers bert/modeling.py unverified MIT (permissive) · 74c0bfda0f255d96 · report
embedding_postprocessor in 7 papers bert/modeling.py unverified MIT (permissive) · 1e3dc39e015d88ab · report
joongbo/tta community (archive-listed) 2 samples, 0 ran · 2 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · d62d803ad81a8a4a · report
embedding_postprocessor in 7 papers modeling.py unverified Apache-2.0 (permissive) · 80aef4984f2a61f8 · report
jsantoso2/yelp-clone-ml-project community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
clean_text in 84 papers app/flask-backend/firebase.py ran Apache-2.0 (permissive) · c7f933f28568cfaa · report fixture: signature tokenizer:MockTokenizer/0/?, text:str/0/str · returned str · level recorded 2026-09-26
jungomi/swiss-language-model community (archive-listed) 1 sample, 0 ran · 1 unverified
mask_tokens in 12 papers dataset.py unverified MIT (permissive) · 9426851b703fea8b · report
junhahyung/bert_finetune community (archive-listed) 1 sample, 0 ran · 1 unverified
streamingConfusionMatrix run_classifier_with_tfhub.py unverified Apache-2.0 (permissive) · 12be9ed008c3f47a · report
kaushaltrivedi/fast-bert community (archive-listed) 1 sample, 0 ran · 1 unverified
BertForMultiLabelSequenceClassification fast_bert/modeling.py unverified Apache-2.0 (permissive) · 88d2575e81797042 · report
keiyamashita111/aaproject community (archive-listed) 1 sample, 0 ran · 1 unverified
file_based_input_fn_builder in 16 papers run_classifier.py unverified Apache-2.0 (permissive) · 9a5abbce8429ae70 · report
kelly2016/multi-label-bert community (archive-listed) 1 sample, 0 ran · 1 unverified
file_based_input_fn_builder in 16 papers run_multilabel_classifier.py unverified Apache-2.0 (permissive) · 601b94f2d092637c · report
khalidsaifullaah/bertify community (archive-listed) 1 sample, 0 ran · 1 unverified
BERTify bertify/bertify.py unverified MIT (permissive) · 0c96804f16a23ffb · report
kpot/keras-transformer community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
BatchGeneratorForBERT keras_transformer/bert.py ran MIT (permissive) · d6be9b6981e1b7dd · report fixture: returned BatchGeneratorForBERT · level recorded 2026-09-22
kyzhouhzau/BERT-NER community (archive-listed) 1 sample, 0 ran · 1 unverified
streaming_confusion_matrix metrics.py unverified MIT (permissive) · 6a1605b748dc3754 · report
lehoanganh298/BERT-Question-Answering community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
convert_single_example in 5 papers run_classifier_predict.py ran Apache-2.0 (permissive) · 6bd23bdfeb17ff94 · report fixture: signature ex_index:int/0/int, example:InputExample/0/?, label_list:list/1/str, max_seq_length:int/0/int, tokenizer:MinimalTokenizer/0/? · returned InputFeatures · level recorded 2026-09-26
file_based_convert_examples_to_features run_classifier_predict.py unverified Apache-2.0 (permissive) · 11bbc9cf3f52d34b · report
lemonhu/ner-bert-pytorch community (archive-listed) 6 samples, 6 ran (0 instrument-failed) · 0 unverified
build_tags build_msra_dataset_tags.py ran MIT (permissive) · 78e003936d274d14 · report fixture: signature data_dir:str/0/str, tags_file:str/0/str · returned set · level recorded 2026-09-26
end_of_chunk in 5 papers metrics.py ran MIT (permissive) · 151e18551b43baef · report fixture: signature prev_tag:str/0/str, tag:str/0/str, prev_type:str/0/str, type_:str/0/str · returned bool · level recorded 2026-09-25
get_entities in 12 papers metrics.py ran MIT (permissive) · 90ade26d2ce0e22f · report fixture: signature seq:list/1/str, suffix:bool/0/bool · returned list · level recorded 2026-09-25
load_checkpoint in 277 papers utils.py ran MIT (permissive) · d8d0beca7d0f8ccb · report fixture: signature checkpoint:str/0/str, model:callable/0/?, optimizer:SGD/0/? · returned dict · level recorded 2026-09-25
load_dataset in 276 papers build_msra_dataset_tags.py ran MIT (permissive) · 94f83a90c6177a65 · report fixture: signature path_dataset:str/0/str · returned list · level recorded 2026-09-26
start_of_chunk metrics.py ran MIT (permissive) · 7373bfcd2aa77048 · report fixture: signature prev_tag:str/0/str, tag:str/0/str, prev_type:str/0/str, type_:str/0/str · returned bool · level recorded 2026-09-25
linlei1214/SITS-BERT community (archive-listed) 6 samples, 2 ran (0 instrument-failed) · 4 unverified
BERTEmbedding code/model/bert.py ran MIT (permissive) · 876070eebb72f76a · report fixture: returned BERTEmbedding · level recorded 2026-09-22
PositionalEncoding in 126 papers
census: 13 implementations from 9 papers, 9 distinct outputs across 5 buckets, one shared input per bucket
code/model/bert.py ran fingerprinted MIT (permissive) · 8721b3fce91b7165 · report fixture: returned PositionalEncoding · level recorded 2026-09-22
MultiHeadedAttention in 38 papers code/model/bert.py unverified MIT (permissive) · a56b4078536a7e01 · report
PositionwiseFeedForward in 36 papers code/model/bert.py unverified MIT (permissive) · bb6ffa608bbf657a · report
SBERT code/model/bert.py unverified MIT (permissive) · a46f4f098334713f · report
TransformerBlock in 73 papers code/model/bert.py unverified MIT (permissive) · 9b28507fe7a827ac · report
lonePatient/Bert-Multi-Label-Text-Classification community (archive-listed) 5 samples, 5 ran (2 instrument-failed) · 0 unverified
whitespace_tokenize in 49 papers pybert/model/albert/tokenization_bert.py ran · our draft was wrong fingerprinted MIT (permissive) · cf9ffa02a42184af · report fixture: signature text:str/0/str · returned list · level recorded, date not recorded
gelu in 308 papers
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32
pybert/model/albert/modeling_bert.py ran · honoured contract fingerprinted MIT (permissive) here; the stored copy is pointer only · 211753ba29188d4e · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22
gelu_new in 55 papers
census: 3 implementations from 7 papers, 1 distinct output on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32
pybert/model/albert/modeling_bert.py ran · honoured contract fingerprinted MIT (permissive) here; the stored copy is pointer only · 77601724cad03f95 · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22
load_tf_weights_in_bert in 135 papers pybert/model/albert/modeling_bert.py ran · our draft was wrong MIT (permissive) here; the stored copy is pointer only · 0c145728a35789fa · report fixture: signature model:callable/0/?, config:Config/0/?, tf_checkpoint_path:str/0/str · returned BertModel · level recorded 2026-09-22
load_vocab in 107 papers pybert/model/albert/tokenization_bert.py ran MIT (permissive) · 659f3761c1dc81fa · report fixture: signature vocab_file:str/0/str · returned OrderedDict · level recorded 2026-09-24
lonePatient/ERNIE-text-classification-pytorch community (archive-listed) 17 samples, 6 ran (4 instrument-failed) · 11 unverified
BertConfig in 14 papers pyernie/model/ernie/modeling.py ran · metamorphic tier: deterministic no licence file found · pointer only · 4c8dd71a74ae58f4 · report fixture: returned BertConfig · level recorded 2026-09-22
BertIntermediate in 15 papers pyernie/model/ernie/modeling.py ran · metamorphic tier: deterministic fingerprinted no licence file found · pointer only · 9597f5146c4fa55c · report fixture: returned BertIntermediate · level recorded 2026-09-22
cached_path in 47 papers pyernie/model/ernie/modeling.py ran · our draft was wrong no licence file found · pointer only · 534dfe582037c26b · report fixture: signature url_or_filename:str/0/str, cache_dir:str/0/str · returned str · level recorded 2026-09-22
s3_request pyernie/model/ernie/modeling.py ran · our draft was wrong no licence file found · pointer only · d03f582131d8575c · report fixture: signature func:callable/0/? · returned function · level recorded 2026-09-22
split_s3_path pyernie/model/ernie/modeling.py ran · our draft was wrong no licence file found · pointer only · 1f8e0d57a93f2b98 · report fixture: signature url:str/0/str · returned tuple · level recorded 2026-09-22
url_to_filename in 73 papers pyernie/model/ernie/modeling.py ran · our draft was wrong fingerprinted no licence file found · pointer only · af64ec220e8bcdbc · report fixture: signature url:str/0/str, etag:str/0/str · returned str · level recorded 2026-09-22
BertAttention in 28 papers pyernie/model/ernie/modeling.py unverified no licence file found · pointer only · 978bca45efc60c53 · report
BertEmbeddings in 21 papers pyernie/model/ernie/modeling.py unverified no licence file found · pointer only · c265396993793fbf · report
BertEncoder in 20 papers pyernie/model/ernie/modeling.py unverified no licence file found · pointer only · 064f9026080680e2 · report
BertLayer in 23 papers pyernie/model/ernie/modeling.py unverified no licence file found · pointer only · 4ea9890699c11b28 · report
BertModel in 16 papers pyernie/model/ernie/modeling.py unverified no licence file found · pointer only · 0a619d4800774912 · report
BertOutput in 13 papers pyernie/model/ernie/modeling.py unverified no licence file found · pointer only · fb6862928ef36d03 · report
PreTrainedBertModel pyernie/model/ernie/modeling.py unverified no licence file found · pointer only · 35ea09ed4f1542c2 · report
get_from_cache pyernie/model/ernie/modeling.py unverified no licence file found · pointer only · e25398920d88eec3 · report
http_get pyernie/model/ernie/modeling.py unverified no licence file found · pointer only · 20bb0eaadd1d38ce · report
s3_etag pyernie/model/ernie/modeling.py unverified no licence file found · pointer only · 43b164ab6ace951e · report
s3_get pyernie/model/ernie/modeling.py unverified no licence file found · pointer only · d3da3cf9bfe8b9a5 · report
louis-udm/ner-bert-crf community (archive-listed) 2 samples, 2 ran (0 instrument-failed) · 0 unverified
f1_score in 121 papers NER_BERT_CRF.py ran fingerprinted MIT (permissive) · 3cbc191d5ba7a810 · report fixture: signature y_true:ndarray/1/int, y_pred:ndarray/1/int · returned tuple · level recorded 2026-09-26
get_data_dir in 9 papers NER_BERT_CRF.py ran MIT (permissive) · 19a646c088e51dd7 · report fixture: signature local_path:str/0/str, server_path:str/0/str · returned str · level recorded 2026-09-26
lvyufeng/mindspore-nlp-tutorial community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
get_attn_pad_mask in 7 papers 5-1.Transformer/Transformer.py ran fingerprinted MIT (permissive) · 0e1d7c4bb776fe62 · report fixture: signature seq_q:Tensor/2/int, seq_k:Tensor/2/int · returned Tensor · level recorded 2026-09-26
maknotavailable/pytorch-pretrained-bert community (archive-listed) 12 samples, 6 ran (1 instrument-failed) · 6 unverified
BertAttention in 28 papers pytorch_pretrained_bert/modeling.py ran fingerprinted Apache-2.0 (permissive) · 149f493786f28d23 · report fixture: signature input_tensor:Tensor/3/float, attention_mask:Tensor/4/float · returned Tensor · level recorded 2026-09-24
BertEmbeddings in 21 papers pytorch_pretrained_bert/modeling.py ran · metamorphic tier: invariant Apache-2.0 (permissive) · 95de1baf9219476c · report fixture: signature input_ids:Tensor/2/int, token_type_ids:Tensor/2/int · returned Tensor · level recorded 2026-09-22
BertLayerNorm pytorch_pretrained_bert/modeling.py ran · metamorphic tier: invariant fingerprinted Apache-2.0 (permissive) · db45f6229b637fb4 · report fixture: signature x:Tensor/3/float · returned Tensor · level recorded 2026-09-22
BertOutput in 13 papers pytorch_pretrained_bert/modeling.py ran · metamorphic tier: invariant Apache-2.0 (permissive) · 85b548d92c70c22b · report fixture: signature hidden_states:Tensor/3/float, input_tensor:Tensor/3/float · returned Tensor · level recorded 2026-09-22
BertSelfOutput in 14 papers pytorch_pretrained_bert/modeling.py ran · metamorphic tier: invariant Apache-2.0 (permissive) · 5c90e4d2568bfcd1 · report fixture: signature hidden_states:Tensor/3/float, input_tensor:Tensor/3/float · returned Tensor · level recorded 2026-09-22
cached_path in 47 papers pytorch_pretrained_bert/modeling.py ran · our draft was wrong Apache-2.0 (permissive) · 6b926a4dea58d814 · report fixture: signature url_or_filename:str/0/str, cache_dir:str/0/str · returned str · level recorded 2026-09-22
BertConfig in 14 papers pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 740f60e01d11ace6 · report
BertEncoder in 20 papers pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 7e1548e1a31a85bc · report
BertLayer in 23 papers pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 6f23494271c18741 · report
BertModel in 16 papers pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 4f399deeb0300ce5 · report
PreTrainedBertModel pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 5819c9932ff45111 · report
get_from_cache pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · f2aa87ff483796f8 · report
meelfy/pytorch_pretrained_bert community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers pytorch_pretrained_bert/modeling.py unverified Apache-2.0 (permissive) · 6725fc5eaa566426 · report
meizi1114/bert community (archive-listed) 3 samples, 1 ran (0 instrument-failed) · 2 unverified
convert_to_unicode in 40 papers tokenization.py ran fingerprinted Apache-2.0 (permissive) · e2bfbb357751d986 · report fixture: signature text:str/0/str · returned str · level recorded 2026-09-26
file_based_input_fn_builder in 16 papers run_mtl.py unverified Apache-2.0 (permissive) · 242ba183419ac2b3 · report
load_vocab in 107 papers tokenization.py unverified Apache-2.0 (permissive) · 71806f38591c80b6 · report
mirbostani/QA-KD-AL community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
BertTokenizerX qa/model/bert.py ran fingerprinted MIT (permissive) · 1d2a6caabd9dc5f0 · report fixture: signature s:str/0/str, debug:bool/0/bool · returned str · level recorded 2026-09-24
mithunpaul08/bert_tensorflow community (archive-listed) 4 samples, 2 ran (0 instrument-failed) · 2 unverified
report_score fnc_scorer.py ran Apache-2.0 (permissive) · 4b450fe6cbd79881 · report fixture: signature actual:list/1/str, predicted:list/1/str · returned float · level recorded 2026-09-26
score_submission fnc_scorer.py ran Apache-2.0 (permissive) · b5f23937875fe0ba · report fixture: signature gold_labels:list/1/str, test_labels:list/1/str · returned tuple · level recorded 2026-09-26
create_optimizer in 37 papers optimization.py unverified Apache-2.0 (permissive) · c070006ff55cd83a · report
get_assignment_map_from_checkpoint in 32 papers modeling.py unverified Apache-2.0 (permissive) · 1afbd244a1386ac2 · report
mkavim/finetune_bert community (archive-listed) 7 samples, 4 ran (2 instrument-failed) · 3 unverified
BertConfig in 14 papers finetune/modeling_bert.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · aac15b5f40a6b617 · report fixture: returned BertConfig · level recorded 2026-09-22
BertMultiHeadSelfAttention finetune/modeling_bert.py ran Apache-2.0 (permissive) · f302dc3e27e4899c · report fixture: returned BertMultiHeadSelfAttention · level recorded 2026-09-22
checkpoint_loader finetune/modeling_bert.py ran · our draft was wrong Apache-2.0 (permissive) · b8840d088409a430 · report fixture: signature checkpoint_file:str/0/str · returned function · level recorded 2026-09-22
create_token_type_ids finetune/modeling_bert.py ran · our draft was wrong fingerprinted Apache-2.0 (permissive) · 29b9ba476de00900 · report fixture: signature input_ids:EagerTensor/2/int · returned EagerTensor · level recorded 2026-09-22
BertModel in 16 papers finetune/modeling_bert.py unverified Apache-2.0 (permissive) · 4ad0a0a5c8931d4f · report
BertPretrained finetune/modeling_bert.py unverified Apache-2.0 (permissive) · e34f104652a8da5a · report
load_bert_model_weights_from_checkpoint finetune/modeling_bert.py unverified Apache-2.0 (permissive) · 1e2cc37deb600404 · report
mocherson/aki_bert community (archive-listed) 3 samples, 2 ran (2 instrument-failed) · 1 unverified
convert_example_to_features in 10 papers lm_finetuning/simple_lm_finetuning.py ran · our draft was wrong no licence file found · pointer only · 22f2bcc8465b2203 · report fixture: signature example:InputExample/0/?, max_seq_length:int/0/int, tokenizer:SimpleTokenizer/0/? · returned InputFeatures · level recorded 2026-09-24
random_word in 5 papers lm_finetuning/simple_lm_finetuning.py ran · our draft was wrong no licence file found · pointer only · a72f84dbce6c5d65 · report fixture: signature tokens:list/1/str, tokenizer:SimpleTokenizer/0/? · returned tuple · level recorded 2026-09-24
BERTDataset lm_finetuning/simple_lm_finetuning.py unverified no licence file found · pointer only · 3fb8e7a9fb8c481b · report
nageshsinghc4/deepwrap community (archive-listed) 1 sample, 0 ran · 1 unverified
_build_bert deepwrap/text/models.py unverified no licence file found · pointer only · 996de2f5520cce23 · report
nicholasbao/nlp_job community (archive-listed) 2 samples, 1 ran (1 instrument-failed) · 1 unverified
get_time_dif text_similarity_cnn/run_cnn.py ran · our draft was wrong Apache-2.0 (permissive) · d9e00c99bc3b43d2 · report fixture: signature start_time:float/0/float · returned timedelta · level recorded 2026-09-22
feed_data text_similarity_cnn/run_cnn.py unverified Apache-2.0 (permissive) · 1d395be1e3a96352 · report
nmfisher/bert-modified community (archive-listed) 3 samples, 2 ran (0 instrument-failed) · 1 unverified
build_char_to_word data_reader.py ran fingerprinted Apache-2.0 (permissive) · d395611f9cd6a0d3 · report fixture: signature text:str/0/str · returned tuple · level recorded 2026-09-26
is_whitespace in 7 papers data_reader.py ran · violated contract Apache-2.0 (permissive) here; the stored copy is pointer only · d2b920290dd11a30 · report fixture: signature c:str/0/str · returned bool · level recorded 2026-09-24
input_fn_builder in 13 papers run_squad_slot_tagger.py unverified Apache-2.0 (permissive) · 49b90dc3f10fce0a · report
noelkelias/multitok community (archive-listed) 1 sample, 0 ran · 1 unverified
bert_tokens experiments/bert.py unverified no licence file found · pointer only · f2fb2830bbc816a7 · report
noise-learning/selfmix community (archive-listed) 2 samples, 0 ran · 2 unverified
BertEncoder4Mix baselines/model/bert_classify.py unverified no licence file found · pointer only · 9e9a027310f7dd84 · report
BertModel4Mix baselines/model/bert_classify.py unverified no licence file found · pointer only · d38eef6a039776c4 · report
okanvk/Turkish-Reading-Comprehension-Question-Answering-Dataset community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
BertQAService web/backend/app/services/BertService.py ran fingerprinted MIT (permissive) · 2a545c0405dc1c93 · report fixture: signature question:str/0/str, context:str/0/str · returned str · level recorded 2026-09-24
overfitter/biobert_embedding community (archive-listed) 2 samples, 0 ran · 2 unverified
get_BioBert biobert_embedding/downloader.py unverified MIT (permissive) · f381271bfc9c337d · report
get_confirm_token in 41 papers biobert_embedding/downloader.py unverified MIT (permissive) here; the stored copy is pointer only · 135b3dc835ffe6ad · report
pengshuyuan/Bert community (archive-listed) 8 samples, 2 ran (1 instrument-failed) · 6 unverified
get_shape_list in 9 papers modeling.py ran · our draft was wrong fingerprinted Apache-2.0 (permissive) · 2d8aa8d9d0c2d5e5 · report fixture: signature tensor:EagerTensor/2/float, expected_rank:int/0/int, name:str/0/str · returned list · level recorded 2026-09-22
reshape_from_matrix in 7 papers modeling.py ran Apache-2.0 (permissive) · e118b009c023bf15 · report fixture: returned SymbolicTensor · level recorded 2026-09-22
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · a05a5798905d6dd0 · report
attention_layer in 9 papers modeling.py unverified Apache-2.0 (permissive) · c18bd0ef8d750675 · report
create_attention_mask_from_input_mask in 8 papers modeling.py unverified Apache-2.0 (permissive) · f4788df953d5dec3 · report
embedding_lookup in 9 papers modeling.py unverified Apache-2.0 (permissive) · ddcb3c30efc18240 · report
embedding_postprocessor in 7 papers modeling.py unverified Apache-2.0 (permissive) · 1d6176191bd79227 · report
transformer_model in 7 papers modeling.py unverified Apache-2.0 (permissive) · 05cc60302ae6f12e · report
pytorch/text community (archive-listed) 3 samples, 2 ran (0 instrument-failed) · 1 unverified
PositionalEmbedding in 43 papers
census: 6 implementations from 6 papers, 4 distinct outputs across 3 buckets, one shared input per bucket
torchtext/models/roberta/model.py ran · metamorphic tier: deterministic fingerprinted BSD-3-Clause (permissive) · 4631d4896f7b464d · report fixture: returned PositionalEmbedding · level recorded 2026-09-22
TransformerEncoder in 96 papers torchtext/models/roberta/model.py ran · metamorphic tier: deterministic BSD-3-Clause (permissive) · 3fa8b8c8ef28e810 · report fixture: returned TransformerEncoder · level recorded 2026-09-22
RobertaEncoder torchtext/models/roberta/model.py unverified BSD-3-Clause (permissive) · 46de24beef44cf28 · report
qywu/Chinese-GPT community (archive-listed) 8 samples, 2 ran (0 instrument-failed) · 6 unverified
TransformerIntermediate chinese_gpt/gpt_modeling.py ran MIT (permissive) · 9be5a608b03add6a · report fixture: signature hidden_states:Tensor/3/float · returned Tensor · level recorded 2026-09-24
gelu in 308 papers
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32
chinese_gpt/gpt_modeling.py ran · honoured contract fingerprinted MIT (permissive) · 409ea40d28f93c7e · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22
TransformerAttention chinese_gpt/gpt_modeling.py unverified MIT (permissive) · 207b46bd316070c6 · report
TransformerLayer in 34 papers chinese_gpt/gpt_modeling.py unverified MIT (permissive) · 07f05b67a5afe0dd · report
TransformerModel in 26 papers chinese_gpt/gpt_modeling.py unverified MIT (permissive) · 946cd24442973489 · report
TransformerOutput in 5 papers chinese_gpt/gpt_modeling.py unverified MIT (permissive) · 03a3d15424bea269 · report
TransformerSelfAttention chinese_gpt/gpt_modeling.py unverified MIT (permissive) · 68634f7940230fc2 · report
TransformerSelfOutput chinese_gpt/gpt_modeling.py unverified MIT (permissive) · 515b61ea2a383523 · report
rajlm10/Chandler community (archive-listed) 5 samples, 5 ran (0 instrument-failed) · 0 unverified
Encoder in 278 papers utils.py ran no licence file found · pointer only · 33a8a91417a6d8be · report fixture: returned Encoder · level recorded 2026-09-22
EncoderLayer in 73 papers utils.py ran no licence file found · pointer only · 3696bbf61fdf1966 · report fixture: returned EncoderLayer · level recorded 2026-09-22
MultiHeadAttention in 124 papers
census: 9 implementations from 7 papers, 9 distinct outputs across 3 buckets, one shared input per bucket
utils.py ran no licence file found · pointer only · d0f7a90c6c7d9e89 · report fixture: returned MultiHeadAttention · level recorded 2026-09-22
PositionalEncoding in 126 papers
census: 13 implementations from 9 papers, 9 distinct outputs across 5 buckets, one shared input per bucket
utils.py ran no licence file found · pointer only · 02b4f900d43f5cdf · report fixture: signature inputs:EagerTensor/3/float · returned EagerTensor · level recorded 2026-09-24
scaled_dot_product_attention in 43 papers utils.py ran · violated contract fingerprinted no licence file found · pointer only · aa2d3d2c35ae9b63 · report fixture: signature queries:EagerTensor/3/float, keys:EagerTensor/3/float, values:EagerTensor/3/float, mask:NoneType/0/? · returned SymbolicTensor · level recorded 2026-09-22
re-search/DocProduct community (archive-listed) 4 samples, 3 ran (0 instrument-failed) · 1 unverified
PositionEmbedding in 7 papers keras_bert/bert.py ran MIT (permissive) · 003d124d2d8b1d66 · report fixture: signature inputs:EagerTensor/2/int · returned EagerTensor · level recorded 2026-09-24
TokenEmbedding in 11 papers keras_bert/bert.py ran fingerprinted MIT (permissive) · dfc55eabce3cbf08 · report fixture: signature inputs:EagerTensor/2/int · returned list · level recorded 2026-09-24
gelu in 308 papers
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input
keras_bert/bert.py ran · honoured contract fingerprinted MIT (permissive) · ac6081d51f65bb8c · report fixture: signature x:EagerTensor/2/float · returned EagerTensor · level recorded 2026-09-22
Bert in 8 papers keras_bert/bert.py unverified MIT (permissive) · a9af20af6f1fc84c · report
ricardordb/bert community (archive-listed) 5 samples, 1 ran (1 instrument-failed) · 4 unverified
embedding_lookup in 9 papers modeling.py ran · our draft was wrong Apache-2.0 (permissive) · 370681b0385cf8f7 · report fixture: signature input_ids:SymbolicTensor/2/int, vocab_size:int/0/int, embedding_size:int/0/int, initializer_range:float/0/float, word_embedding_name:str/0/str, use_one_hot_embeddings:bool/0/bool · returned tuple · level recorded 2026-09-22
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · cdeaf8a002ca4b94 · report
create_attention_mask_from_input_mask in 8 papers modeling.py unverified Apache-2.0 (permissive) · 80cc7be4b4ecc856 · report
embedding_postprocessor in 7 papers modeling.py unverified Apache-2.0 (permissive) · 24b1b48f866e424b · report
layer_norm_and_dropout in 6 papers modeling.py unverified Apache-2.0 (permissive) · 69ead5ac4ce92603 · report
samirsahoo007/Audio-and-Speech-Processing community (archive-listed) 2 samples, 2 ran (1 instrument-failed) · 0 unverified
swish in 258 papers
census: 14 implementations from 37 papers, 2 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32
mockingjay/model.py identical code Syntology harvested from this repository for another paper; this paper's link records no repository, path or licence of its own ran · our draft was wrong fingerprinted licence of this copy not recorded · 0f786c407fb1ee4c · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded, date not recorded
gelu in 308 papers
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32
mockingjay/model.py identical code Syntology harvested from this repository for another paper; this paper's link records no repository, path or licence of its own ran · honoured contract fingerprinted licence of this copy not recorded · fdc64f4c72036ae4 · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22
sberbank-ai/ner-bert community (archive-listed) 13 samples, 12 ran (1 instrument-failed) · 1 unverified
bert_labels2tokens modules/analyze_utils/utils.py ran MIT (permissive) · 8157123cc1775d1e · report fixture: signature dl:MockDataLoader/0/?, labels:list/1/list, fn:callable/0/? · returned tuple · level recorded 2026-09-26
chunk_finder modules/analyze_utils/main_metrics.py ran MIT (permissive) · 8fe6f64121265de8 · report fixture: signature current_token:str/0/str, previous_token:str/0/str, tag:str/0/str · returned tuple · level recorded 2026-09-26
first_choicer modules/analyze_utils/utils.py ran fingerprinted MIT (permissive) · 035ea178c05466c1 · report fixture: signature tok_map:list/1/int, labels:list/1/str · returned list · level recorded 2026-09-26
get_by_class_metric modules/analyze_utils/plot_metrics.py ran MIT (permissive) · 66fa78e9ac27aa7d · report fixture: signature history:list/1/str, metric_:str/0/str, sup_labels:set/0/? · returned defaultdict · level recorded 2026-09-26
get_max_metric modules/analyze_utils/plot_metrics.py ran MIT (permissive) · 2c175ed3d644a05b · report fixture: signature history:list/1/str, metric_:str/0/str, sup_labels:set/0/?, return_idx:bool/0/bool · returned list · level recorded 2026-09-26
get_metrics_by_class modules/analyze_utils/plot_metrics.py ran MIT (permissive) · a8131461fa7068c6 · report fixture: signature text_res:str/0/str, sup_labels:set/0/? · returned dict · level recorded 2026-09-26
if_none modules/utils.py ran fingerprinted MIT (permissive) · 85582e663abb69b2 · report fixture: signature origin:str/0/str, other:str/0/str · returned str · level recorded 2026-09-26
log_sum_exp in 51 papers
census: 10 implementations from 12 papers, 5 distinct outputs across 3 buckets, one shared input per bucket
modules/layers/ncrf.py ran · our draft was wrong fingerprinted MIT (permissive) · 8e960fbb64668568 · report fixture: signature vec:Tensor/3/float, m_size:int/0/int · returned Tensor · level recorded 2026-09-22
precision_recall_f1 modules/analyze_utils/main_metrics.py ran MIT (permissive) · 4c742d96ba772447 · report fixture: signature y_true:list/1/list, y_pred:list/1/list, print_results:bool/0/bool, short_report:bool/0/bool, entity_of_interest:NoneType/0/? · returned OrderedDict · level recorded 2026-09-26
read_config in 49 papers modules/utils.py ran MIT (permissive) · b0e7a08c13d6535c · report fixture: signature config:str/0/str · returned dict · level recorded 2026-09-26
sequence_mask in 55 papers
census: 12 implementations from 15 papers, 5 distinct outputs across 2 buckets, one shared input per bucket
modules/layers/crf.py ran MIT (permissive) · fbfd610e4235afd9 · report fixture: signature lens:Tensor/1/int, max_len:NoneType/0/? · returned Tensor · level recorded 2026-09-26
voting_choicer modules/analyze_utils/utils.py ran MIT (permissive) · 12b283b1c138a097 · report fixture: signature tok_map:list/1/int, labels:list/1/str · returned list · level recorded 2026-09-26
scotthlee/injury_autocoding community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
parse_arguments in 61 papers src/preprocessing.py ran Apache-2.0 (permissive) · 5e8114b1fe8c40c2 · report fixture: signature parser:SimpleParser/0/? · returned Args · level recorded 2026-09-26
parse_arguments in 61 papers src/evaluation.py unverified Apache-2.0 (permissive) · e5e4ad8ef8a96e8d · report
scut-bds/example_repo_from_scutbds community (archive-listed) 6 samples, 3 ran (0 instrument-failed) · 3 unverified
Embedding in 90 papers model/transformer.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · 9b35e4cf0e15ffdd · report fixture: returned Embedding · level recorded 2026-09-22
FeedForward in 198 papers model/transformer.py ran · metamorphic tier: deterministic fingerprinted Apache-2.0 (permissive) · ce2916d914cf9fba · report fixture: returned FeedForward · level recorded 2026-09-22
MultiHeadAttn in 5 papers model/transformer.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · 94f00401c270fbfb · report fixture: returned MultiHeadAttn · level recorded 2026-09-22
Decoder in 210 papers model/transformer.py unverified Apache-2.0 (permissive) · 3ee5d7228f9f7413 · report
Encoder in 278 papers model/transformer.py unverified Apache-2.0 (permissive) · 241a2b5370690f9c · report
Transformer in 173 papers model/transformer.py unverified Apache-2.0 (permissive) · 6df6bb15564e69a3 · report
semal/bert community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers bert/core/modeling.py unverified Apache-2.0 (permissive) · 5eb87d3a8fc7de9a · report
skoltech-nlp/rudetoxifier community (archive-listed) 1 sample, 0 ran · 1 unverified
CondBertRewriter models/condBERT/condbert.py unverified MIT (permissive) · 5922b08ec3b74b7c · report
socc-io/piqaboo community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 5edefb59760db592 · report
sonalisrijan/Deep-Learning-based-Defect-Prediction-Model-for-Source-Code community (archive-listed) 1 sample, 0 ran · 1 unverified
LineBertModel model.py unverified no licence file found · pointer only · 1705400ad5892c18 · report
svakulenk0/response_eval community (archive-listed) 4 samples, 0 ran · 4 unverified
ambiverse_annotation_request utils/ambiverse.py unverified Apache-2.0 (permissive) · b197bed5dd8fcba3 · report
download_and_load_datasets Dialogue_Classifier.py unverified Apache-2.0 (permissive) · 11125cd0d694ad61 · report
load_dataset in 276 papers Dialogue_Classifier.py unverified Apache-2.0 (permissive) · a181d94c3334306d · report
load_directory_data Dialogue_Classifier.py unverified Apache-2.0 (permissive) · 0ccbf8e553bab00d · report
tcnguyen/bert community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 07bff76d62731e8d · report
teghub/TurkishNER-BERT community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers bert/modeling.py unverified no licence file found · pointer only · e9ff615e1693ffe4 · report
thanhlong1997/bert_quora community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
convert_to_k_hot bert_long.py ran fingerprinted Apache-2.0 (permissive) · 4dc95113de962a34 · report fixture: signature labels:list/1/int, num_labels:int/0/int · returned list · level recorded 2026-09-26
thunlp/ReInfoSelect community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
Bert in 8 papers ReInfoSelect/models/bert.py ran fingerprinted MIT (permissive) · 683a4be67f944ea1 · report fixture: signature input_ids:Tensor/2/int, attention_mask:Tensor/2/float, token_type_ids:Tensor/2/int, raw_score:Tensor/1/float · returned tuple · level recorded 2026-09-24
tugstugi/mongolian-bert community (archive-listed) 1 sample, 1 ran (1 instrument-failed) · 0 unverified
create_masked_lm_predictions in 5 papers create_pretraining_data.py ran · our draft was wrong no licence file found · pointer only · b40fc12ef51e9ccc · report fixture: signature tokens:list/1/str, masked_lm_prob:float/0/float, max_predictions_per_seq:int/0/int, vocab_words:list/1/str, rng:SimpleRNG/0/? · returned tuple · level recorded 2026-09-22
tyxr/bert community (archive-listed) 3 samples, 2 ran (0 instrument-failed) · 1 unverified
convert_to_unicode in 40 papers tokenization.py ran fingerprinted Apache-2.0 (permissive) · 595d45bc07678f87 · report fixture: signature text:str/0/str · returned str · level recorded 2026-09-26
printable_text in 36 papers tokenization.py ran fingerprinted Apache-2.0 (permissive) · 1b8d053b2662bc2d · report fixture: signature text:str/0/str · returned str · level recorded 2026-09-26
load_vocab in 107 papers tokenization.py unverified Apache-2.0 (permissive) · b67ad78f40e86899 · report
uygarkurt/BERT-PyTorch community (archive-listed) 2 samples, 2 ran (0 instrument-failed) · 0 unverified
BERT BERT.py ran no licence file found · pointer only · 9f3b950a4be83ebe · report fixture: signature seq:Tensor/2/int, seg:Tensor/2/int · returned Tensor · level recorded 2026-09-24
BERTEmbedding BERT.py ran · metamorphic tier: invariant no licence file found · pointer only · ec36188bdac79842 · report fixture: signature seq:Tensor/2/int, seg:Tensor/2/int · returned Tensor · level recorded 2026-09-22
wchh127/yykf community (archive-listed) 3 samples, 0 ran · 3 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · f298a22a9d079be3 · report
embedding_postprocessor in 7 papers modeling.py unverified Apache-2.0 (permissive) · 34c1f2337ffb814d · report
transformer_model in 7 papers modeling.py unverified Apache-2.0 (permissive) · 79608bac19b3ff5c · report
wenhuchen/HDSA-Dialog community (archive-listed) 5 samples, 3 ran (0 instrument-failed) · 2 unverified
MultiHeadAttention in 124 papers
census: 9 implementations from 7 papers, 9 distinct outputs across 3 buckets, one shared input per bucket
transformer/Transformer.py ran MIT (permissive) · f96d7fde8876634b · report fixture: signature q:Tensor/3/float, k:Tensor/3/float, v:Tensor/3/float, mask:Tensor/3/bool · returned tuple · level recorded 2026-09-24
PositionwiseFeedForward in 36 papers transformer/Transformer.py ran · metamorphic tier: deterministic MIT (permissive) · c47eb374e0a8f194 · report fixture: returned PositionwiseFeedForward · level recorded 2026-09-22
ScaledDotProductAttention in 46 papers transformer/Transformer.py ran · metamorphic tier: deterministic MIT (permissive) · 1bfb42c8f8e10514 · report fixture: returned ScaledDotProductAttention · level recorded 2026-09-22
EncoderLayer in 73 papers transformer/Transformer.py unverified MIT (permissive) · 42ed669c77870eb8 · report
Transformer in 173 papers transformer/Transformer.py unverified MIT (permissive) · c6995481c008210c · report
wyf-python/Bert-Pytorch-TextClassification community (archive-listed) 5 samples, 1 ran (0 instrument-failed) · 4 unverified
BertConfig in 14 papers pytorch_pretrained/modeling.py ran · metamorphic tier: deterministic no licence file found · pointer only · 2f1e6f999036c38d · report fixture: returned BertConfig · level recorded 2026-09-22
BertEncoder in 20 papers pytorch_pretrained/modeling.py unverified no licence file found · pointer only · 348c6586dd6fcb82 · report
BertLayer in 23 papers pytorch_pretrained/modeling.py unverified no licence file found · pointer only · 85b6ae362d64e02e · report
BertModel in 16 papers pytorch_pretrained/modeling.py unverified no licence file found · pointer only · 7fcd355aa43ef519 · report
BertPreTrainedModel in 7 papers pytorch_pretrained/modeling.py unverified no licence file found · pointer only · 8d35a5c30d46d2df · report
wzzzd/LM_NER community (archive-listed) 1 sample, 0 ran · 1 unverified
BertCRF model/bert_crf.py unverified no licence file found · pointer only · ff96aaf623cca5f3 · report
xiangyue9607/CliniRC community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers BERT/modeling.py unverified Apache-2.0 (permissive) · 4b258860805ea4d3 · report
yangyucheng000/ascend_albert community (archive-listed) 5 samples, 5 ran (0 instrument-failed) · 0 unverified
append_cmd script/albert/get_distribute_pretrain_cmd.py ran fingerprinted Apache-2.0 (permissive) · 594c968dcdc272f1 · report fixture: signature cmd:str/0/str, s:str/0/str · returned str · level recorded 2026-09-26
append_cmd_env script/albert/get_distribute_pretrain_cmd.py ran fingerprinted Apache-2.0 (permissive) · 0a8d963b1703c1e8 · report fixture: signature cmd:str/0/str, key:str/0/str, value:str/0/str · returned str · level recorded 2026-09-26
eval_result_print src/Albert_Callback_class.py ran Apache-2.0 (permissive) · f54c096131164be1 · report fixture: signature assessment_method:str/0/str, callback:AccuracyCallback/0/? · returned float · level recorded 2026-09-26
eval_result_print postprocess.py ran Apache-2.0 (permissive) · e512be7d0748330e · report fixture: signature assessment_method:str/0/str, callback:AccuracyCallback/0/? · returned float · level recorded 2026-09-26
set_envs script/albert/get_distribute_pretrain_cmd.py ran Apache-2.0 (permissive) · 95e64675393bf4aa · report fixture: signature cmd:str/0/str, logic_id:int/0/int, rank_id:int/0/int · returned str · level recorded 2026-09-26
yifding/hetseq community (archive-listed) 13 samples, 8 ran (4 instrument-failed) · 5 unverified
BertIntermediate in 15 papers hetseq/bert_modeling.py ran MIT (permissive) · 4073de88226e1038 · report fixture: returned BertIntermediate · level recorded 2026-09-22
BertPooler in 6 papers hetseq/bert_modeling.py ran MIT (permissive) · cc2f2a6451c34620 · report fixture: returned BertPooler · level recorded 2026-09-22
BertSelfAttention in 29 papers hetseq/bert_modeling.py ran MIT (permissive) · deecd100e8c17400 · report fixture: returned BertSelfAttention · level recorded 2026-09-22
LinearActivation in 16 papers hetseq/bert_modeling.py ran MIT (permissive) · 69b2af37fc2ae145 · report fixture: returned LinearActivation · level recorded 2026-09-22
bias_gelu in 7 papers hetseq/bert_modeling.py ran; the contract check could not run (RAISES) MIT (permissive) · de5ea2929d4e4106 · report fixture: returned Tensor · level recorded 2026-09-22
bias_tanh hetseq/bert_modeling.py ran; the contract check could not run (RAISES) MIT (permissive) · 99b92d0744d0386d · report fixture: returned Tensor · level recorded 2026-09-22
f_gelu hetseq/bert_modeling.py ran; the contract check could not run (RAISES) MIT (permissive) · 51bd5bf32f9bb46c · report fixture: returned Tensor · level recorded 2026-09-22
gelu in 308 papers
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32
hetseq/bert_modeling.py ran; the contract check could not run (RAISES) MIT (permissive) · 1ada98e81f3ec64a · report fixture: returned Tensor · level recorded 2026-09-22
BertAttention in 28 papers hetseq/bert_modeling.py unverified MIT (permissive) · 0cb54ae12a698d67 · report
BertEncoder in 20 papers hetseq/bert_modeling.py unverified MIT (permissive) · 87487781c4dcd1a1 · report
BertLayer in 23 papers hetseq/bert_modeling.py unverified MIT (permissive) · bae337e27b7faff5 · report
BertModel in 16 papers hetseq/bert_modeling.py unverified MIT (permissive) · 59bcd923687ae5b0 · report
BertPreTrainedModel in 7 papers hetseq/bert_modeling.py unverified MIT (permissive) · d3b9deead826313f · report
yydai/bert_test community (archive-listed) 1 sample, 0 ran · 1 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 0326eaf7306ca80c · report
zapplea/bert community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
check_unk create_pretraining_aic2018data.py ran Apache-2.0 (permissive) · 3b6fe2941d20238a · report fixture: signature sentence:list/1/str, tokenizer:StandInTokenizer/0/? · returned list · level recorded 2026-09-26
zsweet/BERT_zsw community (archive-listed) 5 samples, 0 ran · 5 unverified
BertModel in 16 papers modeling.py unverified Apache-2.0 (permissive) · 9bf7e74f61786136 · report
attention_layer in 9 papers modeling.py unverified Apache-2.0 (permissive) · 74d797f5a80810b0 · report
create_attention_mask_from_input_mask in 8 papers modeling.py unverified Apache-2.0 (permissive) · 9da7a2d2772fa7d0 · report
embedding_postprocessor in 7 papers modeling.py unverified Apache-2.0 (permissive) · 2a296bcff09a0034 · report
transformer_model in 7 papers modeling.py unverified Apache-2.0 (permissive) · 95cf64fa85a7e558 · report
lvyufeng/Cybertron community (archive-listed) 4 samples, 2 ran (0 instrument-failed) · 2 unverified
convert_state_dict in 13 papers cybertron/utils.py ran Apache-2.0 (permissive) · 8afaa985063f723e · report fixture: signature module_or_pth_file:callable/0/?, model:str/0/str · returned dict · level recorded 2026-09-24
invert_mask in 14 papers cybertron/models/bart.py ran Apache-2.0 (permissive) · e8ae42ea576c0232 · report fixture: signature attention_mask:Tensor/2/int · returned Tensor · level recorded 2026-09-24
load_from_cache cybertron/utils.py unverified Apache-2.0 (permissive) · e462fa293bb314aa · report
vmware-labs/bert-pretraining community (archive-listed) 1 sample, 0 ran · 1 unverified
Pretraining_Config bert_pretraining/bert_pretraining.py unverified Apache-2.0 (permissive) · eae4db3e250e2cba · report
Repository not located 4 samples, 2 ran (0 instrument-failed) · 2 unverified
4 samples are identical to code Syntology harvested from another paper's repository; this paper's own copy was not located, so no repository is named and no licence is recorded.
gelu in 308 papers
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32
repository not located ran · honoured contract fingerprinted licence of this copy not recorded · 62e7409a816626ac · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22
gelu in 308 papers
census: 43 implementations from 74 papers, 6 distinct outputs on one shared input this sample: bucket 1 of 1, arg 1: rank 2, kind float, dtype float32
repository not located ran · honoured contract fingerprinted licence of this copy not recorded · 40e9fee2e0b7e278 · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22
load_tf_weights_in_bert in 135 papers repository not located unverified licence of this copy not recorded · b1a7180868dd8d6a · report
load_tf_weights_in_bert in 135 papers repository not located unverified licence of this copy not recorded · 0453ed29d1aecc4c · report

Method as code Syntology

What Syntology's graph records as this paper's claimed method, lifted into code: each assembly names its bricks (functions and classes), each with its own role and its own verification level. An assembly is not a check that the code implements the method correctly or reproduces the paper's results. Levels are each brick's own verification level in Syntology's graph (level 0: no recorded run), listed brick by brick and never combined into one level; “ran” means the brick executed on a synthesized input, not that its output is correct, and the instrument figure counts failures of Syntology's instrument, not of the code. Where a model read the code against the paper's claim, each assembly's label verdict is one model's judgement, kept in this page's JSON twin; it is not calibrated, so no card prints it. Siblings are assemblies lifted from this paper in the same batch for the same method: alternative readings kept side by side; none replaces or supersedes another.

115 assemblies on this paper: 115 harvested, 0 generated, listed in 1 groups (siblings lifted in one batch form one group).

115 sibling assemblies for BERT (harvested), lifted in the same batch on 2026-09-09: alternative readings kept side by side; none replaces or supersedes another. Bricks printed for 12 of 115 sibling assemblies; the other 103 are listed with their counts; every brick is in this page's JSON twin.

harvested Assembly for BERT (graph method: BERT). 23 bricks; individually on a fixture: 8 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 15 unverified. The assembly has not been run end-to-end.

one of 115 siblings

  1. BertModel entry · level 0 · unverified · d94fb1043848be78
  2. BertEmbeddings model · level 0 · unverified · 77df05a2a5d00853
  3. BertEncoder model · level 0 · unverified · 0be65efc892d53b9
  4. BertPooler model · level 1 · ran · 8f1a0b9437ccc562
  5. BertPreTrainedModel helper · level 0 · unverified · fdd3d4990bea9d9c
  6. BertLayer helper · level 0 · unverified · 89e0fd61eb3504eb
  7. BertConfig helper · level 1 · ran · 96be08a7a7030f60
  8. cached_path helper · level 0 · unverified · ea4ad38c9db984c5
  9. load_tf_weights_in_bert helper · level 0 · unverified · b1a7180868dd8d6a
  10. BertAttention helper · level 0 · unverified · 330e30e5ccfcc515
  11. BertIntermediate helper · level 1 · ran · c7123d4962da3767
  12. BertOutput helper · level 0 · unverified · aea48c66c585eea7
  13. get_from_cache helper · level 0 · unverified · 317c17bb5ff9da3f
  14. BertSelfAttention helper · level 1 · ran · d7fe09a1ec2f4f0d
  15. BertSelfOutput helper · level 0 · unverified · 5a3875e5bed5964b
  16. http_get helper · level 0 · unverified · 18f49ada16168f38
  17. s3_etag helper · level 0 · unverified · 51dd06ec77c8a8d1
  18. s3_get helper · level 0 · unverified · 1079045e75efbf23
  19. url_to_filename helper · level 1 · ran · our draft was wrong · 5eff22fa0a651276
  20. s3_request helper · level 1 · ran · our draft was wrong · 7661139be003d514
  21. split_s3_path helper · level 0 · unverified · d3852f416bfe86c3
  22. gelu helper · level 1 · ran · honoured contract · fdc64f4c72036ae4
  23. swish helper · level 2 · ran · our draft was wrong · 0f786c407fb1ee4c

harvested Assembly for BERT (graph method: BERT). 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified. The assembly has not been run end-to-end.

one of 115 siblings

  1. BertModel entry · level 0 · unverified · c1c5de65dfedcf88
  2. create_attention_mask_from_input_mask model · level 0 · unverified · a019ca35d0434118
  3. create_initializer helper · level 0 · unverified · e3981aa2fadfb2eb
  4. embedding_lookup model · level 0 · unverified · 194a6562b994a2e1
  5. embedding_postprocessor model · level 0 · unverified · 277b18bc7acee12c
  6. get_activation helper · level 1 · ran · our draft was wrong · 61de2f8dfc7d014a
  7. get_shape_list helper · level 1 · ran · our draft was wrong · 4c33136de32333c9
  8. transformer_model model · level 0 · unverified · dbc9628a5ca3b1f5
  9. layer_norm_and_dropout helper · level 0 · unverified · 61cb05022cc82f2b
  10. gelu helper · level 0 · unverified · 71e7e82f26b8d902
  11. assert_rank helper · level 0 · unverified · 01e4a365b28cda00
  12. attention_layer model · level 0 · unverified · 62ba879682ced155
  13. dropout helper · level 1 · ran; the contract check could not run (RAISES) · fb518a8fa5849d2f
  14. layer_norm helper · level 0 · unverified · fedeb6766bad1fad
  15. reshape_from_matrix helper · level 0 · unverified · 3cfa2e7b4d67e9ee
  16. reshape_to_matrix helper · level 1 · ran · our draft was wrong · 7b84f3e6a96584b4

harvested Assembly for BERT (graph method: BERT). 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified. The assembly has not been run end-to-end.

one of 115 siblings

  1. BertModel entry · level 0 · unverified · b84a7e54141c42d4
  2. create_attention_mask_from_input_mask model · level 0 · unverified · ecf19688a7eb0d04
  3. create_initializer helper · level 0 · unverified · e3981aa2fadfb2eb
  4. embedding_lookup model · level 0 · unverified · fe0428bc0b127744
  5. embedding_postprocessor model · level 0 · unverified · 9c69503daf39b4c9
  6. get_activation helper · level 1 · ran · our draft was wrong · 5842ee67106321d6
  7. get_shape_list helper · level 1 · ran · our draft was wrong · 5a657fd9d0832b35
  8. transformer_model model · level 0 · unverified · e353d671edbdf34f
  9. layer_norm_and_dropout helper · level 0 · unverified · 15f847b95346c6d2
  10. gelu helper · level 1 · ran · honoured contract · d08f324f950148de
  11. assert_rank helper · level 0 · unverified · 3626c55dff7dd429
  12. attention_layer model · level 0 · unverified · d16dcfaecf4647ad
  13. dropout helper · level 1 · ran; the contract check could not run (RAISES) · 873e08c3f15eb1e4
  14. layer_norm helper · level 0 · unverified · fedeb6766bad1fad
  15. reshape_from_matrix helper · level 0 · unverified · b1f366f8472004a2
  16. reshape_to_matrix helper · level 1 · ran · our draft was wrong · 7b84f3e6a96584b4

harvested Assembly for BERT (graph method: BERT). 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified. The assembly has not been run end-to-end.

one of 115 siblings

  1. BertModel entry · level 0 · unverified · f298a22a9d079be3
  2. create_attention_mask_from_input_mask helper · level 0 · unverified · ecf19688a7eb0d04
  3. create_initializer helper · level 0 · unverified · e3981aa2fadfb2eb
  4. embedding_lookup model · level 0 · unverified · fe0428bc0b127744
  5. embedding_postprocessor model · level 0 · unverified · 34c1f2337ffb814d
  6. get_activation helper · level 1 · ran · our draft was wrong · 5842ee67106321d6
  7. get_shape_list helper · level 1 · ran · our draft was wrong · 5a657fd9d0832b35
  8. transformer_model model · level 0 · unverified · 79608bac19b3ff5c
  9. layer_norm_and_dropout helper · level 0 · unverified · 15f847b95346c6d2
  10. gelu helper · level 1 · ran · honoured contract · d08f324f950148de
  11. assert_rank helper · level 0 · unverified · 3626c55dff7dd429
  12. attention_layer model · level 0 · unverified · d16dcfaecf4647ad
  13. dropout helper · level 1 · ran; the contract check could not run (RAISES) · 873e08c3f15eb1e4
  14. layer_norm helper · level 0 · unverified · fedeb6766bad1fad
  15. reshape_from_matrix helper · level 0 · unverified · b1f366f8472004a2
  16. reshape_to_matrix helper · level 1 · ran · our draft was wrong · 7b84f3e6a96584b4

harvested Assembly for BERT (graph method: BERT). 14 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 9 unverified. The assembly has not been run end-to-end.

one of 115 siblings

  1. BertModel entry · level 0 · unverified · 57ddc6f7b4914314
  2. BertEmbeddings model · level 0 · unverified · 822402eb726689f9
  3. BertEncoder model · level 0 · unverified · b824da45c7d85285
  4. BertPooler model · level 1 · ran · 1ffe5589b401ff00
  5. BertPreTrainedModel helper · level 0 · unverified · 39f5d68d67913dc7
  6. BertLayer model · level 0 · unverified · 39b12df168592d79
  7. BertConfig helper · level 1 · ran · 8a8e46e7b74bcec6
  8. load_tf_weights_in_bert helper · level 0 · unverified · 0453ed29d1aecc4c
  9. BertAttention model · level 0 · unverified · 5416853a8be3a2d7
  10. BertIntermediate model · level 1 · ran · f27f0935fbe1b62b
  11. BertOutput model · level 0 · unverified · a0407d4bf4593206
  12. BertSelfAttention model · level 1 · ran · 72415b9f7aa76ac9
  13. BertSelfOutput helper · level 0 · unverified · 178a7c8f563f0beb
  14. gelu helper · level 1 · ran · honoured contract · fdc64f4c72036ae4

harvested Assembly for BERT (graph method: BERT). 22 bricks; individually on a fixture: 10 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 12 unverified. The assembly has not been run end-to-end.

one of 115 siblings

  1. BertModel entry · level 0 · unverified · 0a619d4800774912
  2. BertEmbeddings model · level 0 · unverified · c265396993793fbf
  3. BertEncoder model · level 0 · unverified · 064f9026080680e2
  4. BertPooler model · level 1 · ran · 8f1a0b9437ccc562
  5. PreTrainedBertModel helper · level 0 · unverified · 35ea09ed4f1542c2
  6. BertLayer model · level 0 · unverified · 4ea9890699c11b28
  7. BertConfig helper · level 1 · ran · 4c8dd71a74ae58f4
  8. cached_path helper · level 1 · ran · our draft was wrong · 534dfe582037c26b
  9. BertAttention model · level 0 · unverified · 978bca45efc60c53
  10. BertIntermediate model · level 1 · ran · 9597f5146c4fa55c
  11. BertOutput model · level 0 · unverified · fb6862928ef36d03
  12. get_from_cache helper · level 0 · unverified · e25398920d88eec3
  13. BertSelfAttention model · level 1 · ran · d7fe09a1ec2f4f0d
  14. BertSelfOutput helper · level 0 · unverified · 178a7c8f563f0beb
  15. http_get helper · level 0 · unverified · 20bb0eaadd1d38ce
  16. s3_etag helper · level 0 · unverified · 43b164ab6ace951e
  17. s3_get helper · level 0 · unverified · d3da3cf9bfe8b9a5
  18. url_to_filename helper · level 1 · ran · our draft was wrong · af64ec220e8bcdbc
  19. s3_request helper · level 1 · ran · our draft was wrong · d03f582131d8575c
  20. split_s3_path helper · level 1 · ran · our draft was wrong · 1f8e0d57a93f2b98
  21. gelu helper · level 1 · ran · honoured contract · 40e9fee2e0b7e278
  22. swish helper · level 2 · ran · our draft was wrong · 0f786c407fb1ee4c

harvested Assembly for BERT (graph method: BERT). 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified. The assembly has not been run end-to-end.

one of 115 siblings

  1. BertModel entry · level 0 · unverified · 1c8f5d63388f5841
  2. create_attention_mask_from_input_mask model · level 0 · unverified · ecf19688a7eb0d04
  3. create_initializer helper · level 0 · unverified · e3981aa2fadfb2eb
  4. embedding_lookup model · level 0 · unverified · a8b0e78302dc02d4
  5. embedding_postprocessor model · level 0 · unverified · 9c69503daf39b4c9
  6. get_activation helper · level 1 · ran · our draft was wrong · 5681f7dd9b6e3679
  7. get_shape_list helper · level 1 · ran · our draft was wrong · 5a657fd9d0832b35
  8. transformer_model model · level 0 · unverified · 4f87a173bcbfc6e5
  9. layer_norm_and_dropout helper · level 0 · unverified · 15f847b95346c6d2
  10. gelu helper · level 0 · unverified · ecab128238ebf253
  11. assert_rank helper · level 0 · unverified · 3626c55dff7dd429
  12. attention_layer model · level 0 · unverified · f648a4567745fd52
  13. dropout helper · level 1 · ran; the contract check could not run (RAISES) · 873e08c3f15eb1e4
  14. layer_norm helper · level 0 · unverified · fedeb6766bad1fad
  15. reshape_from_matrix helper · level 0 · unverified · b1f366f8472004a2
  16. reshape_to_matrix helper · level 1 · ran · our draft was wrong · 7b84f3e6a96584b4

harvested Assembly for BERT (graph method: BERT). 3 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; every one of the 2 samples that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 115 siblings

  1. RobertaEncoder entry · level 0 · unverified · 46de24beef44cf28
  2. TransformerEncoder model · level 1 · ran · 3fa8b8c8ef28e810
  3. PositionalEmbedding model · level 1 · ran · 4631d4896f7b464d

harvested Assembly for BERT (graph method: BERT). 18 bricks; individually on a fixture: 7 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 11 unverified. The assembly has not been run end-to-end.

one of 115 siblings

  1. BertModel entry · level 0 · unverified · 4d900dd3364ebe60
  2. create_attention_mask_from_input_mask model · level 0 · unverified · a9740dd2f1c01a4f
  3. create_initializer helper · level 0 · unverified · e3981aa2fadfb2eb
  4. embedding_lookup model · level 0 · unverified · 599deae552ebf869
  5. embedding_postprocessor model · level 0 · unverified · 08131d4e8c12f7b0
  6. get_activation helper · level 1 · ran · our draft was wrong · fe35dab7a35b3957
  7. get_custom_getter helper · level 1 · ran · our draft was wrong · d46b96cda962e830
  8. get_shape_list helper · level 1 · ran · our draft was wrong · 35fdcad846dde14a
  9. transformer_model model · level 0 · unverified · f0fc6275fce8ef79
  10. layer_norm_and_dropout helper · level 0 · unverified · 82dc008a899111c5
  11. gelu helper · level 1 · ran · honoured contract · a9f91ae77954f959
  12. float32_variable_storage_getter helper · level 1 · ran; the contract check could not run (RAISES) · 21770a12e09aba7f
  13. assert_rank helper · level 0 · unverified · 7d55cef5a5d36394
  14. attention_layer model · level 0 · unverified · e2b4886c5ce3dcec
  15. dropout helper · level 1 · ran; the contract check could not run · b934a5a18a8186cb
  16. layer_norm helper · level 0 · unverified · fedeb6766bad1fad
  17. reshape_from_matrix helper · level 0 · unverified · 27c0765ef6b89ca9
  18. reshape_to_matrix helper · level 1 · ran · our draft was wrong · 7b84f3e6a96584b4

harvested Assembly for BERT (graph method: BERT). 8 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified. The assembly has not been run end-to-end.

one of 115 siblings

  1. TransformerModel entry · level 0 · unverified · 946cd24442973489
  2. TransformerLayer model · level 0 · unverified · 07f05b67a5afe0dd
  3. TransformerAttention model · level 0 · unverified · 207b46bd316070c6
  4. TransformerIntermediate model · level 1 · ran · 9be5a608b03add6a
  5. TransformerOutput model · level 0 · unverified · 03a3d15424bea269
  6. TransformerSelfAttention model · level 0 · unverified · 68634f7940230fc2
  7. TransformerSelfOutput model · level 0 · unverified · 515b61ea2a383523
  8. gelu helper · level 1 · ran · honoured contract · 409ea40d28f93c7e

harvested Assembly for BERT (graph method: BERT). 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified. The assembly has not been run end-to-end.

one of 115 siblings

  1. BertModel entry · level 0 · unverified · 73c88a124156227a
  2. create_attention_mask_from_input_mask model · level 0 · unverified · ecf19688a7eb0d04
  3. create_initializer helper · level 0 · unverified · e3981aa2fadfb2eb
  4. embedding_lookup model · level 0 · unverified · fd655b6f6e2908d6
  5. embedding_postprocessor model · level 0 · unverified · 9c69503daf39b4c9
  6. get_activation helper · level 1 · ran · our draft was wrong · 5681f7dd9b6e3679
  7. get_shape_list helper · level 1 · ran · our draft was wrong · 5a657fd9d0832b35
  8. transformer_model model · level 0 · unverified · 5e82334665dedf36
  9. layer_norm_and_dropout model · level 0 · unverified · 15f847b95346c6d2
  10. gelu helper · level 0 · unverified · ecab128238ebf253
  11. assert_rank helper · level 0 · unverified · 3626c55dff7dd429
  12. attention_layer model · level 0 · unverified · d16dcfaecf4647ad
  13. dropout model · level 1 · ran; the contract check could not run (RAISES) · 873e08c3f15eb1e4
  14. layer_norm model · level 0 · unverified · fedeb6766bad1fad
  15. reshape_from_matrix helper · level 0 · unverified · b1f366f8472004a2
  16. reshape_to_matrix helper · level 1 · ran · our draft was wrong · 7b84f3e6a96584b4

harvested Assembly for BERT (graph method: BERT). 10 bricks; individually on a fixture: 9 ran (of which 7 constructed an object rather than computing a result; 9 with no instrument failure: 0 honoured, 0 violated, 9 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified. The assembly has not been run end-to-end.

one of 115 siblings

  1. BERT entry · level 0 · unverified · 6674cc6102e96505
  2. BERTEmbedding model · level 1 · ran · a42a5dbeebdf39e3
  3. TransformerBlock model · level 1 · ran · 7e19140b483ea0b1
  4. PositionalEmbedding helper · level 1 · ran · d16f303823d8ee5a
  5. SegmentEmbedding helper · level 1 · ran · ec4cc2e0c00b6449
  6. TokenEmbedding helper · level 1 · ran · 6ac09cf3d33d9991
  7. MultiHeadedAttention model · level 1 · ran · 8708bfceac69760b
  8. PositionwiseFeedForward model · level 1 · ran · 708bd2d8037a185a
  9. SublayerConnection helper · level 1 · ran · 740ab852bb4af958
  10. Attention helper · level 1 · ran · fa24061b6aade569
  1. BertModel · 1f176c1076d7b8c4 · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[12] in the JSON twin
  2. Bert · 20a4fe0ae39f0c9d · 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[13] in the JSON twin
  3. BERT · 21139167bf267d6b · 6 bricks; individually on a fixture: 4 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; every one of the 4 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[14] in the JSON twin
  4. BERTEncoder · 22ecc70ce8ca4689 · 3 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[15] in the JSON twin
  5. Transformer · 27c10e53e7808832 · 8 bricks; individually on a fixture: 4 ran (of which 2 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified · The assembly has not been run end-to-end · assemblies[16] in the JSON twin
  6. BertModel · 28a7cac9ffcc4409 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[17] in the JSON twin
  7. recreate_model · 291e3d832ac1612e · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[18] in the JSON twin
  8. BertModel · 2aa35fb9722dbfb4 · 23 bricks; individually on a fixture: 8 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 15 unverified · The assembly has not been run end-to-end · assemblies[19] in the JSON twin
  9. BertModel · 4ef42b8197ced32e · 16 bricks; individually on a fixture: 13 ran (of which 4 constructed an object rather than computing a result; 8 with no instrument failure: 3 honoured, 1 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 3 unverified · The assembly has not been run end-to-end · assemblies[20] in the JSON twin
  10. BertModel · 50d69f34ed5defde · 22 bricks; individually on a fixture: 10 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[21] in the JSON twin
  11. BertModel · 51ad5c70bbeeee8a · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[22] in the JSON twin
  12. BertModel · 5423c410ccd982d6 · 16 bricks; individually on a fixture: 6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 10 unverified · The assembly has not been run end-to-end · assemblies[23] in the JSON twin
  13. BertQAService · 545140491ce51611 · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[24] in the JSON twin
  14. BertModel · 5590e763202219e4 · 24 bricks; individually on a fixture: 9 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 15 unverified · The assembly has not been run end-to-end · assemblies[25] in the JSON twin
  15. BertModel · 5a8e48d42310e3e6 · 22 bricks; individually on a fixture: 10 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[26] in the JSON twin
  16. BertModel · bcf3708d0745989f · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[27] in the JSON twin
  17. BERTModel · bcfaf2692d5b1025 · 2 bricks; individually on a fixture: 0 ran · 2 unverified · The assembly has not been run end-to-end · assemblies[28] in the JSON twin
  18. BertModel · bd595267f71c2059 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[29] in the JSON twin
  19. CondBertRewriter · bd77b5f169d8988a · 3 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[30] in the JSON twin
  20. BERT · c13a19661fc04682 · 4 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[31] in the JSON twin
  21. BertModel · c3c36791034d397d · 16 bricks; individually on a fixture: 12 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 9 where Syntology's instrument failed) · 4 unverified · The assembly has not been run end-to-end · assemblies[32] in the JSON twin
  22. BERT · c612e31643705391 · 2 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[33] in the JSON twin
  23. BertModel · c9da0f37a1e56f94 · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[34] in the JSON twin
  24. mask_tokens · c9ff3f6195f84e5a · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[35] in the JSON twin
  25. BertTokenizerX · d0df2b684a232509 · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[36] in the JSON twin
  26. BERTGRUSentiment · d2262504200a1910 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[37] in the JSON twin
  27. get_topk_predictions · d2d6efc898d652ba · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[38] in the JSON twin
  28. create_masked_lm_predictions · d46f849385da3068 · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[39] in the JSON twin
  29. PLMEncoder · d7ce04913fcbc492 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[40] in the JSON twin
  30. BertContextEmbedder · d867a56bdc18be8b · 2 bricks; individually on a fixture: 0 ran · 2 unverified · The assembly has not been run end-to-end · assemblies[41] in the JSON twin
  31. MockingjayModel · d9849293b03417a1 · 13 bricks; individually on a fixture: 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 7 unverified · The assembly has not been run end-to-end · assemblies[42] in the JSON twin
  32. SentimentClassifier · dcbfdf175d477d7b · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[43] in the JSON twin
  33. BertModel · dd4b7130d4fb04bb · 3 bricks; individually on a fixture: 0 ran · 3 unverified · The assembly has not been run end-to-end · assemblies[44] in the JSON twin
  34. Bert · dddfc7b3f6a95bf2 · 5 bricks; individually on a fixture: 4 ran (of which 1 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[45] in the JSON twin
  35. BERTDataset · e7f6df713a8aadb2 · 6 bricks; individually on a fixture: 4 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[46] in the JSON twin
  36. BertModel · ed55ec905a27c7f2 · 27 bricks; individually on a fixture: 9 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 18 unverified · The assembly has not been run end-to-end · assemblies[47] in the JSON twin
  37. BertForMaskedLMOptimized · eddbd190bbe091e6 · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[48] in the JSON twin
  38. BertModel · ee60c4256285fb9a · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[49] in the JSON twin
  39. BertModel · efa8e8e0ef8b0d2d · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[50] in the JSON twin
  40. BertCRF · f0ef0840dc4e4a0d · 2 bricks; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[51] in the JSON twin
  41. BertModel · f16ead74399b5d0b · 8 bricks; individually on a fixture: 7 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[52] in the JSON twin
  42. Bert · f291cd6d303fd2d5 · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[53] in the JSON twin
  43. BERT · f3a5cf0773c82d9e · 2 bricks; individually on a fixture: 0 ran · 2 unverified · The assembly has not been run end-to-end · assemblies[54] in the JSON twin
  44. BertModel · f3d5abcb8996497d · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[55] in the JSON twin
  45. BertModel · f46dc6af1458c5f5 · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[56] in the JSON twin
  46. BertForMultiLabelSequenceClassification · f7c0b751dc9a907e · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[57] in the JSON twin
  47. BertModel · fa835e45eaf0b4af · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[58] in the JSON twin
  48. BertModel · fbf6bdff4c1ee8ce · 23 bricks; individually on a fixture: 14 ran (of which 3 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 5 where Syntology's instrument failed) · 9 unverified · The assembly has not been run end-to-end · assemblies[59] in the JSON twin
  49. Encoder · ff238dcf0e792fa1 · 7 bricks; individually on a fixture: 6 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 3 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[60] in the JSON twin
  50. BertModel · 5b17983dea05723d · 22 bricks; individually on a fixture: 10 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 5 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[61] in the JSON twin
  51. BertModel · 5fb96005a4170125 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[62] in the JSON twin
  52. Bertencoder · 61e81a7823c53047 · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[63] in the JSON twin
  53. BertModel · 62bab323eefa8bcc · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[64] in the JSON twin
  54. BertModel · 6b97a9f0220eec1f · 17 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[65] in the JSON twin
  55. BertDataset · 737e9466ad6e2df8 · 4 bricks; individually on a fixture: 3 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[66] in the JSON twin
  56. _build_bert · 7ab4473560479ce9 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[67] in the JSON twin
  57. BertModel · 7d22356c06265f1a · 27 bricks; individually on a fixture: 12 ran (of which 5 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 7 where Syntology's instrument failed) · 15 unverified · The assembly has not been run end-to-end · assemblies[68] in the JSON twin
  58. BertSelfAttention · 7d9faca373ab7334 · 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[69] in the JSON twin
  59. Encoder · 7f8946df8f77313c · 5 bricks; individually on a fixture: 5 ran (of which 3 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 1 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[70] in the JSON twin
  60. BertModel · 867780212a0e6e81 · 18 bricks; individually on a fixture: 6 ran (of which 1 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[71] in the JSON twin
  61. BERT · 8842305e44f87271 · 5 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified · The assembly has not been run end-to-end · assemblies[72] in the JSON twin
  62. bert_tokens · 88f2a797319f9dc5 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[73] in the JSON twin
  63. BERT · 8a438add96704023 · 9 bricks; individually on a fixture: 7 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[74] in the JSON twin
  64. BertModel · 2d3dc26a3e19bbb2 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[75] in the JSON twin
  65. BertLayer · 2efdc6b50487299c · 8 bricks; individually on a fixture: 6 ran (of which 2 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[76] in the JSON twin
  66. build_model · 30e372412c13a481 · 2 bricks; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[77] in the JSON twin
  67. BertModel · 31e2d80a4d1b2075 · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[78] in the JSON twin
  68. FullTokenizer · 31fe56dd0bb81949 · 10 bricks; individually on a fixture: 9 ran (of which 2 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 3 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[79] in the JSON twin
  69. BertModel · 333e53944ff2d0dd · 23 bricks; individually on a fixture: 8 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 1 honoured, 0 violated, 4 with no contract checked; 3 where Syntology's instrument failed) · 15 unverified · The assembly has not been run end-to-end · assemblies[80] in the JSON twin
  70. MT_BERT · 34c88b723c985521 · 6 bricks; individually on a fixture: 4 ran (of which 3 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[81] in the JSON twin
  71. BertModel4Mix · 34dcd5cba3e3a791 · 2 bricks; individually on a fixture: 0 ran · 2 unverified · The assembly has not been run end-to-end · assemblies[82] in the JSON twin
  72. BERT · 3700b2d52162e5b7 · 8 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 1 honoured, 1 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 6 unverified · The assembly has not been run end-to-end · assemblies[83] in the JSON twin
  73. BertModel · 3968314100516660 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[84] in the JSON twin
  74. Transformer · 3b09c9b847ab4fe2 · 8 bricks; individually on a fixture: 5 ran (of which 4 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified · The assembly has not been run end-to-end · assemblies[85] in the JSON twin
  75. BertModel · 3baf2104f9e13ce3 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[86] in the JSON twin
  76. batcher · 3d3ad233b7fdc437 · 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[87] in the JSON twin
  77. Bert_base · 3eab67096e70a1d6 · 2 bricks; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[88] in the JSON twin
  78. BERTify · 48067a9b8cb653cc · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[89] in the JSON twin
  79. Pretraining_Config · 48e50fa4bcfed0b3 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[90] in the JSON twin
  80. Bert · 498c11b591dfce4c · 2 bricks; individually on a fixture: 0 ran · 2 unverified · The assembly has not been run end-to-end · assemblies[91] in the JSON twin
  81. BertModel · 8d29ac68cf362aea · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[92] in the JSON twin
  82. BertModel · 9038c0768ea0b644 · 23 bricks; individually on a fixture: 14 ran (of which 5 constructed an object rather than computing a result; 11 with no instrument failure: 1 honoured, 0 violated, 10 with no contract checked; 3 where Syntology's instrument failed) · 9 unverified · The assembly has not been run end-to-end · assemblies[93] in the JSON twin
  83. BertModel · 92b94b1e4f02fc99 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[94] in the JSON twin
  84. BertModel · 931465ad09d2d346 · 27 bricks; individually on a fixture: 12 ran (of which 4 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 7 where Syntology's instrument failed) · 15 unverified · The assembly has not been run end-to-end · assemblies[95] in the JSON twin
  85. BertModel · 9378352c89e4975f · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[96] in the JSON twin
  86. BertModel4Pretrain · 9748f94b19ff3476 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[97] in the JSON twin
  87. Transformer · 9c074487ef36cc0f · 9 bricks; individually on a fixture: 9 ran (of which 4 constructed an object rather than computing a result; 7 with no instrument failure: 1 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[98] in the JSON twin
  88. SBERT · 9cff77ea06a019dd · 6 bricks; individually on a fixture: 2 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 4 unverified; every one of the 2 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[99] in the JSON twin
  89. BertModel · 9ee34204eebd6ae0 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[100] in the JSON twin
  90. LineBertModel · a3079b80110bb7f9 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[101] in the JSON twin
  91. MultiheadAttention · a690e48296a35d1a · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[102] in the JSON twin
  92. BertModel · a739d9d2304c0555 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[103] in the JSON twin
  93. BERTCollaborativeAdapter · a7593d41dc80fb00 · 3 bricks; individually on a fixture: 2 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 1 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[104] in the JSON twin
  94. DoubleBERT · a7e68b858d6d57c0 · 2 bricks; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[105] in the JSON twin
  95. BertModel · aa204ca91329daa5 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[106] in the JSON twin
  96. BERTEmbedding · acbfa9eca3eff610 · 3 bricks; individually on a fixture: 3 ran (of which 3 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; every one of the 3 samples that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[107] in the JSON twin
  97. BertModel · ae1f565a75599d1a · 15 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 10 unverified · The assembly has not been run end-to-end · assemblies[108] in the JSON twin
  98. BatchGeneratorForBERT · ae902f5f3fa666ae · 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[109] in the JSON twin
  99. predictions · b26a4a0bd17fa4d4 · 3 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[110] in the JSON twin
  100. BertModel · b6e725b818b8fe00 · 16 bricks; individually on a fixture: 5 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 11 unverified · The assembly has not been run end-to-end · assemblies[111] in the JSON twin
  101. BertModel · b8e8e3d2543a3033 · 16 bricks; individually on a fixture: 4 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 12 unverified · The assembly has not been run end-to-end · assemblies[112] in the JSON twin
  102. BERTDataset · ba2f704aff0350dc · 6 bricks; individually on a fixture: 4 ran (of which 2 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[113] in the JSON twin
  103. BertModel · ba978597a88b7b65 · 16 bricks; individually on a fixture: 7 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 6 where Syntology's instrument failed) · 9 unverified · The assembly has not been run end-to-end · assemblies[114] in the JSON twin

Each brick ends with its code_sha256, Syntology's identity for that exact code; click one to copy the get_code call that returns it. For agents, on Syntology's MCP service: assembly(arxiv_id="1810.04805") returns these assemblies with each brick's role and wiring (how to connect).

Tasks

Citation Intent ClassificationCommon Sense ReasoningConversational Response SelectionCoreference ResolutionCross-Lingual Natural Language InferenceEmotion Recognition in ConversationLinear-Probe ClassificationLinguistic AcceptabilityMultimodal Intent RecognitionNamed Entity RecognitionNamed Entity Recognition (NER)Natural Language InferenceNatural Language UnderstandingParaphrase IdentificationQuestion AnsweringSemantic Textual SimilaritySentence ClassificationSentiment AnalysisStock Market PredictionText ClassificationType prediction

Datasets

Introduced by this paper, per the archive.

How to fix QuickBooks Error 30159 – Causes & Fixes

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Common Sense Reasoning ReCoRD BERT-Base (single model) EM 54.040 #33 of 45 Archive leaderboard report
Common Sense Reasoning ReCoRD BERT-Base (single model) F1 56.065 #33 of 45 Archive leaderboard report
Common Sense Reasoning SWAG BERT-LARGE Dev 86.6 #3 of 5 Archive leaderboard report
Common Sense Reasoning SWAG BERT-LARGE Test 86.3 #3 of 5 Archive leaderboard report
Coreference Resolution Winograd Schema Challenge BERT-large 340M Accuracy 62.0 #53 of 82 Archive leaderboard report
Cross-Lingual Natural Language Inference XNLI Zero-Shot English-to-German BERT Accuracy 70.5% #2 of 4 Archive leaderboard report
Cross-Lingual Natural Language Inference XNLI Zero-Shot English-to-Spanish BERT Accuracy 74.3% #2 of 4 Archive leaderboard report
Emotion Recognition in Conversation CPED BERT_{utt} Accuracy of Sentiment 48.96 #5 of 11 Archive leaderboard report
Emotion Recognition in Conversation CPED BERT_{utt} Macro-F1 of Sentiment 45.18 #5 of 11 Archive leaderboard report
Linguistic Acceptability CoLA BERT-LARGE Accuracy 60.5% #29 of 43 Archive leaderboard report
Multimodal Intent Recognition PhotoChat BERT F1 53.2 #4 of 6 Archive leaderboard report
Multimodal Intent Recognition PhotoChat BERT Precision 56.1 #4 of 6 Archive leaderboard report
Multimodal Intent Recognition PhotoChat BERT Recall 50.6 #4 of 6 Archive leaderboard report
Natural Language Inference MultiNLI BERT-LARGE Matched 86.7 #25 of 67 Archive leaderboard report
Natural Language Inference MultiNLI BERT-LARGE Mismatched 85.9 #25 of 67 Archive leaderboard report
Natural Language Inference QNLI BERT-LARGE Accuracy 92.7% #25 of 43 Archive leaderboard report
Natural Language Inference RTE BERT-large 340M Accuracy 70.1% #53 of 90 Archive leaderboard report
Natural Language Inference WNLI BERT-large 340M Accuracy 65.1 #21 of 23 Archive leaderboard report
Natural Language Understanding GLUE BERT-LARGE Average 82.1 #2 of 2 Archive leaderboard report
Natural Language Understanding PDP60 BERT-large 340M Accuracy 78.3 #2 of 13 Archive leaderboard report
Paraphrase Identification Quora Question Pairs BERT-LARGE F1 72.1 #12 of 31 Archive leaderboard report
Question Answering CoQA BERT Large Augmented (single model) In-domain 82.5 #1 of 9 Archive leaderboard report
Question Answering CoQA BERT Large Augmented (single model) Out-of-domain 77.6 #1 of 9 Archive leaderboard report
Question Answering CoQA BERT Large Augmented (single model) Overall 81.1 #1 of 9 Archive leaderboard report
Question Answering CoQA BERT-base finetune (single model) In-domain 79.8 #2 of 9 Archive leaderboard report
Question Answering CoQA BERT-base finetune (single model) Out-of-domain 74.1 #2 of 9 Archive leaderboard report
Question Answering CoQA BERT-base finetune (single model) Overall 78.1 #2 of 9 Archive leaderboard report
Question Answering MRQA BERT (large) Average F1 78.5 #2 of 2 Archive leaderboard report
Question Answering MultiRC BERT-large(single model) EM 24.1 #16 of 30 Archive leaderboard report
Question Answering MultiRC BERT-large(single model) F1 70.0 #16 of 30 Archive leaderboard report
Question Answering MultiTQ BERT Hits@1 8.3 #11 of 11 Archive leaderboard report
Question Answering MultiTQ BERT Hits@10 48.2 #11 of 11 Archive leaderboard report
Question Answering PIQA BERT-Large 340M Accuracy 66.7 #62 of 67 Archive leaderboard report
Question Answering SQuAD1.1 BERT (ensemble) EM 87.433 #17 of 213 Archive leaderboard report
Question Answering SQuAD1.1 BERT (ensemble) F1 93.160 #17 of 213 Archive leaderboard report
Question Answering SQuAD1.1 BERT-LARGE (Ensemble+TriviaQA) EM 87.4 #18 of 213 Archive leaderboard report
Question Answering SQuAD1.1 BERT-LARGE (Ensemble+TriviaQA) F1 93.2 #18 of 213 Archive leaderboard report
Question Answering SQuAD1.1 BERT (single model) EM 85.083 #29 of 213 Archive leaderboard report
Question Answering SQuAD1.1 BERT (single model) F1 91.835 #29 of 213 Archive leaderboard report
Question Answering SQuAD1.1 BERT-LARGE (Single+TriviaQA) F1 91.8 #210 of 213 Archive leaderboard report
Question Answering SQuAD1.1 dev BERT-LARGE (Ensemble+TriviaQA) EM 86.2 #7 of 55 Archive leaderboard report
Question Answering SQuAD1.1 dev BERT-LARGE (Ensemble+TriviaQA) F1 92.2 #7 of 55 Archive leaderboard report
Question Answering SQuAD1.1 dev BERT-LARGE (Single+TriviaQA) EM 84.2 #9 of 55 Archive leaderboard report
Question Answering SQuAD1.1 dev BERT-LARGE (Single+TriviaQA) F1 91.1 #9 of 55 Archive leaderboard report
Semantic Textual Similarity MRPC BERT-LARGE F1 89.3 #40 of 45 Archive leaderboard report
Semantic Textual Similarity STS Benchmark BERT-LARGE Spearman Correlation 0.865 #43 of 66 Archive leaderboard report
Sentiment Analysis SST-2 Binary classification BERT-LARGE Accuracy 94.9 #27 of 87 Archive leaderboard report
Stock Market Prediction Astock Bert Chinese Accuray 59.11 #15 of 17 Archive leaderboard report
Stock Market Prediction Astock Bert Chinese F1-score 58.99 #15 of 17 Archive leaderboard report
Stock Market Prediction Astock Bert Chinese Precision 59.07 #15 of 17 Archive leaderboard report
Stock Market Prediction Astock Bert Chinese Recall 59.20 #15 of 17 Archive leaderboard report
Text Classification DBpedia Bidirectional Encoder Representations from Transformers Error 0.64 #2 of 21 Archive leaderboard report
Type prediction ManyTypes4TypeScript BERT Average Accuracy 57.52 #9 of 9 Archive leaderboard report
Type prediction ManyTypes4TypeScript BERT Average F1 54.10 #9 of 9 Archive leaderboard report
Type prediction ManyTypes4TypeScript BERT Average Precision 54.18 #9 of 9 Archive leaderboard report
Type prediction ManyTypes4TypeScript BERT Average Recall 54.02 #9 of 9 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Introduced by this paper: BERT, mBERT

AdamAttentionAttention DropoutBERTDense ConnectionsDropoutLayer NormalizationLinear LayerLinear Warmup With Linear DecayMulti-Head AttentionResidual ConnectionSoftmaxWeight DecayWordPiecemBERT

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections