{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/transformer-xl-attentive-language-models","title":"Transformer-XL: Attentive Language Models Beyond a Fixed-Length Context","arxiv_id":"1901.02860","date":"2019-01-09","proceeding":"ACL 2019 7","authors":["Zihang Dai","Zhilin Yang","Yiming Yang","Jaime Carbonell","Quoc V. Le","Ruslan Salakhutdinov"],"abstract":"Transformers have a potential of learning longer-term dependency, but are limited by a fixed-length context in the setting of language modeling. We propose a novel neural architecture Transformer-XL that enables learning dependency beyond a fixed length without disrupting temporal coherence. It consists of a segment-level recurrence mechanism and a novel positional encoding scheme. Our method not only enables capturing longer-term dependency, but also resolves the context fragmentation problem. As a result, Transformer-XL learns dependency that is 80% longer than RNNs and 450% longer than vanilla Transformers, achieves better performance on both short and long sequences, and is up to 1,800+ times faster than vanilla Transformers during evaluation. Notably, we improve the state-of-the-art results of bpc/perplexity to 0.99 on enwiki8, 1.08 on text8, 18.3 on WikiText-103, 21.8 on One Billion Word, and 54.5 on Penn Treebank (without finetuning). When trained only on WikiText-103, Transformer-XL manages to generate reasonably coherent, novel text articles with thousands of tokens. Our code, pretrained models, and hyperparameters are available in both Tensorflow and PyTorch.","url_abs":"https://arxiv.org/abs/1901.02860v3","url_pdf":"https://arxiv.org/pdf/1901.02860v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/kimiyoung/transformer-xl","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/Jmkernes/PAR-Transformer-XL","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/Machine-Learning-Tokyo/Poetry-GAN","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/SambhawDrag/XLNet.jl","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"unanswered"}},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/TimDettmers/transformer-xl","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/aiha-lab/Attention-Head-Pruning","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"GPL-3.0"}},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/benkrause/dynamiceval-transformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/cmunnis/BERT_vs_Transformer-XL","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/facebookresearch/code-prediction-transformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/google-research/meliad","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"jax","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/huggingface/transformers","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/huggingface/xlnet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/inzva/fake-academic-paper-generation","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/listenviolet/XLNet","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/mustafaaljadery/gemma-2b-10m","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/okkteam/Transformer-Transducer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/park-cheol/ASR-Conformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/samwisegamjeee/pytorch-transformers","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/sh951011/Attention-Implementation","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/sooftware/Attention-Implementation","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/sooftware/attentions","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/sooftware/conformer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/sooftware/nlp-attentions","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok","spdx":"MIT"}},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/wxt1997/Transformer-Transducer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":{"status":"ok"}},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/zhdbwe/Paper-DailyReading","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/2023-MindSpore-1/ms-code-220/tree/main/transformer_xl","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/AIResearchHub/transformergallery","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/NVIDIA/DeepLearningExamples/tree/master/PyTorch/LanguageModeling/Transformer-XL","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/NVIDIA/DeepLearningExamples/tree/master/TensorFlow/LanguageModeling/Transformer-XL","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/transformer-xl","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"paddle","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/jiean001/models_m/tree/main/transformer_xl","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/jincan333/lot","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/labmlai/annotated_deep_learning_paper_implementations","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/lvyufeng/bert4ms","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"mindspore","reach":{"status":"ok","spdx":"Apache-2.0"}},{"paper_slug":"transformer-xl-attentive-language-models","repo_url":"https://github.com/opendilab/DI-engine","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"articles","task_name":"Articles"},{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"}],"methods":[{"method_slug":"adam","method_name":"Adam"},{"method_slug":"adaptive-input-representations","method_name":"Adaptive Input Representations"},{"method_slug":"adaptive-softmax","method_name":"Adaptive Softmax"},{"method_slug":"attention","method_name":"Attention"},{"method_slug":"cosine-annealing","method_name":"Cosine Annealing"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"layer-normalization","method_name":"Layer Normalization"},{"method_slug":"linear-layer","method_name":"Linear Layer"},{"method_slug":"linear-warmup-with-cosine-annealing","method_name":"Linear Warmup With Cosine Annealing"},{"method_slug":"multi-head-attention","method_name":"Multi-Head Attention"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"residual-connection","method_name":"Residual Connection"},{"method_slug":"softmax","method_name":"Softmax"},{"method_slug":"transformer-xl","method_name":"Transformer-XL"},{"method_slug":"variational-dropout","method_name":"Variational Dropout"}],"datasets_introduced":[],"methods_introduced":[{"slug":"transformer-xl","name":"Transformer-XL","full_name":"Transformer-XL"}],"results":[{"leaderboard":"/sota/language-modelling-on-hutter-prize","task":"Language Modelling","dataset":"Hutter Prize","model":"24-layer Transformer-XL","rank_in_archive_order":4,"of":18,"metrics":{"Bit per Character (BPC)":"0.99","Number of params":"277M"},"uses_additional_data":false},{"leaderboard":"/sota/language-modelling-on-hutter-prize","task":"Language Modelling","dataset":"Hutter Prize","model":"18-layer Transformer-XL","rank_in_archive_order":7,"of":18,"metrics":{"Bit per Character (BPC)":"1.03","Number of params":"88M"},"uses_additional_data":true},{"leaderboard":"/sota/language-modelling-on-hutter-prize","task":"Language Modelling","dataset":"Hutter Prize","model":"12-layer Transformer-XL","rank_in_archive_order":9,"of":18,"metrics":{"Bit per Character (BPC)":"1.06","Number of params":"41M"},"uses_additional_data":true},{"leaderboard":"/sota/language-modelling-on-one-billion-word","task":"Language Modelling","dataset":"One Billion Word","model":"Transformer-XL Large","rank_in_archive_order":4,"of":27,"metrics":{"Number of params":"0.8B","PPL":"21.8"},"uses_additional_data":false},{"leaderboard":"/sota/language-modelling-on-one-billion-word","task":"Language Modelling","dataset":"One Billion Word","model":"Transformer-XL Base","rank_in_archive_order":8,"of":27,"metrics":{"Number of params":"0.46B","PPL":"23.5"},"uses_additional_data":false},{"leaderboard":"/sota/language-modelling-on-penn-treebank-word","task":"Language Modelling","dataset":"Penn Treebank (Word Level)","model":"Transformer-XL","rank_in_archive_order":22,"of":43,"metrics":{"Params":"24M","Test perplexity":"54.55","Validation perplexity":"56.72"},"uses_additional_data":false},{"leaderboard":"/sota/language-modelling-on-text8","task":"Language Modelling","dataset":"Text8","model":"Transformer-XL - 24 layers","rank_in_archive_order":5,"of":24,"metrics":{"Bit per Character (BPC)":"1.08","Number of params":"277M"},"uses_additional_data":false},{"leaderboard":"/sota/language-modelling-on-wikitext-103","task":"Language Modelling","dataset":"WikiText-103","model":"Transformer-XL Large","rank_in_archive_order":34,"of":89,"metrics":{"Number of params":"257M","Test perplexity":"18.3","Validation perplexity":"18.2"},"uses_additional_data":false},{"leaderboard":"/sota/language-modelling-on-wikitext-103","task":"Language Modelling","dataset":"WikiText-103","model":"Transformer-XL Standard","rank_in_archive_order":54,"of":89,"metrics":{"Number of params":"151M","Test perplexity":"24.0","Validation perplexity":"23.1"},"uses_additional_data":false},{"leaderboard":"/sota/language-modelling-on-enwiki8","task":"Language Modelling","dataset":"enwik8","model":"Transformer-XL (24 layers)","rank_in_archive_order":12,"of":42,"metrics":{"Bit per Character (BPC)":"0.99","Number of params":"277M"},"uses_additional_data":false},{"leaderboard":"/sota/language-modelling-on-enwiki8","task":"Language Modelling","dataset":"enwik8","model":"Transformer-XL (18 layers)","rank_in_archive_order":23,"of":42,"metrics":{"Bit per Character (BPC)":"1.03","Number of params":"88M"},"uses_additional_data":false},{"leaderboard":"/sota/language-modelling-on-enwiki8","task":"Language Modelling","dataset":"enwik8","model":"Transformer-XL (12 layers)","rank_in_archive_order":26,"of":42,"metrics":{"Bit per Character (BPC)":"1.06","Number of params":"41M"},"uses_additional_data":false}],"syntology":{"syntology_url":"https://syntology.ai/paper/1901.02860","atlas_url":"https://app.syntology.ai/?focus=1901.02860","mcp":{"get_harvested_code_for_paper":{"arxiv_id":"1901.02860"},"calls":[{"tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1901.02860"},"returns":"the samples harvested from this paper, each with its run record; it does not verify the paper"},{"tool":"get_code","arguments_in":"samples[].code_sha256","returns":"one stored sample by its code_sha256; not shown on this site"}]},"developers":"https://syntology.ai/developers","held":true,"reason":"in_graph_layer","checked_against":null,"agent_calls":[{"tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1901.02860"},"call":"get_harvested_code_for_paper(arxiv_id=\"1901.02860\")"},{"tool":"get_code","arguments_in":{"code_sha256":"syntology.samples[].code_sha256"},"call":"get_code(code_sha256=\"…\")"},{"tool":"get_citation_path","arguments":{"paper_1":"1901.02860"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1901.02860\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1901.02860"},"call":"get_concepts_for_paper(arxiv_id=\"1901.02860\")"}],"by_repo":[{"repo":"kimiyoung/transformer-xl","kind":"official","samples":13,"ran":8,"instrument":1,"unverified":5},{"repo":"Jmkernes/PAR-Transformer-XL","kind":"listed","samples":11,"ran":7,"instrument":4,"unverified":4},{"repo":"Machine-Learning-Tokyo/Poetry-GAN","kind":"listed","samples":3,"ran":1,"instrument":0,"unverified":2},{"repo":"SambhawDrag/XLNet.jl","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"TimDettmers/transformer-xl","kind":"listed","samples":12,"ran":2,"instrument":0,"unverified":10},{"repo":"aiha-lab/Attention-Head-Pruning","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"benkrause/dynamiceval-transformer","kind":"listed","samples":12,"ran":4,"instrument":4,"unverified":8},{"repo":"cedrickchee/pytorch-pretrained-BERT","kind":"listed","samples":17,"ran":4,"instrument":1,"unverified":13},{"repo":"cmunnis/BERT_vs_Transformer-XL","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"facebookresearch/code-prediction-transformer","kind":"listed","samples":8,"ran":6,"instrument":0,"unverified":2},{"repo":"google-research/meliad","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2203.08913"],"harvested_for_calls":[{"arxiv_id":"2203.08913","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2203.08913"},"call":"get_harvested_code_for_paper(arxiv_id=\"2203.08913\")"}]},{"repo":"huggingface/transformers","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":4,"harvested_for":["1706.03762","1910.03771","2006.03654","2010.01057"],"harvested_for_calls":[{"arxiv_id":"1706.03762","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1706.03762"},"call":"get_harvested_code_for_paper(arxiv_id=\"1706.03762\")"},{"arxiv_id":"1910.03771","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1910.03771"},"call":"get_harvested_code_for_paper(arxiv_id=\"1910.03771\")"},{"arxiv_id":"2006.03654","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2006.03654"},"call":"get_harvested_code_for_paper(arxiv_id=\"2006.03654\")"},{"arxiv_id":"2010.01057","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2010.01057"},"call":"get_harvested_code_for_paper(arxiv_id=\"2010.01057\")"}]},{"repo":"huggingface/xlnet","kind":"listed","samples":13,"ran":4,"instrument":3,"unverified":9},{"repo":"inzva/fake-academic-paper-generation","kind":"listed","samples":2,"ran":1,"instrument":0,"unverified":1},{"repo":"listenviolet/XLNet","kind":"listed","samples":1,"ran":0,"instrument":0,"unverified":1},{"repo":"mustafaaljadery/gemma-2b-10m","kind":"listed","samples":7,"ran":4,"instrument":1,"unverified":3},{"repo":"okkteam/Transformer-Transducer","kind":"listed","samples":2,"ran":2,"instrument":0,"unverified":0},{"repo":"park-cheol/ASR-Conformer","kind":"listed","samples":2,"ran":2,"instrument":0,"unverified":0},{"repo":"samwisegamjeee/pytorch-transformers","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["1906.08237"],"harvested_for_calls":[{"arxiv_id":"1906.08237","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1906.08237"},"call":"get_harvested_code_for_paper(arxiv_id=\"1906.08237\")"}]},{"repo":"sh951011/Attention-Implementation","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"shanghai-digital-brain-laboratory/bdm-db1","kind":"listed","samples":14,"ran":10,"instrument":0,"unverified":4},{"repo":"sooftware/Attention-Implementation","kind":"listed","samples":1,"ran":1,"instrument":0,"unverified":0},{"repo":"sooftware/attentions","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"sooftware/conformer","kind":"listed","samples":1,"ran":0,"instrument":0,"unverified":1},{"repo":"sooftware/nlp-attentions","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"wxt1997/Transformer-Transducer","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"zhdbwe/Paper-DailyReading","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"2023-MindSpore-1/ms-code-220","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"AIResearchHub/transformergallery","kind":"listed","samples":4,"ran":2,"instrument":0,"unverified":2},{"repo":"NVIDIA/DeepLearningExamples","kind":"listed","samples":11,"ran":4,"instrument":0,"unverified":7},{"repo":"PaddlePaddle/PaddleNLP","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2301.03416"],"harvested_for_calls":[{"arxiv_id":"2301.03416","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2301.03416"},"call":"get_harvested_code_for_paper(arxiv_id=\"2301.03416\")"}]},{"repo":"jiean001/models_m","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["2010.16143"],"harvested_for_calls":[{"arxiv_id":"2010.16143","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2010.16143"},"call":"get_harvested_code_for_paper(arxiv_id=\"2010.16143\")"}]},{"repo":"jincan333/lot","kind":"listed","samples":2,"ran":0,"instrument":0,"unverified":2},{"repo":"labmlai/annotated_deep_learning_paper_implementations","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":15,"harvested_for":["1312.5602","1412.6980","1502.03167","1505.04597","1511.05952","1511.06434","1710.10903","1803.08494","1904.09751","2104.09864","2105.14491","2106.09685","2112.04426","2112.10752","2305.14342"],"harvested_for_calls":[{"arxiv_id":"1312.5602","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1312.5602"},"call":"get_harvested_code_for_paper(arxiv_id=\"1312.5602\")"},{"arxiv_id":"1412.6980","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1412.6980"},"call":"get_harvested_code_for_paper(arxiv_id=\"1412.6980\")"},{"arxiv_id":"1502.03167","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1502.03167"},"call":"get_harvested_code_for_paper(arxiv_id=\"1502.03167\")"},{"arxiv_id":"1505.04597","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1505.04597"},"call":"get_harvested_code_for_paper(arxiv_id=\"1505.04597\")"},{"arxiv_id":"1511.05952","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1511.05952"},"call":"get_harvested_code_for_paper(arxiv_id=\"1511.05952\")"},{"arxiv_id":"1511.06434","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1511.06434"},"call":"get_harvested_code_for_paper(arxiv_id=\"1511.06434\")"},{"arxiv_id":"1710.10903","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1710.10903"},"call":"get_harvested_code_for_paper(arxiv_id=\"1710.10903\")"},{"arxiv_id":"1803.08494","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1803.08494"},"call":"get_harvested_code_for_paper(arxiv_id=\"1803.08494\")"},{"arxiv_id":"1904.09751","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1904.09751"},"call":"get_harvested_code_for_paper(arxiv_id=\"1904.09751\")"},{"arxiv_id":"2104.09864","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2104.09864"},"call":"get_harvested_code_for_paper(arxiv_id=\"2104.09864\")"},{"arxiv_id":"2105.14491","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2105.14491"},"call":"get_harvested_code_for_paper(arxiv_id=\"2105.14491\")"},{"arxiv_id":"2106.09685","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2106.09685"},"call":"get_harvested_code_for_paper(arxiv_id=\"2106.09685\")"},{"arxiv_id":"2112.04426","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2112.04426"},"call":"get_harvested_code_for_paper(arxiv_id=\"2112.04426\")"},{"arxiv_id":"2112.10752","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2112.10752"},"call":"get_harvested_code_for_paper(arxiv_id=\"2112.10752\")"},{"arxiv_id":"2305.14342","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"2305.14342"},"call":"get_harvested_code_for_paper(arxiv_id=\"2305.14342\")"}]},{"repo":"lvyufeng/bert4ms","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0,"harvested_for_other_papers":1,"harvested_for":["1907.11692"],"harvested_for_calls":[{"arxiv_id":"1907.11692","tool":"get_harvested_code_for_paper","arguments":{"arxiv_id":"1907.11692"},"call":"get_harvested_code_for_paper(arxiv_id=\"1907.11692\")"}]},{"repo":"opendilab/DI-engine","kind":"listed","samples":5,"ran":3,"instrument":3,"unverified":2}],"by_repo_harvested_for_is":"harvested_for: the arXiv ids (as Syntology's graph holds them) of every paper whose samples Syntology's graph links to this repository, in arXiv-id order, complete; the page names the first 3 and says how many more. A link only: it does not say the papers are the same work, that one copied the other, or that the code implements this paper's method; harvested_for_calls gives the get_harvested_code_for_paper call for each arXiv-shaped id among them","by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code","assemblies":[{"assembly_sha256":"0ca4f23ae5c7e26b","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"Transformer-XL is a novel neural architecture that enables learning dependency beyond a fixed length without disrupting temporal coherence in language modeling.","centrality":"contribution","entry":"TransformerXL","entry_sha256":"a2315dc06271216b","n_bricks":15,"bricks":[{"entry":"TransformerXL","code_sha256":"a2315dc06271216b","role":"entry","order":0,"level":0,"status":"unverified"},{"entry":"GatoInputBase","code_sha256":"6a748d270690866b","role":"helper","order":1,"level":1,"status":"ran"},{"entry":"ICTaskInput","code_sha256":"ad41eff0feadfd69","role":"helper","order":2,"level":1,"status":"ran"},{"entry":"NLPTaskInput","code_sha256":"7eb33bec45fe09f3","role":"helper","order":3,"level":1,"status":"ran"},{"entry":"PositionalEmbedding","code_sha256":"142586d370dc7c1e","role":"model","order":4,"level":1,"status":"ran"},{"entry":"RLTaskInput","code_sha256":"2e57dbd19f63d3f4","role":"helper","order":5,"level":1,"status":"ran"},{"entry":"RelPartialLearnableDecoderLayer","code_sha256":"9ec384a6bfe40952","role":"model","order":6,"level":0,"status":"unverified"},{"entry":"VQATaskInput","code_sha256":"2a023fc4bac8d229","role":"helper","order":7,"level":1,"status":"ran"},{"entry":"VisionEmbedding","code_sha256":"2a5f4bac2414eb0f","role":"helper","order":8,"level":1,"status":"ran"},{"entry":"print_with_rank","code_sha256":"bf75653cc30018e0","role":"helper","order":9,"level":0,"status":"unverified"},{"entry":"PositionwiseFF","code_sha256":"eed8c286b97219b7","role":"model","order":10,"level":1,"status":"ran"},{"entry":"RelPartialLearnableMultiHeadAttn","code_sha256":"fdc345d0da45dd95","role":"model","order":11,"level":0,"status":"unverified"},{"entry":"PatchEmbeddings","code_sha256":"b54068382071f8c8","role":"helper","order":12,"level":1,"status":"ran"},{"entry":"to_2tuple","code_sha256":"4e978f9f7835b10a","role":"helper","order":13,"level":1,"status":"ran_violates"},{"entry":"GEGLU","code_sha256":"845f84e3a319753d","role":"helper","order":14,"level":1,"status":"ran"}],"ran_individually":11,"ran_individually_constructed":9,"ran_individually_by_status":{"ran":10,"ran_violates":1},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"0fd00b2522223a49","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"This code implements the Transformer-XL model, which enables learning dependencies beyond a fixed-length context using relative positional encoding and segment-level recurrence.","centrality":"contribution","entry":"TransfoXLModel","entry_sha256":"532a59e61c71b7a8","n_bricks":23,"bricks":[{"entry":"TransfoXLModel","code_sha256":"532a59e61c71b7a8","role":"entry","order":0,"level":0,"status":"unverified"},{"entry":"AdaptiveEmbedding","code_sha256":"e77541c1b4b15830","role":"model","order":1,"level":1,"status":"ran"},{"entry":"DecoderLayer","code_sha256":"fc52846dc775edff","role":"helper","order":2,"level":0,"status":"unverified"},{"entry":"PositionalEmbedding","code_sha256":"06ce2b899569db5b","role":"helper","order":3,"level":1,"status":"ran"},{"entry":"RelLearnableDecoderLayer","code_sha256":"752529d23a4b3b22","role":"model","order":4,"level":0,"status":"unverified"},{"entry":"RelPartialLearnableDecoderLayer","code_sha256":"fd8d58e6a1428332","role":"model","order":5,"level":0,"status":"unverified"},{"entry":"TransfoXLPreTrainedModel","code_sha256":"d7bd7d30264b3658","role":"helper","order":6,"level":0,"status":"unverified"},{"entry":"MultiHeadAttn","code_sha256":"d4857f57ecefa3d5","role":"helper","order":7,"level":0,"status":"unverified"},{"entry":"PositionwiseFF","code_sha256":"62b1b4ab79fdfc8b","role":"helper","order":8,"level":0,"status":"unverified"},{"entry":"RelLearnableMultiHeadAttn","code_sha256":"3dafbc50941af43d","role":"model","order":9,"level":0,"status":"unverified"},{"entry":"RelPartialLearnableMultiHeadAttn","code_sha256":"8361fa24d3e06e13","role":"model","order":10,"level":0,"status":"unverified"},{"entry":"TransfoXLConfig","code_sha256":"a97a22ac6fb31922","role":"helper","order":11,"level":1,"status":"ran"},{"entry":"cached_path","code_sha256":"6fee57012e68e835","role":"helper","order":12,"level":0,"status":"unverified"},{"entry":"load_tf_weights_in_transfo_xl","code_sha256":"1ebc2bf2c3cddc4d","role":"helper","order":13,"level":0,"status":"unverified"},{"entry":"RelMultiHeadAttn","code_sha256":"dc7c9e91c34d6ddf","role":"model","order":14,"level":0,"status":"unverified"},{"entry":"get_from_cache","code_sha256":"b4bb49d2de702f67","role":"helper","order":15,"level":0,"status":"unverified"},{"entry":"build_tf_to_pytorch_map","code_sha256":"35ef111fc00c21b4","role":"helper","order":16,"level":1,"status":"ran_draft_wrong"},{"entry":"http_get","code_sha256":"18f49ada16168f38","role":"helper","order":17,"level":0,"status":"unverified"},{"entry":"s3_etag","code_sha256":"51dd06ec77c8a8d1","role":"helper","order":18,"level":0,"status":"unverified"},{"entry":"s3_get","code_sha256":"1079045e75efbf23","role":"helper","order":19,"level":0,"status":"unverified"},{"entry":"url_to_filename","code_sha256":"5eff22fa0a651276","role":"helper","order":20,"level":1,"status":"ran_draft_wrong"},{"entry":"s3_request","code_sha256":"7661139be003d514","role":"helper","order":21,"level":1,"status":"ran_draft_wrong"},{"entry":"split_s3_path","code_sha256":"d3852f416bfe86c3","role":"helper","order":22,"level":0,"status":"unverified"}],"ran_individually":6,"ran_individually_constructed":3,"ran_individually_by_status":{"ran":3,"ran_draft_wrong":3},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"21dab7af12febce7","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"The code implements a multi-head attention mechanism with relative positional encoding, which enables learning dependency beyond a fixed-length context without disrupting temporal coherence, as proposed in Transformer-XL.","centrality":"contribution","entry":"RelativeMultiHeadAttention","entry_sha256":"c018d465b6253b94","n_bricks":1,"bricks":[{"entry":"RelativeMultiHeadAttention","code_sha256":"c018d465b6253b94","role":"entry","order":0,"level":1,"status":"ran"}],"ran_individually":1,"ran_individually_constructed":0,"ran_individually_by_status":{"ran":1},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"22c271d30593d6c5","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"The code implements Transformer-XL, a novel neural architecture that enables learning dependency beyond a fixed length without disrupting temporal coherence by using a segment-level recurrence mechanism and relative positional encoding.","centrality":"contribution","entry":"MemTransformerLM","entry_sha256":"9ef2fc89678fefb2","n_bricks":14,"bricks":[{"entry":"MemTransformerLM","code_sha256":"9ef2fc89678fefb2","role":"entry","order":0,"level":0,"status":"unverified"},{"entry":"AdaptiveEmbedding","code_sha256":"1ae137f0cee15e33","role":"model","order":1,"level":1,"status":"ran"},{"entry":"DecoderLayer","code_sha256":"e8aac29a19d0c2e7","role":"model","order":2,"level":1,"status":"ran"},{"entry":"LogUniformSampler","code_sha256":"220657028509cfb1","role":"helper","order":3,"level":1,"status":"ran"},{"entry":"PositionalEmbedding","code_sha256":"06ce2b899569db5b","role":"helper","order":4,"level":1,"status":"ran"},{"entry":"ProjectedAdaptiveLogSoftmax","code_sha256":"338c39719307318d","role":"helper","order":5,"level":1,"status":"ran"},{"entry":"RelLearnableDecoderLayer","code_sha256":"17ee18e7e701439f","role":"model","order":6,"level":0,"status":"unverified"},{"entry":"RelPartialLearnableDecoderLayer","code_sha256":"89afd0bff30e18a9","role":"model","order":7,"level":0,"status":"unverified"},{"entry":"sample_logits","code_sha256":"93228a3eb5c4d179","role":"helper","order":8,"level":1,"status":"ran_draft_wrong"},{"entry":"MultiHeadAttn","code_sha256":"d99c9cc9af9de483","role":"helper","order":9,"level":1,"status":"ran"},{"entry":"PositionwiseFF","code_sha256":"c96fba039a607703","role":"helper","order":10,"level":1,"status":"ran"},{"entry":"RelLearnableMultiHeadAttn","code_sha256":"a033a134e9f6452f","role":"model","order":11,"level":0,"status":"unverified"},{"entry":"RelPartialLearnableMultiHeadAttn","code_sha256":"fb613dd5bc21371c","role":"model","order":12,"level":0,"status":"unverified"},{"entry":"RelMultiHeadAttn","code_sha256":"fe28ba867add05c0","role":"model","order":13,"level":1,"status":"ran"}],"ran_individually":9,"ran_individually_constructed":8,"ran_individually_by_status":{"ran":8,"ran_draft_wrong":1},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"2af31d3ea5bdcda7","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"This code implements Transformer-XL, a neural architecture that enables learning dependencies beyond a fixed-length context without disrupting temporal coherence by using a segment-level recurrence mechanism and relative positional encodings.","centrality":"contribution","entry":"transformer","entry_sha256":"d0f56431ab6c3b37","n_bricks":12,"bricks":[{"entry":"transformer","code_sha256":"d0f56431ab6c3b37","role":"entry","order":0,"level":0,"status":"unverified"},{"entry":"_cache_mem","code_sha256":"773651748c9618d6","role":"model","order":1,"level":1,"status":"ran_fixture"},{"entry":"_create_mask","code_sha256":"ed15761e38990647","role":"helper","order":2,"level":0,"status":"unverified"},{"entry":"mask_adaptive_embedding_lookup","code_sha256":"99e35dc770639097","role":"helper","order":3,"level":0,"status":"unverified"},{"entry":"mask_adaptive_logsoftmax","code_sha256":"fca4d6d03913ae24","role":"helper","order":4,"level":0,"status":"unverified"},{"entry":"mul_adaptive_embedding_lookup","code_sha256":"8d07f1308bd24cbc","role":"helper","order":5,"level":0,"status":"unverified"},{"entry":"mul_adaptive_logsoftmax","code_sha256":"e344186184b46850","role":"helper","order":6,"level":0,"status":"unverified"},{"entry":"positional_embedding","code_sha256":"d50e8679cde3a927","role":"model","order":7,"level":1,"status":"ran_fixture"},{"entry":"positionwise_FF","code_sha256":"3652bf001c221967","role":"model","order":8,"level":0,"status":"unverified"},{"entry":"rel_multihead_attn","code_sha256":"b1f1afea05cd968b","role":"model","order":9,"level":0,"status":"unverified"},{"entry":"embedding_lookup","code_sha256":"9109ba9791e44324","role":"helper","order":10,"level":1,"status":"ran_fixture"},{"entry":"rel_shift","code_sha256":"d37883dc58ff9b69","role":"model","order":11,"level":1,"status":"ran_fixture"}],"ran_individually":4,"ran_individually_constructed":0,"ran_individually_by_status":{"ran_fixture":4},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"2c0d4a68af4f251b","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"The code implements Transformer-XL, a neural architecture that enables learning dependency beyond a fixed length without disrupting temporal coherence, using relative positional encodings and a segment-level recurrence mechanism.","centrality":"contribution","entry":"PARTransformerXL","entry_sha256":"de3ab66ec62fc167","n_bricks":11,"bricks":[{"entry":"PARTransformerXL","code_sha256":"de3ab66ec62fc167","role":"entry","order":0,"level":0,"status":"unverified"},{"entry":"AdaptiveSoftmax","code_sha256":"87202268910cb496","role":"model","order":1,"level":0,"status":"unverified"},{"entry":"StochasticBlock","code_sha256":"534b6317f069c394","role":"model","order":2,"level":0,"status":"unverified"},{"entry":"RelMultiHeadAttention","code_sha256":"4c8b264bb79a35a1","role":"model","order":3,"level":1,"status":"ran"},{"entry":"RelaxedOneHot","code_sha256":"1be1a875d12d10b3","role":"helper","order":4,"level":0,"status":"unverified"},{"entry":"positionwise_ffn","code_sha256":"f7a746d73ab2f28c","role":"model","order":5,"level":1,"status":"ran_draft_wrong"},{"entry":"create_lookahead_mask","code_sha256":"499bf5fee7915c78","role":"helper","order":6,"level":1,"status":"ran_honours"},{"entry":"positional_encoding","code_sha256":"2398c4a5c285bdc4","role":"helper","order":7,"level":1,"status":"ran_honours"},{"entry":"relative_position_logits","code_sha256":"edeef97857b7cdca","role":"helper","order":8,"level":1,"status":"ran_fixture"},{"entry":"left_shift","code_sha256":"8d59a6d5900428f5","role":"helper","order":9,"level":1,"status":"ran_fixture"},{"entry":"right_shift","code_sha256":"df4647a6d9f03c0e","role":"helper","order":10,"level":1,"status":"ran_fixture"}],"ran_individually":7,"ran_individually_constructed":1,"ran_individually_by_status":{"ran":1,"ran_draft_wrong":1,"ran_fixture":3,"ran_honours":2},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"2fc24ef33330d8f9","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"The paper claims this code implements a multi-head attention mechanism with relative positional encoding to enable learning dependencies beyond a fixed-length context without disrupting temporal coherence.","centrality":"contribution","entry":"RelPositionMultiHeadedAttention","entry_sha256":"4977fa89216a56fa","n_bricks":2,"bricks":[{"entry":"RelPositionMultiHeadedAttention","code_sha256":"4977fa89216a56fa","role":"entry","order":0,"level":1,"status":"ran"},{"entry":"MultiHeadedAttention","code_sha256":"5597fd8e1219b866","role":"helper","order":1,"level":1,"status":"ran"}],"ran_individually":2,"ran_individually_constructed":2,"ran_individually_by_status":{"ran":2},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"3a67a650732bc14d","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"Implements a Transformer-based attention mechanism that enables learning dependency beyond a fixed-length context without disrupting temporal coherence, as proposed in Transformer-XL.","centrality":"contribution","entry":"GemmaInfiniAttention","entry_sha256":"de07f82e734e3e2c","n_bricks":7,"bricks":[{"entry":"GemmaInfiniAttention","code_sha256":"de07f82e734e3e2c","role":"entry","order":0,"level":0,"status":"unverified"},{"entry":"GemmaAttention","code_sha256":"e4e12108c18eb032","role":"helper","order":1,"level":0,"status":"unverified"},{"entry":"GemmaConfig","code_sha256":"709b8a145b15f0ca","role":"helper","order":2,"level":1,"status":"ran"},{"entry":"GemmaRotaryEmbedding","code_sha256":"39c5be8f7b1c0490","role":"helper","order":3,"level":1,"status":"ran"},{"entry":"apply_rotary_pos_emb","code_sha256":"5c61a4c30ce59547","role":"helper","order":4,"level":0,"status":"unverified"},{"entry":"repeat_kv","code_sha256":"4e762613ee907cdb","role":"helper","order":5,"level":1,"status":"ran_fixture"},{"entry":"rotate_half","code_sha256":"cec833a99feb528c","role":"helper","order":6,"level":1,"status":"ran_honours"}],"ran_individually":4,"ran_individually_constructed":2,"ran_individually_by_status":{"ran":2,"ran_fixture":1,"ran_honours":1},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"430021cafbad26e3","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"The paper claims this code implements Transformer-XL, a novel neural architecture that enables learning dependency beyond a fixed-length context by caching previous keys and values to extend the attention mechanism's effective context.","centrality":"contribution","entry":"TransformerXL","entry_sha256":"fa690903d5ea5d89","n_bricks":6,"bricks":[{"entry":"TransformerXL","code_sha256":"fa690903d5ea5d89","role":"entry","order":0,"level":0,"status":"unverified"},{"entry":"TransformerEmbedding","code_sha256":"c7b5eb55f15a37de","role":"helper","order":1,"level":1,"status":"ran"},{"entry":"XLAttentionLayer","code_sha256":"91e5af7605c83b9a","role":"model","order":2,"level":0,"status":"unverified"},{"entry":"PositionalEncoding","code_sha256":"07bf8cf6e731d1bc","role":"helper","order":3,"level":1,"status":"ran"},{"entry":"TokenEmbedding","code_sha256":"0840d53a3e87bbd0","role":"helper","order":4,"level":1,"status":"ran"},{"entry":"FeedForward","code_sha256":"2893a3bddf619d82","role":"helper","order":5,"level":1,"status":"ran"}],"ran_individually":4,"ran_individually_constructed":4,"ran_individually_by_status":{"ran":4},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"45cdfe7bff4140b0","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"The code implements Transformer-XL, a novel neural architecture that enables learning dependency beyond a fixed length without disrupting temporal coherence by using a segment-level recurrence mechanism and relative positional encoding.","centrality":"contribution","entry":"MemTransformerLM","entry_sha256":"5ffa84d26ba39532","n_bricks":16,"bricks":[{"entry":"MemTransformerLM","code_sha256":"5ffa84d26ba39532","role":"entry","order":0,"level":0,"status":"unverified"},{"entry":"AdaptiveEmbedding","code_sha256":"8a8691f05cb1b5da","role":"model","order":1,"level":1,"status":"ran"},{"entry":"DecoderLayer","code_sha256":"c614edf5b8c0d3b0","role":"model","order":2,"level":0,"status":"unverified"},{"entry":"LogUniformSampler","code_sha256":"220657028509cfb1","role":"helper","order":3,"level":1,"status":"ran"},{"entry":"PositionalEmbedding","code_sha256":"06ce2b899569db5b","role":"helper","order":4,"level":1,"status":"ran"},{"entry":"ProjectedAdaptiveLogSoftmax","code_sha256":"4088ee884194d7c4","role":"helper","order":5,"level":1,"status":"ran"},{"entry":"RelLearnableDecoderLayer","code_sha256":"ea7c8500cbc85ff5","role":"model","order":6,"level":0,"status":"unverified"},{"entry":"RelPartialLearnableDecoderLayer","code_sha256":"5014b04d3358c101","role":"model","order":7,"level":0,"status":"unverified"},{"entry":"sample_logits","code_sha256":"582150577e5bd769","role":"helper","order":8,"level":0,"status":"unverified"},{"entry":"MultiHeadAttn","code_sha256":"e672e8a20905b62b","role":"helper","order":9,"level":1,"status":"ran"},{"entry":"PositionwiseFF","code_sha256":"c96fba039a607703","role":"helper","order":10,"level":1,"status":"ran"},{"entry":"OptionalParameterList","code_sha256":"55b4958b2a4e4373","role":"helper","order":11,"level":0,"status":"unverified"},{"entry":"RelLearnableMultiHeadAttn","code_sha256":"cb862dd19b1f381a","role":"model","order":12,"level":0,"status":"unverified"},{"entry":"RelPartialLearnableMultiHeadAttn","code_sha256":"5e1b71bde76b69e7","role":"model","order":13,"level":0,"status":"unverified"},{"entry":"RelMultiHeadAttn","code_sha256":"8fa37260188b5fd8","role":"model","order":14,"level":1,"status":"ran"},{"entry":"add_and_scale","code_sha256":"78d91efd74e4d12a","role":"helper","order":15,"level":1,"status":"ran_fixture"}],"ran_individually":8,"ran_individually_constructed":7,"ran_individually_by_status":{"ran":7,"ran_fixture":1},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"4dfd72be8446aebc","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"Implements Transformer-XL, a neural architecture enabling learning dependency beyond a fixed length without disrupting temporal coherence by using relative positional encoding and segment-level recurrence.","centrality":"contribution","entry":"transformer_xl","entry_sha256":"d077730400326171","n_bricks":14,"bricks":[{"entry":"transformer_xl","code_sha256":"d077730400326171","role":"entry","order":0,"level":0,"status":"unverified"},{"entry":"_cache_mem","code_sha256":"9d5e914b24b8911a","role":"model","order":1,"level":1,"status":"ran_fixture"},{"entry":"_create_mask","code_sha256":"c1f8a649a7a837d5","role":"helper","order":2,"level":0,"status":"unverified"},{"entry":"embedding_lookup","code_sha256":"5abf0267f0fc7514","role":"helper","order":3,"level":0,"status":"unverified"},{"entry":"positionwise_ffn","code_sha256":"ddf11fc956cd28ce","role":"model","order":4,"level":0,"status":"unverified"},{"entry":"rel_multihead_attn","code_sha256":"6ccb8d28491109b6","role":"model","order":5,"level":0,"status":"unverified"},{"entry":"relative_positional_encoding","code_sha256":"8e76562720b0c921","role":"model","order":6,"level":1,"status":"ran_honours"},{"entry":"two_stream_rel_attn","code_sha256":"2d935f29546db9cd","role":"model","order":7,"level":0,"status":"unverified"},{"entry":"gelu","code_sha256":"d08f324f950148de","role":"helper","order":8,"level":1,"status":"ran_honours"},{"entry":"head_projection","code_sha256":"6804d62cb7cd8df3","role":"model","order":9,"level":0,"status":"unverified"},{"entry":"post_attention","code_sha256":"cf208c8c20d52c1b","role":"model","order":10,"level":0,"status":"unverified"},{"entry":"rel_attn_core","code_sha256":"b517847a8c809203","role":"model","order":11,"level":0,"status":"unverified"},{"entry":"positional_embedding","code_sha256":"9bf0f6e6298f3fbe","role":"helper","order":12,"level":1,"status":"ran_fixture"},{"entry":"rel_shift","code_sha256":"5f7c5b38aeb29bf5","role":"model","order":13,"level":1,"status":"ran_fixture"}],"ran_individually":5,"ran_individually_constructed":0,"ran_individually_by_status":{"ran_fixture":3,"ran_honours":2},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"618dbc8230390485","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"Implements multi-head attention with relative positional encoding as proposed in Transformer-XL to enable learning dependency beyond a fixed-length context.","centrality":"contribution","entry":"RelativeMultiHeadAttention","entry_sha256":"274ae09f88dbb42a","n_bricks":2,"bricks":[{"entry":"RelativeMultiHeadAttention","code_sha256":"274ae09f88dbb42a","role":"entry","order":0,"level":0,"status":"unverified"},{"entry":"Linear","code_sha256":"1f215b06ae5d8476","role":"helper","order":1,"level":1,"status":"ran"}],"ran_individually":1,"ran_individually_constructed":1,"ran_individually_by_status":{"ran":1},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"7e8e94db34a4c27b","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"The paper claims this is the Transformer-XL architecture that enables learning dependency beyond a fixed length without disrupting temporal coherence","centrality":"contribution","entry":"MemTransformerLM","entry_sha256":"a7430322070cedb5","n_bricks":14,"bricks":[{"entry":"MemTransformerLM","code_sha256":"a7430322070cedb5","role":"entry","order":0,"level":0,"status":"unverified"},{"entry":"AdaptiveEmbedding","code_sha256":"1ae137f0cee15e33","role":"model","order":1,"level":1,"status":"ran"},{"entry":"DecoderLayer","code_sha256":"e8aac29a19d0c2e7","role":"model","order":2,"level":1,"status":"ran"},{"entry":"LogUniformSampler","code_sha256":"220657028509cfb1","role":"helper","order":3,"level":1,"status":"ran"},{"entry":"PositionalEmbedding","code_sha256":"06ce2b899569db5b","role":"model","order":4,"level":1,"status":"ran"},{"entry":"ProjectedAdaptiveLogSoftmax","code_sha256":"7d9e9736e6c57d11","role":"helper","order":5,"level":1,"status":"ran"},{"entry":"RelLearnableDecoderLayer","code_sha256":"17ee18e7e701439f","role":"model","order":6,"level":0,"status":"unverified"},{"entry":"RelPartialLearnableDecoderLayer","code_sha256":"89afd0bff30e18a9","role":"model","order":7,"level":0,"status":"unverified"},{"entry":"sample_logits","code_sha256":"93228a3eb5c4d179","role":"helper","order":8,"level":1,"status":"ran_draft_wrong"},{"entry":"MultiHeadAttn","code_sha256":"d99c9cc9af9de483","role":"model","order":9,"level":1,"status":"ran"},{"entry":"PositionwiseFF","code_sha256":"c96fba039a607703","role":"model","order":10,"level":1,"status":"ran"},{"entry":"RelLearnableMultiHeadAttn","code_sha256":"a033a134e9f6452f","role":"model","order":11,"level":0,"status":"unverified"},{"entry":"RelPartialLearnableMultiHeadAttn","code_sha256":"fb613dd5bc21371c","role":"model","order":12,"level":0,"status":"unverified"},{"entry":"RelMultiHeadAttn","code_sha256":"fe28ba867add05c0","role":"model","order":13,"level":1,"status":"ran"}],"ran_individually":9,"ran_individually_constructed":8,"ran_individually_by_status":{"ran":8,"ran_draft_wrong":1},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"b2b2f8242acdc1d5","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"Implements a Transformer-XL model that enables learning dependency beyond a fixed length without disrupting temporal coherence.","centrality":"contribution","entry":"TransformerModel","entry_sha256":"9a2f71717dcf3962","n_bricks":9,"bricks":[{"entry":"TransformerModel","code_sha256":"9a2f71717dcf3962","role":"entry","order":0,"level":0,"status":"unverified"},{"entry":"GPT2LMHead","code_sha256":"117b06ce2fbc7877","role":"model","order":1,"level":0,"status":"unverified"},{"entry":"GPT2Model","code_sha256":"72ccb5501088c2b4","role":"model","order":2,"level":1,"status":"ran"},{"entry":"Block","code_sha256":"548da299b3bc04e9","role":"model","order":3,"level":1,"status":"ran"},{"entry":"LayerNorm","code_sha256":"39480331817170e8","role":"model","order":4,"level":1,"status":"ran"},{"entry":"PathLSTM","code_sha256":"5fb8aacfbced509d","role":"helper","order":5,"level":1,"status":"ran"},{"entry":"Attention","code_sha256":"e3217ee8bd314909","role":"model","order":6,"level":1,"status":"ran"},{"entry":"MLP","code_sha256":"df5a6cf54dd0aca6","role":"model","order":7,"level":1,"status":"ran"},{"entry":"gelu","code_sha256":"8d23fbe2b99b840b","role":"helper","order":8,"level":1,"status":"ran_draft_wrong"}],"ran_individually":7,"ran_individually_constructed":6,"ran_individually_by_status":{"ran":6,"ran_draft_wrong":1},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"e405f80080d3da6d","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"The paper claims this code implements Transformer-XL, a novel neural architecture enabling learning dependency beyond a fixed length without disrupting temporal coherence.","centrality":"contribution","entry":"XLNet","entry_sha256":"2b646a664c00ffa8","n_bricks":1,"bricks":[{"entry":"XLNet","code_sha256":"2b646a664c00ffa8","role":"entry","order":0,"level":0,"status":"unverified"}],"ran_individually":0,"ran_individually_constructed":0,"ran_individually_by_status":{},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"mislabelled","label_verdict_judged":true,"suggested_method":"Transformer-XL","batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"defer","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"ed79e3501287d964","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"Implements a multi-head attention mechanism with relative positional embeddings to enable learning dependencies beyond a fixed-length context, as proposed in Transformer-XL.","centrality":"contribution","entry":"RelativeMultiHeadAttention","entry_sha256":"032b78da6979837c","n_bricks":2,"bricks":[{"entry":"RelativeMultiHeadAttention","code_sha256":"032b78da6979837c","role":"entry","order":0,"level":1,"status":"ran"},{"entry":"Linear","code_sha256":"84585e9be4407fc4","role":"helper","order":1,"level":1,"status":"ran"}],"ran_individually":2,"ran_individually_constructed":0,"ran_individually_by_status":{"ran":2},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"f7629f5167ba1e0d","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"The paper claims a novel neural architecture Transformer-XL that enables learning dependency beyond a fixed length without disrupting temporal coherence, using a segment-level recurrence mechanism and relative positional encoding.","centrality":"component","entry":"TransformerLayer","entry_sha256":"b28585d20fefea46","n_bricks":5,"bricks":[{"entry":"TransformerLayer","code_sha256":"b28585d20fefea46","role":"entry","order":0,"level":0,"status":"unverified"},{"entry":"Attention","code_sha256":"fe3454282cf0b88e","role":"model","order":1,"level":0,"status":"unverified"},{"entry":"build_normalization","code_sha256":"c92e4fc990bba2fe","role":"helper","order":2,"level":1,"status":"ran_draft_wrong"},{"entry":"fc_block","code_sha256":"c1184d27672a7461","role":"helper","order":3,"level":1,"status":"ran_draft_wrong"},{"entry":"sequential_pack","code_sha256":"a4f0d0fb0e45662a","role":"helper","order":4,"level":1,"status":"ran_draft_wrong"}],"ran_individually":3,"ran_individually_constructed":0,"ran_individually_by_status":{"ran_draft_wrong":3},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"COMPONENT","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"cannot_tell","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"defer","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"},{"assembly_sha256":"ff415c7b0c04a973","source_kind":"harvested","method_name":"Transformer-XL","realizes_method":"Transformer-XL","graph_method":"Transformer-XL","realizes_severed":false,"claim":"The code implements Transformer-XL, a neural architecture that enables learning dependency beyond a fixed-length context without disrupting temporal coherence by using recurrent memory and relative positional encoding.","centrality":"contribution","entry":"MemTransformerLM","entry_sha256":"12dd38874c15490a","n_bricks":14,"bricks":[{"entry":"MemTransformerLM","code_sha256":"12dd38874c15490a","role":"entry","order":0,"level":0,"status":"unverified"},{"entry":"AdaptiveEmbedding","code_sha256":"1ae137f0cee15e33","role":"model","order":1,"level":1,"status":"ran"},{"entry":"DecoderLayer","code_sha256":"e8aac29a19d0c2e7","role":"model","order":2,"level":1,"status":"ran"},{"entry":"LogUniformSampler","code_sha256":"220657028509cfb1","role":"helper","order":3,"level":1,"status":"ran"},{"entry":"PositionalEmbedding","code_sha256":"06ce2b899569db5b","role":"helper","order":4,"level":1,"status":"ran"},{"entry":"ProjectedAdaptiveLogSoftmax","code_sha256":"6b820cc9aac66bc1","role":"helper","order":5,"level":0,"status":"unverified"},{"entry":"RelLearnableDecoderLayer","code_sha256":"17ee18e7e701439f","role":"model","order":6,"level":0,"status":"unverified"},{"entry":"RelPartialLearnableDecoderLayer","code_sha256":"89afd0bff30e18a9","role":"model","order":7,"level":0,"status":"unverified"},{"entry":"sample_logits","code_sha256":"93228a3eb5c4d179","role":"helper","order":8,"level":1,"status":"ran_draft_wrong"},{"entry":"MultiHeadAttn","code_sha256":"d99c9cc9af9de483","role":"model","order":9,"level":1,"status":"ran"},{"entry":"PositionwiseFF","code_sha256":"c96fba039a607703","role":"model","order":10,"level":1,"status":"ran"},{"entry":"RelLearnableMultiHeadAttn","code_sha256":"a033a134e9f6452f","role":"model","order":11,"level":0,"status":"unverified"},{"entry":"RelPartialLearnableMultiHeadAttn","code_sha256":"fb613dd5bc21371c","role":"model","order":12,"level":0,"status":"unverified"},{"entry":"RelMultiHeadAttn","code_sha256":"fe28ba867add05c0","role":"model","order":13,"level":1,"status":"ran"}],"ran_individually":8,"ran_individually_constructed":7,"ran_individually_by_status":{"ran":7,"ran_draft_wrong":1},"end_to_end":{"ran":false,"level":0},"level_lowered":null,"claim_match":"IMPLEMENTS","claim_match_rule":"single_judge","claim_match_basis":"judge:global.anthropic.claude-sonnet-4-5-20250929-v1:0","claim_match_judges":["global.anthropic.claude-sonnet-4-5-20250929-v1:0"],"label_verdict":"matches","label_verdict_judged":true,"suggested_method":null,"batch_at":"2026-09-09T22:44:46+00:00","sibling_group":"1335d1734b81","n_siblings":17,"retention":"keep","provenance":"assembly:harvest_method_v6","attached_at":"2026-09-09T22:44:46+00:00","attached_provenance":"assembly:harvest_method_v6"}],"assembly_sibling_groups":[{"group":"1335d1734b81","realizes_method":"Transformer-XL","source_kind":"harvested","batch_at":"2026-09-09T22:44:46+00:00","members":["0ca4f23ae5c7e26b","0fd00b2522223a49","21dab7af12febce7","22c271d30593d6c5","2af31d3ea5bdcda7","2c0d4a68af4f251b","2fc24ef33330d8f9","3a67a650732bc14d","430021cafbad26e3","45cdfe7bff4140b0","4dfd72be8446aebc","618dbc8230390485","7e8e94db34a4c27b","b2b2f8242acdc1d5","e405f80080d3da6d","ed79e3501287d964","f7629f5167ba1e0d","ff415c7b0c04a973"]}],"assemblies_is":{"about":"What Syntology's graph records as this paper's claimed method, lifted into code: each assembly names its bricks (functions and classes), each with its own role and its own verification level. An assembly is not a check that the code implements the method correctly or reproduces the paper's results.","harvested":"assembled from code harvested from a repository linked to the paper","generated":"generated from the paper text, not the repository's code","end_to_end":"for a harvested assembly, the assembly has not been run end-to-end; for a generated one, end_to_end.level is the assembly's own level and against_independent_peer says whether it ran against a peer: an independent peer is a second implementation generated separately from the same paper text; neither implementation read the authors' code. At level 2 the two agreed numerically on the fixture's inputs; level 3 is recorded when property tests derived from the paper also passed on both, and each level 3 card prints how many its report lists","bricks_level":"each brick's own verification level in Syntology's graph (level 0: no recorded run), listed brick by brick and never combined into one level","ran_individually":"a COUNT of bricks that ran on their own on a fixture (split by status in ran_individually_by_status), not a level; instrument statuses are failures of Syntology's instrument, not of the code","siblings":"assemblies lifted from this paper in the same batch for the same method: alternative readings kept side by side; none replaces or supersedes another","judged":"Where a model read the code against the paper's claim, each assembly's label verdict is one model's judgement, kept in this page's JSON twin; it is not calibrated, so no card prints it. A generated assembly's label was set when its code was generated for the method, and no model judged it; its card prints it as \"by construction\" or \"not judged by a model\"","level_lowered":"a generated assembly whose level Syntology's graph lowered, with the level it had, the recorded reason and when","retention":"Syntology's spending triage for further verification, not a verdict","claim_match":"the claim_match vote: IMPLEMENTS, COMPONENT or UNCLEAR. Where claim_match_basis is \"judge:<model>\", it is one model's judgement of the assembly's label against the paper's claim (claim_match_rule single_judge, the model in claim_match_judges): not a verification and not a run. Where it is \"construction\", the value was set when the code was generated for this method and no model judged it, whatever claim_match_rule says. The page prints no claim match for any assembly","label_verdict":"whether the assembly's code is the method it is labelled with: matches, cannot_tell, mislabelled (suggested_method names what it looks like instead) or not_the_method; label_verdict_judged is true only when a model read the code (claim_match_basis \"judge:<model>\")","label_verdict_judged":"where true (claim_match_basis \"judge:<model>\"), label_verdict is a single model's judgement; not calibrated; not printed on the page; where false, it was set by construction, and the page prints it unless the node is shared with another paper (node_properties_written_for)","claim":"the claim text stored on the assembly node: for a harvested assembly, what the paper claims the code implements, as the lifting model wrote it; for a generated one, the specification the code was generated from. Not verified text","centrality":"how central the lifted method is to the paper, as the lifting step recorded it: contribution, component or incidental","v3_tests_passed_both_sides":"end_to_end.v3_tests_passed_both_sides: the number of property tests derived from the paper that passed on both implementations, as the attached report lists them; a level 3 card with 0 says its report lists none","ran_individually_constructed":"ran_individually_constructed: of the bricks counted in ran_individually, how many constructed an object rather than computing a result (Syntology's RAN record's rule, read from the graph-layer sample with the brick's code_sha256); a part of ran_individually, never subtracted from it and never a failure; null where a brick that ran has no sample in the graph layer this build read, so the figure was not counted"},"assemblies_call":{"tool":"assembly","arguments":{"arxiv_id":"1901.02860"},"call":"assembly(arxiv_id=\"1901.02860\")"},"read_at":"2026-10-05T00:36:11+00:00","read_at_is":"when the build read Syntology's graph, not when any sample ran","ran_record":{"url":"https://syntology.ai/api/ran/1901.02860.json","schema":"syntology.ran_record/1","counts_crosswalk":{"n_samples":"syntology.counts.lifted","n_ran":"syntology.counts.executed","n_ran_checked":"syntology.counts.checked","n_instrument":"syntology.counts.instrument_failures","n_unverified":"syntology.counts.no_recorded_run"},"note":"live record, measured at request time; may be newer than this page's graph read","badge":"https://syntology.ai/api/ran/1901.02860.svg"},"claim":"Per-sample execution status on synthesized fixtures; not a correctness claim about the paper. Samples come from repositories linked to the paper, official or community; repo_kind says which.","repos":[{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/huggingface/transformers","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/jiean001/models_m/tree/main/transformer_xl","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/sooftware/attentions","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/lvyufeng/bert4ms","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/SambhawDrag/XLNet.jl","reach":{"status":"unanswered"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/TimDettmers/transformer-xl","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/PaddlePaddle/PaddleNLP/tree/develop/examples/language_model/transformer-xl","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/benkrause/dynamiceval-transformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/mustafaaljadery/gemma-2b-10m","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/wxt1997/Transformer-Transducer","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/okkteam/Transformer-Transducer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/cmunnis/BERT_vs_Transformer-XL","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/Jmkernes/PAR-Transformer-XL","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/kimiyoung/transformer-xl","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/2023-MindSpore-1/ms-code-220/tree/main/transformer_xl","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/aiha-lab/Attention-Head-Pruning","reach":{"status":"ok","spdx":"GPL-3.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/AIResearchHub/transformergallery","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/sh951011/Attention-Implementation","reach":{"status":"ok","spdx":"MIT"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/zhdbwe/Paper-DailyReading","reach":{"status":"ok"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/listenviolet/XLNet","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/facebookresearch/code-prediction-transformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/google-research/meliad","reach":{"status":"ok","spdx":"Apache-2.0"}},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/sooftware/conformer","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/inzva/fake-academic-paper-generation","reach":null},{"provenance":"external:paperswithcode_snapshot_2025-07-28","url":"https://github.com/samwisegamjeee/pytorch-transformers","reach":{"status":"ok","spdx":"Apache-2.0"}}],"summary":{"ran":44,"ran_fixture":12,"ran_draft_wrong":6,"ran_honours":4,"ran_violates":1,"unverified":76},"n_samples":143,"n_ran":67,"n_constructed":37,"n_ran_checked":49,"n_instrument":18,"n_unverified":76,"n_instrument_is":"failures of Syntology's instrument, not of the code","every_run_is_an_instrument_failure":false,"key_notes":{"n_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","n_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"by_repo_kind":{"official":{"samples":13,"ran":8,"n_ran_checked":7,"n_instrument":1,"repositories":1},"listed":{"samples":128,"ran":57,"n_ran_checked":41,"n_instrument":16,"repositories":19},"unlocated":{"samples":2,"ran":2,"n_ran_checked":1,"n_instrument":1,"repositories":0,"is":"identical to code Syntology harvested from another paper's repository; this paper's own copy was not located, so no repository is named and no licence is recorded"}},"repo_kind_vocabulary":{"official":"The archive marks this repository official for the paper","named_in_paper":"The archive records that the paper mentions this repository; it is not marked official","listed":"In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper","found_in_text":"Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted","community":"Not in the archive's code links for this paper; a community repository Syntology harvested"},"n_pointer_only_for_licence":43,"inline_ok_is":"inline_ok is true only when both licence gates allow Syntology to serve this code's text: this paper's link (inline_ok_link, from the licence of this paper's copy) and the stored copy of the same code that Syntology serves, which may have been first harvested from another repository. withheld_clause is Syntology's own wording of which gate keeps the text a pointer and why, and is null when inline_ok is true. This site shows no code text either way; n_pointer_only_for_licence counts samples with inline_ok false (both gates), n_pointer_only_link_allows those of them whose inline_ok_link is true","n_pointer_only_link_allows":0,"fixture_fields_is":{"signature_and_fixture_out_type":"the arguments Syntology's fixture called the sample with, each as name:type/rank/element kind (? where none was recorded), and the type of what the fixture's run returned, exactly as the harness recorded them; the arguments and the returned type were recorded by two separate runs of the same fixture. No output value is shown, and a returned type says nothing about whether the output was right","level_recorded_at":"when Syntology's graph wrote the sample's verification level, not when the code executed; absent where the level was written before the date was kept, and never filled in with the build date","present_on":"samples that ran only; a key is absent, never empty, where the graph records nothing","signature_not_shown":"the graph records a signature for this sample and it is not shown; signature_not_shown_because names why, as the export's field-exclusion reason","signature_not_shown_because":{"signature_is_harness_probe_not_fixture_args":"for a class the fixture built without calling, the harness called the object with inputs it made up itself, so the recorded signature is the harness's probe, not the fixture's arguments"}},"n_ran_with_level_date":67,"n_ran_without_level_date":0,"n_ran_signature_not_shown":10,"levels_written_between":{"first":"2026-09-22","last":"2026-09-26","is":"the first and last UTC dates on which Syntology's graph wrote a verification level for a sample on this page that ran, not when the code executed"},"code_page_min_papers":5,"code_page_is":"a page for the entry name across every paper's harvested code; the name is a string, not an identity","census_is":"Syntology's function-name census ran implementations with this entry name on one shared input per bucket (the positional rank, kind and dtype of each array argument) and counted the distinct output digests (sha256 of the output rounded to 6 decimals). implementations and papers count the compared samples; distinct_outputs counts digests across all buckets; n_buckets is how many shared inputs were used. It is not a statement that any two samples compute one thing, and the name is a string, not an identity.","samples":[{"code_sha256":"e77541c1b4b15830","code_sha256_prefix":"e77541c1b4b15830","entry":"AdaptiveEmbedding","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"AdaptiveEmbedding","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"e77541c1b4b15830"}},{"code_sha256":"1ae137f0cee15e33","code_sha256_prefix":"1ae137f0cee15e33","entry":"AdaptiveEmbedding","repo":"kimiyoung/transformer-xl","repo_kind":"official","path":"pytorch/mem_transformer.py","file_url":"https://github.com/kimiyoung/transformer-xl/blob/HEAD/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"AdaptiveEmbedding","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"1ae137f0cee15e33"}},{"code_sha256":"8a8691f05cb1b5da","code_sha256_prefix":"8a8691f05cb1b5da","entry":"AdaptiveEmbedding","repo":"NVIDIA/DeepLearningExamples","repo_kind":"listed","path":"PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","file_url":"https://github.com/NVIDIA/DeepLearningExamples/blob/HEAD/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"AdaptiveEmbedding","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked","mcp_get_code":{"code_sha256":"8a8691f05cb1b5da"}},{"code_sha256":"e3217ee8bd314909","code_sha256_prefix":"e3217ee8bd314909","entry":"Attention","repo":"facebookresearch/code-prediction-transformer","repo_kind":"listed","path":"model.py","file_url":"https://github.com/facebookresearch/code-prediction-transformer/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"signature_not_shown":true,"signature_not_shown_because":"signature_is_harness_probe_not_fixture_args","fixture_out_type":"Attention","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/attention","census":{"url":"/census/attention","implementations":13,"papers":12,"distinct_outputs":10,"n_buckets":4,"bucket_key":null,"bucket_index":null,"bucket_label":null},"census_bucket_fragment":null,"licence":"NOASSERTION","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub could not classify the licence of this paper's repository, facebookresearch/code-prediction-transformer (NOASSERTION)","mcp_get_code":{"code_sha256":"e3217ee8bd314909"}},{"code_sha256":"548da299b3bc04e9","code_sha256_prefix":"548da299b3bc04e9","entry":"Block","repo":"facebookresearch/code-prediction-transformer","repo_kind":"listed","path":"model.py","file_url":"https://github.com/facebookresearch/code-prediction-transformer/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"signature_not_shown":true,"signature_not_shown_because":"signature_is_harness_probe_not_fixture_args","fixture_out_type":"Block","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/block","census":{"url":"/census/block","implementations":5,"papers":5,"distinct_outputs":3,"n_buckets":2,"bucket_key":null,"bucket_index":null,"bucket_label":null},"census_bucket_fragment":null,"licence":"NOASSERTION","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub could not classify the licence of this paper's repository, facebookresearch/code-prediction-transformer (NOASSERTION)","mcp_get_code":{"code_sha256":"548da299b3bc04e9"}},{"code_sha256":"e8aac29a19d0c2e7","code_sha256_prefix":"e8aac29a19d0c2e7","entry":"DecoderLayer","repo":"kimiyoung/transformer-xl","repo_kind":"official","path":"pytorch/mem_transformer.py","file_url":"https://github.com/kimiyoung/transformer-xl/blob/HEAD/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"signature_not_shown":true,"signature_not_shown_because":"signature_is_harness_probe_not_fixture_args","fixture_out_type":"DecoderLayer","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/decoderlayer","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"e8aac29a19d0c2e7"}},{"code_sha256":"845f84e3a319753d","code_sha256_prefix":"845f84e3a319753d","entry":"GEGLU","repo":"shanghai-digital-brain-laboratory/bdm-db1","repo_kind":"listed","path":"src/model/transformer_xl.py","file_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1/blob/HEAD/src/model/transformer_xl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":true,"signature":"x:Tensor/2/float","fixture_out_type":"Tensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","retrieve_with":{"tool":"get_code","code_sha256":"845f84e3a319753d"},"code_page":"/code/geglu","census":{"url":"/census/geglu","implementations":12,"papers":12,"distinct_outputs":1,"n_buckets":1,"bucket_key":[[2,"float","float32"]],"bucket_index":1,"bucket_label":"arg 1: rank 2, kind float, dtype float32"},"census_bucket_fragment":"bucket-1","licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"845f84e3a319753d"}},{"code_sha256":"72ccb5501088c2b4","code_sha256_prefix":"72ccb5501088c2b4","entry":"GPT2Model","repo":"facebookresearch/code-prediction-transformer","repo_kind":"listed","path":"model.py","file_url":"https://github.com/facebookresearch/code-prediction-transformer/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"fixture_out_type":"GPT2Model","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"NOASSERTION","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub could not classify the licence of this paper's repository, facebookresearch/code-prediction-transformer (NOASSERTION)","mcp_get_code":{"code_sha256":"72ccb5501088c2b4"}},{"code_sha256":"6a748d270690866b","code_sha256_prefix":"6a748d270690866b","entry":"GatoInputBase","repo":"shanghai-digital-brain-laboratory/bdm-db1","repo_kind":"listed","path":"src/model/transformer_xl.py","file_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1/blob/HEAD/src/model/transformer_xl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"GatoInputBase","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"6a748d270690866b"}},{"code_sha256":"709b8a145b15f0ca","code_sha256_prefix":"709b8a145b15f0ca","entry":"GemmaConfig","repo":"mustafaaljadery/gemma-2b-10m","repo_kind":"listed","path":"src/gemma.py","file_url":"https://github.com/mustafaaljadery/gemma-2b-10m/blob/HEAD/src/gemma.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"fixture_out_type":"GemmaConfig","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, mustafaaljadery/gemma-2b-10m when it was checked","mcp_get_code":{"code_sha256":"709b8a145b15f0ca"}},{"code_sha256":"39c5be8f7b1c0490","code_sha256_prefix":"39c5be8f7b1c0490","entry":"GemmaRotaryEmbedding","repo":"mustafaaljadery/gemma-2b-10m","repo_kind":"listed","path":"src/gemma.py","file_url":"https://github.com/mustafaaljadery/gemma-2b-10m/blob/HEAD/src/gemma.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"GemmaRotaryEmbedding","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, mustafaaljadery/gemma-2b-10m when it was checked","mcp_get_code":{"code_sha256":"39c5be8f7b1c0490"}},{"code_sha256":"ad41eff0feadfd69","code_sha256_prefix":"ad41eff0feadfd69","entry":"ICTaskInput","repo":"shanghai-digital-brain-laboratory/bdm-db1","repo_kind":"listed","path":"src/model/transformer_xl.py","file_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1/blob/HEAD/src/model/transformer_xl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"ICTaskInput","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"ad41eff0feadfd69"}},{"code_sha256":"39480331817170e8","code_sha256_prefix":"39480331817170e8","entry":"LayerNorm","repo":"facebookresearch/code-prediction-transformer","repo_kind":"listed","path":"model.py","file_url":"https://github.com/facebookresearch/code-prediction-transformer/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"signature_not_shown":true,"signature_not_shown_because":"signature_is_harness_probe_not_fixture_args","fixture_out_type":"LayerNorm","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/layernorm","census":{"url":"/census/layernorm","implementations":5,"papers":5,"distinct_outputs":5,"n_buckets":3,"bucket_key":null,"bucket_index":null,"bucket_label":null},"census_bucket_fragment":null,"licence":"NOASSERTION","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub could not classify the licence of this paper's repository, facebookresearch/code-prediction-transformer (NOASSERTION)","mcp_get_code":{"code_sha256":"39480331817170e8"}},{"code_sha256":"84585e9be4407fc4","code_sha256_prefix":"84585e9be4407fc4","entry":"Linear","repo":"park-cheol/ASR-Conformer","repo_kind":"listed","path":"model/attention.py","file_url":"https://github.com/park-cheol/ASR-Conformer/blob/HEAD/model/attention.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"signature":"inputs:Tensor/2/float","fixture_out_type":"Tensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/linear","census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, park-cheol/ASR-Conformer when it was checked","mcp_get_code":{"code_sha256":"84585e9be4407fc4"}},{"code_sha256":"220657028509cfb1","code_sha256_prefix":"220657028509cfb1","entry":"LogUniformSampler","repo":"kimiyoung/transformer-xl","repo_kind":"official","path":"pytorch/mem_transformer.py","file_url":"https://github.com/kimiyoung/transformer-xl/blob/HEAD/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"fixture_out_type":"LogUniformSampler","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"220657028509cfb1"}},{"code_sha256":"df5a6cf54dd0aca6","code_sha256_prefix":"df5a6cf54dd0aca6","entry":"MLP","repo":"facebookresearch/code-prediction-transformer","repo_kind":"listed","path":"model.py","file_url":"https://github.com/facebookresearch/code-prediction-transformer/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"signature_not_shown":true,"signature_not_shown_because":"signature_is_harness_probe_not_fixture_args","fixture_out_type":"MLP","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/mlp","census":null,"licence":"NOASSERTION","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub could not classify the licence of this paper's repository, facebookresearch/code-prediction-transformer (NOASSERTION)","mcp_get_code":{"code_sha256":"df5a6cf54dd0aca6"}},{"code_sha256":"d99c9cc9af9de483","code_sha256_prefix":"d99c9cc9af9de483","entry":"MultiHeadAttn","repo":"kimiyoung/transformer-xl","repo_kind":"official","path":"pytorch/mem_transformer.py","file_url":"https://github.com/kimiyoung/transformer-xl/blob/HEAD/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"signature_not_shown":true,"signature_not_shown_because":"signature_is_harness_probe_not_fixture_args","fixture_out_type":"MultiHeadAttn","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/multiheadattn","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"d99c9cc9af9de483"}},{"code_sha256":"e672e8a20905b62b","code_sha256_prefix":"e672e8a20905b62b","entry":"MultiHeadAttn","repo":"NVIDIA/DeepLearningExamples","repo_kind":"listed","path":"PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","file_url":"https://github.com/NVIDIA/DeepLearningExamples/blob/HEAD/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"signature_not_shown":true,"signature_not_shown_because":"signature_is_harness_probe_not_fixture_args","fixture_out_type":"MultiHeadAttn","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/multiheadattn","census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked","mcp_get_code":{"code_sha256":"e672e8a20905b62b"}},{"code_sha256":"5597fd8e1219b866","code_sha256_prefix":"5597fd8e1219b866","entry":"MultiHeadedAttention","repo":"okkteam/Transformer-Transducer","repo_kind":"listed","path":"tt/transformer/attention.py","file_url":"https://github.com/okkteam/Transformer-Transducer/blob/HEAD/tt/transformer/attention.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"MultiHeadedAttention","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/multiheadedattention","census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, okkteam/Transformer-Transducer when it was checked","mcp_get_code":{"code_sha256":"5597fd8e1219b866"}},{"code_sha256":"7eb33bec45fe09f3","code_sha256_prefix":"7eb33bec45fe09f3","entry":"NLPTaskInput","repo":"shanghai-digital-brain-laboratory/bdm-db1","repo_kind":"listed","path":"src/model/transformer_xl.py","file_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1/blob/HEAD/src/model/transformer_xl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"NLPTaskInput","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"7eb33bec45fe09f3"}},{"code_sha256":"b54068382071f8c8","code_sha256_prefix":"b54068382071f8c8","entry":"PatchEmbeddings","repo":"shanghai-digital-brain-laboratory/bdm-db1","repo_kind":"listed","path":"src/model/transformer_xl.py","file_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1/blob/HEAD/src/model/transformer_xl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"PatchEmbeddings","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/patchembeddings","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"b54068382071f8c8"}},{"code_sha256":"5fb8aacfbced509d","code_sha256_prefix":"5fb8aacfbced509d","entry":"PathLSTM","repo":"facebookresearch/code-prediction-transformer","repo_kind":"listed","path":"model.py","file_url":"https://github.com/facebookresearch/code-prediction-transformer/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"fixture_out_type":"PathLSTM","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"NOASSERTION","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub could not classify the licence of this paper's repository, facebookresearch/code-prediction-transformer (NOASSERTION)","mcp_get_code":{"code_sha256":"5fb8aacfbced509d"}},{"code_sha256":"142586d370dc7c1e","code_sha256_prefix":"142586d370dc7c1e","entry":"PositionalEmbedding","repo":"shanghai-digital-brain-laboratory/bdm-db1","repo_kind":"listed","path":"src/model/transformer_xl.py","file_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1/blob/HEAD/src/model/transformer_xl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"PositionalEmbedding","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/positionalembedding","census":{"url":"/census/positionalembedding","implementations":6,"papers":6,"distinct_outputs":4,"n_buckets":3,"bucket_key":null,"bucket_index":null,"bucket_label":null},"census_bucket_fragment":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"142586d370dc7c1e"}},{"code_sha256":"06ce2b899569db5b","code_sha256_prefix":"06ce2b899569db5b","entry":"PositionalEmbedding","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"PositionalEmbedding","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/positionalembedding","census":{"url":"/census/positionalembedding","implementations":6,"papers":6,"distinct_outputs":4,"n_buckets":3,"bucket_key":null,"bucket_index":null,"bucket_label":null},"census_bucket_fragment":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"06ce2b899569db5b"}},{"code_sha256":"07bf8cf6e731d1bc","code_sha256_prefix":"07bf8cf6e731d1bc","entry":"PositionalEncoding","repo":"AIResearchHub/transformergallery","repo_kind":"listed","path":"transformer/transformerxl.py","file_url":"https://github.com/AIResearchHub/transformergallery/blob/HEAD/transformer/transformerxl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":true,"signature_not_shown":true,"signature_not_shown_because":"signature_is_harness_probe_not_fixture_args","fixture_out_type":"PositionalEncoding","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","retrieve_with":{"tool":"get_code","code_sha256":"07bf8cf6e731d1bc"},"code_page":"/code/positionalencoding","census":{"url":"/census/positionalencoding","implementations":13,"papers":9,"distinct_outputs":9,"n_buckets":5,"bucket_key":null,"bucket_index":null,"bucket_label":null},"census_bucket_fragment":null,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"07bf8cf6e731d1bc"}},{"code_sha256":"eed8c286b97219b7","code_sha256_prefix":"eed8c286b97219b7","entry":"PositionwiseFF","repo":"shanghai-digital-brain-laboratory/bdm-db1","repo_kind":"listed","path":"src/model/transformer_xl.py","file_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1/blob/HEAD/src/model/transformer_xl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"signature_not_shown":true,"signature_not_shown_because":"signature_is_harness_probe_not_fixture_args","fixture_out_type":"PositionwiseFF","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"eed8c286b97219b7"}},{"code_sha256":"c96fba039a607703","code_sha256_prefix":"c96fba039a607703","entry":"PositionwiseFF","repo":"kimiyoung/transformer-xl","repo_kind":"official","path":"pytorch/mem_transformer.py","file_url":"https://github.com/kimiyoung/transformer-xl/blob/HEAD/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"signature_not_shown":true,"signature_not_shown_because":"signature_is_harness_probe_not_fixture_args","fixture_out_type":"PositionwiseFF","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"c96fba039a607703"}},{"code_sha256":"338c39719307318d","code_sha256_prefix":"338c39719307318d","entry":"ProjectedAdaptiveLogSoftmax","repo":"kimiyoung/transformer-xl","repo_kind":"official","path":"pytorch/mem_transformer.py","file_url":"https://github.com/kimiyoung/transformer-xl/blob/HEAD/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"ProjectedAdaptiveLogSoftmax","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"338c39719307318d"}},{"code_sha256":"4088ee884194d7c4","code_sha256_prefix":"4088ee884194d7c4","entry":"ProjectedAdaptiveLogSoftmax","repo":"NVIDIA/DeepLearningExamples","repo_kind":"listed","path":"PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","file_url":"https://github.com/NVIDIA/DeepLearningExamples/blob/HEAD/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"ProjectedAdaptiveLogSoftmax","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked","mcp_get_code":{"code_sha256":"4088ee884194d7c4"}},{"code_sha256":"7d9e9736e6c57d11","code_sha256_prefix":"7d9e9736e6c57d11","entry":"ProjectedAdaptiveLogSoftmax","repo":"inzva/fake-academic-paper-generation","repo_kind":"listed","path":"transformer-xl/pytorch/mem_transformer.py","file_url":"https://github.com/inzva/fake-academic-paper-generation/blob/HEAD/transformer-xl/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"fixture_out_type":"ProjectedAdaptiveLogSoftmax","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"7d9e9736e6c57d11"}},{"code_sha256":"2e57dbd19f63d3f4","code_sha256_prefix":"2e57dbd19f63d3f4","entry":"RLTaskInput","repo":"shanghai-digital-brain-laboratory/bdm-db1","repo_kind":"listed","path":"src/model/transformer_xl.py","file_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1/blob/HEAD/src/model/transformer_xl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"RLTaskInput","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"2e57dbd19f63d3f4"}},{"code_sha256":"4c8b264bb79a35a1","code_sha256_prefix":"4c8b264bb79a35a1","entry":"RelMultiHeadAttention","repo":"Jmkernes/PAR-Transformer-XL","repo_kind":"listed","path":"par_model.py","file_url":"https://github.com/Jmkernes/PAR-Transformer-XL/blob/HEAD/par_model.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"fixture_out_type":"RelMultiHeadAttention","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked","mcp_get_code":{"code_sha256":"4c8b264bb79a35a1"}},{"code_sha256":"fe28ba867add05c0","code_sha256_prefix":"fe28ba867add05c0","entry":"RelMultiHeadAttn","repo":"kimiyoung/transformer-xl","repo_kind":"official","path":"pytorch/mem_transformer.py","file_url":"https://github.com/kimiyoung/transformer-xl/blob/HEAD/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"RelMultiHeadAttn","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"fe28ba867add05c0"}},{"code_sha256":"8fa37260188b5fd8","code_sha256_prefix":"8fa37260188b5fd8","entry":"RelMultiHeadAttn","repo":"NVIDIA/DeepLearningExamples","repo_kind":"listed","path":"PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","file_url":"https://github.com/NVIDIA/DeepLearningExamples/blob/HEAD/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"RelMultiHeadAttn","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked","mcp_get_code":{"code_sha256":"8fa37260188b5fd8"}},{"code_sha256":"4977fa89216a56fa","code_sha256_prefix":"4977fa89216a56fa","entry":"RelPositionMultiHeadedAttention","repo":"okkteam/Transformer-Transducer","repo_kind":"listed","path":"tt/transformer/attention.py","file_url":"https://github.com/okkteam/Transformer-Transducer/blob/HEAD/tt/transformer/attention.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"RelPositionMultiHeadedAttention","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, okkteam/Transformer-Transducer when it was checked","mcp_get_code":{"code_sha256":"4977fa89216a56fa"}},{"code_sha256":"c018d465b6253b94","code_sha256_prefix":"c018d465b6253b94","entry":"RelativeMultiHeadAttention","repo":"sooftware/Attention-Implementation","repo_kind":"listed","path":"attentions.py","file_url":"https://github.com/sooftware/Attention-Implementation/blob/HEAD/attentions.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"signature":"query:Tensor/3/float, key:Tensor/3/float, value:Tensor/3/float, pos_embedding:Tensor/3/float, mask:Tensor/3/bool","fixture_out_type":"Tensor","level_recorded_at":"2026-09-24T23:57:41.519889+00:00","code_page":null,"census":null,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"c018d465b6253b94"}},{"code_sha256":"032b78da6979837c","code_sha256_prefix":"032b78da6979837c","entry":"RelativeMultiHeadAttention","repo":"park-cheol/ASR-Conformer","repo_kind":"listed","path":"model/attention.py","file_url":"https://github.com/park-cheol/ASR-Conformer/blob/HEAD/model/attention.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"invariant","behaviour_fingerprint":false,"signature":"q:Tensor/3/float, k:Tensor/3/float, v:Tensor/3/float, pos_embedding:Tensor/3/float, mask:NoneType/0/?","fixture_out_type":"Tensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, park-cheol/ASR-Conformer when it was checked","mcp_get_code":{"code_sha256":"032b78da6979837c"}},{"code_sha256":"a97a22ac6fb31922","code_sha256_prefix":"a97a22ac6fb31922","entry":"TransfoXLConfig","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"TransfoXLConfig","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"a97a22ac6fb31922"}},{"code_sha256":"c7b5eb55f15a37de","code_sha256_prefix":"c7b5eb55f15a37de","entry":"TransformerEmbedding","repo":"AIResearchHub/transformergallery","repo_kind":"listed","path":"transformer/transformerxl.py","file_url":"https://github.com/AIResearchHub/transformergallery/blob/HEAD/transformer/transformerxl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"TransformerEmbedding","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"c7b5eb55f15a37de"}},{"code_sha256":"2a023fc4bac8d229","code_sha256_prefix":"2a023fc4bac8d229","entry":"VQATaskInput","repo":"shanghai-digital-brain-laboratory/bdm-db1","repo_kind":"listed","path":"src/model/transformer_xl.py","file_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1/blob/HEAD/src/model/transformer_xl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"VQATaskInput","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"2a023fc4bac8d229"}},{"code_sha256":"2a5f4bac2414eb0f","code_sha256_prefix":"2a5f4bac2414eb0f","entry":"VisionEmbedding","repo":"shanghai-digital-brain-laboratory/bdm-db1","repo_kind":"listed","path":"src/model/transformer_xl.py","file_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1/blob/HEAD/src/model/transformer_xl.py","link_basis":"first_harvest_node","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":"deterministic","behaviour_fingerprint":false,"fixture_out_type":"VisionEmbedding","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"2a5f4bac2414eb0f"}},{"code_sha256":"773651748c9618d6","code_sha256_prefix":"773651748c9618d6","entry":"_cache_mem","repo":"benkrause/dynamiceval-transformer","repo_kind":"listed","path":"tf/model.py","file_url":"https://github.com/benkrause/dynamiceval-transformer/blob/HEAD/tf/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"signature":"curr_out:EagerTensor/2/float, prev_mem:EagerTensor/2/float, mem_len:int/0/int","fixture_out_type":"EagerTensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","retrieve_with":{"tool":"get_code","code_sha256":"773651748c9618d6"},"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"773651748c9618d6"}},{"code_sha256":"9d5e914b24b8911a","code_sha256_prefix":"9d5e914b24b8911a","entry":"_cache_mem","repo":"huggingface/xlnet","repo_kind":"listed","path":"modeling.py","file_url":"https://github.com/huggingface/xlnet/blob/HEAD/modeling.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"signature":"curr_out:EagerTensor/2/float, prev_mem:EagerTensor/2/float, mem_len:int/0/int, reuse_len:int/0/int","fixture_out_type":"EagerTensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","retrieve_with":{"tool":"get_code","code_sha256":"9d5e914b24b8911a"},"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"9d5e914b24b8911a"}},{"code_sha256":"78d91efd74e4d12a","code_sha256_prefix":"78d91efd74e4d12a","entry":"add_and_scale","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"fixture_out_type":"Tensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":null,"inline_ok":false,"inline_ok_link":false,"withheld_clause":"this paper's copy of the code was not recorded (its link names no repository or source path), so no licence was read for it","mcp_get_code":{"code_sha256":"78d91efd74e4d12a"}},{"code_sha256":"6b2a8f1c93d0b071","code_sha256_prefix":"6b2a8f1c93d0b071","entry":"assign_to_gpu","repo":"TimDettmers/transformer-xl","repo_kind":"listed","path":"tf/gpu_utils.py","file_url":"https://github.com/TimDettmers/transformer-xl/blob/HEAD/tf/gpu_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"signature":"gpu:int/0/int, ps_dev:str/0/str","fixture_out_type":"function","level_recorded_at":"2026-09-25T10:37:12.143382+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"6b2a8f1c93d0b071"}},{"code_sha256":"36eed0b265968be7","code_sha256_prefix":"36eed0b265968be7","entry":"batchify","repo":"TimDettmers/transformer-xl","repo_kind":"listed","path":"tf/data_utils.py","file_url":"https://github.com/TimDettmers/transformer-xl/blob/HEAD/tf/data_utils.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"signature":"data:ndarray/1/int, batch_size:int/0/int, num_passes:int/0/int","fixture_out_type":"ndarray","level_recorded_at":"2026-09-26T05:00:14.332320+00:00","code_page":"/code/batchify","census":{"url":"/census/batchify","implementations":6,"papers":6,"distinct_outputs":3,"n_buckets":3,"bucket_key":null,"bucket_index":null,"bucket_label":null},"census_bucket_fragment":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"36eed0b265968be7"}},{"code_sha256":"c92e4fc990bba2fe","code_sha256_prefix":"c92e4fc990bba2fe","entry":"build_normalization","repo":"opendilab/DI-engine","repo_kind":"listed","path":"ding/torch_utils/network/transformer.py","file_url":"https://github.com/opendilab/DI-engine/blob/HEAD/ding/torch_utils/network/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"signature":"norm_type:str/0/str, dim:int/0/int","fixture_out_type":"type","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"c92e4fc990bba2fe"}},{"code_sha256":"35ef111fc00c21b4","code_sha256_prefix":"35ef111fc00c21b4","entry":"build_tf_to_pytorch_map","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"signature":"model:callable/0/?, config:Config/0/?","fixture_out_type":"dict","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/build-tf-to-pytorch-map","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"35ef111fc00c21b4"}},{"code_sha256":"499bf5fee7915c78","code_sha256_prefix":"499bf5fee7915c78","entry":"create_lookahead_mask","repo":"Jmkernes/PAR-Transformer-XL","repo_kind":"listed","path":"par_model.py","file_url":"https://github.com/Jmkernes/PAR-Transformer-XL/blob/HEAD/par_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"signature":"query_len:int/0/int, key_len:int/0/int, dtype:DType/0/?","fixture_out_type":"EagerTensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked","mcp_get_code":{"code_sha256":"499bf5fee7915c78"}},{"code_sha256":"9109ba9791e44324","code_sha256_prefix":"9109ba9791e44324","entry":"embedding_lookup","repo":"benkrause/dynamiceval-transformer","repo_kind":"listed","path":"tf/model.py","file_url":"https://github.com/benkrause/dynamiceval-transformer/blob/HEAD/tf/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"signature":"lookup_table:EagerTensor/2/float, x:EagerTensor/2/int, use_tpu:bool/0/bool","fixture_out_type":"EagerTensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/embedding-lookup","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"9109ba9791e44324"}},{"code_sha256":"c1184d27672a7461","code_sha256_prefix":"c1184d27672a7461","entry":"fc_block","repo":"opendilab/DI-engine","repo_kind":"listed","path":"ding/torch_utils/network/transformer.py","file_url":"https://github.com/opendilab/DI-engine/blob/HEAD/ding/torch_utils/network/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"signature":"in_channels:int/0/int, out_channels:int/0/int, activation:callable/0/?, norm_type:str/0/str, use_dropout:bool/0/bool, dropout_probability:float/0/float","fixture_out_type":"Sequential","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"c1184d27672a7461"}},{"code_sha256":"8d59a6d5900428f5","code_sha256_prefix":"8d59a6d5900428f5","entry":"left_shift","repo":"Jmkernes/PAR-Transformer-XL","repo_kind":"listed","path":"par_model.py","file_url":"https://github.com/Jmkernes/PAR-Transformer-XL/blob/HEAD/par_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"signature":"x:EagerTensor/4/float","fixture_out_type":"EagerTensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","retrieve_with":{"tool":"get_code","code_sha256":"8d59a6d5900428f5"},"code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked","mcp_get_code":{"code_sha256":"8d59a6d5900428f5"}},{"code_sha256":"d50e8679cde3a927","code_sha256_prefix":"d50e8679cde3a927","entry":"positional_embedding","repo":"benkrause/dynamiceval-transformer","repo_kind":"listed","path":"tf/model.py","file_url":"https://github.com/benkrause/dynamiceval-transformer/blob/HEAD/tf/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"signature":"pos_seq:EagerTensor/1/float, inv_freq:EagerTensor/1/float, bsz:int/0/int","fixture_out_type":"EagerTensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"d50e8679cde3a927"}},{"code_sha256":"9bf0f6e6298f3fbe","code_sha256_prefix":"9bf0f6e6298f3fbe","entry":"positional_embedding","repo":"huggingface/xlnet","repo_kind":"listed","path":"modeling.py","file_url":"https://github.com/huggingface/xlnet/blob/HEAD/modeling.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":false,"signature":"pos_seq:EagerTensor/1/float, inv_freq:EagerTensor/1/float, bsz:int/0/int","fixture_out_type":"EagerTensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"9bf0f6e6298f3fbe"}},{"code_sha256":"2398c4a5c285bdc4","code_sha256_prefix":"2398c4a5c285bdc4","entry":"positional_encoding","repo":"Jmkernes/PAR-Transformer-XL","repo_kind":"listed","path":"par_model.py","file_url":"https://github.com/Jmkernes/PAR-Transformer-XL/blob/HEAD/par_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"signature":"max_position:int/0/int, d_embed:int/0/int, min_freq:float/0/float","fixture_out_type":"EagerTensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","retrieve_with":{"tool":"get_code","code_sha256":"2398c4a5c285bdc4"},"code_page":"/code/positional-encoding","census":{"url":"/census/positional-encoding","implementations":5,"papers":6,"distinct_outputs":4,"n_buckets":1,"bucket_key":null,"bucket_index":null,"bucket_label":null},"census_bucket_fragment":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked","mcp_get_code":{"code_sha256":"2398c4a5c285bdc4"}},{"code_sha256":"f7a746d73ab2f28c","code_sha256_prefix":"f7a746d73ab2f28c","entry":"positionwise_ffn","repo":"Jmkernes/PAR-Transformer-XL","repo_kind":"listed","path":"par_model.py","file_url":"https://github.com/Jmkernes/PAR-Transformer-XL/blob/HEAD/par_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":"none","behaviour_fingerprint":false,"signature":"d_model:int/0/int, d_fnn:int/0/int, activation:str/0/str","fixture_out_type":"Sequential","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked","mcp_get_code":{"code_sha256":"f7a746d73ab2f28c"}},{"code_sha256":"9d6735f22035b700","code_sha256_prefix":"9d6735f22035b700","entry":"post_process","repo":"Machine-Learning-Tokyo/Poetry-GAN","repo_kind":"listed","path":"lang_model.py","file_url":"https://github.com/Machine-Learning-Tokyo/Poetry-GAN/blob/HEAD/lang_model.py","link_basis":"harvester_set","language":"python","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"signature":"text:str/0/str","fixture_out_type":"str","level_recorded_at":"2026-09-24T22:24:42.659479+00:00","retrieve_with":{"tool":"get_code","code_sha256":"9d6735f22035b700"},"code_page":"/code/post-process","census":null,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"9d6735f22035b700"}},{"code_sha256":"d37883dc58ff9b69","code_sha256_prefix":"d37883dc58ff9b69","entry":"rel_shift","repo":"benkrause/dynamiceval-transformer","repo_kind":"listed","path":"tf/model.py","file_url":"https://github.com/benkrause/dynamiceval-transformer/blob/HEAD/tf/model.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"signature":"x:EagerTensor/4/float","fixture_out_type":"EagerTensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","retrieve_with":{"tool":"get_code","code_sha256":"d37883dc58ff9b69"},"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"d37883dc58ff9b69"}},{"code_sha256":"5f7c5b38aeb29bf5","code_sha256_prefix":"5f7c5b38aeb29bf5","entry":"rel_shift","repo":"huggingface/xlnet","repo_kind":"listed","path":"modeling.py","file_url":"https://github.com/huggingface/xlnet/blob/HEAD/modeling.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"signature":"x:EagerTensor/4/float, klen:int/0/int","fixture_out_type":"EagerTensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","retrieve_with":{"tool":"get_code","code_sha256":"5f7c5b38aeb29bf5"},"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"5f7c5b38aeb29bf5"}},{"code_sha256":"edeef97857b7cdca","code_sha256_prefix":"edeef97857b7cdca","entry":"relative_position_logits","repo":"Jmkernes/PAR-Transformer-XL","repo_kind":"listed","path":"par_model.py","file_url":"https://github.com/Jmkernes/PAR-Transformer-XL/blob/HEAD/par_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":false,"signature":"q:EagerTensor/4/float, R:EagerTensor/4/float, direction:str/0/str","fixture_out_type":"EagerTensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked","mcp_get_code":{"code_sha256":"edeef97857b7cdca"}},{"code_sha256":"8e76562720b0c921","code_sha256_prefix":"8e76562720b0c921","entry":"relative_positional_encoding","repo":"huggingface/xlnet","repo_kind":"listed","path":"modeling.py","file_url":"https://github.com/huggingface/xlnet/blob/HEAD/modeling.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":false,"signature":"qlen:int/0/int, klen:int/0/int, d_model:int/0/int, clamp_len:int/0/int, attn_type:str/0/str, bi_data:bool/0/bool, bsz:int/0/int, dtype:DType/0/?","fixture_out_type":"EagerTensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"8e76562720b0c921"}},{"code_sha256":"4e762613ee907cdb","code_sha256_prefix":"4e762613ee907cdb","entry":"repeat_kv","repo":"mustafaaljadery/gemma-2b-10m","repo_kind":"listed","path":"src/gemma.py","file_url":"https://github.com/mustafaaljadery/gemma-2b-10m/blob/HEAD/src/gemma.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"signature":"hidden_states:Tensor/4/float, n_rep:int/0/int","fixture_out_type":"Tensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","retrieve_with":{"tool":"get_code","code_sha256":"4e762613ee907cdb"},"code_page":"/code/repeat-kv","census":{"url":"/census/repeat-kv","implementations":15,"papers":60,"distinct_outputs":2,"n_buckets":1,"bucket_key":[[4,"float","float32"]],"bucket_index":1,"bucket_label":"arg 1: rank 4, kind float, dtype float32"},"census_bucket_fragment":"bucket-1","licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, mustafaaljadery/gemma-2b-10m when it was checked","mcp_get_code":{"code_sha256":"4e762613ee907cdb"}},{"code_sha256":"df4647a6d9f03c0e","code_sha256_prefix":"df4647a6d9f03c0e","entry":"right_shift","repo":"Jmkernes/PAR-Transformer-XL","repo_kind":"listed","path":"par_model.py","file_url":"https://github.com/Jmkernes/PAR-Transformer-XL/blob/HEAD/par_model.py","link_basis":"first_harvest_node","language":"python","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"signature":"x:EagerTensor/4/float","fixture_out_type":"EagerTensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","retrieve_with":{"tool":"get_code","code_sha256":"df4647a6d9f03c0e"},"code_page":"/code/right-shift","census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked","mcp_get_code":{"code_sha256":"df4647a6d9f03c0e"}},{"code_sha256":"cec833a99feb528c","code_sha256_prefix":"cec833a99feb528c","entry":"rotate_half","repo":"mustafaaljadery/gemma-2b-10m","repo_kind":"listed","path":"src/gemma.py","file_url":"https://github.com/mustafaaljadery/gemma-2b-10m/blob/HEAD/src/gemma.py","link_basis":"first_harvest_node","language":"python","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":null,"behaviour_fingerprint":true,"signature":"x:Tensor/2/float","fixture_out_type":"Tensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","retrieve_with":{"tool":"get_code","code_sha256":"cec833a99feb528c"},"code_page":"/code/rotate-half","census":{"url":"/census/rotate-half","implementations":24,"papers":96,"distinct_outputs":4,"n_buckets":2,"bucket_key":[[2,"float","float32"]],"bucket_index":1,"bucket_label":"arg 1: rank 2, kind float, dtype float32"},"census_bucket_fragment":"bucket-1","licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, mustafaaljadery/gemma-2b-10m when it was checked","mcp_get_code":{"code_sha256":"cec833a99feb528c"}},{"code_sha256":"93228a3eb5c4d179","code_sha256_prefix":"93228a3eb5c4d179","entry":"sample_logits","repo":"kimiyoung/transformer-xl","repo_kind":"official","path":"pytorch/mem_transformer.py","file_url":"https://github.com/kimiyoung/transformer-xl/blob/HEAD/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"signature":"embedding:callable/0/?, bias:Tensor/1/float, labels:Tensor/2/int, inputs:Tensor/3/float, sampler:LogUniformSampler/0/?","fixture_out_type":"Tensor","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":"/code/sample-logits","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"93228a3eb5c4d179"}},{"code_sha256":"a4f0d0fb0e45662a","code_sha256_prefix":"a4f0d0fb0e45662a","entry":"sequential_pack","repo":"opendilab/DI-engine","repo_kind":"listed","path":"ding/torch_utils/network/transformer.py","file_url":"https://github.com/opendilab/DI-engine/blob/HEAD/ding/torch_utils/network/transformer.py","link_basis":"first_harvest_node","language":"python","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"signature":"layers:list/1/callable","fixture_out_type":"Sequential","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"a4f0d0fb0e45662a"}},{"code_sha256":"4e978f9f7835b10a","code_sha256_prefix":"4e978f9f7835b10a","entry":"to_2tuple","repo":null,"repo_kind":null,"path":null,"file_url":null,"link_basis":"identical_code_first_harvested_elsewhere","language":"python","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"signature":"x:int/0/int","fixture_out_type":"tuple","level_recorded_at":"2026-09-22T14:31:46.068493+00:00","retrieve_with":{"tool":"get_code","code_sha256":"4e978f9f7835b10a"},"code_page":"/code/to-2tuple","census":null,"licence":null,"inline_ok":false,"inline_ok_link":false,"withheld_clause":"this paper's copy of the code was not recorded (its link names no repository or source path), so no licence was read for it","mcp_get_code":{"code_sha256":"4e978f9f7835b10a"}},{"code_sha256":"87202268910cb496","code_sha256_prefix":"87202268910cb496","entry":"AdaptiveSoftmax","repo":"Jmkernes/PAR-Transformer-XL","repo_kind":"listed","path":"par_model.py","file_url":"https://github.com/Jmkernes/PAR-Transformer-XL/blob/HEAD/par_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked","mcp_get_code":{"code_sha256":"87202268910cb496"}},{"code_sha256":"fe3454282cf0b88e","code_sha256_prefix":"fe3454282cf0b88e","entry":"Attention","repo":"opendilab/DI-engine","repo_kind":"listed","path":"ding/torch_utils/network/transformer.py","file_url":"https://github.com/opendilab/DI-engine/blob/HEAD/ding/torch_utils/network/transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/attention","census":{"url":"/census/attention","implementations":13,"papers":12,"distinct_outputs":10,"n_buckets":4,"bucket_key":null,"bucket_index":null,"bucket_label":null},"census_bucket_fragment":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"fe3454282cf0b88e"}},{"code_sha256":"fc52846dc775edff","code_sha256_prefix":"fc52846dc775edff","entry":"DecoderLayer","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/decoderlayer","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"fc52846dc775edff"}},{"code_sha256":"c614edf5b8c0d3b0","code_sha256_prefix":"c614edf5b8c0d3b0","entry":"DecoderLayer","repo":"NVIDIA/DeepLearningExamples","repo_kind":"listed","path":"PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","file_url":"https://github.com/NVIDIA/DeepLearningExamples/blob/HEAD/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/decoderlayer","census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked","mcp_get_code":{"code_sha256":"c614edf5b8c0d3b0"}},{"code_sha256":"117b06ce2fbc7877","code_sha256_prefix":"117b06ce2fbc7877","entry":"GPT2LMHead","repo":"facebookresearch/code-prediction-transformer","repo_kind":"listed","path":"model.py","file_url":"https://github.com/facebookresearch/code-prediction-transformer/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"NOASSERTION","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub could not classify the licence of this paper's repository, facebookresearch/code-prediction-transformer (NOASSERTION)","mcp_get_code":{"code_sha256":"117b06ce2fbc7877"}},{"code_sha256":"e4e12108c18eb032","code_sha256_prefix":"e4e12108c18eb032","entry":"GemmaAttention","repo":"mustafaaljadery/gemma-2b-10m","repo_kind":"listed","path":"src/gemma.py","file_url":"https://github.com/mustafaaljadery/gemma-2b-10m/blob/HEAD/src/gemma.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, mustafaaljadery/gemma-2b-10m when it was checked","mcp_get_code":{"code_sha256":"e4e12108c18eb032"}},{"code_sha256":"de07f82e734e3e2c","code_sha256_prefix":"de07f82e734e3e2c","entry":"GemmaInfiniAttention","repo":"mustafaaljadery/gemma-2b-10m","repo_kind":"listed","path":"src/gemma.py","file_url":"https://github.com/mustafaaljadery/gemma-2b-10m/blob/HEAD/src/gemma.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, mustafaaljadery/gemma-2b-10m when it was checked","mcp_get_code":{"code_sha256":"de07f82e734e3e2c"}},{"code_sha256":"9ef2fc89678fefb2","code_sha256_prefix":"9ef2fc89678fefb2","entry":"MemTransformerLM","repo":"kimiyoung/transformer-xl","repo_kind":"official","path":"pytorch/mem_transformer.py","file_url":"https://github.com/kimiyoung/transformer-xl/blob/HEAD/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"9ef2fc89678fefb2"}},{"code_sha256":"5ffa84d26ba39532","code_sha256_prefix":"5ffa84d26ba39532","entry":"MemTransformerLM","repo":"NVIDIA/DeepLearningExamples","repo_kind":"listed","path":"PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","file_url":"https://github.com/NVIDIA/DeepLearningExamples/blob/HEAD/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked","mcp_get_code":{"code_sha256":"5ffa84d26ba39532"}},{"code_sha256":"a7430322070cedb5","code_sha256_prefix":"a7430322070cedb5","entry":"MemTransformerLM","repo":"inzva/fake-academic-paper-generation","repo_kind":"listed","path":"transformer-xl/pytorch/mem_transformer.py","file_url":"https://github.com/inzva/fake-academic-paper-generation/blob/HEAD/transformer-xl/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"a7430322070cedb5"}},{"code_sha256":"12dd38874c15490a","code_sha256_prefix":"12dd38874c15490a","entry":"MemTransformerLM","repo":"jincan333/lot","repo_kind":"listed","path":"model/mem_transformer.py","file_url":"https://github.com/jincan333/lot/blob/HEAD/model/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"12dd38874c15490a"}},{"code_sha256":"d4857f57ecefa3d5","code_sha256_prefix":"d4857f57ecefa3d5","entry":"MultiHeadAttn","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/multiheadattn","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"d4857f57ecefa3d5"}},{"code_sha256":"de3ab66ec62fc167","code_sha256_prefix":"de3ab66ec62fc167","entry":"PARTransformerXL","repo":"Jmkernes/PAR-Transformer-XL","repo_kind":"listed","path":"par_model.py","file_url":"https://github.com/Jmkernes/PAR-Transformer-XL/blob/HEAD/par_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked","mcp_get_code":{"code_sha256":"de3ab66ec62fc167"}},{"code_sha256":"62b1b4ab79fdfc8b","code_sha256_prefix":"62b1b4ab79fdfc8b","entry":"PositionwiseFF","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"62b1b4ab79fdfc8b"}},{"code_sha256":"6b820cc9aac66bc1","code_sha256_prefix":"6b820cc9aac66bc1","entry":"ProjectedAdaptiveLogSoftmax","repo":"jincan333/lot","repo_kind":"listed","path":"model/mem_transformer.py","file_url":"https://github.com/jincan333/lot/blob/HEAD/model/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"6b820cc9aac66bc1"}},{"code_sha256":"752529d23a4b3b22","code_sha256_prefix":"752529d23a4b3b22","entry":"RelLearnableDecoderLayer","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"752529d23a4b3b22"}},{"code_sha256":"17ee18e7e701439f","code_sha256_prefix":"17ee18e7e701439f","entry":"RelLearnableDecoderLayer","repo":"kimiyoung/transformer-xl","repo_kind":"official","path":"pytorch/mem_transformer.py","file_url":"https://github.com/kimiyoung/transformer-xl/blob/HEAD/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"17ee18e7e701439f"}},{"code_sha256":"ea7c8500cbc85ff5","code_sha256_prefix":"ea7c8500cbc85ff5","entry":"RelLearnableDecoderLayer","repo":"NVIDIA/DeepLearningExamples","repo_kind":"listed","path":"PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","file_url":"https://github.com/NVIDIA/DeepLearningExamples/blob/HEAD/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked","mcp_get_code":{"code_sha256":"ea7c8500cbc85ff5"}},{"code_sha256":"3dafbc50941af43d","code_sha256_prefix":"3dafbc50941af43d","entry":"RelLearnableMultiHeadAttn","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"3dafbc50941af43d"}},{"code_sha256":"a033a134e9f6452f","code_sha256_prefix":"a033a134e9f6452f","entry":"RelLearnableMultiHeadAttn","repo":"kimiyoung/transformer-xl","repo_kind":"official","path":"pytorch/mem_transformer.py","file_url":"https://github.com/kimiyoung/transformer-xl/blob/HEAD/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"a033a134e9f6452f"}},{"code_sha256":"cb862dd19b1f381a","code_sha256_prefix":"cb862dd19b1f381a","entry":"RelLearnableMultiHeadAttn","repo":"NVIDIA/DeepLearningExamples","repo_kind":"listed","path":"PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","file_url":"https://github.com/NVIDIA/DeepLearningExamples/blob/HEAD/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked","mcp_get_code":{"code_sha256":"cb862dd19b1f381a"}},{"code_sha256":"dc7c9e91c34d6ddf","code_sha256_prefix":"dc7c9e91c34d6ddf","entry":"RelMultiHeadAttn","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"dc7c9e91c34d6ddf"}},{"code_sha256":"9ec384a6bfe40952","code_sha256_prefix":"9ec384a6bfe40952","entry":"RelPartialLearnableDecoderLayer","repo":"shanghai-digital-brain-laboratory/bdm-db1","repo_kind":"listed","path":"src/model/transformer_xl.py","file_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1/blob/HEAD/src/model/transformer_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"9ec384a6bfe40952"}},{"code_sha256":"fd8d58e6a1428332","code_sha256_prefix":"fd8d58e6a1428332","entry":"RelPartialLearnableDecoderLayer","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"fd8d58e6a1428332"}},{"code_sha256":"89afd0bff30e18a9","code_sha256_prefix":"89afd0bff30e18a9","entry":"RelPartialLearnableDecoderLayer","repo":"kimiyoung/transformer-xl","repo_kind":"official","path":"pytorch/mem_transformer.py","file_url":"https://github.com/kimiyoung/transformer-xl/blob/HEAD/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"89afd0bff30e18a9"}},{"code_sha256":"5014b04d3358c101","code_sha256_prefix":"5014b04d3358c101","entry":"RelPartialLearnableDecoderLayer","repo":"NVIDIA/DeepLearningExamples","repo_kind":"listed","path":"PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","file_url":"https://github.com/NVIDIA/DeepLearningExamples/blob/HEAD/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked","mcp_get_code":{"code_sha256":"5014b04d3358c101"}},{"code_sha256":"fdc345d0da45dd95","code_sha256_prefix":"fdc345d0da45dd95","entry":"RelPartialLearnableMultiHeadAttn","repo":"shanghai-digital-brain-laboratory/bdm-db1","repo_kind":"listed","path":"src/model/transformer_xl.py","file_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1/blob/HEAD/src/model/transformer_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/relpartiallearnablemultiheadattn","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"fdc345d0da45dd95"}},{"code_sha256":"8361fa24d3e06e13","code_sha256_prefix":"8361fa24d3e06e13","entry":"RelPartialLearnableMultiHeadAttn","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/relpartiallearnablemultiheadattn","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"8361fa24d3e06e13"}},{"code_sha256":"fb613dd5bc21371c","code_sha256_prefix":"fb613dd5bc21371c","entry":"RelPartialLearnableMultiHeadAttn","repo":"kimiyoung/transformer-xl","repo_kind":"official","path":"pytorch/mem_transformer.py","file_url":"https://github.com/kimiyoung/transformer-xl/blob/HEAD/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/relpartiallearnablemultiheadattn","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"fb613dd5bc21371c"}},{"code_sha256":"5e1b71bde76b69e7","code_sha256_prefix":"5e1b71bde76b69e7","entry":"RelPartialLearnableMultiHeadAttn","repo":"NVIDIA/DeepLearningExamples","repo_kind":"listed","path":"PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","file_url":"https://github.com/NVIDIA/DeepLearningExamples/blob/HEAD/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/relpartiallearnablemultiheadattn","census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked","mcp_get_code":{"code_sha256":"5e1b71bde76b69e7"}},{"code_sha256":"274ae09f88dbb42a","code_sha256_prefix":"274ae09f88dbb42a","entry":"RelativeMultiHeadAttention","repo":"sooftware/conformer","repo_kind":"listed","path":"conformer/attention.py","file_url":"https://github.com/sooftware/conformer/blob/HEAD/conformer/attention.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"274ae09f88dbb42a"}},{"code_sha256":"1be1a875d12d10b3","code_sha256_prefix":"1be1a875d12d10b3","entry":"RelaxedOneHot","repo":"Jmkernes/PAR-Transformer-XL","repo_kind":"listed","path":"par_model.py","file_url":"https://github.com/Jmkernes/PAR-Transformer-XL/blob/HEAD/par_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked","mcp_get_code":{"code_sha256":"1be1a875d12d10b3"}},{"code_sha256":"534b6317f069c394","code_sha256_prefix":"534b6317f069c394","entry":"StochasticBlock","repo":"Jmkernes/PAR-Transformer-XL","repo_kind":"listed","path":"par_model.py","file_url":"https://github.com/Jmkernes/PAR-Transformer-XL/blob/HEAD/par_model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, Jmkernes/PAR-Transformer-XL when it was checked","mcp_get_code":{"code_sha256":"534b6317f069c394"}},{"code_sha256":"532a59e61c71b7a8","code_sha256_prefix":"532a59e61c71b7a8","entry":"TransfoXLModel","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"532a59e61c71b7a8"}},{"code_sha256":"d7bd7d30264b3658","code_sha256_prefix":"d7bd7d30264b3658","entry":"TransfoXLPreTrainedModel","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"d7bd7d30264b3658"}},{"code_sha256":"b28585d20fefea46","code_sha256_prefix":"b28585d20fefea46","entry":"TransformerLayer","repo":"opendilab/DI-engine","repo_kind":"listed","path":"ding/torch_utils/network/transformer.py","file_url":"https://github.com/opendilab/DI-engine/blob/HEAD/ding/torch_utils/network/transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/transformerlayer","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"b28585d20fefea46"}},{"code_sha256":"9a2f71717dcf3962","code_sha256_prefix":"9a2f71717dcf3962","entry":"TransformerModel","repo":"facebookresearch/code-prediction-transformer","repo_kind":"listed","path":"model.py","file_url":"https://github.com/facebookresearch/code-prediction-transformer/blob/HEAD/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/transformermodel","census":null,"licence":"NOASSERTION","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub could not classify the licence of this paper's repository, facebookresearch/code-prediction-transformer (NOASSERTION)","mcp_get_code":{"code_sha256":"9a2f71717dcf3962"}},{"code_sha256":"a2315dc06271216b","code_sha256_prefix":"a2315dc06271216b","entry":"TransformerXL","repo":"shanghai-digital-brain-laboratory/bdm-db1","repo_kind":"listed","path":"src/model/transformer_xl.py","file_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1/blob/HEAD/src/model/transformer_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"a2315dc06271216b"}},{"code_sha256":"fa690903d5ea5d89","code_sha256_prefix":"fa690903d5ea5d89","entry":"TransformerXL","repo":"AIResearchHub/transformergallery","repo_kind":"listed","path":"transformer/transformerxl.py","file_url":"https://github.com/AIResearchHub/transformergallery/blob/HEAD/transformer/transformerxl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"fa690903d5ea5d89"}},{"code_sha256":"91e5af7605c83b9a","code_sha256_prefix":"91e5af7605c83b9a","entry":"XLAttentionLayer","repo":"AIResearchHub/transformergallery","repo_kind":"listed","path":"transformer/transformerxl.py","file_url":"https://github.com/AIResearchHub/transformergallery/blob/HEAD/transformer/transformerxl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"91e5af7605c83b9a"}},{"code_sha256":"2b646a664c00ffa8","code_sha256_prefix":"2b646a664c00ffa8","entry":"XLNet","repo":"listenviolet/XLNet","repo_kind":"listed","path":"xlnet.py","file_url":"https://github.com/listenviolet/XLNet/blob/HEAD/xlnet.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"2b646a664c00ffa8"}},{"code_sha256":"ed15761e38990647","code_sha256_prefix":"ed15761e38990647","entry":"_create_mask","repo":"benkrause/dynamiceval-transformer","repo_kind":"listed","path":"tf/model.py","file_url":"https://github.com/benkrause/dynamiceval-transformer/blob/HEAD/tf/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"ed15761e38990647"}},{"code_sha256":"c1f8a649a7a837d5","code_sha256_prefix":"c1f8a649a7a837d5","entry":"_create_mask","repo":"huggingface/xlnet","repo_kind":"listed","path":"modeling.py","file_url":"https://github.com/huggingface/xlnet/blob/HEAD/modeling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"c1f8a649a7a837d5"}},{"code_sha256":"5c61a4c30ce59547","code_sha256_prefix":"5c61a4c30ce59547","entry":"apply_rotary_pos_emb","repo":"mustafaaljadery/gemma-2b-10m","repo_kind":"listed","path":"src/gemma.py","file_url":"https://github.com/mustafaaljadery/gemma-2b-10m/blob/HEAD/src/gemma.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/apply-rotary-pos-emb","census":{"url":"/census/apply-rotary-pos-emb","implementations":14,"papers":15,"distinct_outputs":8,"n_buckets":7,"bucket_key":null,"bucket_index":null,"bucket_label":null},"census_bucket_fragment":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, mustafaaljadery/gemma-2b-10m when it was checked","mcp_get_code":{"code_sha256":"5c61a4c30ce59547"}},{"code_sha256":"0e3f1e158da4c3b8","code_sha256_prefix":"0e3f1e158da4c3b8","entry":"average_grads_and_vars","repo":"TimDettmers/transformer-xl","repo_kind":"listed","path":"tf/gpu_utils.py","file_url":"https://github.com/TimDettmers/transformer-xl/blob/HEAD/tf/gpu_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"0e3f1e158da4c3b8"}},{"code_sha256":"6fee57012e68e835","code_sha256_prefix":"6fee57012e68e835","entry":"cached_path","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/cached-path","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"6fee57012e68e835"}},{"code_sha256":"e505aeb6374f0f1c","code_sha256_prefix":"e505aeb6374f0f1c","entry":"checkpoint_exists","repo":"TimDettmers/transformer-xl","repo_kind":"listed","path":"tf/avg_checkpoints.py","file_url":"https://github.com/TimDettmers/transformer-xl/blob/HEAD/tf/avg_checkpoints.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"e505aeb6374f0f1c"}},{"code_sha256":"48246428164ddbc5","code_sha256_prefix":"48246428164ddbc5","entry":"create_ordered_tfrecords","repo":"TimDettmers/transformer-xl","repo_kind":"listed","path":"tf/data_utils.py","file_url":"https://github.com/TimDettmers/transformer-xl/blob/HEAD/tf/data_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"48246428164ddbc5"}},{"code_sha256":"5abf0267f0fc7514","code_sha256_prefix":"5abf0267f0fc7514","entry":"embedding_lookup","repo":"huggingface/xlnet","repo_kind":"listed","path":"modeling.py","file_url":"https://github.com/huggingface/xlnet/blob/HEAD/modeling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/embedding-lookup","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"5abf0267f0fc7514"}},{"code_sha256":"f07d3c5f67c9a93d","code_sha256_prefix":"f07d3c5f67c9a93d","entry":"generate_per_core_enqueue_ops_fn_for_host","repo":"TimDettmers/transformer-xl","repo_kind":"listed","path":"tf/tpu_estimator.py","file_url":"https://github.com/TimDettmers/transformer-xl/blob/HEAD/tf/tpu_estimator.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"f07d3c5f67c9a93d"}},{"code_sha256":"d5a05e8b3b59f012","code_sha256_prefix":"d5a05e8b3b59f012","entry":"generate_per_host_enqueue_ops_fn_for_host","repo":"TimDettmers/transformer-xl","repo_kind":"listed","path":"tf/tpu_estimator.py","file_url":"https://github.com/TimDettmers/transformer-xl/blob/HEAD/tf/tpu_estimator.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"d5a05e8b3b59f012"}},{"code_sha256":"8ca3ba583d69ea38","code_sha256_prefix":"8ca3ba583d69ea38","entry":"generate_per_host_v2_enqueue_ops_fn_for_host","repo":"TimDettmers/transformer-xl","repo_kind":"listed","path":"tf/tpu_estimator.py","file_url":"https://github.com/TimDettmers/transformer-xl/blob/HEAD/tf/tpu_estimator.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"8ca3ba583d69ea38"}},{"code_sha256":"ab8eff277d0925e9","code_sha256_prefix":"ab8eff277d0925e9","entry":"get_bin_sizes","repo":"TimDettmers/transformer-xl","repo_kind":"listed","path":"tf/data_utils.py","file_url":"https://github.com/TimDettmers/transformer-xl/blob/HEAD/tf/data_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"ab8eff277d0925e9"}},{"code_sha256":"b4bb49d2de702f67","code_sha256_prefix":"b4bb49d2de702f67","entry":"get_from_cache","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"b4bb49d2de702f67"}},{"code_sha256":"6804d62cb7cd8df3","code_sha256_prefix":"6804d62cb7cd8df3","entry":"head_projection","repo":"huggingface/xlnet","repo_kind":"listed","path":"modeling.py","file_url":"https://github.com/huggingface/xlnet/blob/HEAD/modeling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"6804d62cb7cd8df3"}},{"code_sha256":"c1c98338b80e7459","code_sha256_prefix":"c1c98338b80e7459","entry":"lm_loss","repo":"Machine-Learning-Tokyo/Poetry-GAN","repo_kind":"listed","path":"textgan.py","file_url":"https://github.com/Machine-Learning-Tokyo/Poetry-GAN/blob/HEAD/textgan.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"c1c98338b80e7459"}},{"code_sha256":"3d6b054785523852","code_sha256_prefix":"3d6b054785523852","entry":"load_from_checkpoint","repo":"TimDettmers/transformer-xl","repo_kind":"listed","path":"tf/gpu_utils.py","file_url":"https://github.com/TimDettmers/transformer-xl/blob/HEAD/tf/gpu_utils.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/load-from-checkpoint","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"3d6b054785523852"}},{"code_sha256":"1ebc2bf2c3cddc4d","code_sha256_prefix":"1ebc2bf2c3cddc4d","entry":"load_tf_weights_in_transfo_xl","repo":"cedrickchee/pytorch-pretrained-BERT","repo_kind":"listed","path":"pytorch_pretrained_bert/modeling_transfo_xl.py","file_url":"https://github.com/cedrickchee/pytorch-pretrained-BERT/blob/HEAD/pytorch_pretrained_bert/modeling_transfo_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/load-tf-weights-in-transfo-xl","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"1ebc2bf2c3cddc4d"}},{"code_sha256":"99e35dc770639097","code_sha256_prefix":"99e35dc770639097","entry":"mask_adaptive_embedding_lookup","repo":"benkrause/dynamiceval-transformer","repo_kind":"listed","path":"tf/model.py","file_url":"https://github.com/benkrause/dynamiceval-transformer/blob/HEAD/tf/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"99e35dc770639097"}},{"code_sha256":"fca4d6d03913ae24","code_sha256_prefix":"fca4d6d03913ae24","entry":"mask_adaptive_logsoftmax","repo":"benkrause/dynamiceval-transformer","repo_kind":"listed","path":"tf/model.py","file_url":"https://github.com/benkrause/dynamiceval-transformer/blob/HEAD/tf/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"fca4d6d03913ae24"}},{"code_sha256":"8d07f1308bd24cbc","code_sha256_prefix":"8d07f1308bd24cbc","entry":"mul_adaptive_embedding_lookup","repo":"benkrause/dynamiceval-transformer","repo_kind":"listed","path":"tf/model.py","file_url":"https://github.com/benkrause/dynamiceval-transformer/blob/HEAD/tf/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"8d07f1308bd24cbc"}},{"code_sha256":"e344186184b46850","code_sha256_prefix":"e344186184b46850","entry":"mul_adaptive_logsoftmax","repo":"benkrause/dynamiceval-transformer","repo_kind":"listed","path":"tf/model.py","file_url":"https://github.com/benkrause/dynamiceval-transformer/blob/HEAD/tf/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"e344186184b46850"}},{"code_sha256":"3652bf001c221967","code_sha256_prefix":"3652bf001c221967","entry":"positionwise_FF","repo":"benkrause/dynamiceval-transformer","repo_kind":"listed","path":"tf/model.py","file_url":"https://github.com/benkrause/dynamiceval-transformer/blob/HEAD/tf/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"3652bf001c221967"}},{"code_sha256":"ddf11fc956cd28ce","code_sha256_prefix":"ddf11fc956cd28ce","entry":"positionwise_ffn","repo":"huggingface/xlnet","repo_kind":"listed","path":"modeling.py","file_url":"https://github.com/huggingface/xlnet/blob/HEAD/modeling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"ddf11fc956cd28ce"}},{"code_sha256":"cf208c8c20d52c1b","code_sha256_prefix":"cf208c8c20d52c1b","entry":"post_attention","repo":"huggingface/xlnet","repo_kind":"listed","path":"modeling.py","file_url":"https://github.com/huggingface/xlnet/blob/HEAD/modeling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"cf208c8c20d52c1b"}},{"code_sha256":"bf75653cc30018e0","code_sha256_prefix":"bf75653cc30018e0","entry":"print_with_rank","repo":"shanghai-digital-brain-laboratory/bdm-db1","repo_kind":"listed","path":"src/model/transformer_xl.py","file_url":"https://github.com/shanghai-digital-brain-laboratory/bdm-db1/blob/HEAD/src/model/transformer_xl.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"bf75653cc30018e0"}},{"code_sha256":"b517847a8c809203","code_sha256_prefix":"b517847a8c809203","entry":"rel_attn_core","repo":"huggingface/xlnet","repo_kind":"listed","path":"modeling.py","file_url":"https://github.com/huggingface/xlnet/blob/HEAD/modeling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"b517847a8c809203"}},{"code_sha256":"b1f1afea05cd968b","code_sha256_prefix":"b1f1afea05cd968b","entry":"rel_multihead_attn","repo":"benkrause/dynamiceval-transformer","repo_kind":"listed","path":"tf/model.py","file_url":"https://github.com/benkrause/dynamiceval-transformer/blob/HEAD/tf/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"b1f1afea05cd968b"}},{"code_sha256":"6ccb8d28491109b6","code_sha256_prefix":"6ccb8d28491109b6","entry":"rel_multihead_attn","repo":"huggingface/xlnet","repo_kind":"listed","path":"modeling.py","file_url":"https://github.com/huggingface/xlnet/blob/HEAD/modeling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"6ccb8d28491109b6"}},{"code_sha256":"582150577e5bd769","code_sha256_prefix":"582150577e5bd769","entry":"sample_logits","repo":"NVIDIA/DeepLearningExamples","repo_kind":"listed","path":"PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","file_url":"https://github.com/NVIDIA/DeepLearningExamples/blob/HEAD/PyTorch/LanguageModeling/Transformer-XL/pytorch/mem_transformer.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/sample-logits","census":null,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, NVIDIA/DeepLearningExamples when it was checked","mcp_get_code":{"code_sha256":"582150577e5bd769"}},{"code_sha256":"69598ced7806d8c3","code_sha256_prefix":"69598ced7806d8c3","entry":"scatter","repo":"TimDettmers/transformer-xl","repo_kind":"listed","path":"pytorch/utils/data_parallel.py","file_url":"https://github.com/TimDettmers/transformer-xl/blob/HEAD/pytorch/utils/data_parallel.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/scatter","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"69598ced7806d8c3"}},{"code_sha256":"aa1de448b0528802","code_sha256_prefix":"aa1de448b0528802","entry":"scatter_kwargs","repo":"TimDettmers/transformer-xl","repo_kind":"listed","path":"pytorch/utils/data_parallel.py","file_url":"https://github.com/TimDettmers/transformer-xl/blob/HEAD/pytorch/utils/data_parallel.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/scatter-kwargs","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"aa1de448b0528802"}},{"code_sha256":"e7ebaba541ff0216","code_sha256_prefix":"e7ebaba541ff0216","entry":"seq_gumbel_softmax","repo":"Machine-Learning-Tokyo/Poetry-GAN","repo_kind":"listed","path":"textgan.py","file_url":"https://github.com/Machine-Learning-Tokyo/Poetry-GAN/blob/HEAD/textgan.py","link_basis":"harvester_set","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"e7ebaba541ff0216"}},{"code_sha256":"d0f56431ab6c3b37","code_sha256_prefix":"d0f56431ab6c3b37","entry":"transformer","repo":"benkrause/dynamiceval-transformer","repo_kind":"listed","path":"tf/model.py","file_url":"https://github.com/benkrause/dynamiceval-transformer/blob/HEAD/tf/model.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":"/code/transformer-2","census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"d0f56431ab6c3b37"}},{"code_sha256":"d077730400326171","code_sha256_prefix":"d077730400326171","entry":"transformer_xl","repo":"huggingface/xlnet","repo_kind":"listed","path":"modeling.py","file_url":"https://github.com/huggingface/xlnet/blob/HEAD/modeling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"d077730400326171"}},{"code_sha256":"2d935f29546db9cd","code_sha256_prefix":"2d935f29546db9cd","entry":"two_stream_rel_attn","repo":"huggingface/xlnet","repo_kind":"listed","path":"modeling.py","file_url":"https://github.com/huggingface/xlnet/blob/HEAD/modeling.py","link_basis":"first_harvest_node","language":"python","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"code_page":null,"census":null,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"mcp_get_code":{"code_sha256":"2d935f29546db9cd"}}]},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"922c34cc3b169dc24a8050f011df9fad0ba236a36ba37ef173376c4b7479d7c7","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}