Papers › LoRA: Low-Rank Adaptation of Large Language Models

LoRA: Low-Rank Adaptation of Large Language Models

17 Jun 2021ICLR 2022 4arXiv:2106.09685archive 2025-07-28

Edward J. Hu, Yelong Shen, Phillip Wallis, Zeyuan Allen-Zhu, Yuanzhi Li, Shean Wang, Lu Wang, Weizhu Chen

An important paradigm of natural language processing consists of large-scale pre-training on general domain data and adaptation to particular tasks or domains. As we pre-train larger models, full fine-tuning, which retrains all model parameters, becomes less feasible. Using GPT-3 175B as an example -- deploying independent instances of fine-tuned models, each with 175B parameters, is prohibitively expensive. We propose Low-Rank Adaptation, or LoRA, which freezes the pre-trained model weights and injects trainable rank decomposition matrices into each layer of the Transformer architecture, greatly reducing the number of trainable parameters for downstream tasks. Compared to GPT-3 175B fine-tuned with Adam, LoRA can reduce the number of trainable parameters by 10,000 times and the GPU memory requirement by 3 times. LoRA performs on-par or better than fine-tuning in model quality on RoBERTa, DeBERTa, GPT-2, and GPT-3, despite having fewer trainable parameters, a higher training throughput, and, unlike adapters, no additional inference latency. We also provide an empirical investigation into rank-deficiency in language model adaptation, which sheds light on the efficacy of LoRA. We release a package that facilitates the integration of LoRA with PyTorch models and provide our implementations and model checkpoints for RoBERTa, DeBERTa, and GPT-2 at https://github.com/microsoft/LoRA.

PaperPDFConference PDFCodeCode Syntology ranMethod as code

In Syntology View this paper on Syntology, its page in Syntology's graph. That page adds which of its functions are also present in other papers' code Syntology holds, with dates, and its dated run record as JSON and a README badge. It also lists the repositories linked to the paper, the abstract and the calls for agents.

Open this paper in Syntology's Atlas, the map of the papers in Syntology's graph and their citations.

For agents, on Syntology's MCP service (how to connect):

Code

No sample from the archive's official repository (microsoft/LoRA) is linked to this paper; the 84 samples below come from 24 community repositories. Syntology harvested code from microsoft/LoRA for another paper.

microsoft/LoRA: Syntology's graph links these samples to Novelty Controlled Paraphrase Generation with Retrieval Augmented Conditional Prompt Tuning (arXiv:2202.00535; that paper's own run record: 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method.

Syntology 84 code samples harvested from 24 repositories linked to this paper: 51 ran (of which 19 constructed an object rather than computing a result; 43 with no instrument failure: 1 honoured, 0 violated, 42 with no contract checked; 8 where Syntology's instrument failed) · 33 unverified. Where Syntology's instrument failed: 6 where our contract draft was wrong; 2 where the contract check could not run; failures of Syntology's instrument, not of the code.

By repository: community (archive-listed): 84 samples from 24 repositories, 51 ran (43 with no instrument failure; 8 where Syntology's instrument failed). The run record, sample by sample. “Ran” means executed on a synthesized input, not that the code is correct or reproduces the paper.

No sample is linked to this paper from 36 of its repositories that Syntology harvested for other papers:

Levels written between 2026-09-22 and 2026-09-24 (UTC): the dates Syntology's graph wrote each sample's verification level, not when the code executed.

74 repositories listed; official and paper-mentioned ones first.

microsoft/LoRA officialmentioned in papermentioned on GitHubjaxMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Novelty Controlled Paraphrase Generation with Retrieval Augmented Conditional Prompt Tuning (arXiv:2202.00535; that paper's own run record: 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
12kimih/hicupid mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Exploring the Potential of LLMs as Personalized Assistants: Dataset, Evaluation, and Analysis (arXiv:2506.01262; that paper's own run record: 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
Davidzhangyuanhan/NOAH mentioned on GitHubtfSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Parameter-Efficient Transfer Learning for NLP (arXiv:1902.00751; that paper's own run record: 14 ran (of which 3 constructed an object rather than computing a result; 14 with no instrument failure: 0 honoured, 0 violated, 14 with no contract checked; 0 where Syntology's instrument failed) · 8 unverified); nothing checks that they implement this paper's method. report
KU-CVLAB/MoA mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
Lightning-AI/lit-llama mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
Luohh5/Chain-of-Exemplar mentioned on GitHubpytorchNOASSERTIONSyntology: not harvested report
Owen-Oertell/rlcm mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to REBEL: Reinforcement Learning via Regressing Relative Rewards (arXiv:2404.16767; that paper's own run record: 16 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 2 honoured, 1 violated, 5 with no contract checked; 8 where Syntology's instrument failed) · 4 unverified); nothing checks that they implement this paper's method. report
QwenLM/Qwen-7B mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Qwen Technical Report (arXiv:2309.16609; that paper's own run record: 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified); nothing checks that they implement this paper's method. report
ZhangYuanhan-AI/NOAH mentioned on GitHubtfMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Neural Prompt Search (arXiv:2206.04673; that paper's own run record: 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 2 honoured, 0 violated, 2 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
aleemsidra/convlora mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to ConvLoRA and AdaBN based Domain Adaptation via Self-Training (arXiv:2402.04964; that paper's own run record: 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
arielnlee/Platypus mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Platypus: Quick, Cheap, and Powerful Refinement of LLMs (arXiv:2308.07317; that paper's own run record: 4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 0 where Syntology's instrument failed) · 2 unverified); nothing checks that they implement this paper's method. report
brandon3964/multimodal-task-vector mentioned on GitHubpytorchNOASSERTIONSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text... (arXiv:2308.12966; that paper's own run record: 0 ran · 2 unverified) and Multimodal Task Vectors Enable Many-Shot Multimodal In-Context Learning (arXiv:2406.15334; that paper's own run record: 16 ran (of which 0 constructed an object rather than computing a result; 15 with no instrument failure: 5 honoured, 2 violated, 8 with no contract checked; 1 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
chenlicodebank/lora_on_analog_hardware mentioned on GitHubpytorchMITSyntology: 6 samples, 3 ran (1 instrument-failed) · 3 unverified report
clementromac/lamorel mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Grounding Large Language Models in Interactive Environments with Online Reinforcement Learning (arXiv:2302.02662; that paper's own run record: 9 ran (of which 2 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
davisyoshida/lorax mentioned on GitHubjaxMITSyntology: 2 samples, 0 ran · 2 unverified report
debjitpaul/refiner mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to REFINER: Reasoning Feedback on Intermediate Representations (arXiv:2304.01904; that paper's own run record: 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
durham/rwkv-finetune-script mentioned on GitHubpytorchApache-2.0Syntology: not harvested report
facebookresearch/pytorch-dp mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Large Language Models Can Be Strong Differentially Private Learners (arXiv:2110.05679; that paper's own run record: 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
facico/chinese-vicuna mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Self-Instruct: Aligning Language Models with Self-Generated Instructions (arXiv:2212.10560; that paper's own run record: 10 ran (of which 3 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 4 where Syntology's instrument failed) · 7 unverified); nothing checks that they implement this paper's method. report
flagai-open/aquila2 mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
flagalpha/llama2-chinese mentioned on GitHubpytorchSyntology: not harvested report
flowersteam/lamorel mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Grounding Large Language Models in Interactive Environments with Online Reinforcement Learning (arXiv:2302.02662; that paper's own run record: 9 ran (of which 2 constructed an object rather than computing a result; 6 with no instrument failure: 1 honoured, 0 violated, 5 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
google-deepmind/thunnini mentioned on GitHubjaxApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Understanding Prompt Tuning and In-Context Learning via Meta-Learning (arXiv:2505.17010; that paper's own run record: 3 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 0 honoured, 0 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
gt-ripl/selective-projection-decay mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Rethinking Weight Decay for Robust Fine-Tuning of Foundation Models (arXiv:2411.01713; that paper's own run record: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result); nothing checks that they implement this paper's method. report
h2oai/alpaca-lora mentioned on GitHubpytorchnot reachable when probed 2026-09-17 — repositories for recent papers often appear after camera-readySyntology: not harvested report
h2oai/h2o-llmstudio mentioned on GitHubpytorchApache-2.0Syntology: 2 samples, 2 ran (0 instrument-failed) · 0 unverified report
heekhero/DTL mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Visual Prompt Tuning (arXiv:2203.12119; that paper's own run record: 18 ran (of which 12 constructed an object rather than computing a result; 16 with no instrument failure: 1 honoured, 1 violated, 14 with no contract checked; 2 where Syntology's instrument failed) · 9 unverified); nothing checks that they implement this paper's method. report
hellokevin07/elastictrainer mentioned on GitHubtfMITSyntology: 8 samples, 5 ran (0 instrument-failed) · 3 unverified report
hitz-zentroa/this-is-not-a-dataset mentioned on GitHubpytorchSyntology: 5 samples, 3 ran (3 instrument-failed) · 2 unverified report
hiyouga/llama-efficient-tuning mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Large Language Models for Cyber Security: A Systematic Literature Review (arXiv:2405.04760; that paper's own run record: 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
if001/rwkv-lm-lora-ja mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
ikergarcia1996/sequence-labeling-llms mentioned on GitHubpytorchApache-2.0Syntology: 14 samples, 9 ran (0 instrument-failed) · 5 unverified report
internlm/xtuner mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (1 instrument-failed) · 0 unverified report
lif31up/attention-is-all-you-need mentioned on GitHubpytorchMITSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
lif31up/extended-BERT-for-low-rank-adaption mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Attention Is All You Need (arXiv:1706.03762; that paper's own run record: 610 ran (of which 293 constructed an object rather than computing a result; 529 with no instrument failure: 45 honoured, 15 violated, 469 with no contract checked; 81 where Syntology's instrument failed) · 336 unverified); nothing checks that they implement this paper's method. report
lighterswang/biomedclip-lora mentioned on GitHubpytorchSyntology: 2 samples, 1 ran (0 instrument-failed) · 1 unverified report
liucongg/chatglm-finetuning mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to GPT Understands, Too (arXiv:2103.10385; that paper's own run record: 3 ran (of which 1 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
llamafamily/llama-chinese mentioned on GitHubpytorchSyntology: not harvested report
longyuewangdcu/chinese-llama-2 mentioned on GitHubjaxSyntology: not harvested report
lxe/simple-llama-finetuner mentioned on GitHubpytorchMITSyntology: not harvested report
mchl-labs/stambecco mentioned on GitHubNOASSERTIONSyntology: not harvested report
mistralai/mistral-finetune mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
mistralai/mistral-inference mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
mistralai/mistral-src mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Mistral 7B (arXiv:2310.06825; that paper's own run record: 10 ran (of which 0 constructed an object rather than computing a result; 10 with no instrument failure: 0 honoured, 0 violated, 10 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified); nothing checks that they implement this paper's method. report
oseyosey/ccds mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Compute-Constrained Data Selection (arXiv:2410.16208; that paper's own run record: 14 ran (of which 0 constructed an object rather than computing a result; 8 with no instrument failure: 0 honoured, 1 violated, 7 with no contract checked; 6 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
phoebussi/alpaca-cot mentioned on GitHubpytorchApache-2.0Syntology: 7 samples, 4 ran (0 instrument-failed) · 3 unverified report
pilancilab/Riemannian_Preconditioned_LoRA mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models (arXiv:2402.02347; that paper's own run record: 15 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 2 honoured, 1 violated, 6 with no contract checked; 6 where Syntology's instrument failed) · 6 unverified); nothing checks that they implement this paper's method. report
pilancilab/caldera mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to QLoRA: Efficient Finetuning of Quantized LLMs (arXiv:2305.14314; that paper's own run record: 18 ran (of which 1 constructed an object rather than computing a result; 6 with no instrument failure: 2 honoured, 2 violated, 2 with no contract checked; 12 where Syntology's instrument failed) · 8 unverified); nothing checks that they implement this paper's method. report
punica-ai/punica mentioned on GitHubpytorchSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
pytorch/opacus mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Large Language Models Can Be Strong Differentially Private Learners (arXiv:2110.05679; that paper's own run record: 6 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 0 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
qwenlm/qwen mentioned on GitHubpytorchApache-2.0Syntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
qwenlm/qwen-vl mentioned on GitHubpytorchNOASSERTIONSyntology: 1 sample, 1 ran (0 instrument-failed) · 0 unverified report
simula/pointdetectcount mentioned on GitHubpytorchSyntology: not harvested report
song-wx/sift mentioned on GitHubpytorchSyntology: 2 samples, 0 ran · 2 unverified report
sultan-hassan/CosmoGemma mentioned on GitHubSyntology: not harvested report
sunildkumar/lora_from_scratch mentioned on GitHubpytorchMITSyntology: not harvested report
tatsu-lab/stanford_alpaca mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to AMATA: Adaptive Multi-Agent Trajectory Alignment for Knowledge-Intensive Question Answering (arXiv:2605.17352; that paper's own run record: 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified) and Modelpedia: A Catalog of Model Findings for the Meta-Science of AI (arXiv:2609.01090; that paper's own run record: 4 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
teelinsan/camoscio mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to LLaMA: Open and Efficient Foundation Language Models (arXiv:2302.13971; that paper's own run record: 37 ran (of which 9 constructed an object rather than computing a result; 25 with no instrument failure: 3 honoured, 0 violated, 22 with no contract checked; 12 where Syntology's instrument failed) · 21 unverified); nothing checks that they implement this paper's method. report
theodb/asr-whisper-finetuning mentioned on GitHubpytorchSyntology: not harvested report
thuml/AutoTimes mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Are Language Models Actually Useful for Time Series Forecasting? (arXiv:2406.16964; that paper's own run record: 5 ran (of which 0 constructed an object rather than computing a result; 3 with no instrument failure: 3 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
tloen/alpaca-lora mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to VeLoRA: Memory Efficient Training using Rank-1 Sub-Token Projections (arXiv:2405.17991; that paper's own run record: 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 3 unverified); nothing checks that they implement this paper's method. report
uds-lsv/llmft mentioned on GitHubpytorchSyntology: not harvested report
videocrafter/videocrafter mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to VideoCrafter2: Overcoming Data Limitations for High-Quality Video Diffusion Models (arXiv:2401.09047; that paper's own run record: 15 ran (of which 1 constructed an object rather than computing a result; 8 with no instrument failure: 3 honoured, 3 violated, 2 with no contract checked; 7 where Syntology's instrument failed) · 6 unverified); nothing checks that they implement this paper's method. report
vivo-ai-lab/bluelm mentioned on GitHubpytorchSyntology: 3 samples, 2 ran (2 instrument-failed) · 1 unverified report
wwxu21/cut mentioned on GitHubpytorchSyntology: 1 sample, 0 ran · 1 unverified report
yjiangcm/lion mentioned on GitHubpytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Lion: Adversarial Distillation of Proprietary Large Language Models (arXiv:2305.12870; that paper's own run record: 6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 2 where Syntology's instrument failed) · 5 unverified); nothing checks that they implement this paper's method. report
yjiangcm/lte mentioned on GitHubpytorchApache-2.0Syntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Learning to Edit: Aligning LLMs with Knowledge Editing (arXiv:2402.11905; that paper's own run record: 8 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 0 violated, 4 with no contract checked; 4 where Syntology's instrument failed) · 5 unverified); nothing checks that they implement this paper's method. report
ykwon0407/datainf mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models (arXiv:2310.00902; that paper's own run record: 0 ran · 1 unverified); nothing checks that they implement this paper's method. report
zhanglab-aim/lingo mentioned on GitHubpytorchSyntology: 18 samples, 11 ran (1 instrument-failed) · 7 unverified report
zhaolingao/langptune mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to End-to-end Training for Recommendation with Language-based User Profiles (arXiv:2410.18870; that paper's own run record: 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
zjunlp/trice mentioned on GitHubpytorchSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Making Language Models Better Tool Learners with Execution Feedback (arXiv:2305.13068; that paper's own run record: 3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified); nothing checks that they implement this paper's method. report
dreamboat26/fuzzy-logic pytorchGPL-3.0Syntology: not harvested report
jackaduma/Alpaca-LoRA-RLHF-PyTorch pytorchMITSyntology: no sample linked to this paper (harvested for another paper). Syntology's graph links these samples to Efficient and Effective Text Encoding for Chinese LLaMA and Alpaca (arXiv:2304.08177; that paper's own run record: 18 ran (of which 0 constructed an object rather than computing a result; 9 with no instrument failure: 1 honoured, 0 violated, 8 with no contract checked; 9 where Syntology's instrument failed) · 6 unverified); nothing checks that they implement this paper's method. report
labmlai/annotated_deep_learning_paper_implementations pytorchSyntology: 2 samples, 2 ran (0 instrument-failed) · 0 unverified report

Repository list and official/mentioned flags are the archive's, frozen 2025-07-28. Reachability, where shown, is from one Syntology probe window (2026-09-16 to 2026-09-18); repositories not probed show nothing. GitHub stars are not tracked.

A paper named beside a repository with no sample linked to this paper is shown with that paper's own run record, not this paper's: “ran” means executed on a synthesized input, not that the code is correct, and “where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Papers are listed in arXiv-id order, at most three per repository.

Code Syntology ran Syntology

84 samples harvested: 51 ran (of which 19 constructed an object rather than computing a result; 43 with no instrument failure: 1 honoured, 0 violated, 42 with no contract checked; 8 where Syntology's instrument failed) · 33 unverified. “Where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record. That date is not when the samples ran.

1ran · honoured contract
6ran · our draft was wrong
2ran; the contract check could not run
42ran
33unverified

Licence: 30 of the 84 samples are pointer only, meaning Syntology does not serve that copy's text. For 2 of them, this paper's copy is under a permissive licence and cleared, but the stored copy of the same code that Syntology serves is not; the licence label's tooltip gives Syntology's recorded reason. This page shows no code text for any sample; each one links to its file in the repository.

Harvested from 24 repositories linked to this paper, official or community; the list below is grouped by repository, each group headed by its name and what it is to the paper. “Ran” means the sample executed on a synthesized input. It does not mean the output is correct, and nothing here reproduces the paper's results. A line beginning “fixture:” under a sample that ran gives the arguments Syntology's fixture called the sample with, each as name:type/rank/element kind (? where none was recorded), and the type of what the fixture's run returned, exactly as the harness recorded them; the arguments and the returned type were recorded by two separate runs of the same fixture. No output value is shown, and a returned type says nothing about whether the output was right. “Level recorded” gives the UTC date when Syntology's graph wrote the sample's verification level, not when the code executed; where the level was written before Syntology's graph kept that date, the row says “level recorded, date not recorded”. For 7 samples that ran, the graph records a signature this page does not show: for a class the fixture built without calling, the harness called the object with inputs it made up itself, so the recorded signature is the harness's probe, not the fixture's arguments. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself. “Our draft was wrong” and “the contract check could not run” are failures of Syntology's instrument, not of the code: the sample ran on Syntology's synthesized input, and then the drafted contract did not describe it, or the check itself raised an error (RAISES), lacked a dependency (DEP_MISSING) or ran out of time (TIMEOUT); hover the label for which. A metamorphic tier, where shown, is evidence of the output's shape, not that the sample implements the method.

Each sample ends with its code_sha256. A sample's code_sha256 is Syntology's identity for that exact code. It is printed in full (16 hexadecimal characters for every sample in this build), and get_code(code_sha256="…") takes it exactly as printed. An agent calls it on Syntology's MCP service (how to connect); click an identity to copy that call.

Repository labels, per sample. official repository: The archive marks this repository official for the paper. named in the paper: The archive records that the paper mentions this repository; it is not marked official. community (archive-listed): In the archive's code links for this paper, not marked official and not recorded as mentioned in the paper. found in paper text by Syntology: Syntology found this repository in the paper's own text; whether it is the authors' implementation is not asserted. community: Not in the archive's code links for this paper; a community repository Syntology harvested. Samples are grouped by repository: a repository marked official first, then by how directly the repository is tied to the paper, then in the archive's order; never by how many ran. Licence labels name the repository's licence as recorded at harvest. “Pointer only” means Syntology does not serve that copy's text, for one of six reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar); this paper's copy was not located, so its licence is not recorded; or this paper's copy is cleared, but the stored copy of the same code that Syntology serves is not. Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence label for the reason. File links open the file on GitHub at the default branch, which may have changed since the harvest.

A function or class name links to its page when the name occurs in the harvested code of at least 5 papers; the name is a string, not an identity. A census tag appears when Syntology's census ran implementations with that name on one shared input per bucket: it gives how many were compared, from how many papers, and how many distinct outputs they produced, and names this sample's bucket when this sample was one of them.

KU-CVLAB/MoA community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
LoraInjectedLinear domainbed/models/lora/lora_util.py ran no licence file found · pointer only · d4f1b87ebb0746ff · report fixture: returned LoraInjectedLinear · level recorded 2026-09-22
Lightning-AI/lit-llama community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
LoRALayer in 10 papers lit_llama/lora.py ran Apache-2.0 (permissive) · 03b78b050e202a11 · report fixture: returned LoRALayer · level recorded 2026-09-22
chenlicodebank/lora_on_analog_hardware community (archive-listed) 6 samples, 3 ran (1 instrument-failed) · 3 unverified
convert_to_analog_according_to_name hardware_aware_training/related_functions.py ran MIT (permissive) · f0826162829e047c · report fixture: signature module:callable/0/?, parent_name:str/0/str · returned list · level recorded 2026-09-24
get_label_list in 7 papers lora_training_glue/run_classification.py ran · our draft was wrong MIT (permissive) · adb7541f2edf078e · report fixture: signature raw_dataset:dict/0/?, split:str/0/str · returned list · level recorded 2026-09-24
list_linear_layers hardware_aware_training/related_functions.py ran MIT (permissive) · 8bf57961090630be · report fixture: signature module:callable/0/?, parent_name:str/0/str · returned list · level recorded 2026-09-24
gen_rpu_config instruction_tuning/custom_analog_model.py unverified MIT (permissive) · db888a8265d40f72 · report
postprocess_qa_predictions in 10 papers hardware_aware_training/utils_qa.py unverified MIT (permissive) here; the stored copy is pointer only · ac56d3e7b79dbc18 · report
postprocess_qa_predictions_with_beam_search in 10 papers hardware_aware_training/utils_qa.py unverified MIT (permissive) here; the stored copy is pointer only · 8c51f5aaf2f659e2 · report
davisyoshida/lorax community (archive-listed) 2 samples, 0 ran · 2 unverified
init_lora lorax/helpers.py unverified MIT (permissive) · e91d5f03692ee82c · report
simple_spec lorax/helpers.py unverified MIT (permissive) · 094357d881289dc6 · report
flagai-open/aquila2 community (archive-listed) 1 sample, 0 ran · 1 unverified
LoraArguments finetune/finetune.py unverified no licence file found · pointer only · a2a949d390f89698 · report
h2oai/h2o-llmstudio community (archive-listed) 2 samples, 2 ran (0 instrument-failed) · 0 unverified
get_cfg in 7 papers llm_studio/src/loggers.py ran Apache-2.0 (permissive) · 078030b5193a097e · report fixture: signature cfg:MockConfig/0/? · returned dict · level recorded 2026-09-24
parse_param llm_studio/prompt.py ran Apache-2.0 (permissive) · 1db3631aa8a1aa75 · report fixture: signature cfg:Config/0/?, prompt:str/0/str · returned Config · level recorded 2026-09-24
hellokevin07/elastictrainer community (archive-listed) 8 samples, 5 ran (0 instrument-failed) · 3 unverified
downscale_t_dy_and_t_dw selection_solver_DP.py ran MIT (permissive) · 3a4aed8b19f818f9 · report fixture: signature t_dy:ndarray/1/float, t_dw:ndarray/1/float, Tq:float/0/float · returned tuple · level recorded 2026-09-24
interpret_image_size vit_utils.py ran · honoured contract fingerprinted MIT (permissive) · a6d5b89d9b7d3d00 · report fixture: signature image_size_arg:int/0/int · returned tuple · level recorded 2026-09-22
my_bool utils.py ran MIT (permissive) · e9b9102ba2736955 · report fixture: signature s:str/0/str · returned bool · level recorded 2026-09-24
read_data_from_tfboard_logs plot_curves.py ran MIT (permissive) · b0ef8d0623af5966 · report fixture: signature path:str/0/str, x_tag:str/0/str, y_tag:str/0/str · returned tuple · level recorded 2026-09-24
selection_DP selection_solver_DP.py ran MIT (permissive) · 5f63441b43fd9611 · report fixture: signature t_dy:ndarray/1/int, t_dw:ndarray/1/int, I:ndarray/1/float, rho:float/0/float · returned tuple · level recorded 2026-09-24
preprocess_inputs vit_utils.py unverified MIT (permissive) · 17ac338f74db73e2 · report
profile_backpropagation profiler.py unverified MIT (permissive) · d26b6c885a1aa8e6 · report
profile_parser profiler.py unverified MIT (permissive) · 143cc53e7535f55f · report
hitz-zentroa/this-is-not-a-dataset community (archive-listed) 5 samples, 3 ran (3 instrument-failed) · 2 unverified
find_all_linear_names in 50 papers load_model.py ran · our draft was wrong Apache-2.0 (permissive) · cfdc29157de085e3 · report fixture: signature model:callable/0/?, quantization:NoneType/0/? · returned list · level recorded 2026-09-22
get_device_map load_model.py ran · our draft was wrong fingerprinted Apache-2.0 (permissive) · a145b7042b65ac5e · report fixture: signature force_auto_device_map:bool/0/bool, max_memory_MB:int/0/int, use_better_transformer:bool/0/bool · returned tuple · level recorded 2026-09-22
get_trainable_parameters load_model.py ran; the contract check could not run (RAISES) Apache-2.0 (permissive) · 96cb172b7d428b13 · report fixture: signature model:callable/0/? · returned tuple · level recorded 2026-09-22
load_model in 479 papers load_model.py unverified Apache-2.0 (permissive) · 60b08148856c99db · report
merge_lora_model load_model.py unverified Apache-2.0 (permissive) · 6cdb58fcb28a6786 · report
if001/rwkv-lm-lora-ja community (archive-listed) 1 sample, 0 ran · 1 unverified
LoraLinear RWKV-v4neo/src/model.py unverified Apache-2.0 (permissive) · 399aed0da4b85280 · report
ikergarcia1996/sequence-labeling-llms community (archive-listed) 14 samples, 9 ran (0 instrument-failed) · 5 unverified
compute_words_ids constrained_generation.py ran Apache-2.0 (permissive) · 336b88501d97f8d6 · report fixture: signature tokenizer:MockTokenizer/0/?, sentence:str/0/str · returned list · level recorded 2026-09-24
get_device_map load_model.py ran Apache-2.0 (permissive) · 47660e151147cb9e · report fixture: signature force_auto_device_map:bool/0/bool, max_memory_MB:int/0/int, use_better_transformer:bool/0/bool · returned tuple · level recorded 2026-09-24
get_dtype in 14 papers seq2seq.py ran Apache-2.0 (permissive) · db50388eace49466 · report fixture: signature accelerator:Accelerator/0/? · returned str · level recorded 2026-09-24
print_trainable_parameters in 9 papers seq2seq.py ran Apache-2.0 (permissive) · 14548ec0148ab8ec · report fixture: signature model:callable/0/? · returned tuple · level recorded 2026-09-24
run_model in 27 papers constrained_generation.py ran Apache-2.0 (permissive) · 6704486d6cc51ef0 · report fixture: signature model:callable/0/?, input_ids:Tensor/2/int, decoder_args:dict/0/?, is_encoder_decoder:bool/0/bool · returned tuple · level recorded 2026-09-24
split_sentence in 8 papers evaluate.py ran Apache-2.0 (permissive) · 02c2c36a57cb4648 · report fixture: signature tag_regex:Pattern/0/?, sentence:str/0/str, recursion_limit:int/0/int · returned list · level recorded 2026-09-24
to_bilou_encoding tag_encoding.py ran Apache-2.0 (permissive) · d7678113426bdefa · report fixture: signature tags:list/1/str · returned list · level recorded 2026-09-24
to_iob2_encoding tag_encoding.py ran Apache-2.0 (permissive) · 60b66de5aeee97ce · report fixture: signature tags:list/1/str · returned list · level recorded 2026-09-24
to_iob_encoding tag_encoding.py ran Apache-2.0 (permissive) · 2ec748940a02967a · report fixture: signature tags:list/1/str · returned list · level recorded 2026-09-24
constrained_beam_search constrained_generation.py unverified Apache-2.0 (permissive) · 7b6da4bad1690c28 · report
experiment_done seq2seq.py unverified Apache-2.0 (permissive) · b2c115afec17443b · report
get_f1 in 6 papers Medical-MT5/get_results.py unverified Apache-2.0 (permissive) · f3fdd2b33f8ca63e · report
label2name label_names.py unverified Apache-2.0 (permissive) · 70bab034f9244cb1 · report
name2label label_names.py unverified Apache-2.0 (permissive) · 346a92eaf1c6cc2d · report
internlm/xtuner community (archive-listed) 1 sample, 1 ran (1 instrument-failed) · 0 unverified
find_all_linear_names in 50 papers xtuner/model/utils.py ran · our draft was wrong Apache-2.0 (permissive) · 53281c424cf5891f · report fixture: signature model:callable/0/? · returned list · level recorded 2026-09-22
lif31up/attention-is-all-you-need community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
embed in 13 papers EmbeddedDataset.py ran MIT (permissive) · 6351105db75b9e71 · report fixture: signature text:str/0/str, tokenizer:callable/0/?, model:callable/0/? · returned Tensor · level recorded 2026-09-24
get_embedder in 88 papers config.py unverified MIT (permissive) · 2792e933b772b0f7 · report
lighterswang/biomedclip-lora community (archive-listed) 2 samples, 1 ran (0 instrument-failed) · 1 unverified
_LoRA_qkv_timm lora.py ran no licence file found · pointer only · d8d584f9d3ef1a8f · report fixture: signature x:Tensor/3/float · returned Tensor · level recorded 2026-09-24
LoRA_ViT_timm lora.py unverified no licence file found · pointer only · 3dd0d78f6a42a263 · report
mistralai/mistral-finetune community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
LoRALinear model/lora.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · 0fa772920c405ed2 · report fixture: returned LoRALinear · level recorded 2026-09-22
mistralai/mistral-inference community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
LoRALinear src/mistral_inference/lora.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · d91b99d50ee2e13b · report fixture: returned LoRALinear · level recorded 2026-09-22
phoebussi/alpaca-cot community (archive-listed) 7 samples, 4 ran (0 instrument-failed) · 3 unverified
Conv2d in 43 papers
census: 7 implementations from 7 papers, 6 distinct outputs on one shared input
peft/src/peft/tuners/lora.py ran · metamorphic tier: deterministic fingerprinted Apache-2.0 (permissive) · f156ba83a62bfd88 · report fixture: returned Conv2d · level recorded 2026-09-22
Embedding in 90 papers peft/src/peft/tuners/lora.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · 1d022836585085cb · report fixture: returned Embedding · level recorded 2026-09-22
Linear in 127 papers peft/src/peft/tuners/lora.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · 1f506a3641c40fac · report fixture: returned Linear · level recorded 2026-09-22
ModulesToSaveWrapper peft/src/peft/tuners/lora.py ran · metamorphic tier: deterministic Apache-2.0 (permissive) · 5e92a950d55ba432 · report fixture: returned ModulesToSaveWrapper · level recorded 2026-09-22
LoraLayer in 5 papers peft/src/peft/tuners/lora.py unverified Apache-2.0 (permissive) · 4e130d790f7e7dcd · report
LoraModel in 6 papers peft/src/peft/tuners/lora.py unverified Apache-2.0 (permissive) · 4e64816ecd5d8675 · report
mark_only_lora_as_trainable in 11 papers peft/src/peft/tuners/lora.py unverified Apache-2.0 (permissive) · 84f4e84719d66f4c · report
punica-ai/punica community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
LoraWeight src/punica/utils/lora.py ran Apache-2.0 (permissive) · b6d5f1638edabb8a · report fixture: returned LoraWeight · level recorded 2026-09-22
qwenlm/qwen community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
LoraArguments finetune.py ran Apache-2.0 (permissive) · 33efd3e3245a8802 · report fixture: returned LoraArguments · level recorded 2026-09-22
qwenlm/qwen-vl community (archive-listed) 1 sample, 1 ran (0 instrument-failed) · 0 unverified
LoraArguments finetune.py ran licence not identified · pointer only · e9170e0ed6d12210 · report fixture: returned LoraArguments · level recorded 2026-09-22
song-wx/sift community (archive-listed) 2 samples, 0 ran · 2 unverified
make_diff exp/instruction_finetuning/weight_diff.py unverified no licence file found · pointer only · 1bad2db22f04ac99 · report
smart_tokenizer_and_embedding_resize exp/instruction_finetuning/weight_diff.py unverified no licence file found · pointer only · 840d5d0a1e7b3a5e · report
vivo-ai-lab/bluelm community (archive-listed) 3 samples, 2 ran (2 instrument-failed) · 1 unverified
find_all_linear_modules in 5 papers train/utils/finetune_peft.py ran · our draft was wrong licence not identified · pointer only · 848321f611fd218e · report fixture: signature model:callable/0/? · returned list · level recorded 2026-09-22
get_peft_config train/utils/finetune_peft.py ran; the contract check could not run (DEP_MISSING) licence not identified · pointer only · 60df31a5803dfdaa · report fixture: signature model:callable/0/?, args:ArgsConfig/0/? · returned LoraConfig · level recorded 2026-09-22
get_peft_lora_model train/utils/finetune_peft.py unverified licence not identified · pointer only · 7a1b3f8b8ad8779a · report
wwxu21/cut community (archive-listed) 1 sample, 0 ran · 1 unverified
PeftModelForCausalLM modeling_llama_unlikelihood.py unverified Apache-2.0 (permissive) · 551a5af99158f91b · report
zhanglab-aim/lingo community (archive-listed) 18 samples, 11 ran (1 instrument-failed) · 7 unverified
Conv2d in 43 papers
census: 7 implementations from 7 papers, 6 distinct outputs on one shared input
peftnew/tuners/lora.py ran · metamorphic tier: deterministic fingerprinted GPL-3.0 (copyleft) · pointer only · 4025b3aa55f8b3e1 · report fixture: returned Conv2d · level recorded 2026-09-22
Embedding in 90 papers peftnew/tuners/lora.py ran · metamorphic tier: deterministic GPL-3.0 (copyleft) · pointer only · 747685b3f553947b · report fixture: returned Embedding · level recorded 2026-09-22
Linear in 127 papers peftnew/tuners/lora.py ran · metamorphic tier: deterministic GPL-3.0 (copyleft) · pointer only · 81d374052d6022b2 · report fixture: returned Linear · level recorded 2026-09-22
LoraLayer in 5 papers peftnew/tuners/lora.py ran GPL-3.0 (copyleft) · pointer only · e5f9e40bdb24afdb · report fixture: returned LoraLayer · level recorded 2026-09-22
ModulesToSaveWrapper peftnew/tuners/lora.py ran GPL-3.0 (copyleft) · pointer only · 7bb2b9cb3064a59c · report fixture: returned ModulesToSaveWrapper · level recorded 2026-09-22
PeftConfig peftnew/tuners/lora.py ran · metamorphic tier: deterministic GPL-3.0 (copyleft) · pointer only · b368ffa3c3d69f27 · report fixture: returned PeftConfig · level recorded 2026-09-22
PeftConfigMixin peftnew/tuners/lora.py ran · metamorphic tier: deterministic GPL-3.0 (copyleft) · pointer only · 867983846f2ffb06 · report fixture: returned PeftConfigMixin · level recorded 2026-09-22
QuantLinear in 6 papers peftnew/tuners/lora.py ran · metamorphic tier: deterministic GPL-3.0 (copyleft) · pointer only · 1464d2a7f4cf160e · report fixture: returned QuantLinear · level recorded 2026-09-22
get_quantization_config in 5 papers peftnew/tuners/lora.py ran · our draft was wrong GPL-3.0 (copyleft) · pointer only · 4236f53faf916aa2 · report fixture: signature model:callable/0/?, method:str/0/str · returned QuantizationConfig · level recorded 2026-09-22
is_auto_gptq_available peftnew/tuners/lora.py ran · metamorphic tier: deterministic GPL-3.0 (copyleft) · pointer only · 9027fb9844632cf2 · report fixture: returned bool · level recorded 2026-09-22
is_bnb_4bit_available peftnew/tuners/lora.py ran · metamorphic tier: deterministic GPL-3.0 (copyleft) · pointer only · 7d44a88878819ef3 · report fixture: returned bool · level recorded 2026-09-22
BaseTuner peftnew/tuners/lora.py unverified GPL-3.0 (copyleft) · pointer only · f877238ebdc262f1 · report
BaseTunerLayer peftnew/tuners/lora.py unverified GPL-3.0 (copyleft) · pointer only · 0cf569603c64a959 · report
LoraConfig peftnew/tuners/lora.py unverified GPL-3.0 (copyleft) · pointer only · 20fd5846de4854e1 · report
LoraModel in 6 papers peftnew/tuners/lora.py unverified GPL-3.0 (copyleft) · pointer only · e9fa57bcc18e8142 · report
PeftType peftnew/tuners/lora.py unverified GPL-3.0 (copyleft) · pointer only · ad8420238d39e438 · report
TaskType in 7 papers peftnew/tuners/lora.py unverified GPL-3.0 (copyleft) · pointer only · 258dc95ececd559e · report
get_auto_gptq_quant_linear peftnew/tuners/lora.py unverified GPL-3.0 (copyleft) · pointer only · cd0246549fc50335 · report
labmlai/annotated_deep_learning_paper_implementations community (archive-listed) 2 samples, 2 ran (0 instrument-failed) · 0 unverified
Linear in 127 papers labml_nn/lora/gpt2.py ran · metamorphic tier: invariant MIT (permissive) · 57b8771890dd7b1b · report fixture: signature x:Tensor/2/float · returned Tensor · level recorded 2026-09-22
MultiHeadAttention in 124 papers
census: 9 implementations from 7 papers, 9 distinct outputs across 3 buckets, one shared input per bucket
labml_nn/lora/gpt2.py ran MIT (permissive) · 7a1353c5e5ac87b5 · report fixture: signature x:Tensor/3/float · returned Tensor · level recorded 2026-09-24

Method as code Syntology

What Syntology's graph records as this paper's claimed method, lifted into code: each assembly names its bricks (functions and classes), each with its own role and its own verification level. An assembly is not a check that the code implements the method correctly or reproduces the paper's results. Levels are each brick's own verification level in Syntology's graph (level 0: no recorded run), listed brick by brick and never combined into one level; “ran” means the brick executed on a synthesized input, not that its output is correct, and the instrument figure counts failures of Syntology's instrument, not of the code. Where a model read the code against the paper's claim, each assembly's label verdict is one model's judgement, kept in this page's JSON twin; it is not calibrated, so no card prints it. Siblings are assemblies lifted from this paper in the same batch for the same method: alternative readings kept side by side; none replaces or supersedes another.

21 assemblies on this paper: 21 harvested, 0 generated, listed in 1 groups (siblings lifted in one batch form one group).

21 sibling assemblies for Low-Rank Adaptation (LoRA) (harvested), lifted in the same batch on 2026-09-09: alternative readings kept side by side; none replaces or supersedes another. Bricks printed for 12 of 21 sibling assemblies; the other 9 are listed with their counts; every brick is in this page's JSON twin.

harvested Assembly for Low-Rank Adaptation (LoRA) (graph method: Low-Rank Adaptation (LoRA)). 22 bricks; individually on a fixture: 14 ran (of which 8 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 3 where Syntology's instrument failed) · 8 unverified. The assembly has not been run end-to-end.

one of 21 siblings

  1. LoraModel entry · level 0 · unverified · e9fa57bcc18e8142
  2. BaseTuner helper · level 0 · unverified · f877238ebdc262f1
  3. Conv2d model · level 1 · ran · 4025b3aa55f8b3e1
  4. Embedding model · level 1 · ran · 747685b3f553947b
  5. Linear model · level 1 · ran · 81d374052d6022b2
  6. LoraConfig helper · level 0 · unverified · 20fd5846de4854e1
  7. LoraLayer helper · level 1 · ran · e5f9e40bdb24afdb
  8. ModulesToSaveWrapper helper · level 1 · ran · 7bb2b9cb3064a59c
  9. QuantLinear model · level 1 · ran · 1464d2a7f4cf160e
  10. _freeze_adapter helper · level 0 · unverified · 599fe61280ffc433
  11. _get_submodules helper · level 1 · ran · our draft was wrong · 127b2b488cacb9c4
  12. get_auto_gptq_quant_linear helper · level 0 · unverified · cd0246549fc50335
  13. get_quantization_config helper · level 1 · ran · our draft was wrong · 4236f53faf916aa2
  14. is_bnb_4bit_available helper · level 1 · ran · 7d44a88878819ef3
  15. BaseTunerLayer helper · level 0 · unverified · 0cf569603c64a959
  16. PeftConfig helper · level 1 · ran · b368ffa3c3d69f27
  17. transpose helper · level 1 · ran; the contract check could not run · 8f1a49e9d8b29d83
  18. PeftType helper · level 0 · unverified · ad8420238d39e438
  19. is_auto_gptq_available helper · level 1 · ran · 9027fb9844632cf2
  20. is_bnb_available helper · level 1 · ran · d82bb63b6ee3c783
  21. PeftConfigMixin helper · level 1 · ran · 867983846f2ffb06
  22. TaskType helper · level 0 · unverified · 258dc95ececd559e

harvested Assembly for Low-Rank Adaptation (LoRA) (graph method: Low-Rank Adaptation (LoRA)). 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 21 siblings

  1. LoRALinear entry · level 1 · ran · d91b99d50ee2e13b

harvested Assembly for Low-Rank Adaptation (LoRA) (graph method: Low-Rank Adaptation (LoRA)). 1 brick; individually on a fixture: 0 ran · 1 unverified. The assembly has not been run end-to-end.

one of 21 siblings

  1. LoraLinear entry · level 0 · unverified · 399aed0da4b85280

harvested Assembly for Low-Rank Adaptation (LoRA) (graph method: Low-Rank Adaptation (LoRA)). 1 brick; individually on a fixture: 0 ran · 1 unverified. The assembly has not been run end-to-end.

one of 21 siblings

  1. PeftModelForCausalLM entry · level 0 · unverified · 551a5af99158f91b

harvested Assembly for Low-Rank Adaptation (LoRA) (graph method: Low-Rank Adaptation (LoRA)). 12 bricks; individually on a fixture: 8 ran (of which 4 constructed an object rather than computing a result; 6 with no instrument failure: 0 honoured, 0 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 4 unverified. The assembly has not been run end-to-end.

one of 21 siblings

  1. LoraModel entry · level 0 · unverified · 4e64816ecd5d8675
  2. Conv2d model · level 1 · ran · f156ba83a62bfd88
  3. Embedding model · level 1 · ran · 1d022836585085cb
  4. Linear model · level 1 · ran · 1f506a3641c40fac
  5. LoraLayer model · level 0 · unverified · 4e130d790f7e7dcd
  6. ModulesToSaveWrapper helper · level 1 · ran · 5e92a950d55ba432
  7. _freeze_adapter helper · level 0 · unverified · 599fe61280ffc433
  8. _get_submodules helper · level 1 · ran · our draft was wrong · 127b2b488cacb9c4
  9. is_bnb_4bit_available helper · level 1 · ran · 7d44a88878819ef3
  10. is_bnb_available helper · level 1 · ran · d82bb63b6ee3c783
  11. mark_only_lora_as_trainable update_rule · level 0 · unverified · 84f4e84719d66f4c
  12. transpose helper · level 1 · ran; the contract check could not run · 8f1a49e9d8b29d83

harvested Assembly for Low-Rank Adaptation (LoRA) (graph method: Low-Rank Adaptation (LoRA)). 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 21 siblings

  1. LoRALinear entry · level 1 · ran · 0fa772920c405ed2

harvested Assembly for Low-Rank Adaptation (LoRA) (graph method: Low-Rank Adaptation (LoRA)). 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 21 siblings

  1. LoRALayer entry · level 1 · ran · 03b78b050e202a11

harvested Assembly for Low-Rank Adaptation (LoRA) (graph method: Low-Rank Adaptation (LoRA)). 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 21 siblings

  1. LoraArguments entry · level 1 · ran · e9170e0ed6d12210

harvested Assembly for Low-Rank Adaptation (LoRA) (graph method: Low-Rank Adaptation (LoRA)). 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 21 siblings

  1. LoraInjectedLinear entry · level 1 · ran · d4f1b87ebb0746ff

harvested Assembly for Low-Rank Adaptation (LoRA) (graph method: Low-Rank Adaptation (LoRA)). 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 21 siblings

  1. LoraArguments entry · level 1 · ran · 33efd3e3245a8802

harvested Assembly for Low-Rank Adaptation (LoRA) (graph method: Low-Rank Adaptation (LoRA)). 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result. The assembly has not been run end-to-end.

one of 21 siblings

  1. LoraWeight entry · level 1 · ran · b6d5f1638edabb8a

harvested Assembly for Low-Rank Adaptation (LoRA) (graph method: Low-Rank Adaptation (LoRA)). 2 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified. The assembly has not been run end-to-end.

one of 21 siblings

  1. MultiHeadAttention entry · level 1 · ran · 7a1353c5e5ac87b5
  2. Linear helper · level 1 · ran · 57b8771890dd7b1b
  1. get_peft_lora_model · c323465a4b5ed133 · 3 bricks; individually on a fixture: 2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[12] in the JSON twin
  2. MultiHeadAttention · cdaa08d3bec71273 · 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[13] in the JSON twin
  3. LinearSuper · d2138626056fee4e · 3 bricks; individually on a fixture: 3 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[14] in the JSON twin
  4. merge_lora_model · d7c85625a6478ea6 · 5 bricks; individually on a fixture: 3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified · The assembly has not been run end-to-end · assemblies[15] in the JSON twin
  5. make_diff · da084a3172acebca · 2 bricks; individually on a fixture: 0 ran · 2 unverified · The assembly has not been run end-to-end · assemblies[16] in the JSON twin
  6. find_all_linear_names · eab2a0cf03cbf5e1 · 1 brick; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified · The assembly has not been run end-to-end · assemblies[17] in the JSON twin
  7. LoRALayer · edcb8fde700fddd9 · 1 brick; individually on a fixture: 1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result · The assembly has not been run end-to-end · assemblies[18] in the JSON twin
  8. LoraArguments · f33a8cf30e84ace6 · 1 brick; individually on a fixture: 0 ran · 1 unverified · The assembly has not been run end-to-end · assemblies[19] in the JSON twin
  9. LoRA_ViT_timm · fe4a200469f3f3ae · 2 bricks; individually on a fixture: 1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified · The assembly has not been run end-to-end · assemblies[20] in the JSON twin

Each brick ends with its code_sha256, Syntology's identity for that exact code; click one to copy the get_code call that returns it. For agents, on Syntology's MCP service: assembly(arxiv_id="2106.09685") returns these assemblies with each brick's role and wiring (how to connect).

Tasks

Language ModellingMathematical Reasoningparameter-efficient fine-tuning

1 archive task tag without a task page not shown.

Results from the paper archive 2025-07-28

TaskDatasetModelMetricValueRank at snapshotLeaderboardReport
Mathematical Reasoning AMC23 Math-Master Acc 82 #2 of 3 Archive leaderboard report
parameter-efficient fine-tuning BoolQ LLaMA2-7b Accuracy (% ) 80.28 #4 of 4 Archive leaderboard report
parameter-efficient fine-tuning HellaSwag LLaMA2-7b Accuracy (% ) 76.67 #2 of 3 Archive leaderboard report
parameter-efficient fine-tuning WinoGrande LLaMA2-7b Accuracy (% ) 69.85 #3 of 3 Archive leaderboard report

Ranks are positions in the archive's leaderboards as they stood at the 2025-07-28 snapshot. Results published since then are not among these rows, so a rank here is not a current standing.

Methods

Absolute Position EncodingsAdamAttentionAttention DropoutBERTBPECosine AnnealingDeBERTaDense ConnectionsDiscriminative Fine-TuningDropoutGPT-2GPT-3Label SmoothingLayer NormalizationLinear LayerLinear Warmup With Cosine AnnealingLinear Warmup With Linear DecayMulti-Head AttentionPosition-Wise Feed-Forward LayerResidual ConnectionRoBERTaSoftmaxTransformerWeight DecayWordPiece

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections