Home › Code › exact_match

exact_match

Syntologyentry name in harvested code

Syntology's record for this page last changed ; when this build read Syntology's graph is in the build record.

exact_match appears in the code Syntology harvested for 23 papers, as 22 distinct code bodies found in 23 places (a place is one code body under one paper). Of the 23 papers, 23 with a sample that ran: 21 with a run with no instrument failure, 2 where every run was a failure of Syntology's instrument. 14 of the code bodies carry a behaviour fingerprint.

What this page is not. Routines are grouped here by the exact string of their function or class name. Nothing asserts that two samples named exact_match do the same thing, share code, or are comparable; the name is a string, not an identity. Behaviour outputs (what a fingerprinted sample returned on the shared battery) are not in this export and are not shown here; get_code(code_sha256="…") returns this sample's fingerprint on the shared battery, with the battery's shuffled null and lift; not shown on this site (how to connect). "Ran" means executed on a synthesized fixture, not that the code is correct or reproduces a paper.

Samples Syntology

The 22 distinct code bodies named exact_match: 22 ran (of which 0 constructed an object rather than computing a result; 20 with no instrument failure: 5 honoured, 9 violated, 6 with no contract checked; 2 where Syntology's instrument failed) · 0 unverified. “Where Syntology's instrument failed” counts failures of Syntology's instrument, not of the code. One tile per status, in the site's fixed vocabulary, each code body counted once:

5ran · honoured contract
9ran · violated contract
2ran · our draft was wrong
0ran; the contract check could not run
6ran
0unverified
14fingerprinted

Licence is a property of each copy, so it is counted per place: 8 of the 23 places are pointer only (Syntology does not serve that copy's text). This site shows no code text for any sample; every row below links to the file in its repository where the record names one.

“Ran” means the sample executed on a synthesized input; it does not mean the output is correct. “Honoured” and “violated” refer to a contract Syntology drafted from the code itself; “our draft was wrong” and “the contract check could not run” (RAISES, DEP_MISSING or TIMEOUT; hover a row's label for which) are failures of Syntology's instrument, not of the code, and those samples did run. The ran count above is every status except unverified, the same rule as each paper page; “with no instrument failure” is honoured, violated and ran with no contract checked. A metamorphic tier, where shown, is evidence of the output's shape, not that the sample implements the method.

Papers

23 papers shown of 23, newest first; 23 places in the table. A paper with no recorded date is placed by the month its arXiv id encodes, shown in the Date column as YYYY-MM (from id). One row per place: a paper whose repository defines the name more than once appears more than once, and the same code body held for several papers appears once under each, with the same status. Titles and dates are the archive's archive 2025-07-28 for papers in the archive, and the graph's for 9 papers added by Syntology; 1 papers have no page here and are shown by their id only (arXiv: for an arXiv id; an id from another venue, such as ACL Anthology or AAAI, is named as that venue's id, never as an arXiv id). Status and fingerprint are Syntology's record of each code body; licence is recorded for each place. The File cell ends with the code body's code_sha256. A sample's code_sha256 is Syntology's identity for that exact code. It is printed in full (16 hexadecimal characters for every sample in this build), and get_code(code_sha256="…") takes it exactly as printed. An agent calls it on Syntology's MCP service (how to connect); click an identity to copy that call.

PaperDateFileStatus SyntologyLicence
Model of Models: When Does Emitting a Specialist Beat Attending, Adapting, or Tuning? A Controlled Cross-Domain Study of Amortized Weight Generation added by Syntology 2026-08 (from id) johnchowell/Model-of-Models/exp16_arc.py 8b3aae2b84b3210e ran · our draft was wrong fingerprinted MIT (permissive)
Beyond "What to Retrieve": Uncertainty in Retrieval-Augmented Code Generation added by Syntology 2026-07 (from id) Rocky5502/OpenCoder_V1/opencoder/evaluation/metrics.py 095c99ea52e24d66 ran · honoured contract fingerprinted MIT (permissive)
RIMS: Preference Optimization via Smoothed Multi-pair Aggregation for Small-Scale LLM Retrieval-Augmented Generation added by Syntology 2026-07 (from id) tptrix29/RIMS/baseline/baseline_instructrag.py 693e3eb42781f873 ran · violated contract fingerprinted MIT (permissive)
DMF: A Deterministic Memory Framework for Conversational AI Agents added by Syntology 2026-06 (from id) matstech/dmf-benchmarks/dmf_bench/benchmarks/locomo/rigorous.py 6aea303b6aec6c67 ran · honoured contract fingerprinted MIT (permissive)
ComplexMCP: Evaluation of LLM Agents in Dynamic, Interdependent, and Large-Scale Tool Sandbox added by Syntology 2026-05 (from id) AIDC-AI/complex-mcp/benchmark/judge.py 051ed74b766c82aa ran · violated contract fingerprinted MIT (permissive)
RSAT: Structured Attribution Makes Small Language Models Faithful Table Reasoners added by Syntology 2026-05 (from id) JugalGajjar/RSAT/src/rewards/answer_reward.py 8200854ddbd775fd ran · honoured contract fingerprinted MIT (permissive)
Reinforcement Learning with Conditional Expectation Reward added by Syntology 2026-03 (from id) changyi7231/CER/recipe/cer/src/reward_manager.py bacda3216fdce102 ran · our draft was wrong fingerprinted Apache-2.0 (permissive)
Small Reward Models via Backward Inference added by Syntology 2026-02 (from id) yikee/FLIP/open-instruct/decontamination/search.py b9ce489e37ca0182 ran no licence file found · pointer only
EverTracer: Hunting Stolen Large Language Models via Stealthy and Robust Probabilistic Fingerprint added by Syntology 2025-09 (from id) Xuzhenhua55/EverTracer/Utils/evaluation.py ab51854fed6480f7 ran fingerprinted no licence file found · pointer only
Data Whisperer: Efficient Data Selection for Task-Specific LLM Fine-Tuning via Few-Shot In-Context Learning 18 May 2025 gszfwsb/Data-Whisperer/pruning/datawhisperer_gsm_pruner.py 7d4e720c5eec0e6f ran · violated contract fingerprinted no licence file found · pointer only
Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models 25 Mar 2025 stogiannidis/srbench/src/eval/acc.py 512557f1eb973e22 ran fingerprinted MIT (permissive)
SMARTCAL: An Approach to Self-Aware Tool-Use Evaluation and Calibration 11 Dec 2024 Henrysyh2000/SMARTCAL/ART_SM_CAL/art_uw.py a442b0bd917515d1 ran · honoured contract MIT (permissive)
SURf: Teaching Large Vision-Language Models to Selectively Utilize Retrieved Information 21 Sep 2024 GasolSun36/SURf/initial/tool_evaluate.py 442f044af42b5b3f ran · violated contract fingerprinted no licence file found · pointer only
Generate-on-Graph: Treat LLM as both Agent and KG in Incomplete Knowledge Graph Question Answering 23 Apr 2024 YaooXu/GoG/src/evaluate.py d37ef44866e11f1d ran · violated contract no licence file found · pointer only
IDGenRec: LLM-RecSys Alignment with Textual ID Learning 27 Mar 2024 agiresearch/idgenrec/src/utils/generation_trie.py ddaa9fa31e2c803d ran no licence file found · pointer only
Online Adaptation of Language Models with a Memory of Amortized Contexts 7 Mar 2024 jihoontack/mac/models/amortized_encdec.py 64702a446a4111bd ran · violated contract MIT (permissive)
PromptKD: Distilling Student-Friendly Knowledge for Generative Language Models via Prompt Tuning 20 Feb 2024 gmkim-ai/promptkd/rouge_metric.py 61c5ad3a7b3c5731 ran · violated contract MIT (permissive)
Prompt Optimization via Adversarial In-Context Learning 5 Dec 2023 zhaoyiran924/adv-in-context-learning/eval/automatic/evaluation.py 41e978babf390372 ran · violated contract no licence file found · pointer only
Can Large Language Models be Good Path Planners? A Benchmark and Investigation on Spatial-temporal Reasoning 5 Oct 2023 mohamedaghzal/llms-as-path-planners/gpt-4-path-planning/src/evaluate.py 806fb301720451ec ran fingerprinted no licence file found · pointer only
Coloring the Blank Slate: Pre-training Imparts a Hierarchical Inductive Bias to Sequence-to-sequence Models 17 Mar 2022 sebschu/multilingual-transformations/models/metrics.py 66552297bbb6cd38 ran · honoured contract MIT (permissive)
Scale Efficiently: Insights from Pre-training and Fine-tuning Transformers 22 Sep 2021 aaronmueller/emergent-syntax/models/metrics.py 66552297bbb6cd38 ran · honoured contract MIT (permissive)
Quasar: Datasets for Question Answering by Search and Reading 12 Jul 2017 bdhingra/quasar/metric.py 8c2b5b40e8ea29f0 ran · violated contract fingerprinted BSD-2-Clause (permissive)
ACL Anthology id 2023.findings-emnlp.221 RshNk73/PistaQ-SREQA/PistaQ/triplet_extraction_NN_coref_rule_block.py fec01a8869724531 ran fingerprinted MIT (permissive)

This site shows no code text; each File cell links to the file on GitHub at the repository's current default branch, which may have changed since the harvest. "Pointer only" means Syntology does not serve that copy's text, for one of six reasons: no licence file was found; the licence was not identified; the licence is recorded as permissive but that copy's record is not marked cleared; the licence is outside the permissive list Syntology serves text under (MIT, Apache-2.0, BSD and similar); this paper's copy was not located, so its licence is not recorded; or this paper's copy is under a permissive licence, but the stored copy of the same code that Syntology serves is not cleared for its text. Some licences outside that list permit redistribution, such as WTFPL, and GPL-3.0 under its conditions; they are simply not on the list. Hover a licence cell for the reason. Per-sample records for a paper are on its paper page under "Code Syntology ran".

Report a problem or propose a change · a person checks every report against the paper or source before anything changes; decisions are listed on /corrections