{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/code/get-metric","entry":"get_metric","source":"Syntology graph, per-sample; not an archive number","read_at":"2026-10-05T00:36:11+00:00","claim":"Names are grouped by exact entry-name string. Same-named routines are NOT asserted to be equivalent; 'ran' means executed on a synthesized fixture, not correctness. n_samples_ran = sum of by_status over every status except 'unverified' (ran_draft_wrong and ran_fixture are failures of Syntology's instrument, not of the code); n_papers_ran = papers with at least one such sample = n_papers_ran_no_instrument_failure (papers with a run with no instrument failure) + n_papers_ran_instrument_only (papers where every run was a failure of Syntology's instrument); n_samples_ran = n_samples_ran_checked (honoured, violated, no contract) + n_samples_instrument (failures of Syntology's instrument, not of the code).","status_vocabulary":{"ran_honours":"ran, honoured the contract we drafted","ran_violates":"ran, violated the contract we drafted","ran_draft_wrong":"ran; our contract draft was wrong, not the code","ran_fixture":"ran; the contract check could not run (RAISES, DEP_MISSING or TIMEOUT)","ran":"ran on a synthesized input","unverified":"unverified (harvested, no recorded run)"},"n_papers":19,"n_papers_ran":16,"n_papers_ran_no_instrument_failure":10,"n_papers_ran_instrument_only":6,"units":"n_samples, n_samples_ran, n_samples_fingerprinted and by_status count distinct code bodies (code_sha256); n_places and n_places_pointer_only count places, one per (paper, code body) pair, which is also the unit of the samples list","n_samples":20,"n_samples_ran":16,"n_samples_constructed":0,"n_samples_ran_checked":9,"n_samples_instrument":7,"n_samples_unverified":4,"n_samples_fingerprinted":6,"n_places":21,"n_places_pointer_only":2,"n_places_pointer_only_link_open":0,"inline_ok_is":"inline_ok is true only when both licence gates allow Syntology to serve this code's text: this paper's link (inline_ok_link, from the licence of this paper's copy) and the stored copy of the same code that Syntology serves, which may have been first harvested from another repository. withheld_clause is Syntology's own wording of which gate keeps the text a pointer and why, and is null when inline_ok is true. This site shows no code text either way; n_places_pointer_only_link_open counts the places where this paper's link allows the text and the stored copy does not","by_status":{"ran_honours":1,"ran_violates":1,"ran_draft_wrong":4,"ran_fixture":3,"ran":7,"unverified":4},"key_notes":{"n_samples_ran_checked":"legacy name, kept unchanged so existing readers do not break: it counts the samples that ran with no instrument failure (honoured, violated, and ran with no contract checked); it does not mean a contract was checked, and the pages print it as 'K with no instrument failure', not 'K checked'","n_samples_constructed":"a sub-count of the samples that ran, never subtracted from them and never a failure: an executed sample whose run returned an instance of its own class (fixture_out_type equals the entry name): the run built an object and did not compute a result (Syntology's RAN record, counts.constructed)"},"syntology":{"atlas_url":null,"mcp":null,"mcp_per_sample":{"tool":"get_code","arguments_in":"samples[].mcp_get_code"},"developers":"https://syntology.ai/developers"},"samples":[{"arxiv_id":"2505.23032","arxiv_id_is_arxiv":true,"paper":"/paper/bayesian-neural-scaling-laws-extrapolation","title":"Bayesian Neural Scaling Laws Extrapolation with Prior-Fitted Networks","date":"2025-05-29","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"dongwoolee-eli/nslpfn","path":"inference.py","file_url":"https://github.com/dongwoolee-eli/nslpfn/blob/HEAD/inference.py","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"invariant","behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"98177f96938533ef","code_sha256_prefix":"98177f96938533ef","mcp_get_code":{"code_sha256":"98177f96938533ef"}},{"arxiv_id":"2502.11986","arxiv_id_is_arxiv":true,"paper":"/paper/selective-task-group-updates-for-multi-task","title":"Selective Task Group Updates for Multi-Task Optimization","date":"2025-02-17","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"wooseong97/sel-update-mtl","path":"sel-update-mtl/utils/train_utils.py","file_url":"https://github.com/wooseong97/sel-update-mtl/blob/HEAD/sel-update-mtl/utils/train_utils.py","status":"ran_violates","verification_level":1,"contract_check":"VIOLATES","metamorphic_tier":"invariant","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"4799ae2084413fda","code_sha256_prefix":"4799ae2084413fda","mcp_get_code":{"code_sha256":"4799ae2084413fda"}},{"arxiv_id":"2409.02772","arxiv_id_is_arxiv":true,"paper":"/paper/unifying-causal-representation-learning-with","title":"Unifying Causal Representation Learning with the Invariance Principle","date":"2024-09-04","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"causallearningai/istant","path":"src/utils.py","file_url":"https://github.com/causallearningai/istant/blob/HEAD/src/utils.py","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"b22d0f8ac28b9717","code_sha256_prefix":"b22d0f8ac28b9717","mcp_get_code":{"code_sha256":"b22d0f8ac28b9717"}},{"arxiv_id":"2407.02112","arxiv_id_is_arxiv":true,"paper":"/paper/a-data-centric-perspective-on-evaluating","title":"A Data-Centric Perspective on Evaluating Machine Learning Models for Tabular Data","date":"2024-07-02","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"atschalz/dc_tabeval","path":"utils.py","file_url":"https://github.com/atschalz/dc_tabeval/blob/HEAD/utils.py","status":"ran_draft_wrong","verification_level":1,"contract_check":"OUTPUT_MISDECLARED","metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"53162b711345d934","code_sha256_prefix":"53162b711345d934","mcp_get_code":{"code_sha256":"53162b711345d934"}},{"arxiv_id":"2406.04759","arxiv_id_is_arxiv":true,"paper":"/paper/probabilistic-weather-forecasting-with","title":"Probabilistic Weather Forecasting with Hierarchical Graph Neural Networks","date":"2024-06-07","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"joeloskarsson/neural-lam","path":"neural_lam/metrics.py","file_url":"https://github.com/joeloskarsson/neural-lam/blob/HEAD/neural_lam/metrics.py","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"754c85f8fa7a35e7","code_sha256_prefix":"754c85f8fa7a35e7","mcp_get_code":{"code_sha256":"754c85f8fa7a35e7"}},{"arxiv_id":"2406.04759","arxiv_id_is_arxiv":true,"paper":"/paper/probabilistic-weather-forecasting-with","title":"Probabilistic Weather Forecasting with Hierarchical Graph Neural Networks","date":"2024-06-07","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"joeloskarsson/neural-lam-dev","path":"neural_lam/metrics.py","file_url":"https://github.com/joeloskarsson/neural-lam-dev/blob/HEAD/neural_lam/metrics.py","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"5e4a4870f3bf627d","code_sha256_prefix":"5e4a4870f3bf627d","mcp_get_code":{"code_sha256":"5e4a4870f3bf627d"}},{"arxiv_id":"2402.10426","arxiv_id_is_arxiv":true,"paper":"/paper/dell-generating-reactions-and-explanations","title":"DELL: Generating Reactions and Explanations for LLM-Based Misinformation Detection","date":"2024-02-16","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"whr000001/dell","path":"ensemble/confidence.py","file_url":"https://github.com/whr000001/dell/blob/HEAD/ensemble/confidence.py","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"55aa60d550a7a519","code_sha256_prefix":"55aa60d550a7a519","mcp_get_code":{"code_sha256":"55aa60d550a7a519"}},{"arxiv_id":"2402.10426","arxiv_id_is_arxiv":true,"paper":"/paper/dell-generating-reactions-and-explanations","title":"DELL: Generating Reactions and Explanations for LLM-Based Misinformation Detection","date":"2024-02-16","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"whr000001/dell","path":"ensemble/ensemble_utils.py","file_url":"https://github.com/whr000001/dell/blob/HEAD/ensemble/ensemble_utils.py","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"69b987d6d189b093","code_sha256_prefix":"69b987d6d189b093","mcp_get_code":{"code_sha256":"69b987d6d189b093"}},{"arxiv_id":"2306.16842","arxiv_id_is_arxiv":true,"paper":"/paper/tokenization-and-the-noiseless-channel","title":"Tokenization and the Noiseless Channel","date":"2023-06-29","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"zouharvi/tokenization-scorer","path":"tokenization_scorer/metrics.py","file_url":"https://github.com/zouharvi/tokenization-scorer/blob/HEAD/tokenization_scorer/metrics.py","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"4b7cef617d5cca71","code_sha256_prefix":"4b7cef617d5cca71","mcp_get_code":{"code_sha256":"4b7cef617d5cca71"}},{"arxiv_id":"2302.01524","arxiv_id_is_arxiv":true,"paper":"/paper/ordered-gnn-ordering-message-passing-to-deal","title":"Ordered GNN: Ordering Message Passing to Deal with Heterophily and Over-smoothing","date":"2023-02-03","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"lumia-group/orderedgnn","path":"task_node.py","file_url":"https://github.com/lumia-group/orderedgnn/blob/HEAD/task_node.py","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"c63f69f76b82bf84","code_sha256_prefix":"c63f69f76b82bf84","mcp_get_code":{"code_sha256":"c63f69f76b82bf84"}},{"arxiv_id":"2208.00108","arxiv_id_is_arxiv":true,"paper":"/paper/some-practice-for-improving-the-search","title":"Some Practice for Improving the Search Results of E-commerce","date":"2022-07-30","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"wufanyou/kdd-cup-2022-amazon","path":"utils/metric.py","file_url":"https://github.com/wufanyou/kdd-cup-2022-amazon/blob/HEAD/utils/metric.py","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"0fb0c7261afe47ce","code_sha256_prefix":"0fb0c7261afe47ce","mcp_get_code":{"code_sha256":"0fb0c7261afe47ce"}},{"arxiv_id":"2205.01753","arxiv_id_is_arxiv":true,"paper":"/paper/self-focusing-virtual-screening-with-active","title":"Self-focusing virtual screening with active design space pruning","date":"2022-05-03","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"coleygroup/molpal","path":"molpal/acquirer/metrics.py","file_url":"https://github.com/coleygroup/molpal/blob/HEAD/molpal/acquirer/metrics.py","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"0f7275ce83ed510e","code_sha256_prefix":"0f7275ce83ed510e","mcp_get_code":{"code_sha256":"0f7275ce83ed510e"}},{"arxiv_id":"2204.13653","arxiv_id_is_arxiv":true,"paper":"/paper/grit-general-robust-image-task-benchmark","title":"GRIT: General Robust Image Task Benchmark","date":"2022-04-28","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"allenai/grit_official","path":"evaluate.py","file_url":"https://github.com/allenai/grit_official/blob/HEAD/evaluate.py","status":"ran_honours","verification_level":1,"contract_check":"HONOURS","metamorphic_tier":"well_formed","behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"0721c0dabf3ece54","code_sha256_prefix":"0721c0dabf3ece54","mcp_get_code":{"code_sha256":"0721c0dabf3ece54"}},{"arxiv_id":"2108.03861","arxiv_id_is_arxiv":true,"paper":"/paper/knowledge-graph-augmented-political","title":"KGAP: Knowledge Graph Augmented Political Perspective Detection in News Media","date":"2021-08-09","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"BunsenFeng/news_stance_detection","path":"SemEval.py","file_url":"https://github.com/BunsenFeng/news_stance_detection/blob/HEAD/SemEval.py","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":false,"licence":"NONE","inline_ok":false,"inline_ok_link":false,"withheld_clause":"GitHub detected no licence in this paper's repository, BunsenFeng/news_stance_detection when it was checked","code_sha256":"b47d3b1ea7216a2d","code_sha256_prefix":"b47d3b1ea7216a2d","mcp_get_code":{"code_sha256":"b47d3b1ea7216a2d"}},{"arxiv_id":"2104.14757","arxiv_id_is_arxiv":true,"paper":"/paper/an-adversarial-transfer-network-for-knowledge","title":"An Adversarial Transfer Network for Knowledge Representation Learning","date":"2021-04-30","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"LemonNoel/ATransN","path":"src/convertor.py","file_url":"https://github.com/LemonNoel/ATransN/blob/HEAD/src/convertor.py","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":true,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"6dfb1c716b6c83a7","code_sha256_prefix":"6dfb1c716b6c83a7","mcp_get_code":{"code_sha256":"6dfb1c716b6c83a7"}},{"arxiv_id":"2008.11297","arxiv_id_is_arxiv":true,"paper":"/paper/transductive-information-maximization-for-few","title":"Transductive Information Maximization For Few-Shot Learning","date":"2020-08-25","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"mboudiaf/TIM","path":"src/models/ProtoNet.py","file_url":"https://github.com/mboudiaf/TIM/blob/HEAD/src/models/ProtoNet.py","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"235da783eeb0573f","code_sha256_prefix":"235da783eeb0573f","mcp_get_code":{"code_sha256":"235da783eeb0573f"}},{"arxiv_id":"2003.10555","arxiv_id_is_arxiv":true,"paper":"/paper/electra-pre-training-text-encoders-as-1","title":"ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators","date":"2020-03-23","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"YChen1993/ELECRec","path":"src/trainers.py","file_url":"https://github.com/YChen1993/ELECRec/blob/HEAD/src/trainers.py","status":"ran_fixture","verification_level":1,"contract_check":"RAISES","metamorphic_tier":"well_formed","behaviour_fingerprint":true,"licence":"BSD-3-Clause","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"ac6da27d75f60e2b","code_sha256_prefix":"ac6da27d75f60e2b","mcp_get_code":{"code_sha256":"ac6da27d75f60e2b"}},{"arxiv_id":"1912.04761","arxiv_id_is_arxiv":true,"paper":"/paper/sound-event-detection-of-weakly-labelled-data","title":"Sound Event Detection of Weakly Labelled Data with CNN-Transformer and Automatic Threshold Optimization","date":null,"month_inferred_from_arxiv_id":"2019-12","title_source":"archive","repo":"qiuqiangkong/sound_event_detection_dcase2017_task4","path":"utils/calculate_metrics.py","file_url":"https://github.com/qiuqiangkong/sound_event_detection_dcase2017_task4/blob/HEAD/utils/calculate_metrics.py","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":false,"inline_ok_link":false,"withheld_clause":"MIT, as GitHub detects it on this paper's repository, qiuqiangkong/sound_event_detection_dcase2017_task4, is in the permissive set, but a licence decision keeps the body a pointer: the reason for that decision is not recorded with it","code_sha256":"dc424c820e96f8a2","code_sha256_prefix":"dc424c820e96f8a2","mcp_get_code":{"code_sha256":"dc424c820e96f8a2"}},{"arxiv_id":"1911.04623","arxiv_id_is_arxiv":true,"paper":"/paper/simpleshot-revisiting-nearest-neighbor","title":"SimpleShot: Revisiting Nearest-Neighbor Classification for Few-Shot Learning","date":"2019-11-12","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"mileyan/simple_shot","path":"src/models/ProtoNet.py","file_url":"https://github.com/mileyan/simple_shot/blob/HEAD/src/models/ProtoNet.py","status":"ran","verification_level":1,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"235da783eeb0573f","code_sha256_prefix":"235da783eeb0573f","mcp_get_code":{"code_sha256":"235da783eeb0573f"}},{"arxiv_id":"1609.09799","arxiv_id_is_arxiv":true,"paper":"/paper/optimal-spectral-transportation-with","title":"Optimal spectral transportation with application to music transcription","date":"2016-09-30","month_inferred_from_arxiv_id":null,"title_source":"archive","repo":"rflamary/OST","path":"ost.py","file_url":"https://github.com/rflamary/OST/blob/HEAD/ost.py","status":"ran_draft_wrong","verification_level":1,"contract_check":"MISDECLARED","metamorphic_tier":"deterministic","behaviour_fingerprint":true,"licence":"MIT","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"e5de15a2ddaf4e49","code_sha256_prefix":"e5de15a2ddaf4e49","mcp_get_code":{"code_sha256":"e5de15a2ddaf4e49"}},{"arxiv_id":"2021.findings-emnlp.152","arxiv_id_is_arxiv":false,"paper":null,"title":"ACL Anthology id 2021.findings-emnlp.152","date":null,"month_inferred_from_arxiv_id":null,"title_source":null,"repo":"ruidan/IMN-E2E-ABSA","path":"code/evaluation.py","file_url":"https://github.com/ruidan/IMN-E2E-ABSA/blob/HEAD/code/evaluation.py","status":"unverified","verification_level":0,"contract_check":null,"metamorphic_tier":null,"behaviour_fingerprint":false,"licence":"Apache-2.0","inline_ok":true,"inline_ok_link":true,"withheld_clause":null,"code_sha256":"13e12c365a1499e9","code_sha256_prefix":"13e12c365a1499e9","mcp_get_code":{"code_sha256":"13e12c365a1499e9"}}],"record_sha256":"68b0c809991234438c2b0214495cee90f39b8bdebcdc012c737a732d97c18c0c","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}