{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/multi-head-attention","slug":"multi-head-attention","name":"Multi-Head Attention","full_name":"Multi-Head Attention","full_name_withheld":false,"description_markdown":"**Multi-head Attention** is a module for attention mechanisms which runs through an attention mechanism several times in parallel. The independent attention outputs are then concatenated and linearly transformed into the expected dimension. Intuitively, multiple attention heads allows for attending to parts of the sequence differently (e.g. longer-term dependencies versus shorter-term dependencies). \r\n\r\n$$ \\text{MultiHead}\\left(\\textbf{Q}, \\textbf{K}, \\textbf{V}\\right) = \\left[\\text{head}\\_{1},\\dots,\\text{head}\\_{h}\\right]\\textbf{W}_{0}$$\r\n\r\n$$\\text{where} \\text{ head}\\_{i} = \\text{Attention} \\left(\\textbf{Q}\\textbf{W}\\_{i}^{Q}, \\textbf{K}\\textbf{W}\\_{i}^{K}, \\textbf{V}\\textbf{W}\\_{i}^{V} \\right) $$\r\n\r\nAbove $\\textbf{W}$ are all learnable parameter matrices.\r\n\r\nNote that [scaled dot-product attention](https://paperswithcode.com/method/scaled) is most commonly used in this module, although in principle it can be swapped out for other types of attention mechanism.\r\n\r\nSource: [Lilian Weng](https://lilianweng.github.io/lil-log/2018/06/24/attention-attention.html#a-family-of-attention-mechanisms)","description_state":"present","introduced_year":null,"introduced_by":{"title":null,"paper":null,"first_author":null,"n_authors":0,"url_abs":null,"archive_paper_url":null},"source":{"url":"https://arxiv.org/abs/1706.03762v7","title":"Attention Is All You Need","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/jadore801120/attention-is-all-you-need-pytorch/blob/fec78a687210851f055f792d45300d27cc60ae41/transformer/SubLayers.py#L9","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Attention Modules","url":"/methods/category/attention-modules","pwc_aliases":[]}],"n_papers_tagged":24855,"archive_num_papers":null,"papers_newest_first":[{"paper":null,"slug":"2506-10330","title":"Augmenting Large Language Models with Static Code Analysis for Automated Code Quality Improvements","date":"2025-06-12","arxiv_id":"2506.10330","n_code_links":0,"syntology":null},{"paper":"/paper/ciir-liverag-2025-optimizing-multi-agent","slug":"ciir-liverag-2025-optimizing-multi-agent","title":"CIIR@LiveRAG 2025: Optimizing Multi-Agent Retrieval Augmented Generation through Self-Training","date":"2025-06-12","arxiv_id":"2506.10844","n_code_links":1,"syntology":null},{"paper":"/paper/constructing-and-evaluating-declarative-rag","slug":"constructing-and-evaluating-declarative-rag","title":"Constructing and Evaluating Declarative RAG Pipelines in PyTerrier","date":"2025-06-12","arxiv_id":"2506.10802","n_code_links":1,"syntology":null},{"paper":"/paper/dart-differentiable-dynamic-adaptive-region","slug":"dart-differentiable-dynamic-adaptive-region","title":"DART: Differentiable Dynamic Adaptive Region Tokenizer for Vision Transformer and Mamba","date":"2025-06-12","arxiv_id":"2506.10390","n_code_links":1,"syntology":null},{"paper":"/paper/decomposing-mlp-activations-into","slug":"decomposing-mlp-activations-into","title":"Decomposing MLP Activations into Interpretable Features via Semi-Nonnegative Matrix Factorization","date":"2025-06-12","arxiv_id":"2506.10920","n_code_links":1,"syntology":null},{"paper":"/paper/neuralnexus-at-bea-2025-shared-task-retrieval","slug":"neuralnexus-at-bea-2025-shared-task-retrieval","title":"NeuralNexus at BEA 2025 Shared Task: Retrieval-Augmented Prompting for Mistake Identification in AI Tutors","date":"2025-06-12","arxiv_id":"2506.10627","n_code_links":1,"syntology":null},{"paper":"/paper/pipvit-patch-based-visual-interpretable","slug":"pipvit-patch-based-visual-interpretable","title":"PiPViT: Patch-based Visual Interpretable Prototypes for Retinal Image Analysis","date":"2025-06-12","arxiv_id":"2506.10669","n_code_links":1,"syntology":null},{"paper":null,"slug":"reasoning-rag-via-system-1-or-system-2-a","title":"Reasoning RAG via System 1 or System 2: A Survey on Reasoning Agentic Retrieval-Augmented Generation for Industry Challenges","date":"2025-06-12","arxiv_id":"2506.10408","n_code_links":0,"syntology":null},{"paper":"/paper/tablerag-a-retrieval-augmented-generation","slug":"tablerag-a-retrieval-augmented-generation","title":"TableRAG: A Retrieval Augmented Generation Framework for Heterogeneous Document Reasoning","date":"2025-06-12","arxiv_id":"2506.10380","n_code_links":1,"syntology":null},{"paper":"/paper/towards-robust-multimodal-emotion-recognition","slug":"towards-robust-multimodal-emotion-recognition","title":"Towards Robust Multimodal Emotion Recognition under Missing Modalities and Distribution Shifts","date":"2025-06-12","arxiv_id":"2506.10452","n_code_links":1,"syntology":null},{"paper":"/paper/2506-10174","slug":"2506-10174","title":"Retrieval of Surface Solar Radiation through Implicit Albedo Recovery from Temporal Context","date":"2025-06-11","arxiv_id":"2506.10174","n_code_links":1,"syntology":null},{"paper":null,"slug":"a-novel-lightweight-transformer-with-edge","title":"A Novel Lightweight Transformer with Edge-Aware Fusion for Remote Sensing Image Captioning","date":"2025-06-11","arxiv_id":"2506.09429","n_code_links":0,"syntology":null},{"paper":null,"slug":"auto-compressing-networks","title":"Auto-Compressing Networks","date":"2025-06-11","arxiv_id":"2506.09714","n_code_links":0,"syntology":null},{"paper":"/paper/learning-efficient-and-generalizable-graph","slug":"learning-efficient-and-generalizable-graph","title":"Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answering","date":"2025-06-11","arxiv_id":"2506.09645","n_code_links":1,"syntology":null},{"paper":"/paper/llm-powered-cpi-prediction-inference-with","slug":"llm-powered-cpi-prediction-inference-with","title":"LLM-Powered CPI Prediction Inference with Online Text Time Series","date":"2025-06-11","arxiv_id":"2506.09516","n_code_links":1,"syntology":null},{"paper":null,"slug":"measuring-corporate-human-capital-disclosures","title":"Measuring Corporate Human Capital Disclosures: Lexicon, Data, Code, and Research Opportunities","date":"2025-06-11","arxiv_id":"2506.10155","n_code_links":0,"syntology":null},{"paper":null,"slug":"sparsessm-efficient-selective-structured","title":"SparseSSM: Efficient Selective Structured State Space Models Can Be Pruned in One-Shot","date":"2025-06-11","arxiv_id":"2506.09613","n_code_links":0,"syntology":null},{"paper":null,"slug":"you-are-what-you-say-exploiting-linguistic","title":"You Are What You Say: Exploiting Linguistic Content for VoicePrivacy Attacks","date":"2025-06-11","arxiv_id":"2506.09521","n_code_links":0,"syntology":null},{"paper":"/paper/2506-10030","slug":"2506-10030","title":"Safeguarding Multimodal Knowledge Copyright in the RAG-as-a-Service Environment","date":"2025-06-10","arxiv_id":"2506.10030","n_code_links":1,"syntology":null},{"paper":null,"slug":"arareasoner-evaluating-reasoning-based-llms","title":"AraReasoner: Evaluating Reasoning-Based LLMs for Arabic NLP","date":"2025-06-10","arxiv_id":"2506.08768","n_code_links":0,"syntology":null},{"paper":null,"slug":"biolangfusion-multimodal-fusion-of-dna-mrna","title":"BioLangFusion: Multimodal Fusion of DNA, mRNA, and Protein Language Models","date":"2025-06-10","arxiv_id":"2506.08936","n_code_links":0,"syntology":null},{"paper":null,"slug":"cc-rag-structured-multi-hop-reasoning-via","title":"CC-RAG: Structured Multi-Hop Reasoning via Theme-Based Causal Graphs","date":"2025-06-10","arxiv_id":"2506.08364","n_code_links":0,"syntology":null},{"paper":"/paper/dragged-into-conflicts-detecting-and","slug":"dragged-into-conflicts-detecting-and","title":"DRAGged into Conflicts: Detecting and Addressing Conflicting Sources in Search-Augmented LLMs","date":"2025-06-10","arxiv_id":"2506.08500","n_code_links":1,"syntology":null},{"paper":"/paper/evaluating-llms-across-multi-cognitive-levels","slug":"evaluating-llms-across-multi-cognitive-levels","title":"Evaluating LLMs Across Multi-Cognitive Levels: From Medical Knowledge Mastery to Scenario-Based Problem Solving","date":"2025-06-10","arxiv_id":"2506.08349","n_code_links":1,"syntology":{"ran":3,"of":3,"n_ran_checked":0,"n_instrument":3,"unverified":0,"pointer_only":3,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 0 unverified","official":{"repos":["thumlp/multicogeval"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/faithfulrag-fact-level-conflict-modeling-for","slug":"faithfulrag-fact-level-conflict-modeling-for","title":"FaithfulRAG: Fact-Level Conflict Modeling for Context-Faithful Retrieval-Augmented Generation","date":"2025-06-10","arxiv_id":"2506.08938","n_code_links":1,"syntology":null},{"paper":"/paper/fedrag-a-framework-for-fine-tuning-retrieval","slug":"fedrag-a-framework-for-fine-tuning-retrieval","title":"FedRAG: A Framework for Fine-Tuning Retrieval-Augmented Generation Systems","date":"2025-06-10","arxiv_id":"2506.09200","n_code_links":1,"syntology":null},{"paper":null,"slug":"fine-grained-spatially-varying-material","title":"Fine-Grained Spatially Varying Material Selection in Images","date":"2025-06-10","arxiv_id":"2506.09023","n_code_links":0,"syntology":null},{"paper":null,"slug":"floorplanmae-a-self-supervised-framework-for","title":"FloorplanMAE:A self-supervised framework for complete floorplan generation from partial inputs","date":"2025-06-10","arxiv_id":"2506.08363","n_code_links":0,"syntology":null},{"paper":null,"slug":"hierarchical-neural-collapse-detection","title":"Hierarchical Neural Collapse Detection Transformer for Class Incremental Object Detection","date":"2025-06-10","arxiv_id":"2506.08562","n_code_links":0,"syntology":null},{"paper":"/paper/hyperspectral-image-classification-via","slug":"hyperspectral-image-classification-via","title":"Hyperspectral Image Classification via Transformer-based Spectral-Spatial Attention Decoupling and Adaptive Gating","date":"2025-06-10","arxiv_id":"2506.08324","n_code_links":1,"syntology":null},{"paper":null,"slug":"medmoe-modality-specialized-mixture-of","title":"MedMoE: Modality-Specialized Mixture of Experts for Medical Vision-Language Understanding","date":"2025-06-10","arxiv_id":"2506.08356","n_code_links":0,"syntology":null},{"paper":"/paper/olica-efficient-structured-pruning-of-large","slug":"olica-efficient-structured-pruning-of-large","title":"Olica: Efficient Structured Pruning of Large Language Models without Retraining","date":"2025-06-10","arxiv_id":"2506.08436","n_code_links":1,"syntology":{"ran":4,"of":10,"n_ran_checked":3,"n_instrument":1,"unverified":6,"pointer_only":10,"phrase":"4 ran (of which 2 constructed an object rather than computing a result; 3 with no instrument failure: 1 honoured, 0 violated, 2 with no contract checked; 1 where Syntology's instrument failed) · 6 unverified","official":{"repos":["bettertmrr/llm-olica"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":2,"n_ran_no_instrument_failure":3,"n_unverified":6,"ran_from_kinds":["official"]}}},{"paper":"/paper/patchguard-adversarially-robust-anomaly-1","slug":"patchguard-adversarially-robust-anomaly-1","title":"PatchGuard: Adversarially Robust Anomaly Detection and Localization through Vision Transformers and Pseudo Anomalies","date":"2025-06-10","arxiv_id":"2506.09237","n_code_links":2,"syntology":null},{"paper":null,"slug":"robust-visual-localization-via-semantic","title":"Robust Visual Localization via Semantic-Guided Multi-Scale Transformer","date":"2025-06-10","arxiv_id":"2506.08526","n_code_links":0,"syntology":null},{"paper":"/paper/tactic-translation-agents-with-cognitive","slug":"tactic-translation-agents-with-cognitive","title":"TACTIC: Translation Agents with Cognitive-Theoretic Interactive Collaboration","date":"2025-06-10","arxiv_id":"2506.08403","n_code_links":1,"syntology":null},{"paper":null,"slug":"the-predictive-brain-neural-correlates-of","title":"The Predictive Brain: Neural Correlates of Word Expectancy Align with Large Language Model Prediction Probabilities","date":"2025-06-10","arxiv_id":"2506.08511","n_code_links":0,"syntology":null},{"paper":null,"slug":"time-series-representations-for","title":"Time Series Representations for Classification Lie Hidden in Pretrained Vision Transformers","date":"2025-06-10","arxiv_id":"2506.08641","n_code_links":0,"syntology":null},{"paper":null,"slug":"4dgt-learning-a-4d-gaussian-transformer-using","title":"4DGT: Learning a 4D Gaussian Transformer Using Real-World Monocular Videos","date":"2025-06-09","arxiv_id":"2506.08015","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-comprehensive-study-of-decoder-only-llms-1","title":"A Comprehensive Study of Decoder-Only LLMs for Text-to-Image Generation","date":"2025-06-09","arxiv_id":"2506.08210","n_code_links":0,"syntology":null},{"paper":null,"slug":"generative-voice-bursts-during-phone-call","title":"Generative Voice Bursts during Phone Call","date":"2025-06-09","arxiv_id":"2506.07526","n_code_links":0,"syntology":null},{"paper":"/paper/hierarchical-lexical-graph-for-enhanced-multi","slug":"hierarchical-lexical-graph-for-enhanced-multi","title":"Hierarchical Lexical Graph for Enhanced Multi-Hop Retrieval","date":"2025-06-09","arxiv_id":"2506.08074","n_code_links":1,"syntology":null},{"paper":null,"slug":"lightweight-sequential-transformers-for-blood","title":"Lightweight Sequential Transformers for Blood Glucose Level Prediction in Type-1 Diabetes","date":"2025-06-09","arxiv_id":"2506.07864","n_code_links":0,"syntology":null},{"paper":"/paper/llamarec-lkg-rag-a-single-pass-learnable","slug":"llamarec-lkg-rag-a-single-pass-learnable","title":"LlamaRec-LKG-RAG: A Single-Pass, Learnable Knowledge Graph-RAG Framework for LLM-Based Ranking","date":"2025-06-09","arxiv_id":"2506.07449","n_code_links":1,"syntology":null},{"paper":null,"slug":"llm-driven-indoor-scene-layout-generation-via","title":"LLM-driven Indoor Scene Layout Generation via Scaled Human-aligned Data Synthesis and Multi-Stage Preference Optimization","date":"2025-06-09","arxiv_id":"2506.07570","n_code_links":0,"syntology":null},{"paper":null,"slug":"madformer-mixed-autoregressive-and-diffusion","title":"MADFormer: Mixed Autoregressive and Diffusion Transformers for Continuous Image Generation","date":"2025-06-09","arxiv_id":"2506.07999","n_code_links":0,"syntology":null},{"paper":null,"slug":"multilingual-hate-speech-detection-in-social","title":"Multilingual Hate Speech Detection in Social Media Using Translation-Based Approaches with Large Language Models","date":"2025-06-09","arxiv_id":"2506.08147","n_code_links":0,"syntology":null},{"paper":null,"slug":"quantum-graph-transformer-for-nlp-sentiment","title":"Quantum Graph Transformer for NLP Sentiment Classification","date":"2025-06-09","arxiv_id":"2506.07937","n_code_links":0,"syntology":null},{"paper":null,"slug":"scenerag-scene-level-retrieval-augmented","title":"SceneRAG: Scene-level Retrieval-Augmented Generation for Video Understanding","date":"2025-06-09","arxiv_id":"2506.07600","n_code_links":0,"syntology":null},{"paper":null,"slug":"quality-diversity-red-teaming-automated","title":"Quality-Diversity Red-Teaming: Automated Generation of High-Quality and Diverse Attackers for Large Language Models","date":"2025-06-08","arxiv_id":"2506.07121","n_code_links":0,"syntology":null},{"paper":null,"slug":"breaking-data-silos-towards-open-and-scalable","title":"Breaking Data Silos: Towards Open and Scalable Mobility Foundation Models via Generative Continual Learning","date":"2025-06-07","arxiv_id":"2506.06694","n_code_links":0,"syntology":null},{"paper":null,"slug":"can-in-context-reinforcement-learning-recover","title":"Can In-Context Reinforcement Learning Recover From Reward Poisoning Attacks?","date":"2025-06-07","arxiv_id":"2506.06891","n_code_links":0,"syntology":null},{"paper":null,"slug":"robocerebra-a-large-scale-benchmark-for-long","title":"RoboCerebra: A Large-scale Benchmark for Long-horizon Robotic Manipulation Evaluation","date":"2025-06-07","arxiv_id":"2506.06677","n_code_links":0,"syntology":null},{"paper":null,"slug":"beast-efficient-tokenization-of-b-splines","title":"BEAST: Efficient Tokenization of B-Splines Encoded Action Sequences for Imitation Learning","date":"2025-06-06","arxiv_id":"2506.06072","n_code_links":0,"syntology":null},{"paper":null,"slug":"direct-behavior-optimization-unlocking-the","title":"Direct Behavior Optimization: Unlocking the Potential of Lightweight LLMs","date":"2025-06-06","arxiv_id":"2506.06401","n_code_links":0,"syntology":null},{"paper":"/paper/joint-gcg-unified-gradient-based-poisoning","slug":"joint-gcg-unified-gradient-based-poisoning","title":"Joint-GCG: Unified Gradient-Based Poisoning Attacks on Retrieval-Augmented Generation Systems","date":"2025-06-06","arxiv_id":"2506.06151","n_code_links":1,"syntology":null},{"paper":null,"slug":"textile-analysis-for-recycling-automation","title":"Textile Analysis for Recycling Automation using Transfer Learning and Zero-Shot Foundation Models","date":"2025-06-06","arxiv_id":"2506.06569","n_code_links":0,"syntology":null},{"paper":null,"slug":"the-lock-in-hypothesis-stagnation-by","title":"The Lock-in Hypothesis: Stagnation by Algorithm","date":"2025-06-06","arxiv_id":"2506.06166","n_code_links":0,"syntology":null},{"paper":"/paper/when-to-use-graphs-in-rag-a-comprehensive","slug":"when-to-use-graphs-in-rag-a-comprehensive","title":"When to use Graphs in RAG: A Comprehensive Analysis for Graph Retrieval-Augmented Generation","date":"2025-06-06","arxiv_id":"2506.05690","n_code_links":1,"syntology":{"ran":5,"of":5,"n_ran_checked":5,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"5 ran (of which 0 constructed an object rather than computing a result; 5 with no instrument failure: 0 honoured, 0 violated, 5 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["graphrag-bench/graphrag-benchmark"],"state":"official (archive's flag): 5 ran","n_ran":5,"n_constructed":0,"n_ran_no_instrument_failure":5,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/2506-05041","slug":"2506-05041","title":"DACN: Dual-Attention Convolutional Network for Hyperspectral Image Super-Resolution","date":"2025-06-05","arxiv_id":"2506.05041","n_code_links":1,"syntology":null},{"paper":null,"slug":"a-multi-dataset-evaluation-of-models-for","title":"A Multi-Dataset Evaluation of Models for Automated Vulnerability Repair","date":"2025-06-05","arxiv_id":"2506.04987","n_code_links":0,"syntology":null},{"paper":null,"slug":"design-of-intelligent-proofreading-system-for","title":"Design of intelligent proofreading system for English translation based on CNN and BERT","date":"2025-06-05","arxiv_id":"2506.04811","n_code_links":0,"syntology":null},{"paper":null,"slug":"dissecting-bias-in-llms-a-mechanistic","title":"Dissecting Bias in LLMs: A Mechanistic Interpretability Perspective","date":"2025-06-05","arxiv_id":"2506.05166","n_code_links":0,"syntology":null},{"paper":null,"slug":"dynamic-context-tuning-for-retrieval","title":"Dynamic Context Tuning for Retrieval-Augmented Generation: Enhancing Multi-Turn Planning and Tool Adaptation","date":"2025-06-05","arxiv_id":"2506.11092","n_code_links":0,"syntology":null},{"paper":"/paper/ecorag-evidentiality-guided-compression-for","slug":"ecorag-evidentiality-guided-compression-for","title":"ECoRAG: Evidentiality-guided Compression for Long Context RAG","date":"2025-06-05","arxiv_id":"2506.05167","n_code_links":1,"syntology":null},{"paper":null,"slug":"grapheme-coherent-phonemic-and-prosodic","title":"Grapheme-Coherent Phonemic and Prosodic Annotation of Speech by Implicit and Explicit Grapheme Conditioning","date":"2025-06-05","arxiv_id":"2506.04527","n_code_links":0,"syntology":null},{"paper":null,"slug":"intentionally-unintentional-genai","title":"Intentionally Unintentional: GenAI Exceptionalism and the First Amendment","date":"2025-06-05","arxiv_id":"2506.05211","n_code_links":0,"syntology":null},{"paper":"/paper/knowledgeable-r1-policy-optimization-for","slug":"knowledgeable-r1-policy-optimization-for","title":"Knowledgeable-r1: Policy Optimization for Knowledge Exploration in Retrieval-Augmented Generation","date":"2025-06-05","arxiv_id":"2506.05154","n_code_links":1,"syntology":{"ran":3,"of":5,"n_ran_checked":0,"n_instrument":3,"unverified":2,"pointer_only":0,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 3 where Syntology's instrument failed) · 2 unverified","official":{"repos":["lcy80366872/knowledgeable-r1"],"state":"official (archive's flag): 3 ran","n_ran":3,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":"/paper/mathematical-reasoning-for-unmanned-aerial","slug":"mathematical-reasoning-for-unmanned-aerial","title":"Mathematical Reasoning for Unmanned Aerial Vehicles: A RAG-Based Approach for Complex Arithmetic Reasoning","date":"2025-06-05","arxiv_id":"2506.04998","n_code_links":1,"syntology":null},{"paper":"/paper/micro-act-mitigate-knowledge-conflict-in","slug":"micro-act-mitigate-knowledge-conflict-in","title":"Micro-Act: Mitigate Knowledge Conflict in Question Answering via Actionable Self-Reasoning","date":"2025-06-05","arxiv_id":"2506.05278","n_code_links":1,"syntology":null},{"paper":null,"slug":"on-automating-security-policies-with","title":"On Automating Security Policies with Contemporary LLMs","date":"2025-06-05","arxiv_id":"2506.04838","n_code_links":0,"syntology":null},{"paper":"/paper/predicting-icu-in-hospital-mortality-using","slug":"predicting-icu-in-hospital-mortality-using","title":"Predicting ICU In-Hospital Mortality Using Adaptive Transformer Layer Fusion","date":"2025-06-05","arxiv_id":"2506.04924","n_code_links":1,"syntology":null},{"paper":null,"slug":"the-ntnu-system-at-the-s-i-challenge-2025-sla","title":"The NTNU System at the S&I Challenge 2025 SLA Open Track","date":"2025-06-05","arxiv_id":"2506.05121","n_code_links":0,"syntology":null},{"paper":null,"slug":"facts-are-harder-than-opinions-a-multilingual","title":"Facts are Harder Than Opinions -- A Multilingual, Comparative Analysis of LLM-Based Fact-Checking Reliability","date":"2025-06-04","arxiv_id":"2506.03655","n_code_links":0,"syntology":null},{"paper":null,"slug":"magic-mushroom-a-customizable-benchmark-for","title":"Magic Mushroom: A Customizable Benchmark for Fine-grained Analysis of Retrieval Noise Erosion in RAG Systems","date":"2025-06-04","arxiv_id":"2506.03901","n_code_links":0,"syntology":null},{"paper":null,"slug":"privacy-and-security-threat-for-openai-gpts","title":"Privacy and Security Threat for OpenAI GPTs","date":"2025-06-04","arxiv_id":"2506.04036","n_code_links":0,"syntology":null},{"paper":"/paper/r-search-empowering-llm-reasoning-with-search","slug":"r-search-empowering-llm-reasoning-with-search","title":"R-Search: Empowering LLM Reasoning with Search via Multi-Reward Reinforcement Learning","date":"2025-06-04","arxiv_id":"2506.04185","n_code_links":1,"syntology":null},{"paper":"/paper/tracllm-a-generic-framework-for-attributing","slug":"tracllm-a-generic-framework-for-attributing","title":"TracLLM: A Generic Framework for Attributing Long Context LLMs","date":"2025-06-04","arxiv_id":"2506.04202","n_code_links":1,"syntology":null},{"paper":null,"slug":"2506-03100","title":"Retrieval-Augmented Generation as Noisy In-Context Learning: A Unified Theory and Risk Bounds","date":"2025-06-03","arxiv_id":"2506.03100","n_code_links":0,"syntology":null},{"paper":null,"slug":"an-exploratory-framework-for-future-seti","title":"An Exploratory Framework for Future SETI Applications: Detecting Generative Reactivity via Language Models","date":"2025-06-03","arxiv_id":"2506.02730","n_code_links":0,"syntology":null},{"paper":"/paper/attacking-attention-of-foundation-models","slug":"attacking-attention-of-foundation-models","title":"Attacking Attention of Foundation Models Disrupts Downstream Tasks","date":"2025-06-03","arxiv_id":"2506.05394","n_code_links":1,"syntology":null},{"paper":null,"slug":"core-mmrag-cross-source-knowledge","title":"CoRe-MMRAG: Cross-Source Knowledge Reconciliation for Multimodal RAG","date":"2025-06-03","arxiv_id":"2506.02544","n_code_links":0,"syntology":null},{"paper":null,"slug":"enhancing-automatic-pt-tagging-for-medline","title":"Enhancing Automatic PT Tagging for MEDLINE Citations Using Transformer-Based Models","date":"2025-06-03","arxiv_id":"2506.03321","n_code_links":0,"syntology":null},{"paper":null,"slug":"multi-modal-brain-mri-synthesis-based-on","title":"Multi-modal brain MRI synthesis based on SwinUNETR","date":"2025-06-03","arxiv_id":"2506.02467","n_code_links":0,"syntology":null},{"paper":null,"slug":"rethinking-the-effects-of-data-contamination","title":"Rethinking the effects of data contamination in Code Intelligence","date":"2025-06-03","arxiv_id":"2506.02791","n_code_links":0,"syntology":null},{"paper":null,"slug":"talk2sam-text-guided-semantic-enhancement-for","title":"Talk2SAM: Text-Guided Semantic Enhancement for Complex-Shaped Object Segmentation","date":"2025-06-03","arxiv_id":"2506.05396","n_code_links":0,"syntology":null},{"paper":null,"slug":"weightlora-keep-only-necessary-adapters","title":"WeightLoRA: Keep Only Necessary Adapters","date":"2025-06-03","arxiv_id":"2506.02724","n_code_links":0,"syntology":null},{"paper":"/paper/automatic-stage-lighting-control-is-it-a-rule","slug":"automatic-stage-lighting-control-is-it-a-rule","title":"Automatic Stage Lighting Control: Is it a Rule-Driven Process or Generative Task?","date":"2025-06-02","arxiv_id":"2506.01482","n_code_links":1,"syntology":null},{"paper":null,"slug":"llm-in-the-loop-creating-the-paradehate","title":"LLM in the Loop: Creating the PARADEHATE Dataset for Hate Speech Detoxification","date":"2025-06-02","arxiv_id":"2506.01484","n_code_links":0,"syntology":null},{"paper":null,"slug":"llms-as-world-models-data-driven-and-human","title":"LLMs as World Models: Data-Driven and Human-Centered Pre-Event Simulation for Disaster Impact Assessment","date":"2025-06-02","arxiv_id":"2506.06355","n_code_links":0,"syntology":null},{"paper":null,"slug":"retrieval-augmented-generation-of-ontologies","title":"Retrieval-Augmented Generation of Ontologies from Relational Databases","date":"2025-06-02","arxiv_id":"2506.01232","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-graph-retrieval-augmented-generation","title":"A Graph-Retrieval-Augmented Generation Framework Enhances Decision-Making in the Circular Economy","date":"2025-06-01","arxiv_id":"2506.04252","n_code_links":0,"syntology":null},{"paper":null,"slug":"clap-art-automated-audio-captioning-with","title":"CLAP-ART: Automated Audio Captioning with Semantic-rich Audio Representation Tokenizer","date":"2025-06-01","arxiv_id":"2506.00800","n_code_links":0,"syntology":null},{"paper":"/paper/how-neural-networks-organize-concepts","slug":"how-neural-networks-organize-concepts","title":"How Neural Networks Organize Concepts: Introducing Concept Trajectory Analysis for Deep Learning Interpretability","date":"2025-06-01","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/leveraging-am-and-fm-rhythm-spectrograms-for","slug":"leveraging-am-and-fm-rhythm-spectrograms-for","title":"Leveraging AM and FM Rhythm Spectrograms for Dementia Classification and Assessment","date":"2025-06-01","arxiv_id":"2506.00861","n_code_links":1,"syntology":null},{"paper":"/paper/rare-retrieval-aware-robustness-evaluation","slug":"rare-retrieval-aware-robustness-evaluation","title":"RARE: Retrieval-Aware Robustness Evaluation for Retrieval-Augmented Generation Systems","date":"2025-06-01","arxiv_id":"2506.00789","n_code_links":1,"syntology":null},{"paper":null,"slug":"rhythm-controllable-and-efficient-zero-shot","title":"Rhythm Controllable and Efficient Zero-Shot Voice Conversion via Shortcut Flow Matching","date":"2025-06-01","arxiv_id":"2506.01014","n_code_links":0,"syntology":null},{"paper":null,"slug":"assortment-of-attention-heads-accelerating","title":"Assortment of Attention Heads: Accelerating Federated PEFT with Head Pruning and Strategic Client Selection","date":"2025-05-31","arxiv_id":"2506.00743","n_code_links":0,"syntology":null},{"paper":null,"slug":"channel-imposed-fusion-a-simple-yet-effective","title":"Channel-Imposed Fusion: A Simple yet Effective Method for Medical Time Series Classification","date":"2025-05-31","arxiv_id":"2506.00337","n_code_links":0,"syntology":null},{"paper":null,"slug":"evaluating-robot-policies-in-a-world-model","title":"Evaluating Robot Policies in a World Model","date":"2025-05-31","arxiv_id":"2506.00613","n_code_links":0,"syntology":null},{"paper":null,"slug":"finbert2-a-specialized-bidirectional-encoder","title":"FinBERT2: A Specialized Bidirectional Encoder for Bridging the Gap in Finance-Specific Deployment of Large Language Models","date":"2025-05-31","arxiv_id":"2506.06335","n_code_links":0,"syntology":null}],"papers_shown":100,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":24855,"with_a_code_link":11214,"where_syntology_ran_a_sample":3454,"not_listed_spam_title":0,"listed":24855,"listed_where_code_ran":3454,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":2813,"every_run_a_failure_of_syntologys_instrument":641,"listed_with_a_run_with_no_instrument_failure":2813,"listed_every_run_a_failure_of_syntologys_instrument":641,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":3454,"papers_where_code_ran_first_page":"/method/multi-head-attention/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"archive","page":2,"of":249,"url":"/method/multi-head-attention/papers/2","json":"/method/multi-head-attention/papers/2.json","rows":100},{"order":"archive","page":3,"of":249,"url":"/method/multi-head-attention/papers/3","json":"/method/multi-head-attention/papers/3.json","rows":100},{"order":"archive","page":4,"of":249,"url":"/method/multi-head-attention/papers/4","json":"/method/multi-head-attention/papers/4.json","rows":100},{"order":"archive","page":5,"of":249,"url":"/method/multi-head-attention/papers/5","json":"/method/multi-head-attention/papers/5.json","rows":100},{"order":"archive","page":6,"of":249,"url":"/method/multi-head-attention/papers/6","json":"/method/multi-head-attention/papers/6.json","rows":100},{"order":"archive","page":7,"of":249,"url":"/method/multi-head-attention/papers/7","json":"/method/multi-head-attention/papers/7.json","rows":100},{"order":"archive","page":8,"of":249,"url":"/method/multi-head-attention/papers/8","json":"/method/multi-head-attention/papers/8.json","rows":100},{"order":"archive","page":9,"of":249,"url":"/method/multi-head-attention/papers/9","json":"/method/multi-head-attention/papers/9.json","rows":100},{"order":"archive","page":10,"of":249,"url":"/method/multi-head-attention/papers/10","json":"/method/multi-head-attention/papers/10.json","rows":100},{"order":"archive","page":11,"of":249,"url":"/method/multi-head-attention/papers/11","json":"/method/multi-head-attention/papers/11.json","rows":100},{"order":"archive","page":12,"of":249,"url":"/method/multi-head-attention/papers/12","json":"/method/multi-head-attention/papers/12.json","rows":100},{"order":"archive","page":13,"of":249,"url":"/method/multi-head-attention/papers/13","json":"/method/multi-head-attention/papers/13.json","rows":100},{"order":"archive","page":14,"of":249,"url":"/method/multi-head-attention/papers/14","json":"/method/multi-head-attention/papers/14.json","rows":100},{"order":"archive","page":15,"of":249,"url":"/method/multi-head-attention/papers/15","json":"/method/multi-head-attention/papers/15.json","rows":100},{"order":"archive","page":16,"of":249,"url":"/method/multi-head-attention/papers/16","json":"/method/multi-head-attention/papers/16.json","rows":100},{"order":"archive","page":17,"of":249,"url":"/method/multi-head-attention/papers/17","json":"/method/multi-head-attention/papers/17.json","rows":100},{"order":"archive","page":18,"of":249,"url":"/method/multi-head-attention/papers/18","json":"/method/multi-head-attention/papers/18.json","rows":100},{"order":"archive","page":19,"of":249,"url":"/method/multi-head-attention/papers/19","json":"/method/multi-head-attention/papers/19.json","rows":100},{"order":"archive","page":20,"of":249,"url":"/method/multi-head-attention/papers/20","json":"/method/multi-head-attention/papers/20.json","rows":100},{"order":"archive","page":21,"of":249,"url":"/method/multi-head-attention/papers/21","json":"/method/multi-head-attention/papers/21.json","rows":100},{"order":"archive","page":22,"of":249,"url":"/method/multi-head-attention/papers/22","json":"/method/multi-head-attention/papers/22.json","rows":100},{"order":"archive","page":23,"of":249,"url":"/method/multi-head-attention/papers/23","json":"/method/multi-head-attention/papers/23.json","rows":100},{"order":"archive","page":24,"of":249,"url":"/method/multi-head-attention/papers/24","json":"/method/multi-head-attention/papers/24.json","rows":100},{"order":"archive","page":25,"of":249,"url":"/method/multi-head-attention/papers/25","json":"/method/multi-head-attention/papers/25.json","rows":100},{"order":"archive","page":26,"of":249,"url":"/method/multi-head-attention/papers/26","json":"/method/multi-head-attention/papers/26.json","rows":100},{"order":"archive","page":27,"of":249,"url":"/method/multi-head-attention/papers/27","json":"/method/multi-head-attention/papers/27.json","rows":100},{"order":"archive","page":28,"of":249,"url":"/method/multi-head-attention/papers/28","json":"/method/multi-head-attention/papers/28.json","rows":100},{"order":"archive","page":29,"of":249,"url":"/method/multi-head-attention/papers/29","json":"/method/multi-head-attention/papers/29.json","rows":100},{"order":"archive","page":30,"of":249,"url":"/method/multi-head-attention/papers/30","json":"/method/multi-head-attention/papers/30.json","rows":100},{"order":"archive","page":31,"of":249,"url":"/method/multi-head-attention/papers/31","json":"/method/multi-head-attention/papers/31.json","rows":100},{"order":"archive","page":32,"of":249,"url":"/method/multi-head-attention/papers/32","json":"/method/multi-head-attention/papers/32.json","rows":100},{"order":"archive","page":33,"of":249,"url":"/method/multi-head-attention/papers/33","json":"/method/multi-head-attention/papers/33.json","rows":100},{"order":"archive","page":34,"of":249,"url":"/method/multi-head-attention/papers/34","json":"/method/multi-head-attention/papers/34.json","rows":100},{"order":"archive","page":35,"of":249,"url":"/method/multi-head-attention/papers/35","json":"/method/multi-head-attention/papers/35.json","rows":100},{"order":"archive","page":36,"of":249,"url":"/method/multi-head-attention/papers/36","json":"/method/multi-head-attention/papers/36.json","rows":100},{"order":"archive","page":37,"of":249,"url":"/method/multi-head-attention/papers/37","json":"/method/multi-head-attention/papers/37.json","rows":100},{"order":"archive","page":38,"of":249,"url":"/method/multi-head-attention/papers/38","json":"/method/multi-head-attention/papers/38.json","rows":100},{"order":"archive","page":39,"of":249,"url":"/method/multi-head-attention/papers/39","json":"/method/multi-head-attention/papers/39.json","rows":100},{"order":"archive","page":40,"of":249,"url":"/method/multi-head-attention/papers/40","json":"/method/multi-head-attention/papers/40.json","rows":100},{"order":"archive","page":41,"of":249,"url":"/method/multi-head-attention/papers/41","json":"/method/multi-head-attention/papers/41.json","rows":100},{"order":"archive","page":42,"of":249,"url":"/method/multi-head-attention/papers/42","json":"/method/multi-head-attention/papers/42.json","rows":100},{"order":"archive","page":43,"of":249,"url":"/method/multi-head-attention/papers/43","json":"/method/multi-head-attention/papers/43.json","rows":100},{"order":"archive","page":44,"of":249,"url":"/method/multi-head-attention/papers/44","json":"/method/multi-head-attention/papers/44.json","rows":100},{"order":"archive","page":45,"of":249,"url":"/method/multi-head-attention/papers/45","json":"/method/multi-head-attention/papers/45.json","rows":100},{"order":"archive","page":46,"of":249,"url":"/method/multi-head-attention/papers/46","json":"/method/multi-head-attention/papers/46.json","rows":100},{"order":"archive","page":47,"of":249,"url":"/method/multi-head-attention/papers/47","json":"/method/multi-head-attention/papers/47.json","rows":100},{"order":"archive","page":48,"of":249,"url":"/method/multi-head-attention/papers/48","json":"/method/multi-head-attention/papers/48.json","rows":100},{"order":"archive","page":49,"of":249,"url":"/method/multi-head-attention/papers/49","json":"/method/multi-head-attention/papers/49.json","rows":100},{"order":"archive","page":50,"of":249,"url":"/method/multi-head-attention/papers/50","json":"/method/multi-head-attention/papers/50.json","rows":100},{"order":"archive","page":51,"of":249,"url":"/method/multi-head-attention/papers/51","json":"/method/multi-head-attention/papers/51.json","rows":100},{"order":"archive","page":52,"of":249,"url":"/method/multi-head-attention/papers/52","json":"/method/multi-head-attention/papers/52.json","rows":100},{"order":"archive","page":53,"of":249,"url":"/method/multi-head-attention/papers/53","json":"/method/multi-head-attention/papers/53.json","rows":100},{"order":"archive","page":54,"of":249,"url":"/method/multi-head-attention/papers/54","json":"/method/multi-head-attention/papers/54.json","rows":100},{"order":"archive","page":55,"of":249,"url":"/method/multi-head-attention/papers/55","json":"/method/multi-head-attention/papers/55.json","rows":100},{"order":"archive","page":56,"of":249,"url":"/method/multi-head-attention/papers/56","json":"/method/multi-head-attention/papers/56.json","rows":100},{"order":"archive","page":57,"of":249,"url":"/method/multi-head-attention/papers/57","json":"/method/multi-head-attention/papers/57.json","rows":100},{"order":"archive","page":58,"of":249,"url":"/method/multi-head-attention/papers/58","json":"/method/multi-head-attention/papers/58.json","rows":100},{"order":"archive","page":59,"of":249,"url":"/method/multi-head-attention/papers/59","json":"/method/multi-head-attention/papers/59.json","rows":100},{"order":"archive","page":60,"of":249,"url":"/method/multi-head-attention/papers/60","json":"/method/multi-head-attention/papers/60.json","rows":100},{"order":"archive","page":61,"of":249,"url":"/method/multi-head-attention/papers/61","json":"/method/multi-head-attention/papers/61.json","rows":100},{"order":"archive","page":62,"of":249,"url":"/method/multi-head-attention/papers/62","json":"/method/multi-head-attention/papers/62.json","rows":100},{"order":"archive","page":63,"of":249,"url":"/method/multi-head-attention/papers/63","json":"/method/multi-head-attention/papers/63.json","rows":100},{"order":"archive","page":64,"of":249,"url":"/method/multi-head-attention/papers/64","json":"/method/multi-head-attention/papers/64.json","rows":100},{"order":"archive","page":65,"of":249,"url":"/method/multi-head-attention/papers/65","json":"/method/multi-head-attention/papers/65.json","rows":100},{"order":"archive","page":66,"of":249,"url":"/method/multi-head-attention/papers/66","json":"/method/multi-head-attention/papers/66.json","rows":100},{"order":"archive","page":67,"of":249,"url":"/method/multi-head-attention/papers/67","json":"/method/multi-head-attention/papers/67.json","rows":100},{"order":"archive","page":68,"of":249,"url":"/method/multi-head-attention/papers/68","json":"/method/multi-head-attention/papers/68.json","rows":100},{"order":"archive","page":69,"of":249,"url":"/method/multi-head-attention/papers/69","json":"/method/multi-head-attention/papers/69.json","rows":100},{"order":"archive","page":70,"of":249,"url":"/method/multi-head-attention/papers/70","json":"/method/multi-head-attention/papers/70.json","rows":100},{"order":"archive","page":71,"of":249,"url":"/method/multi-head-attention/papers/71","json":"/method/multi-head-attention/papers/71.json","rows":100},{"order":"archive","page":72,"of":249,"url":"/method/multi-head-attention/papers/72","json":"/method/multi-head-attention/papers/72.json","rows":100},{"order":"archive","page":73,"of":249,"url":"/method/multi-head-attention/papers/73","json":"/method/multi-head-attention/papers/73.json","rows":100},{"order":"archive","page":74,"of":249,"url":"/method/multi-head-attention/papers/74","json":"/method/multi-head-attention/papers/74.json","rows":100},{"order":"archive","page":75,"of":249,"url":"/method/multi-head-attention/papers/75","json":"/method/multi-head-attention/papers/75.json","rows":100},{"order":"archive","page":76,"of":249,"url":"/method/multi-head-attention/papers/76","json":"/method/multi-head-attention/papers/76.json","rows":100},{"order":"archive","page":77,"of":249,"url":"/method/multi-head-attention/papers/77","json":"/method/multi-head-attention/papers/77.json","rows":100},{"order":"archive","page":78,"of":249,"url":"/method/multi-head-attention/papers/78","json":"/method/multi-head-attention/papers/78.json","rows":100},{"order":"archive","page":79,"of":249,"url":"/method/multi-head-attention/papers/79","json":"/method/multi-head-attention/papers/79.json","rows":100},{"order":"archive","page":80,"of":249,"url":"/method/multi-head-attention/papers/80","json":"/method/multi-head-attention/papers/80.json","rows":100},{"order":"archive","page":81,"of":249,"url":"/method/multi-head-attention/papers/81","json":"/method/multi-head-attention/papers/81.json","rows":100},{"order":"archive","page":82,"of":249,"url":"/method/multi-head-attention/papers/82","json":"/method/multi-head-attention/papers/82.json","rows":100},{"order":"archive","page":83,"of":249,"url":"/method/multi-head-attention/papers/83","json":"/method/multi-head-attention/papers/83.json","rows":100},{"order":"archive","page":84,"of":249,"url":"/method/multi-head-attention/papers/84","json":"/method/multi-head-attention/papers/84.json","rows":100},{"order":"archive","page":85,"of":249,"url":"/method/multi-head-attention/papers/85","json":"/method/multi-head-attention/papers/85.json","rows":100},{"order":"archive","page":86,"of":249,"url":"/method/multi-head-attention/papers/86","json":"/method/multi-head-attention/papers/86.json","rows":100},{"order":"archive","page":87,"of":249,"url":"/method/multi-head-attention/papers/87","json":"/method/multi-head-attention/papers/87.json","rows":100},{"order":"archive","page":88,"of":249,"url":"/method/multi-head-attention/papers/88","json":"/method/multi-head-attention/papers/88.json","rows":100},{"order":"archive","page":89,"of":249,"url":"/method/multi-head-attention/papers/89","json":"/method/multi-head-attention/papers/89.json","rows":100},{"order":"archive","page":90,"of":249,"url":"/method/multi-head-attention/papers/90","json":"/method/multi-head-attention/papers/90.json","rows":100},{"order":"archive","page":91,"of":249,"url":"/method/multi-head-attention/papers/91","json":"/method/multi-head-attention/papers/91.json","rows":100},{"order":"archive","page":92,"of":249,"url":"/method/multi-head-attention/papers/92","json":"/method/multi-head-attention/papers/92.json","rows":100},{"order":"archive","page":93,"of":249,"url":"/method/multi-head-attention/papers/93","json":"/method/multi-head-attention/papers/93.json","rows":100},{"order":"archive","page":94,"of":249,"url":"/method/multi-head-attention/papers/94","json":"/method/multi-head-attention/papers/94.json","rows":100},{"order":"archive","page":95,"of":249,"url":"/method/multi-head-attention/papers/95","json":"/method/multi-head-attention/papers/95.json","rows":100},{"order":"archive","page":96,"of":249,"url":"/method/multi-head-attention/papers/96","json":"/method/multi-head-attention/papers/96.json","rows":100},{"order":"archive","page":97,"of":249,"url":"/method/multi-head-attention/papers/97","json":"/method/multi-head-attention/papers/97.json","rows":100},{"order":"archive","page":98,"of":249,"url":"/method/multi-head-attention/papers/98","json":"/method/multi-head-attention/papers/98.json","rows":100},{"order":"archive","page":99,"of":249,"url":"/method/multi-head-attention/papers/99","json":"/method/multi-head-attention/papers/99.json","rows":100},{"order":"archive","page":100,"of":249,"url":"/method/multi-head-attention/papers/100","json":"/method/multi-head-attention/papers/100.json","rows":100},{"order":"archive","page":101,"of":249,"url":"/method/multi-head-attention/papers/101","json":"/method/multi-head-attention/papers/101.json","rows":100},{"order":"archive","page":102,"of":249,"url":"/method/multi-head-attention/papers/102","json":"/method/multi-head-attention/papers/102.json","rows":100},{"order":"archive","page":103,"of":249,"url":"/method/multi-head-attention/papers/103","json":"/method/multi-head-attention/papers/103.json","rows":100},{"order":"archive","page":104,"of":249,"url":"/method/multi-head-attention/papers/104","json":"/method/multi-head-attention/papers/104.json","rows":100},{"order":"archive","page":105,"of":249,"url":"/method/multi-head-attention/papers/105","json":"/method/multi-head-attention/papers/105.json","rows":100},{"order":"archive","page":106,"of":249,"url":"/method/multi-head-attention/papers/106","json":"/method/multi-head-attention/papers/106.json","rows":100},{"order":"archive","page":107,"of":249,"url":"/method/multi-head-attention/papers/107","json":"/method/multi-head-attention/papers/107.json","rows":100},{"order":"archive","page":108,"of":249,"url":"/method/multi-head-attention/papers/108","json":"/method/multi-head-attention/papers/108.json","rows":100},{"order":"archive","page":109,"of":249,"url":"/method/multi-head-attention/papers/109","json":"/method/multi-head-attention/papers/109.json","rows":100},{"order":"archive","page":110,"of":249,"url":"/method/multi-head-attention/papers/110","json":"/method/multi-head-attention/papers/110.json","rows":100},{"order":"archive","page":111,"of":249,"url":"/method/multi-head-attention/papers/111","json":"/method/multi-head-attention/papers/111.json","rows":100},{"order":"archive","page":112,"of":249,"url":"/method/multi-head-attention/papers/112","json":"/method/multi-head-attention/papers/112.json","rows":100},{"order":"archive","page":113,"of":249,"url":"/method/multi-head-attention/papers/113","json":"/method/multi-head-attention/papers/113.json","rows":100},{"order":"archive","page":114,"of":249,"url":"/method/multi-head-attention/papers/114","json":"/method/multi-head-attention/papers/114.json","rows":100},{"order":"archive","page":115,"of":249,"url":"/method/multi-head-attention/papers/115","json":"/method/multi-head-attention/papers/115.json","rows":100},{"order":"archive","page":116,"of":249,"url":"/method/multi-head-attention/papers/116","json":"/method/multi-head-attention/papers/116.json","rows":100},{"order":"archive","page":117,"of":249,"url":"/method/multi-head-attention/papers/117","json":"/method/multi-head-attention/papers/117.json","rows":100},{"order":"archive","page":118,"of":249,"url":"/method/multi-head-attention/papers/118","json":"/method/multi-head-attention/papers/118.json","rows":100},{"order":"archive","page":119,"of":249,"url":"/method/multi-head-attention/papers/119","json":"/method/multi-head-attention/papers/119.json","rows":100},{"order":"archive","page":120,"of":249,"url":"/method/multi-head-attention/papers/120","json":"/method/multi-head-attention/papers/120.json","rows":100},{"order":"archive","page":121,"of":249,"url":"/method/multi-head-attention/papers/121","json":"/method/multi-head-attention/papers/121.json","rows":100},{"order":"archive","page":122,"of":249,"url":"/method/multi-head-attention/papers/122","json":"/method/multi-head-attention/papers/122.json","rows":100},{"order":"archive","page":123,"of":249,"url":"/method/multi-head-attention/papers/123","json":"/method/multi-head-attention/papers/123.json","rows":100},{"order":"archive","page":124,"of":249,"url":"/method/multi-head-attention/papers/124","json":"/method/multi-head-attention/papers/124.json","rows":100},{"order":"archive","page":125,"of":249,"url":"/method/multi-head-attention/papers/125","json":"/method/multi-head-attention/papers/125.json","rows":100},{"order":"archive","page":126,"of":249,"url":"/method/multi-head-attention/papers/126","json":"/method/multi-head-attention/papers/126.json","rows":100},{"order":"archive","page":127,"of":249,"url":"/method/multi-head-attention/papers/127","json":"/method/multi-head-attention/papers/127.json","rows":100},{"order":"archive","page":128,"of":249,"url":"/method/multi-head-attention/papers/128","json":"/method/multi-head-attention/papers/128.json","rows":100},{"order":"archive","page":129,"of":249,"url":"/method/multi-head-attention/papers/129","json":"/method/multi-head-attention/papers/129.json","rows":100},{"order":"archive","page":130,"of":249,"url":"/method/multi-head-attention/papers/130","json":"/method/multi-head-attention/papers/130.json","rows":100},{"order":"archive","page":131,"of":249,"url":"/method/multi-head-attention/papers/131","json":"/method/multi-head-attention/papers/131.json","rows":100},{"order":"archive","page":132,"of":249,"url":"/method/multi-head-attention/papers/132","json":"/method/multi-head-attention/papers/132.json","rows":100},{"order":"archive","page":133,"of":249,"url":"/method/multi-head-attention/papers/133","json":"/method/multi-head-attention/papers/133.json","rows":100},{"order":"archive","page":134,"of":249,"url":"/method/multi-head-attention/papers/134","json":"/method/multi-head-attention/papers/134.json","rows":100},{"order":"archive","page":135,"of":249,"url":"/method/multi-head-attention/papers/135","json":"/method/multi-head-attention/papers/135.json","rows":100},{"order":"archive","page":136,"of":249,"url":"/method/multi-head-attention/papers/136","json":"/method/multi-head-attention/papers/136.json","rows":100},{"order":"archive","page":137,"of":249,"url":"/method/multi-head-attention/papers/137","json":"/method/multi-head-attention/papers/137.json","rows":100},{"order":"archive","page":138,"of":249,"url":"/method/multi-head-attention/papers/138","json":"/method/multi-head-attention/papers/138.json","rows":100},{"order":"archive","page":139,"of":249,"url":"/method/multi-head-attention/papers/139","json":"/method/multi-head-attention/papers/139.json","rows":100},{"order":"archive","page":140,"of":249,"url":"/method/multi-head-attention/papers/140","json":"/method/multi-head-attention/papers/140.json","rows":100},{"order":"archive","page":141,"of":249,"url":"/method/multi-head-attention/papers/141","json":"/method/multi-head-attention/papers/141.json","rows":100},{"order":"archive","page":142,"of":249,"url":"/method/multi-head-attention/papers/142","json":"/method/multi-head-attention/papers/142.json","rows":100},{"order":"archive","page":143,"of":249,"url":"/method/multi-head-attention/papers/143","json":"/method/multi-head-attention/papers/143.json","rows":100},{"order":"archive","page":144,"of":249,"url":"/method/multi-head-attention/papers/144","json":"/method/multi-head-attention/papers/144.json","rows":100},{"order":"archive","page":145,"of":249,"url":"/method/multi-head-attention/papers/145","json":"/method/multi-head-attention/papers/145.json","rows":100},{"order":"archive","page":146,"of":249,"url":"/method/multi-head-attention/papers/146","json":"/method/multi-head-attention/papers/146.json","rows":100},{"order":"archive","page":147,"of":249,"url":"/method/multi-head-attention/papers/147","json":"/method/multi-head-attention/papers/147.json","rows":100},{"order":"archive","page":148,"of":249,"url":"/method/multi-head-attention/papers/148","json":"/method/multi-head-attention/papers/148.json","rows":100},{"order":"archive","page":149,"of":249,"url":"/method/multi-head-attention/papers/149","json":"/method/multi-head-attention/papers/149.json","rows":100},{"order":"archive","page":150,"of":249,"url":"/method/multi-head-attention/papers/150","json":"/method/multi-head-attention/papers/150.json","rows":100},{"order":"archive","page":151,"of":249,"url":"/method/multi-head-attention/papers/151","json":"/method/multi-head-attention/papers/151.json","rows":100},{"order":"archive","page":152,"of":249,"url":"/method/multi-head-attention/papers/152","json":"/method/multi-head-attention/papers/152.json","rows":100},{"order":"archive","page":153,"of":249,"url":"/method/multi-head-attention/papers/153","json":"/method/multi-head-attention/papers/153.json","rows":100},{"order":"archive","page":154,"of":249,"url":"/method/multi-head-attention/papers/154","json":"/method/multi-head-attention/papers/154.json","rows":100},{"order":"archive","page":155,"of":249,"url":"/method/multi-head-attention/papers/155","json":"/method/multi-head-attention/papers/155.json","rows":100},{"order":"archive","page":156,"of":249,"url":"/method/multi-head-attention/papers/156","json":"/method/multi-head-attention/papers/156.json","rows":100},{"order":"archive","page":157,"of":249,"url":"/method/multi-head-attention/papers/157","json":"/method/multi-head-attention/papers/157.json","rows":100},{"order":"archive","page":158,"of":249,"url":"/method/multi-head-attention/papers/158","json":"/method/multi-head-attention/papers/158.json","rows":100},{"order":"archive","page":159,"of":249,"url":"/method/multi-head-attention/papers/159","json":"/method/multi-head-attention/papers/159.json","rows":100},{"order":"archive","page":160,"of":249,"url":"/method/multi-head-attention/papers/160","json":"/method/multi-head-attention/papers/160.json","rows":100},{"order":"archive","page":161,"of":249,"url":"/method/multi-head-attention/papers/161","json":"/method/multi-head-attention/papers/161.json","rows":100},{"order":"archive","page":162,"of":249,"url":"/method/multi-head-attention/papers/162","json":"/method/multi-head-attention/papers/162.json","rows":100},{"order":"archive","page":163,"of":249,"url":"/method/multi-head-attention/papers/163","json":"/method/multi-head-attention/papers/163.json","rows":100},{"order":"archive","page":164,"of":249,"url":"/method/multi-head-attention/papers/164","json":"/method/multi-head-attention/papers/164.json","rows":100},{"order":"archive","page":165,"of":249,"url":"/method/multi-head-attention/papers/165","json":"/method/multi-head-attention/papers/165.json","rows":100},{"order":"archive","page":166,"of":249,"url":"/method/multi-head-attention/papers/166","json":"/method/multi-head-attention/papers/166.json","rows":100},{"order":"archive","page":167,"of":249,"url":"/method/multi-head-attention/papers/167","json":"/method/multi-head-attention/papers/167.json","rows":100},{"order":"archive","page":168,"of":249,"url":"/method/multi-head-attention/papers/168","json":"/method/multi-head-attention/papers/168.json","rows":100},{"order":"archive","page":169,"of":249,"url":"/method/multi-head-attention/papers/169","json":"/method/multi-head-attention/papers/169.json","rows":100},{"order":"archive","page":170,"of":249,"url":"/method/multi-head-attention/papers/170","json":"/method/multi-head-attention/papers/170.json","rows":100},{"order":"archive","page":171,"of":249,"url":"/method/multi-head-attention/papers/171","json":"/method/multi-head-attention/papers/171.json","rows":100},{"order":"archive","page":172,"of":249,"url":"/method/multi-head-attention/papers/172","json":"/method/multi-head-attention/papers/172.json","rows":100},{"order":"archive","page":173,"of":249,"url":"/method/multi-head-attention/papers/173","json":"/method/multi-head-attention/papers/173.json","rows":100},{"order":"archive","page":174,"of":249,"url":"/method/multi-head-attention/papers/174","json":"/method/multi-head-attention/papers/174.json","rows":100},{"order":"archive","page":175,"of":249,"url":"/method/multi-head-attention/papers/175","json":"/method/multi-head-attention/papers/175.json","rows":100},{"order":"archive","page":176,"of":249,"url":"/method/multi-head-attention/papers/176","json":"/method/multi-head-attention/papers/176.json","rows":100},{"order":"archive","page":177,"of":249,"url":"/method/multi-head-attention/papers/177","json":"/method/multi-head-attention/papers/177.json","rows":100},{"order":"archive","page":178,"of":249,"url":"/method/multi-head-attention/papers/178","json":"/method/multi-head-attention/papers/178.json","rows":100},{"order":"archive","page":179,"of":249,"url":"/method/multi-head-attention/papers/179","json":"/method/multi-head-attention/papers/179.json","rows":100},{"order":"archive","page":180,"of":249,"url":"/method/multi-head-attention/papers/180","json":"/method/multi-head-attention/papers/180.json","rows":100},{"order":"archive","page":181,"of":249,"url":"/method/multi-head-attention/papers/181","json":"/method/multi-head-attention/papers/181.json","rows":100},{"order":"archive","page":182,"of":249,"url":"/method/multi-head-attention/papers/182","json":"/method/multi-head-attention/papers/182.json","rows":100},{"order":"archive","page":183,"of":249,"url":"/method/multi-head-attention/papers/183","json":"/method/multi-head-attention/papers/183.json","rows":100},{"order":"archive","page":184,"of":249,"url":"/method/multi-head-attention/papers/184","json":"/method/multi-head-attention/papers/184.json","rows":100},{"order":"archive","page":185,"of":249,"url":"/method/multi-head-attention/papers/185","json":"/method/multi-head-attention/papers/185.json","rows":100},{"order":"archive","page":186,"of":249,"url":"/method/multi-head-attention/papers/186","json":"/method/multi-head-attention/papers/186.json","rows":100},{"order":"archive","page":187,"of":249,"url":"/method/multi-head-attention/papers/187","json":"/method/multi-head-attention/papers/187.json","rows":100},{"order":"archive","page":188,"of":249,"url":"/method/multi-head-attention/papers/188","json":"/method/multi-head-attention/papers/188.json","rows":100},{"order":"archive","page":189,"of":249,"url":"/method/multi-head-attention/papers/189","json":"/method/multi-head-attention/papers/189.json","rows":100},{"order":"archive","page":190,"of":249,"url":"/method/multi-head-attention/papers/190","json":"/method/multi-head-attention/papers/190.json","rows":100},{"order":"archive","page":191,"of":249,"url":"/method/multi-head-attention/papers/191","json":"/method/multi-head-attention/papers/191.json","rows":100},{"order":"archive","page":192,"of":249,"url":"/method/multi-head-attention/papers/192","json":"/method/multi-head-attention/papers/192.json","rows":100},{"order":"archive","page":193,"of":249,"url":"/method/multi-head-attention/papers/193","json":"/method/multi-head-attention/papers/193.json","rows":100},{"order":"archive","page":194,"of":249,"url":"/method/multi-head-attention/papers/194","json":"/method/multi-head-attention/papers/194.json","rows":100},{"order":"archive","page":195,"of":249,"url":"/method/multi-head-attention/papers/195","json":"/method/multi-head-attention/papers/195.json","rows":100},{"order":"archive","page":196,"of":249,"url":"/method/multi-head-attention/papers/196","json":"/method/multi-head-attention/papers/196.json","rows":100},{"order":"archive","page":197,"of":249,"url":"/method/multi-head-attention/papers/197","json":"/method/multi-head-attention/papers/197.json","rows":100},{"order":"archive","page":198,"of":249,"url":"/method/multi-head-attention/papers/198","json":"/method/multi-head-attention/papers/198.json","rows":100},{"order":"archive","page":199,"of":249,"url":"/method/multi-head-attention/papers/199","json":"/method/multi-head-attention/papers/199.json","rows":100},{"order":"archive","page":200,"of":249,"url":"/method/multi-head-attention/papers/200","json":"/method/multi-head-attention/papers/200.json","rows":100},{"order":"archive","page":201,"of":249,"url":"/method/multi-head-attention/papers/201","json":"/method/multi-head-attention/papers/201.json","rows":100},{"order":"archive","page":202,"of":249,"url":"/method/multi-head-attention/papers/202","json":"/method/multi-head-attention/papers/202.json","rows":100},{"order":"archive","page":203,"of":249,"url":"/method/multi-head-attention/papers/203","json":"/method/multi-head-attention/papers/203.json","rows":100},{"order":"archive","page":204,"of":249,"url":"/method/multi-head-attention/papers/204","json":"/method/multi-head-attention/papers/204.json","rows":100},{"order":"archive","page":205,"of":249,"url":"/method/multi-head-attention/papers/205","json":"/method/multi-head-attention/papers/205.json","rows":100},{"order":"archive","page":206,"of":249,"url":"/method/multi-head-attention/papers/206","json":"/method/multi-head-attention/papers/206.json","rows":100},{"order":"archive","page":207,"of":249,"url":"/method/multi-head-attention/papers/207","json":"/method/multi-head-attention/papers/207.json","rows":100},{"order":"archive","page":208,"of":249,"url":"/method/multi-head-attention/papers/208","json":"/method/multi-head-attention/papers/208.json","rows":100},{"order":"archive","page":209,"of":249,"url":"/method/multi-head-attention/papers/209","json":"/method/multi-head-attention/papers/209.json","rows":100},{"order":"archive","page":210,"of":249,"url":"/method/multi-head-attention/papers/210","json":"/method/multi-head-attention/papers/210.json","rows":100},{"order":"archive","page":211,"of":249,"url":"/method/multi-head-attention/papers/211","json":"/method/multi-head-attention/papers/211.json","rows":100},{"order":"archive","page":212,"of":249,"url":"/method/multi-head-attention/papers/212","json":"/method/multi-head-attention/papers/212.json","rows":100},{"order":"archive","page":213,"of":249,"url":"/method/multi-head-attention/papers/213","json":"/method/multi-head-attention/papers/213.json","rows":100},{"order":"archive","page":214,"of":249,"url":"/method/multi-head-attention/papers/214","json":"/method/multi-head-attention/papers/214.json","rows":100},{"order":"archive","page":215,"of":249,"url":"/method/multi-head-attention/papers/215","json":"/method/multi-head-attention/papers/215.json","rows":100},{"order":"archive","page":216,"of":249,"url":"/method/multi-head-attention/papers/216","json":"/method/multi-head-attention/papers/216.json","rows":100},{"order":"archive","page":217,"of":249,"url":"/method/multi-head-attention/papers/217","json":"/method/multi-head-attention/papers/217.json","rows":100},{"order":"archive","page":218,"of":249,"url":"/method/multi-head-attention/papers/218","json":"/method/multi-head-attention/papers/218.json","rows":100},{"order":"archive","page":219,"of":249,"url":"/method/multi-head-attention/papers/219","json":"/method/multi-head-attention/papers/219.json","rows":100},{"order":"archive","page":220,"of":249,"url":"/method/multi-head-attention/papers/220","json":"/method/multi-head-attention/papers/220.json","rows":100},{"order":"archive","page":221,"of":249,"url":"/method/multi-head-attention/papers/221","json":"/method/multi-head-attention/papers/221.json","rows":100},{"order":"archive","page":222,"of":249,"url":"/method/multi-head-attention/papers/222","json":"/method/multi-head-attention/papers/222.json","rows":100},{"order":"archive","page":223,"of":249,"url":"/method/multi-head-attention/papers/223","json":"/method/multi-head-attention/papers/223.json","rows":100},{"order":"archive","page":224,"of":249,"url":"/method/multi-head-attention/papers/224","json":"/method/multi-head-attention/papers/224.json","rows":100},{"order":"archive","page":225,"of":249,"url":"/method/multi-head-attention/papers/225","json":"/method/multi-head-attention/papers/225.json","rows":100},{"order":"archive","page":226,"of":249,"url":"/method/multi-head-attention/papers/226","json":"/method/multi-head-attention/papers/226.json","rows":100},{"order":"archive","page":227,"of":249,"url":"/method/multi-head-attention/papers/227","json":"/method/multi-head-attention/papers/227.json","rows":100},{"order":"archive","page":228,"of":249,"url":"/method/multi-head-attention/papers/228","json":"/method/multi-head-attention/papers/228.json","rows":100},{"order":"archive","page":229,"of":249,"url":"/method/multi-head-attention/papers/229","json":"/method/multi-head-attention/papers/229.json","rows":100},{"order":"archive","page":230,"of":249,"url":"/method/multi-head-attention/papers/230","json":"/method/multi-head-attention/papers/230.json","rows":100},{"order":"archive","page":231,"of":249,"url":"/method/multi-head-attention/papers/231","json":"/method/multi-head-attention/papers/231.json","rows":100},{"order":"archive","page":232,"of":249,"url":"/method/multi-head-attention/papers/232","json":"/method/multi-head-attention/papers/232.json","rows":100},{"order":"archive","page":233,"of":249,"url":"/method/multi-head-attention/papers/233","json":"/method/multi-head-attention/papers/233.json","rows":100},{"order":"archive","page":234,"of":249,"url":"/method/multi-head-attention/papers/234","json":"/method/multi-head-attention/papers/234.json","rows":100},{"order":"archive","page":235,"of":249,"url":"/method/multi-head-attention/papers/235","json":"/method/multi-head-attention/papers/235.json","rows":100},{"order":"archive","page":236,"of":249,"url":"/method/multi-head-attention/papers/236","json":"/method/multi-head-attention/papers/236.json","rows":100},{"order":"archive","page":237,"of":249,"url":"/method/multi-head-attention/papers/237","json":"/method/multi-head-attention/papers/237.json","rows":100},{"order":"archive","page":238,"of":249,"url":"/method/multi-head-attention/papers/238","json":"/method/multi-head-attention/papers/238.json","rows":100},{"order":"archive","page":239,"of":249,"url":"/method/multi-head-attention/papers/239","json":"/method/multi-head-attention/papers/239.json","rows":100},{"order":"archive","page":240,"of":249,"url":"/method/multi-head-attention/papers/240","json":"/method/multi-head-attention/papers/240.json","rows":100},{"order":"archive","page":241,"of":249,"url":"/method/multi-head-attention/papers/241","json":"/method/multi-head-attention/papers/241.json","rows":100},{"order":"archive","page":242,"of":249,"url":"/method/multi-head-attention/papers/242","json":"/method/multi-head-attention/papers/242.json","rows":100},{"order":"archive","page":243,"of":249,"url":"/method/multi-head-attention/papers/243","json":"/method/multi-head-attention/papers/243.json","rows":100},{"order":"archive","page":244,"of":249,"url":"/method/multi-head-attention/papers/244","json":"/method/multi-head-attention/papers/244.json","rows":100},{"order":"archive","page":245,"of":249,"url":"/method/multi-head-attention/papers/245","json":"/method/multi-head-attention/papers/245.json","rows":100},{"order":"archive","page":246,"of":249,"url":"/method/multi-head-attention/papers/246","json":"/method/multi-head-attention/papers/246.json","rows":100},{"order":"archive","page":247,"of":249,"url":"/method/multi-head-attention/papers/247","json":"/method/multi-head-attention/papers/247.json","rows":100},{"order":"archive","page":248,"of":249,"url":"/method/multi-head-attention/papers/248","json":"/method/multi-head-attention/papers/248.json","rows":100},{"order":"archive","page":249,"of":249,"url":"/method/multi-head-attention/papers/249","json":"/method/multi-head-attention/papers/249.json","rows":55},{"order":"ran","page":1,"of":35,"url":"/method/multi-head-attention/papers/ran/1","json":"/method/multi-head-attention/papers/ran/1.json","rows":100},{"order":"ran","page":2,"of":35,"url":"/method/multi-head-attention/papers/ran/2","json":"/method/multi-head-attention/papers/ran/2.json","rows":100},{"order":"ran","page":3,"of":35,"url":"/method/multi-head-attention/papers/ran/3","json":"/method/multi-head-attention/papers/ran/3.json","rows":100},{"order":"ran","page":4,"of":35,"url":"/method/multi-head-attention/papers/ran/4","json":"/method/multi-head-attention/papers/ran/4.json","rows":100},{"order":"ran","page":5,"of":35,"url":"/method/multi-head-attention/papers/ran/5","json":"/method/multi-head-attention/papers/ran/5.json","rows":100},{"order":"ran","page":6,"of":35,"url":"/method/multi-head-attention/papers/ran/6","json":"/method/multi-head-attention/papers/ran/6.json","rows":100},{"order":"ran","page":7,"of":35,"url":"/method/multi-head-attention/papers/ran/7","json":"/method/multi-head-attention/papers/ran/7.json","rows":100},{"order":"ran","page":8,"of":35,"url":"/method/multi-head-attention/papers/ran/8","json":"/method/multi-head-attention/papers/ran/8.json","rows":100},{"order":"ran","page":9,"of":35,"url":"/method/multi-head-attention/papers/ran/9","json":"/method/multi-head-attention/papers/ran/9.json","rows":100},{"order":"ran","page":10,"of":35,"url":"/method/multi-head-attention/papers/ran/10","json":"/method/multi-head-attention/papers/ran/10.json","rows":100},{"order":"ran","page":11,"of":35,"url":"/method/multi-head-attention/papers/ran/11","json":"/method/multi-head-attention/papers/ran/11.json","rows":100},{"order":"ran","page":12,"of":35,"url":"/method/multi-head-attention/papers/ran/12","json":"/method/multi-head-attention/papers/ran/12.json","rows":100},{"order":"ran","page":13,"of":35,"url":"/method/multi-head-attention/papers/ran/13","json":"/method/multi-head-attention/papers/ran/13.json","rows":100},{"order":"ran","page":14,"of":35,"url":"/method/multi-head-attention/papers/ran/14","json":"/method/multi-head-attention/papers/ran/14.json","rows":100},{"order":"ran","page":15,"of":35,"url":"/method/multi-head-attention/papers/ran/15","json":"/method/multi-head-attention/papers/ran/15.json","rows":100},{"order":"ran","page":16,"of":35,"url":"/method/multi-head-attention/papers/ran/16","json":"/method/multi-head-attention/papers/ran/16.json","rows":100},{"order":"ran","page":17,"of":35,"url":"/method/multi-head-attention/papers/ran/17","json":"/method/multi-head-attention/papers/ran/17.json","rows":100},{"order":"ran","page":18,"of":35,"url":"/method/multi-head-attention/papers/ran/18","json":"/method/multi-head-attention/papers/ran/18.json","rows":100},{"order":"ran","page":19,"of":35,"url":"/method/multi-head-attention/papers/ran/19","json":"/method/multi-head-attention/papers/ran/19.json","rows":100},{"order":"ran","page":20,"of":35,"url":"/method/multi-head-attention/papers/ran/20","json":"/method/multi-head-attention/papers/ran/20.json","rows":100},{"order":"ran","page":21,"of":35,"url":"/method/multi-head-attention/papers/ran/21","json":"/method/multi-head-attention/papers/ran/21.json","rows":100},{"order":"ran","page":22,"of":35,"url":"/method/multi-head-attention/papers/ran/22","json":"/method/multi-head-attention/papers/ran/22.json","rows":100},{"order":"ran","page":23,"of":35,"url":"/method/multi-head-attention/papers/ran/23","json":"/method/multi-head-attention/papers/ran/23.json","rows":100},{"order":"ran","page":24,"of":35,"url":"/method/multi-head-attention/papers/ran/24","json":"/method/multi-head-attention/papers/ran/24.json","rows":100},{"order":"ran","page":25,"of":35,"url":"/method/multi-head-attention/papers/ran/25","json":"/method/multi-head-attention/papers/ran/25.json","rows":100},{"order":"ran","page":26,"of":35,"url":"/method/multi-head-attention/papers/ran/26","json":"/method/multi-head-attention/papers/ran/26.json","rows":100},{"order":"ran","page":27,"of":35,"url":"/method/multi-head-attention/papers/ran/27","json":"/method/multi-head-attention/papers/ran/27.json","rows":100},{"order":"ran","page":28,"of":35,"url":"/method/multi-head-attention/papers/ran/28","json":"/method/multi-head-attention/papers/ran/28.json","rows":100},{"order":"ran","page":29,"of":35,"url":"/method/multi-head-attention/papers/ran/29","json":"/method/multi-head-attention/papers/ran/29.json","rows":100},{"order":"ran","page":30,"of":35,"url":"/method/multi-head-attention/papers/ran/30","json":"/method/multi-head-attention/papers/ran/30.json","rows":100},{"order":"ran","page":31,"of":35,"url":"/method/multi-head-attention/papers/ran/31","json":"/method/multi-head-attention/papers/ran/31.json","rows":100},{"order":"ran","page":32,"of":35,"url":"/method/multi-head-attention/papers/ran/32","json":"/method/multi-head-attention/papers/ran/32.json","rows":100},{"order":"ran","page":33,"of":35,"url":"/method/multi-head-attention/papers/ran/33","json":"/method/multi-head-attention/papers/ran/33.json","rows":100},{"order":"ran","page":34,"of":35,"url":"/method/multi-head-attention/papers/ran/34","json":"/method/multi-head-attention/papers/ran/34.json","rows":100},{"order":"ran","page":35,"of":35,"url":"/method/multi-head-attention/papers/ran/35","json":"/method/multi-head-attention/papers/ran/35.json","rows":54}],"tasks":[{"task":"/task/language-modelling","name":"Language Modelling","papers":3000},{"task":"/task/language-modeling","name":"Language Modeling","papers":2346},{"task":"/task/retrieval","name":"Retrieval","papers":1792},{"task":"/task/question-answering","name":"Question Answering","papers":1481},{"task":"/task/decoder","name":"Decoder","papers":1392},{"task":"/task/sentence","name":"Sentence","papers":1337},{"task":"/task/rag","name":"RAG","papers":1320},{"task":"/task/retrieval-augmented-generation","name":"Retrieval-augmented Generation","papers":1149},{"task":"/task/translation","name":"Translation","papers":1035},{"task":"/task/machine-translation","name":"Machine Translation","papers":929},{"task":"/task/semantic-segmentation","name":"Semantic Segmentation","papers":859},{"task":"/task/large-language-model","name":"Large Language Model","papers":836},{"task":"/task/text-generation","name":"Text Generation","papers":762},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":713},{"task":"/task/image-classification","name":"Image Classification","papers":709},{"task":"/task/object-detection","name":"Object Detection","papers":665},{"task":"/task/representation-learning","name":"Representation Learning","papers":630},{"task":"/task/sentiment-analysis","name":"Sentiment Analysis","papers":614},{"task":"/task/classification-1","name":"Classification","papers":607},{"task":"/task/segmentation","name":"Segmentation","papers":596}],"tasks_shown":20,"n_tasks":2604,"usage_by_year":[{"year":"2017","papers":22},{"year":"2018","papers":126},{"year":"2019","papers":1081},{"year":"2020","papers":2162},{"year":"2021","papers":3154},{"year":"2022","papers":3332},{"year":"2023","papers":5274},{"year":"2024","papers":7098},{"year":"2025","papers":2606}],"row_source":"embedded","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/multi-head-attention"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=Multi-Head%20Attention","read_at":"2026-10-05T00:59:24+00:00","query":"Multi-Head Attention","kind":"paper","have":"unknown_name","tier":null,"verified_implementation":null,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":null,"resolution":null,"resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":null,"archive_paper_arxiv_id":null,"repositories":null,"retrieve_with":null,"name_competition":{"verdict":"unresolved_bearers","may_be_wrong_sense":true,"bearers_found":2,"served":null,"leading_other_bearer":{"arxiv_id":"2006.16362","title":"Multi-Head Attention: Collaborate Instead of Concatenate","citations":191,"named_by":["title_prefix"],"bearer_name":"Multi-Head Attention: Collaborate Instead of Concatenate","ask_with":"have('2006.16362')"},"n_other_bearers_listed":2,"note":"Nothing resolved to 'Multi-Head Attention' by name, but 2 thing(s) here DECLARE that name -- most cited: the paper 'Multi-Head Attention: Collaborate Instead of Concatenate' (arXiv:2006.16362, 191 citations). That is a RESOLUTION miss, not a coverage gap: the corpus holds the name under a spelling the lookup did not reach. Ask again with an entry of `also_named`."},"name_competition_text":"Nothing resolved to this name, but 2 entries in Syntology's graph carry it; the most cited is the paper “Multi-Head Attention: Collaborate Instead of Concatenate” (arXiv:2006.16362, 191 citations). The lookup reads this as a miss of its own name matching, not a gap in coverage: the graph holds the name under a spelling the lookup did not reach.","near_matches":["Multi-Head Knowledge Attention","multi-head attention neural network","Multi-head Explicit Attention (MEA)","Gaussian Multi-head Attention (GMA)","Multihead Low-Rank Attention (MLRA)","Multi-head Attention Fusion Network","Multi-Head Low-Rank Attention (MLRA)","Multi-Head Tropical Attention (MHTA)"],"code_nearby":[],"code_nearby_caption":null,"origin_paper":null,"line":"name not resolved (unknown_name). Other entries in Syntology's graph carry this name; the lookup's note below says what that means for this name.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"2d724207c9e3865ee8d475fae4ee203fd163a59edd3723c01d800a630935b248","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}