{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/dropconnect","slug":"dropconnect","name":"DropConnect","full_name":"DropConnect","full_name_withheld":false,"description_markdown":"**DropConnect** generalizes [Dropout](https://paperswithcode.com/method/dropout) by randomly dropping the weights rather than the activations with probability $1-p$. DropConnect is similar to Dropout as it introduces dynamic sparsity within the model, but differs in that the sparsity is on the weights $W$, rather than the output vectors of a layer. In other words, the fully connected layer with DropConnect becomes a sparsely connected layer in which the connections are chosen at random during the training stage. Note that this is not equivalent to setting $W$ to be a fixed sparse matrix during training.\r\n\r\nFor a DropConnect layer, the output is given as:\r\n\r\n$$ r = a \\left(\\left(M * W\\right){v}\\right)$$\r\n\r\nHere $r$ is the output of a layer, $v$ is the input to a layer, $W$ are weight parameters, and $M$ is a binary matrix encoding the connection information where $M\\_{ij} \\sim \\text{Bernoulli}\\left(p\\right)$. Each element of the mask $M$ is drawn independently for each example during training, essentially instantiating a different connectivity for each example seen. Additionally, the biases are also masked out during training.","description_state":"present","introduced_year":null,"introduced_by":{"title":"Regularization of Neural Networks using DropConnect","paper":"/paper/regularization-of-neural-networks-using","first_author":"Li Wan","n_authors":5,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/regularization-of-neural-networks-using"},"source":{"url":"http://cds.nyu.edu/projects/regularization-neural-networks-using-dropconnect/","title":"Regularization of Neural Networks using DropConnect","url_on_a_paper_host":false},"code_snippet_url":"https://github.com/teelinsan/KerasDropconnect/blob/0b203b56b2564686358fe0907b89316e3fce4014/ddrop/layers.py#L24","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Regularization","url":"/methods/category/regularization","pwc_aliases":[]}],"n_papers_tagged":84,"archive_num_papers":84,"papers_newest_first":[{"paper":null,"slug":"advanced-deep-learning-techniques-for","title":"Advanced Deep Learning Techniques for Analyzing Earnings Call Transcripts: Methodologies and Applications","date":"2025-02-27","arxiv_id":"2503.01886","n_code_links":0,"syntology":null},{"paper":"/paper/dynamic-dropconnect-enhancing-neural-network","slug":"dynamic-dropconnect-enhancing-neural-network","title":"Dynamic DropConnect: Enhancing Neural Network Robustness through Adaptive Edge Dropping Strategies","date":"2025-02-27","arxiv_id":"2502.19948","n_code_links":1,"syntology":null},{"paper":null,"slug":"no-argument-left-behind-overlapping-chunks","title":"No Argument Left Behind: Overlapping Chunks for Faster Processing of Arbitrarily Long Legal Texts","date":"2024-10-24","arxiv_id":"2410.19184","n_code_links":0,"syntology":null},{"paper":"/paper/terrain-classification-enhanced-with","slug":"terrain-classification-enhanced-with","title":"Terrain Classification Enhanced with Uncertainty for Space Exploration Robots from Proprioceptive Data","date":"2024-07-03","arxiv_id":"2407.03241","n_code_links":0,"syntology":{"ran":6,"of":7,"n_ran_checked":4,"n_instrument":2,"unverified":1,"pointer_only":0,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 1 honoured, 0 violated, 3 with no contract checked; 2 where Syntology's instrument failed) · 1 unverified","official":null}},{"paper":"/paper/rico-reddit-ideological-communities","slug":"rico-reddit-ideological-communities","title":"RICo: Reddit ideological communities","date":"2024-06-05","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"information-theoretic-generalization-bounds-8","title":"Information-Theoretic Generalization Bounds for Deep Neural Networks","date":"2024-04-04","arxiv_id":"2404.03176","n_code_links":0,"syntology":null},{"paper":"/paper/exploring-multi-level-threats-in-telegram","slug":"exploring-multi-level-threats-in-telegram","title":"Exploring Multi-Level Threats in Telegram Data with AI-Human Annotation: A Preliminary Study","date":"2023-12-15","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"illicit-darkweb-classification-via-natural","title":"Illicit Darkweb Classification via Natural-language Processing: Classifying Illicit Content of Webpages based on Textual Information","date":"2023-12-08","arxiv_id":"2312.04944","n_code_links":0,"syntology":null},{"paper":"/paper/bayesian-posterior-approximation-with","slug":"bayesian-posterior-approximation-with","title":"Bayesian posterior approximation with stochastic ensembles","date":"2022-12-15","arxiv_id":"2212.08123","n_code_links":1,"syntology":{"ran":4,"of":4,"n_ran_checked":4,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"4 ran (of which 0 constructed an object rather than computing a result; 4 with no instrument failure: 0 honoured, 1 violated, 3 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["oleksandr-balabanov/stochastic-ensembles"],"state":"official (archive's flag): 4 ran","n_ran":4,"n_constructed":0,"n_ran_no_instrument_failure":4,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"disentangled-uncertainty-and-out-of","title":"Disentangled Uncertainty and Out of Distribution Detection in Medical Generative Models","date":"2022-11-11","arxiv_id":"2211.06250","n_code_links":0,"syntology":null},{"paper":null,"slug":"explainable-and-high-performance-hate-and","title":"Explainable and High-Performance Hate and Offensive Speech Detection","date":"2022-06-26","arxiv_id":"2206.12983","n_code_links":0,"syntology":null},{"paper":"/paper/softdropconnect-sdc-effective-and-efficient","slug":"softdropconnect-sdc-effective-and-efficient","title":"SoftDropConnect (SDC) -- Effective and Efficient Quantification of the Network Uncertainty in Deep MR Image Analysis","date":"2022-01-20","arxiv_id":"2201.08418","n_code_links":1,"syntology":null},{"paper":"/paper/iiitt-dravidian-codemix-fire2021","slug":"iiitt-dravidian-codemix-fire2021","title":"IIITT@Dravidian-CodeMix-FIRE2021: Transliterate or translate? Sentiment analysis of code-mixed text in Dravidian languages","date":"2021-11-15","arxiv_id":"2111.07906","n_code_links":1,"syntology":null},{"paper":null,"slug":"entropy-optimized-semi-supervised-decomposed","title":"Entropy optimized semi-supervised decomposed vector-quantized variational autoencoder model based on transfer learning for multiclass text classification and generation","date":"2021-11-10","arxiv_id":"2111.08453","n_code_links":0,"syntology":null},{"paper":"/paper/offensive-language-identification-in-low","slug":"offensive-language-identification-in-low","title":"Offensive Language Identification in Low-resourced Code-mixed Dravidian languages using Pseudo-labeling","date":"2021-08-27","arxiv_id":"2108.12177","n_code_links":1,"syntology":null},{"paper":"/paper/sn-computer-science-towards-offensive","slug":"sn-computer-science-towards-offensive","title":"Towards Offensive Language Identification for Tamil Code-Mixed YouTube Comments and Posts","date":"2021-08-24","arxiv_id":"2108.10939","n_code_links":1,"syntology":null},{"paper":null,"slug":"learning-ulmfit-and-self-distillation-with","title":"Learning ULMFiT and Self-Distillation with Calibration for Medical Dialogue System","date":"2021-07-20","arxiv_id":"2107.09625","n_code_links":0,"syntology":null},{"paper":"/paper/structured-dropconnect-for-uncertainty","slug":"structured-dropconnect-for-uncertainty","title":"Structured DropConnect for Uncertainty Inference in Image Classification","date":"2021-06-16","arxiv_id":"2106.08624","n_code_links":1,"syntology":null},{"paper":null,"slug":"the-regularizing-effect-of-different-output","title":"The Regularizing Effect of Different Output Layer Designs in Deep Neural Networks","date":"2021-05-21","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/whose-heritage-classification-of-unesco-world","slug":"whose-heritage-classification-of-unesco-world","title":"WHOSe Heritage: Classification of UNESCO World Heritage \"Outstanding Universal Value\" Documents with Soft Labels","date":"2021-04-12","arxiv_id":"2104.05547","n_code_links":1,"syntology":null},{"paper":"/paper/l3cubemahasent-a-marathi-tweet-based","slug":"l3cubemahasent-a-marathi-tweet-based","title":"L3CubeMahaSent: A Marathi Tweet-based Sentiment Analysis Dataset","date":"2021-03-21","arxiv_id":"2103.11408","n_code_links":1,"syntology":null},{"paper":"/paper/indicnlp-kgp-at-dravidianlangtech-eacl2021","slug":"indicnlp-kgp-at-dravidianlangtech-eacl2021","title":"indicnlp@kgp at DravidianLangTech-EACL2021: Offensive Language Identification in Dravidian Languages","date":"2021-02-14","arxiv_id":"2102.07150","n_code_links":1,"syntology":null},{"paper":"/paper/indicnlp-kgp-at-dravidianlangtech-eacl2021-1","slug":"indicnlp-kgp-at-dravidianlangtech-eacl2021-1","title":"indicnlp@ kgp at DravidianLangTech-EACL2021: Offensive Language Identification in Dravidian Languages","date":"2021-02-14","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"train-your-classifier-first-cascade-neural","title":"Train your classifier first: Cascade Neural Networks Training from upper layers to lower layers","date":"2021-02-09","arxiv_id":"2102.04697","n_code_links":0,"syntology":null},{"paper":null,"slug":"experimental-evaluation-of-deep-learning","title":"Experimental Evaluation of Deep Learning models for Marathi Text Classification","date":"2021-01-13","arxiv_id":"2101.04899","n_code_links":0,"syntology":null},{"paper":"/paper/ladiff-ulmfit-a-layer-differentiated-training","slug":"ladiff-ulmfit-a-layer-differentiated-training","title":"LaDiff ULMFiT: A Layer Differentiated training approach for ULMFiT","date":"2021-01-13","arxiv_id":"2101.04965","n_code_links":1,"syntology":null},{"paper":null,"slug":"post-training-weighted-quantization-of-neural","title":"Post-Training Weighted Quantization of Neural Networks for Language Models","date":"2021-01-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/hinglishnlp-at-semeval-2020-task-9-fine-tuned","slug":"hinglishnlp-at-semeval-2020-task-9-fine-tuned","title":"HinglishNLP at SemEval-2020 Task 9: Fine-tuned Language Models for Hinglish Sentiment Detection","date":"2020-12-01","arxiv_id":null,"n_code_links":2,"syntology":null},{"paper":null,"slug":"smash-at-semeval-2020-task-7-optimizing-the","title":"Smash at SemEval-2020 Task 7: Optimizing the Hyperparameters of ERNIE 2.0 for Humor Ranking and Rating","date":"2020-12-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"palomino-ochoa-at-semeval-2020-task-9-robust","title":"Palomino-Ochoa at SemEval-2020 Task 9: Robust System based on Transformer for Code-Mixed Sentiment Classification","date":"2020-11-18","arxiv_id":"2011.09448","n_code_links":0,"syntology":null},{"paper":null,"slug":"know-where-to-drop-your-weights-towards","title":"Know Where To Drop Your Weights: Towards Faster Uncertainty Estimation","date":"2020-10-27","arxiv_id":"2010.14019","n_code_links":0,"syntology":null},{"paper":"/paper/delta-stn-efficient-bilevel-optimization-for","slug":"delta-stn-efficient-bilevel-optimization-for","title":"Delta-STN: Efficient Bilevel Optimization for Neural Networks using Structured Response Jacobians","date":"2020-10-26","arxiv_id":"2010.13514","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"1 ran (of which 1 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified; the one sample that ran constructed an object rather than computing a result","official":{"repos":["pomonam/Self-Tuning-Networks"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":1,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":"/paper/pagsusuri-ng-rnn-based-transfer-learning","slug":"pagsusuri-ng-rnn-based-transfer-learning","title":"Pagsusuri ng RNN-based Transfer Learning Technique sa Low-Resource Language","date":"2020-10-13","arxiv_id":"2010.06447","n_code_links":2,"syntology":null},{"paper":null,"slug":"gauravarora-hasoc-dravidian-codemix-fire2020","title":"Gauravarora@HASOC-Dravidian-CodeMix-FIRE2020: Pre-training ULMFiT on Synthetically Generated Code-Mixed Data for Hate Speech Detection","date":"2020-10-05","arxiv_id":"2010.02094","n_code_links":0,"syntology":null},{"paper":null,"slug":"fine-tuning-pre-trained-contextual-embeddings","title":"Fine-tuning Pre-trained Contextual Embeddings for Citation Content Analysis in Scholarly Publication","date":"2020-09-12","arxiv_id":"2009.05836","n_code_links":0,"syntology":null},{"paper":"/paper/hinglishnlp-fine-tuned-language-models-for","slug":"hinglishnlp-fine-tuned-language-models-for","title":"HinglishNLP: Fine-tuned Language Models for Hinglish Sentiment Detection","date":"2020-08-22","arxiv_id":"2008.09820","n_code_links":2,"syntology":null},{"paper":"/paper/composer-style-classification-of-piano-sheet","slug":"composer-style-classification-of-piano-sheet","title":"Composer Style Classification of Piano Sheet Music Images Using Language Model Pretraining","date":"2020-07-29","arxiv_id":"2007.14587","n_code_links":1,"syntology":null},{"paper":"/paper/rifle-backpropagation-in-depth-for-deep","slug":"rifle-backpropagation-in-depth-for-deep","title":"RIFLE: Backpropagation in Depth for Deep Transfer Learning through Re-Initializing the Fully-connected LayEr","date":"2020-07-07","arxiv_id":"2007.03349","n_code_links":1,"syntology":null},{"paper":null,"slug":"probing-for-referential-information-in","title":"Probing for Referential Information in Language Models","date":"2020-07-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/wcp-worst-case-perturbations-for-semi","slug":"wcp-worst-case-perturbations-for-semi","title":"WCP: Worst-Case Perturbations for Semi-Supervised Deep Learning","date":"2020-06-01","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"evaluation-metrics-for-headline-generation","title":"Evaluation Metrics for Headline Generation Using Deep Pre-Trained Embeddings","date":"2020-05-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":"/paper/locally-constant-networks-1","slug":"locally-constant-networks-1","title":"Locally Constant Networks","date":"2020-05-01","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/offensive-language-detection-in-arabic-using","slug":"offensive-language-detection-in-arabic-using","title":"Offensive language detection in Arabic using ULMFiT","date":"2020-05-01","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":null,"slug":"text-categorization-for-conflict-event","title":"Text Categorization for Conflict Event Annotation","date":"2020-05-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"dynamic-bayesian-neural-networks","title":"Hidden Markov Neural Networks","date":"2020-04-15","arxiv_id":"2004.06963","n_code_links":0,"syntology":null},{"paper":"/paper/inferring-the-source-of-official-texts-can","slug":"inferring-the-source-of-official-texts-can","title":"Inferring the source of official texts: can SVM beat ULMFiT?","date":"2020-03-02","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/maxup-a-simple-way-to-improve-generalization","slug":"maxup-a-simple-way-to-improve-generalization","title":"MaxUp: A Simple Way to Improve Generalization of Neural Network Training","date":"2020-02-20","arxiv_id":"2002.09024","n_code_links":1,"syntology":{"ran":0,"of":1,"n_ran_checked":0,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"0 ran · 1 unverified","official":null}},{"paper":null,"slug":"localized-flood-detectionwith-minimal-labeled","title":"Localized Flood DetectionWith Minimal Labeled Social Media Data Using Transfer Learning","date":"2020-02-10","arxiv_id":"2003.04973","n_code_links":0,"syntology":null},{"paper":null,"slug":"natural-language-processing-of-mimic-iii","title":"Natural language processing of MIMIC-III clinical notes for identifying diagnosis and procedures with neural networks","date":"2019-12-28","arxiv_id":"1912.12397","n_code_links":0,"syntology":null},{"paper":null,"slug":"a-comparative-study-of-pretrained-language","title":"A Comparative Study of Pretrained Language Models on Thai Social Text Categorization","date":"2019-12-03","arxiv_id":"1912.01580","n_code_links":0,"syntology":null},{"paper":"/paper/continuous-dropout","slug":"continuous-dropout","title":"Continuous Dropout","date":"2019-11-28","arxiv_id":"1911.12675","n_code_links":1,"syntology":null},{"paper":"/paper/define-deep-factorized-input-word-embeddings-1","slug":"define-deep-factorized-input-word-embeddings-1","title":"DeFINE: DEep Factorized INput Token Embeddings for Neural Sequence Modeling","date":"2019-11-27","arxiv_id":"1911.12385","n_code_links":1,"syntology":null},{"paper":"/paper/parameters-estimation-for-the-cosmic","slug":"parameters-estimation-for-the-cosmic","title":"Parameters Estimation for the Cosmic Microwave Background with Bayesian Neural Networks","date":"2019-11-19","arxiv_id":"1911.08508","n_code_links":2,"syntology":{"ran":2,"of":2,"n_ran_checked":1,"n_instrument":1,"unverified":0,"pointer_only":2,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 1 honoured, 0 violated, 0 with no contract checked; 1 where Syntology's instrument failed) · 0 unverified","official":{"repos":["JavierOrjuela/BayesianNN_CMB","JavierOrjuela/BayesianNeuralNets_CMB"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"a-subword-level-language-model-for-bangla","title":"A Subword Level Language Model for Bangla Language","date":"2019-11-15","arxiv_id":"1911.07613","n_code_links":0,"syntology":null},{"paper":null,"slug":"on-the-regularization-properties-of","title":"On the Regularization Properties of Structured Dropout","date":"2019-10-30","arxiv_id":"1910.14186","n_code_links":0,"syntology":null},{"paper":null,"slug":"evolution-of-transfer-learning-in-natural","title":"Evolution of transfer learning in natural language processing","date":"2019-10-16","arxiv_id":"1910.07370","n_code_links":0,"syntology":null},{"paper":"/paper/the-merits-of-universal-language-model-fine","slug":"the-merits-of-universal-language-model-fine","title":"The merits of Universal Language Model Fine-tuning for Small Datasets -- a case with Dutch book reviews","date":"2019-10-02","arxiv_id":"1910.00896","n_code_links":2,"syntology":null},{"paper":"/paper/locally-constant-networks","slug":"locally-constant-networks","title":"Oblique Decision Trees from Derivatives of ReLU Networks","date":"2019-09-30","arxiv_id":"1909.13488","n_code_links":1,"syntology":null},{"paper":null,"slug":"analyzing-customer-feedback-for-product-fit","title":"Analyzing Customer Feedback for Product Fit Prediction","date":"2019-08-28","arxiv_id":"1908.10896","n_code_links":0,"syntology":null},{"paper":null,"slug":"low-shot-classification-a-comparison-of","title":"Low-Shot Classification: A Comparison of Classical and Deep Transfer Machine Learning Approaches","date":"2019-07-17","arxiv_id":"1907.07543","n_code_links":0,"syntology":null},{"paper":null,"slug":"spatially-coupled-neural-network","title":"Spatially-Coupled Neural Network Architectures","date":"2019-07-03","arxiv_id":"1907.02051","n_code_links":0,"syntology":null},{"paper":"/paper/evaluating-language-model-finetuning","slug":"evaluating-language-model-finetuning","title":"Evaluating Language Model Finetuning Techniques for Low-resource Languages","date":"2019-06-30","arxiv_id":"1907.00409","n_code_links":2,"syntology":null},{"paper":null,"slug":"exploiting-unsupervised-pre-training-and","title":"Exploiting Unsupervised Pre-training and Automated Feature Engineering for Low-resource Hate Speech Detection in Polish","date":"2019-06-17","arxiv_id":"1906.09325","n_code_links":0,"syntology":null},{"paper":null,"slug":"figure-eight-at-semeval-2019-task-3-ensemble","title":"Figure Eight at SemEval-2019 Task 3: Ensemble of Transfer Learning Methods for Contextual Emotion Detection","date":"2019-06-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"speak-up-fight-back-detection-of-social-media","title":"Speak up, Fight Back! Detection of Social Media Disclosures of Sexual Harassment","date":"2019-06-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"an-empirical-evaluation-of-text","title":"An Empirical Evaluation of Text Representation Schemes on Multilingual Social Web to Filter the Textual Aggression","date":"2019-04-16","arxiv_id":"1904.08770","n_code_links":0,"syntology":null},{"paper":"/paper/low-resource-text-classification-with-ulmfit","slug":"low-resource-text-classification-with-ulmfit","title":"Low Resource Text Classification with ULMFit and Backtranslation","date":"2019-03-21","arxiv_id":"1903.09244","n_code_links":1,"syntology":null},{"paper":"/paper/pay-less-attention-with-lightweight-and","slug":"pay-less-attention-with-lightweight-and","title":"Pay Less Attention with Lightweight and Dynamic Convolutions","date":"2019-01-29","arxiv_id":"1901.10430","n_code_links":3,"syntology":null},{"paper":null,"slug":"dropfilter-a-novel-regularization-method-for","title":"DropFilter: A Novel Regularization Method for Learning Convolutional Neural Networks","date":"2018-11-16","arxiv_id":"1811.06783","n_code_links":0,"syntology":null},{"paper":null,"slug":"radius-margin-bounds-for-deep-neural-networks","title":"Radius-margin bounds for deep neural networks","date":"2018-11-03","arxiv_id":"1811.01171","n_code_links":0,"syntology":null},{"paper":"/paper/online-cyber-attack-detection-in-smart-grid-a","slug":"online-cyber-attack-detection-in-smart-grid-a","title":"Online Cyber-Attack Detection in Smart Grid: A Reinforcement Learning Approach","date":"2018-09-14","arxiv_id":"1809.05258","n_code_links":1,"syntology":null},{"paper":null,"slug":"language-informed-modeling-of-code-switched","title":"Language Informed Modeling of Code-Switched Text","date":"2018-07-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"deep-network-regularization-via-bayesian","title":"Deep Network Regularization via Bayesian Inference of Synaptic Connectivity","date":"2018-03-04","arxiv_id":"1803.01349","n_code_links":0,"syntology":null},{"paper":"/paper/universal-language-model-fine-tuning-for-text","slug":"universal-language-model-fine-tuning-for-text","title":"Universal Language Model Fine-tuning for Text Classification","date":"2018-01-18","arxiv_id":"1801.06146","n_code_links":66,"syntology":{"ran":2,"of":5,"n_ran_checked":0,"n_instrument":2,"unverified":3,"pointer_only":3,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 0 with no instrument failure: 0 honoured, 0 violated, 0 with no contract checked; 2 where Syntology's instrument failed) · 3 unverified","official":{"repos":["fastai/fastai"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"paper":"/paper/breaking-the-softmax-bottleneck-a-high-rank","slug":"breaking-the-softmax-bottleneck-a-high-rank","title":"Breaking the Softmax Bottleneck: A High-Rank RNN Language Model","date":"2017-11-10","arxiv_id":"1711.03953","n_code_links":9,"syntology":{"ran":12,"of":23,"n_ran_checked":11,"n_instrument":1,"unverified":11,"pointer_only":1,"phrase":"12 ran (of which 0 constructed an object rather than computing a result; 11 with no instrument failure: 0 honoured, 0 violated, 11 with no contract checked; 1 where Syntology's instrument failed) · 11 unverified","official":{"repos":["zihangdai/mos"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":1,"ran_from_kinds":["listed","official"]}}},{"paper":"/paper/regularizing-and-optimizing-lstm-language","slug":"regularizing-and-optimizing-lstm-language","title":"Regularizing and Optimizing LSTM Language Models","date":"2017-08-07","arxiv_id":"1708.02182","n_code_links":45,"syntology":{"ran":6,"of":7,"n_ran_checked":2,"n_instrument":4,"unverified":1,"pointer_only":7,"phrase":"6 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 4 where Syntology's instrument failed) · 1 unverified","official":{"repos":["salesforce/awd-lstm-lm"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"paper":null,"slug":"leveraging-the-path-signature-for-skeleton","title":"Developing the Path Signature Methodology and its Application to Landmark-based Human Action Recognition","date":"2017-07-13","arxiv_id":"1707.03993","n_code_links":0,"syntology":null},{"paper":null,"slug":"robustly-representing-uncertainty-in-deep","title":"Robustly representing uncertainty in deep neural networks through sampling","date":"2016-11-05","arxiv_id":"1611.01639","n_code_links":0,"syntology":null},{"paper":null,"slug":"regularized-dynamic-boltzmann-machine-with","title":"Regularized Dynamic Boltzmann Machine with Delay Pruning for Unsupervised Learning of Temporal Sequences","date":"2016-09-22","arxiv_id":"1610.01989","n_code_links":0,"syntology":null},{"paper":null,"slug":"softtarget-regularization-an-effective","title":"SoftTarget Regularization: An Effective Technique to Reduce Over-Fitting in Neural Networks","date":"2016-09-21","arxiv_id":"1609.06693","n_code_links":0,"syntology":null},{"paper":null,"slug":"graphconnect-a-regularization-framework-for","title":"GraphConnect: A Regularization Framework for Neural Networks","date":"2015-12-21","arxiv_id":"1512.06757","n_code_links":0,"syntology":null},{"paper":null,"slug":"stochastic-synapses-enable-efficient-brain","title":"Stochastic Synapses Enable Efficient Brain-Inspired Learning Machines","date":"2015-11-14","arxiv_id":"1511.04484","n_code_links":0,"syntology":null},{"paper":null,"slug":"prediction-of-breast-cancer-recurrence-using","title":"Prediction of breast cancer recurrence using Classification Restricted Boltzmann Machine with Dropping","date":"2013-08-28","arxiv_id":"1308.6324","n_code_links":0,"syntology":null},{"paper":"/paper/regularization-of-neural-networks-using","slug":"regularization-of-neural-networks-using","title":"Regularization of Neural Networks using DropConnect","date":"2013-06-13","arxiv_id":null,"n_code_links":1,"syntology":null}],"papers_shown":84,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":84,"with_a_code_link":37,"where_syntology_ran_a_sample":7,"not_listed_spam_title":0,"listed":84,"listed_where_code_ran":7,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":6,"every_run_a_failure_of_syntologys_instrument":1,"listed_with_a_run_with_no_instrument_failure":6,"listed_every_run_a_failure_of_syntologys_instrument":1,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":7,"papers_where_code_ran_first_page":"/method/dropconnect/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"ran","page":1,"of":1,"url":"/method/dropconnect/papers/ran/1","json":"/method/dropconnect/papers/ran/1.json","rows":7}],"tasks":[{"task":"/task/language-modelling","name":"Language Modelling","papers":20},{"task":"/task/language-modeling","name":"Language Modeling","papers":18},{"task":"/task/transfer-learning","name":"Transfer Learning","papers":18},{"task":"/task/text-classification","name":"Text Classification","papers":16},{"task":"/task/classification","name":"General Classification","papers":15},{"task":"/task/text-classification-1","name":"text-classification","papers":12},{"task":"/task/classification-1","name":"Classification","papers":11},{"task":"/task/sentiment-analysis","name":"Sentiment Analysis","papers":9},{"task":"/task/image-classification","name":"Image Classification","papers":8},{"task":"/task/translation","name":"Translation","papers":6},{"task":"/task/image-classification","name":"image-classification","papers":5},{"task":"/task/language-identification","name":"Language Identification","papers":4},{"task":"/task/machine-translation","name":"Machine Translation","papers":4},{"task":"/task/word-embeddings","name":"Word Embeddings","papers":4},{"task":"/task/bayesian-inference","name":"Bayesian Inference","papers":3},{"task":"/task/decision-making","name":"Decision Making","papers":3},{"task":"/task/hate-speech-detection","name":"Hate Speech Detection","papers":3},{"task":"/task/sentence","name":"Sentence","papers":3},{"task":"/task/sentiment-classification","name":"Sentiment Classification","papers":3},{"task":"/task/time-series-1","name":"Time Series","papers":3}],"tasks_shown":20,"n_tasks":93,"usage_by_year":[{"year":"2013","papers":2},{"year":"2015","papers":2},{"year":"2016","papers":3},{"year":"2017","papers":3},{"year":"2018","papers":6},{"year":"2019","papers":20},{"year":"2020","papers":21},{"year":"2021","papers":15},{"year":"2022","papers":4},{"year":"2023","papers":2},{"year":"2024","papers":4},{"year":"2025","papers":2}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/dropconnect"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=DropConnect","read_at":"2026-10-05T00:55:17+00:00","query":"DropConnect","kind":"method","have":"unknown_name","tier":null,"verified_implementation":null,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":null,"resolution":null,"resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":null,"archive_paper_arxiv_id":null,"repositories":null,"retrieve_with":null,"name_competition":{"verdict":"none","may_be_wrong_sense":false,"bearers_found":0,"served":null,"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing in this corpus is named 'DropConnect' -- no method node, no paper announcing it in its title, no expanded form declaring it as an acronym."},"name_competition_text":null,"near_matches":[],"code_nearby":[],"code_nearby_caption":null,"origin_paper":null,"line":"name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"fcc6129586275d4af16162093a6c70c59ae6db53bcf14185150d415f6023bfbd","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}