{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/method/orthogonal-regularization","slug":"orthogonal-regularization","name":"Orthogonal Regularization","full_name":"Orthogonal Regularization","full_name_withheld":false,"description_markdown":"**Orthogonal Regularization** is a regularization technique for convolutional neural networks, introduced with generative modelling as the task in mind. Orthogonality is argued to be a desirable quality in ConvNet filters, partially because multiplication by an orthogonal matrix leaves the norm of the original matrix unchanged. This property is valuable in deep or recurrent networks, where repeated matrix multiplication can result in signals vanishing or exploding. To try to maintain orthogonality throughout training, Orthogonal Regularization encourages weights to be orthogonal by pushing them towards the nearest orthogonal manifold. The objective function is augmented with the cost:\r\n\r\n$$ \\mathcal{L}\\_{ortho} = \\sum\\left(|WW^{T} − I|\\right) $$\r\n\r\nWhere $\\sum$ indicates a sum across all filter banks, $W$ is a filter bank, and $I$ is the identity matrix","description_state":"present","introduced_year":null,"introduced_by":{"title":"Neural Photo Editing with Introspective Adversarial Networks","paper":"/paper/neural-photo-editing-with-introspective","first_author":"Andrew Brock","n_authors":4,"url_abs":null,"archive_paper_url":"https://paperswithcode.com/paper/neural-photo-editing-with-introspective"},"source":{"url":"http://arxiv.org/abs/1609.07093v3","title":"Neural Photo Editing with Introspective Adversarial Networks","url_on_a_paper_host":true},"code_snippet_url":"https://github.com/pytorch/pytorch/blob/b7bda236d18815052378c88081f64935427d7716/torch/nn/init.py#L423","code_snippet_url_on_a_code_host":true,"categories":[{"area":"General","area_id":"general","collection":"Regularization","url":"/methods/category/regularization","pwc_aliases":[]}],"n_papers_tagged":27,"archive_num_papers":27,"papers_newest_first":[{"paper":null,"slug":"stochastic-orthogonal-regularization-for-deep","title":"Stochastic Orthogonal Regularization for deep projective priors","date":"2025-05-19","arxiv_id":"2505.13078","n_code_links":0,"syntology":null},{"paper":"/paper/preventing-dimensional-collapse-in-self","slug":"preventing-dimensional-collapse-in-self","title":"Preventing Dimensional Collapse in Self-Supervised Learning via Orthogonality Regularization","date":"2024-11-01","arxiv_id":"2411.00392","n_code_links":1,"syntology":{"ran":1,"of":1,"n_ran_checked":1,"n_instrument":0,"unverified":0,"pointer_only":1,"phrase":"1 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":null}},{"paper":"/paper/principal-orthogonal-latent-components","slug":"principal-orthogonal-latent-components","title":"Principal Orthogonal Latent Components Analysis (POLCA Net)","date":"2024-10-09","arxiv_id":"2410.07289","n_code_links":1,"syntology":null},{"paper":null,"slug":"convolutional-neural-network-compression-1","title":"Convolutional Neural Network Compression Based on Low-Rank Decomposition","date":"2024-08-29","arxiv_id":"2408.16289","n_code_links":0,"syntology":null},{"paper":"/paper/cross-view-geolocalization-and-disaster","slug":"cross-view-geolocalization-and-disaster","title":"Cross-View Geolocalization and Disaster Mapping with Street-View and VHR Satellite Imagery: A Case Study of Hurricane IAN","date":"2024-08-13","arxiv_id":"2408.06761","n_code_links":1,"syntology":null},{"paper":null,"slug":"efficient-pareto-manifold-learning-with-low","title":"Efficient Pareto Manifold Learning with Low-Rank Structure","date":"2024-07-30","arxiv_id":"2407.20734","n_code_links":0,"syntology":null},{"paper":"/paper/learn-to-preserve-and-diversify-parameter","slug":"learn-to-preserve-and-diversify-parameter","title":"Learn to Preserve and Diversify: Parameter-Efficient Group with Orthogonal Regularization for Domain Generalization","date":"2024-07-21","arxiv_id":"2407.15085","n_code_links":1,"syntology":{"ran":11,"of":13,"n_ran_checked":6,"n_instrument":5,"unverified":2,"pointer_only":3,"phrase":"11 ran (of which 0 constructed an object rather than computing a result; 6 with no instrument failure: 4 honoured, 0 violated, 2 with no contract checked; 5 where Syntology's instrument failed) · 2 unverified","official":{"repos":["JudgingH/PEGO"],"state":"official (archive's flag): 11 ran","n_ran":11,"n_constructed":0,"n_ran_no_instrument_failure":6,"n_unverified":2,"ran_from_kinds":["official"]}}},{"paper":null,"slug":"energizing-federated-learning-via-filter","title":"Energizing Federated Learning via Filter-Aware Attention","date":"2023-11-18","arxiv_id":"2311.12049","n_code_links":0,"syntology":null},{"paper":null,"slug":"free-lunch-for-gait-recognition-a-novel","title":"Free Lunch for Gait Recognition: A Novel Relation Descriptor","date":"2023-08-22","arxiv_id":"2308.11487","n_code_links":0,"syntology":null},{"paper":"/paper/inferior-alveolar-nerve-segmentation-in-cbct","slug":"inferior-alveolar-nerve-segmentation-in-cbct","title":"Inferior Alveolar Nerve Segmentation in CBCT images using Connectivity-Based Selective Re-training","date":"2023-08-18","arxiv_id":"2308.09298","n_code_links":1,"syntology":null},{"paper":"/paper/revisiting-orthogonality-regularization-a","slug":"revisiting-orthogonality-regularization-a","title":"Revisiting Orthogonality Regularization: A Study for Convolutional Neural Networks in Image Classification","date":"2022-06-23","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/profairrec-provider-fairness-aware-news","slug":"profairrec-provider-fairness-aware-news","title":"ProFairRec: Provider Fairness-aware News Recommendation","date":"2022-04-10","arxiv_id":"2204.04724","n_code_links":1,"syntology":null},{"paper":null,"slug":"dreaming-to-prune-image-deraining-networks","title":"Dreaming To Prune Image Deraining Networks","date":"2022-01-01","arxiv_id":null,"n_code_links":0,"syntology":null},{"paper":null,"slug":"ortho-shot-low-displacement-rank","title":"Ortho-Shot: Low Displacement Rank Regularization with Data Augmentation for Few-Shot Learning","date":"2021-10-18","arxiv_id":"2110.09374","n_code_links":0,"syntology":null},{"paper":"/paper/subspace-learning-for-personalized-federated","slug":"subspace-learning-for-personalized-federated","title":"Connecting Low-Loss Subspace for Personalized Federated Learning","date":"2021-09-16","arxiv_id":"2109.07628","n_code_links":1,"syntology":{"ran":0,"of":2,"n_ran_checked":0,"n_instrument":0,"unverified":2,"pointer_only":2,"phrase":"0 ran · 2 unverified","official":{"repos":["vaseline555/superfed"],"state":"official: harvested, nothing ran","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":2,"ran_from_kinds":[]}}},{"paper":null,"slug":"arabic-aspect-based-sentiment-analysis-using","title":"Arabic aspect based sentiment analysis using bidirectional GRU based models","date":"2021-01-23","arxiv_id":"2101.10539","n_code_links":0,"syntology":null},{"paper":"/paper/disentangling-latent-space-for-unsupervised","slug":"disentangling-latent-space-for-unsupervised","title":"Towards Disentangling Latent Space for Unsupervised Semantic Face Editing","date":"2020-11-05","arxiv_id":"2011.02638","n_code_links":1,"syntology":null},{"paper":"/paper/a-spectral-energy-distance-for-parallel","slug":"a-spectral-energy-distance-for-parallel","title":"A Spectral Energy Distance for Parallel Speech Synthesis","date":"2020-08-03","arxiv_id":"2008.01160","n_code_links":2,"syntology":{"ran":2,"of":3,"n_ran_checked":2,"n_instrument":0,"unverified":1,"pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 0 honoured, 0 violated, 2 with no contract checked; 0 where Syntology's instrument failed) · 1 unverified","official":{"repos":["google-research/google-research"],"state":"community repositories only","n_ran":0,"n_constructed":0,"n_ran_no_instrument_failure":0,"n_unverified":0,"ran_from_kinds":["listed"]}}},{"paper":"/paper/2003-13549","slug":"2003-13549","title":"Rethinking Depthwise Separable Convolutions: How Intra-Kernel Correlations Lead to Improved MobileNets","date":"2020-03-30","arxiv_id":"2003.13549","n_code_links":1,"syntology":null},{"paper":"/paper/transformation-based-adversarial-video","slug":"transformation-based-adversarial-video","title":"Transformation-based Adversarial Video Prediction on Large-Scale Data","date":"2020-03-09","arxiv_id":"2003.04035","n_code_links":0,"syntology":null},{"paper":"/paper/efficient-model-for-image-classification-with","slug":"efficient-model-for-image-classification-with","title":"Efficient Model for Image Classification With Regularization Tricks","date":"2020-02-01","arxiv_id":null,"n_code_links":1,"syntology":null},{"paper":"/paper/high-fidelity-speech-synthesis-with-1","slug":"high-fidelity-speech-synthesis-with-1","title":"High Fidelity Speech Synthesis with Adversarial Networks","date":"2019-09-25","arxiv_id":"1909.11646","n_code_links":3,"syntology":{"ran":3,"of":5,"n_ran_checked":1,"n_instrument":2,"unverified":2,"pointer_only":4,"phrase":"3 ran (of which 0 constructed an object rather than computing a result; 1 with no instrument failure: 0 honoured, 0 violated, 1 with no contract checked; 2 where Syntology's instrument failed) · 2 unverified","official":{"repos":["mbinkowski/DeepSpeechDistances"],"state":"official (archive's flag): 1 ran","n_ran":1,"n_constructed":0,"n_ran_no_instrument_failure":1,"n_unverified":0,"ran_from_kinds":["listed","official"]}}},{"paper":"/paper/efficient-video-generation-on-complex","slug":"efficient-video-generation-on-complex","title":"Adversarial Video Generation on Complex Datasets","date":"2019-07-15","arxiv_id":"1907.06571","n_code_links":1,"syntology":null},{"paper":"/paper/oogan-disentangling-gan-with-one-hot-sampling","slug":"oogan-disentangling-gan-with-one-hot-sampling","title":"OOGAN: Disentangling GAN with One-Hot Sampling and Orthogonal Regularization","date":"2019-05-26","arxiv_id":"1905.10836","n_code_links":1,"syntology":null},{"paper":null,"slug":"can-constrained-attention-networks-for-multi","title":"CAN: Constrained Attention Networks for Multi-Aspect Sentiment Analysis","date":"2018-12-27","arxiv_id":"1812.10735","n_code_links":0,"syntology":null},{"paper":"/paper/large-scale-gan-training-for-high-fidelity","slug":"large-scale-gan-training-for-high-fidelity","title":"Large Scale GAN Training for High Fidelity Natural Image Synthesis","date":"2018-09-28","arxiv_id":"1809.11096","n_code_links":35,"syntology":{"ran":28,"of":41,"n_ran_checked":14,"n_instrument":14,"unverified":13,"pointer_only":14,"phrase":"28 ran (of which 0 constructed an object rather than computing a result; 14 with no instrument failure: 1 honoured, 3 violated, 10 with no contract checked; 14 where Syntology's instrument failed) · 13 unverified","official":null}},{"paper":"/paper/neural-photo-editing-with-introspective","slug":"neural-photo-editing-with-introspective","title":"Neural Photo Editing with Introspective Adversarial Networks","date":"2016-09-22","arxiv_id":"1609.07093","n_code_links":2,"syntology":{"ran":2,"of":2,"n_ran_checked":2,"n_instrument":0,"unverified":0,"pointer_only":0,"phrase":"2 ran (of which 0 constructed an object rather than computing a result; 2 with no instrument failure: 2 honoured, 0 violated, 0 with no contract checked; 0 where Syntology's instrument failed) · 0 unverified","official":{"repos":["ajbrock/Neural-Photo-Editor"],"state":"official (archive's flag): 2 ran","n_ran":2,"n_constructed":0,"n_ran_no_instrument_failure":2,"n_unverified":0,"ran_from_kinds":["official"]}}}],"papers_shown":27,"papers_order":"date (newest first), then slug","paper_counts":{"archive_papers_tagged":27,"with_a_code_link":17,"where_syntology_ran_a_sample":6,"not_listed_spam_title":0,"listed":27,"listed_where_code_ran":6,"where_syntology_ran_a_sample_split":{"with_a_run_with_no_instrument_failure":6,"every_run_a_failure_of_syntologys_instrument":0,"listed_with_a_run_with_no_instrument_failure":6,"listed_every_run_a_failure_of_syntologys_instrument":0,"filter":{"states":["a run with no instrument failure","any run, instrument failures included"],"default":"a run with no instrument failure","note":"on the 'only where code ran' pages the default hides, in the browser, the rows where every run was a failure of Syntology's instrument; the second state shows them again. Rows are hidden, never re-ordered; these twins list every row"}},"definition":"distinct papers the archive tags; 'where Syntology ran a sample' counts papers with at least one harvested sample that ran, which is not a correctness claim"},"papers_where_code_ran":6,"papers_where_code_ran_first_page":"/method/orthogonal-regularization/papers/ran/1","papers_where_code_ran_caption":"We ran code from the paper's repository; we did not isolate this method inside it.","pages":[{"order":"ran","page":1,"of":1,"url":"/method/orthogonal-regularization/papers/ran/1","json":"/method/orthogonal-regularization/papers/ran/1.json","rows":6}],"tasks":[{"task":"/task/image-classification","name":"Image Classification","papers":3},{"task":"/task/image-generation","name":"Image Generation","papers":3},{"task":"/task/data-augmentation","name":"Data Augmentation","papers":2},{"task":"/task/dimensionality-reduction","name":"Dimensionality Reduction","papers":2},{"task":"/task/federated-learning","name":"Federated Learning","papers":2},{"task":"/task/classification","name":"General Classification","papers":2},{"task":"/task/model-compression","name":"Model Compression","papers":2},{"task":"/task/sentence","name":"Sentence","papers":2},{"task":"/task/sentiment-analysis","name":"Sentiment Analysis","papers":2},{"task":"/task/speech-synthesis","name":"Speech Synthesis","papers":2},{"task":"/task/video-generation","name":"Video Generation","papers":2},{"task":"/task/video-prediction","name":"Video Prediction","papers":2},{"task":"/task/high","name":"Vocal Bursts Intensity Prediction","papers":2},{"task":"/task/image-classification","name":"image-classification","papers":2},{"task":"/task/3d-character-animation-from-a-single-photo","name":"3D Character Animation From A Single Photo","papers":1},{"task":"/task/articles","name":"Articles","papers":1},{"task":"/task/aspect-based-sentiment-analysis-1","name":"Aspect-Based Sentiment Analysis","papers":1},{"task":"/task/aspect-based-sentiment-analysis","name":"Aspect-Based Sentiment Analysis (ABSA)","papers":1},{"task":"/task/attribute","name":"Attribute","papers":1},{"task":"/task/classification-1","name":"Classification","papers":1}],"tasks_shown":20,"n_tasks":52,"usage_by_year":[{"year":"2016","papers":1},{"year":"2018","papers":2},{"year":"2019","papers":3},{"year":"2020","papers":5},{"year":"2021","papers":3},{"year":"2022","papers":3},{"year":"2023","papers":3},{"year":"2024","papers":6},{"year":"2025","papers":1}],"row_source":"methods_table","archive":{"source":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","archive_url":"https://paperswithcode.com/method/orthogonal-regularization"},"syntology_read_at":"2026-10-05T00:36:11+00:00","syntology":{"source":"Syntology's have check for this name (the free coverage lookup), read from Syntology's graph","have_url":"https://syntology.ai/api/graph/have?x=Orthogonal%20Regularization","read_at":"2026-10-05T00:59:55+00:00","query":"Orthogonal Regularization","kind":"method","have":"unknown_name","tier":null,"verified_implementation":null,"level":null,"level_meaning":"the served verification level, per answer; never summed across methods","resolved_to":null,"resolution":null,"resolved_name_differs":false,"absence_asserted":false,"absence_unchecked":null,"no_code_is_about_this_method":false,"subject":null,"archive_paper_arxiv_id":"1609.07093","repositories":null,"retrieve_with":null,"name_competition":{"verdict":"none","may_be_wrong_sense":false,"bearers_found":0,"served":null,"leading_other_bearer":null,"n_other_bearers_listed":0,"note":"Nothing in this corpus is named 'Orthogonal Regularization' -- no method node, no paper announcing it in its title, no expanded form declaring it as an acronym."},"name_competition_text":null,"near_matches":["Orthogonality Regularization","Orthogonal Jacobian Regularization (OroJaR)","Orthogonal Decoupling Contrastive Regularization (ODCR)","Orthogonal JEPA","orthogonal growth","cost regularization","regularization loss","Path Regularization"],"code_nearby":[],"code_nearby_caption":null,"origin_paper":null,"line":"name not resolved (unknown_name). The lookup matched no method, paper or venue by this name; that asserts nothing about whether code exists.","level_legend":null},"syntology_have_state":"loaded","record_sha256":"aac7b9cdb24fbc21b68174e21cfc423eedd058c86d507a82e7a2a179796fc70b","record_changed_at":"2026-10-05","record_changed_at_basis":"changed"}