{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/progressivespinalnet-architecture-for-fc","title":"ProgressiveSpinalNet architecture for FC layers","arxiv_id":"2103.11373","date":"2021-03-21","proceeding":null,"authors":["Praveen Chopra"],"abstract":"In deeplearning models the FC (fully connected) layer has biggest important role for classification of the input based on the learned features from previous layers. The FC layers has highest numbers of parameters and fine-tuning these large numbers of parameters, consumes most of the computational resources, so in this paper it is aimed to reduce these large numbers of parameters significantly with improved performance. The motivation is inspired from SpinalNet and other biological architecture. The proposed architecture has a gradient highway between input to output layers and this solves the problem of diminishing gradient in deep networks. In this all the layers receives the input from previous layers as well as the CNN layer output and this way all layers contribute in decision making with last layer. This approach has improved classification performance over the SpinalNet architecture and has SOTA performance on many datasets such as Caltech101, KMNIST, QMNIST and EMNIST. The source code is available at https://github.com/praveenchopra/ProgressiveSpinalNet.","url_abs":"https://arxiv.org/abs/2103.11373v1","url_pdf":"https://arxiv.org/pdf/2103.11373v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"progressivespinalnet-architecture-for-fc","repo_url":"https://github.com/praveenchopra/ProgressiveSpinalNet","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"decision-making","task_name":"Decision Making"},{"task_slug":"fine-grained-image-classification","task_name":"Fine-Grained Image Classification"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"},{"method_slug":"dense-connections","method_name":"Dense Connections"},{"method_slug":"dropout","method_name":"Dropout"},{"method_slug":"max-pooling","method_name":"Max Pooling"},{"method_slug":"relu","method_name":"ReLU"},{"method_slug":"sgd","method_name":"SGD"},{"method_slug":"softmax","method_name":"Softmax"}],"datasets_introduced":[],"methods_introduced":[],"results":[{"leaderboard":"/sota/fine-grained-image-classification-on-bird-225","task":"Fine-Grained Image Classification","dataset":"Bird-225","model":"Pre trained wide-resnet-101","rank_in_archive_order":2,"of":5,"metrics":{"Accuracy":"99.55"},"uses_additional_data":false},{"leaderboard":"/sota/fine-grained-image-classification-on-caltech","task":"Fine-Grained Image Classification","dataset":"Caltech-101","model":"Pre trained wide-resnet-101","rank_in_archive_order":18,"of":18,"metrics":{"Accuracy":"97.76"},"uses_additional_data":false},{"leaderboard":"/sota/fine-grained-image-classification-on-emnist","task":"Fine-Grained Image Classification","dataset":"EMNIST-Digits","model":"VGG-5","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"99.82"},"uses_additional_data":false},{"leaderboard":"/sota/fine-grained-image-classification-on-emnist-1","task":"Fine-Grained Image Classification","dataset":"EMNIST-Letters","model":"VGG-5","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"95.86"},"uses_additional_data":false},{"leaderboard":"/sota/fine-grained-image-classification-on-fruits","task":"Fine-Grained Image Classification","dataset":"Fruits-360","model":"Pre trained wide-resnet-101","rank_in_archive_order":3,"of":3,"metrics":{"Accuracy":"99.97"},"uses_additional_data":false},{"leaderboard":"/sota/fine-grained-image-classification-on-1","task":"Fine-Grained Image Classification","dataset":"Kuzushiji-MNIST","model":"VGG-5","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"98.98"},"uses_additional_data":false},{"leaderboard":"/sota/fine-grained-image-classification-on-mnist","task":"Fine-Grained Image Classification","dataset":"MNIST","model":"Vanilla FC layer only","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"98.19"},"uses_additional_data":false},{"leaderboard":"/sota/fine-grained-image-classification-on-qmnist","task":"Fine-Grained Image Classification","dataset":"QMNIST","model":"VGG-5","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"99.6867"},"uses_additional_data":false},{"leaderboard":"/sota/fine-grained-image-classification-on-stl-10","task":"Fine-Grained Image Classification","dataset":"STL-10","model":"Pre trained wide-resnet-101","rank_in_archive_order":1,"of":1,"metrics":{"Accuracy":"98.18"},"uses_additional_data":false}],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"praveenchopra/ProgressiveSpinalNet","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"fec41955e64bc202fd5bdf8befe87173ae145b4881e1b4c37af98c6133b75c4b","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}