{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/meta-learning-with-hessian-free-approach-in","title":"Meta-Learning with Hessian-Free Approach in Deep Neural Nets Training","arxiv_id":"1805.08462","date":"2018-05-22","proceeding":null,"authors":["Boyu Chen","Wenlian Lu","Ernest Fokoue"],"abstract":"Meta-learning is a promising method to achieve efficient training method\ntowards deep neural net and has been attracting increases interests in recent\nyears. But most of the current methods are still not capable to train complex\nneuron net model with long-time training process. In this paper, a novel\nsecond-order meta-optimizer, named Meta-learning with Hessian-Free(MLHF)\napproach, is proposed based on the Hessian-Free approach. Two recurrent neural\nnetworks are established to generate the damping and the precondition matrix of\nthis Hessian-Free framework. A series of techniques to meta-train the MLHF\ntowards stable and reinforce the meta-training of this optimizer, including the\ngradient calculation of $H$. Numerical experiments on deep convolution neural\nnets, including CUDA-convnet and ResNet18(v2), with datasets of CIFAR10 and\nILSVRC2012, indicate that the MLHF shows good and continuous training\nperformance during the whole long-time training process, i.e., both the\nrapid-decreasing early stage and the steadily-deceasing later stage, and so is\na promising meta-learning framework towards elevating the training efficiency\nin real-world deep neural nets.","url_abs":"http://arxiv.org/abs/1805.08462v2","url_pdf":"http://arxiv.org/pdf/1805.08462v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"meta-learning-with-hessian-free-approach-in","repo_url":"https://github.com/ozzzp/MLHF","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":null}],"tasks":[{"task_slug":"meta-learning","task_name":"Meta-Learning"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"ozzzp/MLHF","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"7c718966b4a612bcbba535241a8b2e1d1564bb20bacd0c4e36fe076d3f1f6ee9","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}