{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/feature-selection-with-optimal-coordinate","title":"Feature selection with optimal coordinate ascent (OCA)","arxiv_id":"1811.12064","date":"2018-11-29","proceeding":null,"authors":["David Saltiel","Eric Benhamou"],"abstract":"In machine learning, Feature Selection (FS) is a major part of efficient\nalgorithm. It fuels the algorithm and is the starting block for our prediction.\nIn this paper, we present a new method, called Optimal Coordinate Ascent (OCA)\nthat allows us selecting features among block and individual features. OCA\nrelies on coordinate ascent to find an optimal solution for gradient boosting\nmethods score (number of correctly classified samples). OCA takes into account\nthe notion of dependencies between variables forming blocks in our\noptimization. The coordinate ascent optimization solves the issue of the NP\nhard original problem where the number of combinations rapidly explode making a\ngrid search unfeasible. It reduces considerably the number of iterations\nchanging this NP hard problem into a polynomial search one. OCA brings\nsubstantial differences and improvements compared to previous coordinate ascent\nfeature selection method: we group variables into block and individual\nvariables instead of a binary selection. Our initial guess is based on the\nk-best group variables making our initial point more robust. We also introduced\nnew stopping criteria making our optimization faster. We compare these two\nmethods on our data set. We found that our method outperforms the initial one.\nWe also compare our method to the Recursive Feature Elimination (RFE) method\nand find that OCA leads to the minimum feature set with the highest score. This\nis a nice byproduct of our method as it provides empirically the most compact\ndata set with optimal performance.","url_abs":"http://arxiv.org/abs/1811.12064v3","url_pdf":"http://arxiv.org/pdf/1811.12064v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"feature-selection-with-optimal-coordinate","repo_url":"https://github.com/davidsaltiel/OCA","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"feature-selection","task_name":"feature selection"}],"methods":[{"method_slug":"affine-coupling","method_name":"Affine Coupling"},{"method_slug":"normalizing-flows","method_name":"Normalizing Flows"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"davidsaltiel/OCA","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"b2d412b3c9adbd0efb0efecbe9cd0a4c6b32729d55ca29fc719a8b16e657e38a","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}