{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/iohprofiler-a-benchmarking-and-profiling-tool","title":"IOHprofiler: A Benchmarking and Profiling Tool for Iterative Optimization Heuristics","arxiv_id":"1810.05281","date":"2018-10-11","proceeding":null,"authors":["Carola Doerr","Hao Wang","Furong Ye","Sander van Rijn","Thomas Bäck"],"abstract":"IOHprofiler is a new tool for analyzing and comparing iterative optimization\nheuristics. Given as input algorithms and problems written in C or Python, it\nprovides as output a statistical evaluation of the algorithms' performance by\nmeans of the distribution on the fixed-target running time and the fixed-budget\nfunction values. In addition, IOHprofiler also allows to track the evolution of\nalgorithm parameters, making our tool particularly useful for the analysis,\ncomparison, and design of (self-)adaptive algorithms.\n  IOHprofiler is a ready-to-use software. It consists of two parts: an\nexperimental part, which generates the running time data, and a post-processing\npart, which produces the summarizing comparisons and statistical evaluations.\nThe experimental part is build on the COCO software, which has been adjusted to\ncope with optimization problems that are formulated as functions\n$f:\\mathcal{S}^n \\to \\R$ with $\\mathcal{S}$ being a discrete alphabet of\nintegers. The post-processing part is our own work. It can be used as a\nstand-alone tool for the evaluation of running time data of arbitrary benchmark\nproblems. It accepts as input files not only the output files of IOHprofiler,\nbut also original COCO data files. The post-processing tool is designed for an\ninteractive evaluation, allowing the user to chose the ranges and the precision\nof the displayed data according to his/her needs.\n  IOHprofiler is available on GitHub at \\url{https://github.com/IOHprofiler}.","url_abs":"http://arxiv.org/abs/1810.05281v1","url_pdf":"http://arxiv.org/pdf/1810.05281v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"iohprofiler-a-benchmarking-and-profiling-tool","repo_url":"https://github.com/IOHprofiler/Analyzer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"iohprofiler-a-benchmarking-and-profiling-tool","repo_url":"https://github.com/IOHprofiler/IOHAnalyzer","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"iohprofiler-a-benchmarking-and-profiling-tool","repo_url":"https://github.com/IOHprofiler/IOHexperimenter","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"iohprofiler-a-benchmarking-and-profiling-tool","repo_url":"https://github.com/IOHprofiler/Post-Processing","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}},{"paper_slug":"iohprofiler-a-benchmarking-and-profiling-tool","repo_url":"https://github.com/nojhan/IOHexperimenter","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"ok","spdx":"NOASSERTION"}}],"tasks":[{"task_slug":"benchmarking","task_name":"Benchmarking"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1810.05281","atlas_url":"https://app.syntology.ai/?focus=1810.05281","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1810.05281"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1810.05281\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1810.05281"},"call":"get_concepts_for_paper(arxiv_id=\"1810.05281\")"}],"by_repo":[{"repo":"IOHprofiler/Analyzer","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"IOHprofiler/IOHAnalyzer","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"IOHprofiler/IOHexperimenter","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"IOHprofiler/Post-Processing","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"nojhan/IOHexperimenter","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"76f90be6a358c619fdbcf4e234cd29b68fa6bbc67c29970434b051b130abd81c","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}