{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/the-impact-of-random-models-on-clustering","title":"The Impact of Random Models on Clustering Similarity","arxiv_id":"1701.06508","date":"2017-01-23","proceeding":null,"authors":["Alexander J. Gates","Yong-Yeol Ahn"],"abstract":"Clustering is a central approach for unsupervised learning. After clustering\nis applied, the most fundamental analysis is to quantitatively compare\nclusterings. Such comparisons are crucial for the evaluation of clustering\nmethods as well as other tasks such as consensus clustering. It is often argued\nthat, in order to establish a baseline, clustering similarity should be\nassessed in the context of a random ensemble of clusterings. The prevailing\nassumption for the random clustering ensemble is the permutation model in which\nthe number and sizes of clusters are fixed. However, this assumption does not\nnecessarily hold in practice; for example, multiple runs of K-means clustering\nreturns clusterings with a fixed number of clusters, while the cluster size\ndistribution varies greatly. Here, we derive corrected variants of two\nclustering similarity measures (the Rand index and Mutual Information) in the\ncontext of two random clustering ensembles in which the number and sizes of\nclusters vary. In addition, we study the impact of one-sided comparisons in the\nscenario with a reference clustering. The consequences of different random\nmodels are illustrated using synthetic examples, handwriting recognition, and\ngene expression data. We demonstrate that the choice of random model can have a\ndrastic impact on the ranking of similar clustering pairs, and the evaluation\nof a clustering method with respect to a random baseline; thus, the choice of\nrandom clustering model should be carefully justified.","url_abs":"http://arxiv.org/abs/1701.06508v2","url_pdf":"http://arxiv.org/pdf/1701.06508v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"the-impact-of-random-models-on-clustering","repo_url":"https://github.com/ajgates42/clusim","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"clustering","task_name":"Clustering"},{"task_slug":"clustering-ensemble","task_name":"Clustering Ensemble"},{"task_slug":"handwriting-recognition","task_name":"Handwriting Recognition"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1701.06508","atlas_url":"https://app.syntology.ai/?focus=1701.06508","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1701.06508"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1701.06508\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1701.06508"},"call":"get_concepts_for_paper(arxiv_id=\"1701.06508\")"}],"by_repo":[{"repo":"ajgates42/clusim","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"e66f164b2ded89b3dbe9d3d13e0ea2cbd85ef4bf3cfeba4edb1a301f6462122a","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}