{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/a-novel-performance-evaluation-methodology","title":"A Novel Performance Evaluation Methodology for Single-Target Trackers","arxiv_id":"1503.01313","date":"2015-03-04","proceeding":null,"authors":["Matej Kristan","Jiri Matas","Ales Leonardis","Tomas Vojir","Roman Pflugfelder","Gustavo Fernandez","Georg Nebehay","Fatih Porikli","Luka Cehovin"],"abstract":"This paper addresses the problem of single-target tracker performance\nevaluation. We consider the performance measures, the dataset and the\nevaluation system to be the most important components of tracker evaluation and\npropose requirements for each of them. The requirements are the basis of a new\nevaluation methodology that aims at a simple and easily interpretable tracker\ncomparison. The ranking-based methodology addresses tracker equivalence in\nterms of statistical significance and practical differences. A fully-annotated\ndataset with per-frame annotations with several visual attributes is\nintroduced. The diversity of its visual properties is maximized in a novel way\nby clustering a large number of videos according to their visual attributes.\nThis makes it the most sophistically constructed and annotated dataset to date.\nA multi-platform evaluation system allowing easy integration of third-party\ntrackers is presented as well. The proposed evaluation methodology was tested\non the VOT2014 challenge on the new dataset and 38 trackers, making it the\nlargest benchmark to date. Most of the tested trackers are indeed\nstate-of-the-art since they outperform the standard baselines, resulting in a\nhighly-challenging benchmark. An exhaustive analysis of the dataset from the\nperspective of tracking difficulty is carried out. To facilitate tracker\ncomparison a new performance visualization technique is proposed.","url_abs":"http://arxiv.org/abs/1503.01313v3","url_pdf":"http://arxiv.org/pdf/1503.01313v3.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"clustering","task_name":"Clustering"}],"methods":[],"datasets_introduced":[{"slug":"vot2014","name":"VOT2014","full_name":"Visual Object Tracking Challenge 2014"}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1503.01313","atlas_url":"https://app.syntology.ai/?focus=1503.01313","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1503.01313"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1503.01313\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1503.01313"},"call":"get_concepts_for_paper(arxiv_id=\"1503.01313\")"}],"by_repo":[],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":"the archive holds no code link for this paper","arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"63718f4be8613a5688cfd5b2c60aabc89dcdf52af63d11fe08a1f182c247f252","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}