{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/sart-similarity-analogies-and-relatedness-for","title":"SART - Similarity, Analogies, and Relatedness for Tatar Language: New Benchmark Datasets for Word Embeddings Evaluation","arxiv_id":"1904.00365","date":"2019-03-31","proceeding":null,"authors":["Albina Khusainova","Adil Khan","Adín Ramírez Rivera"],"abstract":"There is a huge imbalance between languages currently spoken and\ncorresponding resources to study them. Most of the attention naturally goes to\nthe \"big\" languages: those which have the largest presence in terms of media\nand number of speakers. Other less represented languages sometimes do not even\nhave a good quality corpus to study them. In this paper, we tackle this\nimbalance by presenting a new set of evaluation resources for Tatar, a language\nof the Turkic language family which is mainly spoken in Tatarstan Republic,\nRussia.\n  We present three datasets: Similarity and Relatedness datasets that consist\nof human scored word pairs and can be used to evaluate semantic models; and\nAnalogies dataset that comprises analogy questions and allows to explore\nsemantic, syntactic, and morphological aspects of language modeling. All three\ndatasets build upon existing datasets for the English language and follow the\nsame structure. However, they are not mere translations. They take into account\nspecifics of the Tatar language and expand beyond the original datasets. We\nevaluate state-of-the-art word embedding models for two languages using our\nproposed datasets for Tatar and the original datasets for English and report\nour findings on performance comparison.","url_abs":"http://arxiv.org/abs/1904.00365v1","url_pdf":"http://arxiv.org/pdf/1904.00365v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"sart-similarity-analogies-and-relatedness-for","repo_url":"https://github.com/tat-nlp/SART","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null}],"tasks":[{"task_slug":"embeddings-evaluation","task_name":"Embeddings Evaluation"},{"task_slug":"language-modeling","task_name":"Language Modeling"},{"task_slug":"language-modelling","task_name":"Language Modelling"},{"task_slug":"word-embeddings","task_name":"Word Embeddings"}],"methods":[],"datasets_introduced":[{"slug":"sart","name":"SART","full_name":null}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"tat-nlp/SART","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"6c4ffa38d4f686e23b291c6f1163b757f90030923e5ac737131ea14bfe54d8b5","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}