{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/neural-vector-spaces-for-unsupervised","title":"Neural Vector Spaces for Unsupervised Information Retrieval","arxiv_id":"1708.02702","date":"2017-08-09","proceeding":null,"authors":["Christophe Van Gysel","Maarten de Rijke","Evangelos Kanoulas"],"abstract":"We propose the Neural Vector Space Model (NVSM), a method that learns\nrepresentations of documents in an unsupervised manner for news article\nretrieval. In the NVSM paradigm, we learn low-dimensional representations of\nwords and documents from scratch using gradient descent and rank documents\naccording to their similarity with query representations that are composed from\nword representations. We show that NVSM performs better at document ranking\nthan existing latent semantic vector space methods. The addition of NVSM to a\nmixture of lexical language models and a state-of-the-art baseline vector space\nmodel yields a statistically significant increase in retrieval effectiveness.\nConsequently, NVSM adds a complementary relevance signal. Next to semantic\nmatching, we find that NVSM performs well in cases where lexical matching is\nneeded.\n  NVSM learns a notion of term specificity directly from the document\ncollection without feature engineering. We also show that NVSM learns\nregularities related to Luhn significance. Finally, we give advice on how to\ndeploy NVSM in situations where model selection (e.g., cross-validation) is\ninfeasible. We find that an unsupervised ensemble of multiple models trained\nwith different hyperparameter values performs better than a single\ncross-validated model. Therefore, NVSM can safely be used for ranking documents\nwithout supervised relevance judgments.","url_abs":"http://arxiv.org/abs/1708.02702v4","url_pdf":"http://arxiv.org/pdf/1708.02702v4.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"neural-vector-spaces-for-unsupervised","repo_url":"https://github.com/cvangysel/cuNVSM","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"none","reach":null},{"paper_slug":"neural-vector-spaces-for-unsupervised","repo_url":"https://github.com/osirrc/nvsm-docker","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"neural-vector-spaces-for-unsupervised","repo_url":"https://github.com/osirrc2019/nvsm-docker","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":null},{"paper_slug":"neural-vector-spaces-for-unsupervised","repo_url":"https://github.com/rodgzilla/NVSM_pytorch","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"pytorch","reach":null}],"tasks":[{"task_slug":"document-ranking","task_name":"Document Ranking"},{"task_slug":"feature-engineering","task_name":"Feature Engineering"},{"task_slug":"information-retrieval","task_name":"Information Retrieval"},{"task_slug":"model-selection","task_name":"Model Selection"},{"task_slug":"retrieval","task_name":"Retrieval"},{"task_slug":"specificity","task_name":"Specificity"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1708.02702","atlas_url":"https://app.syntology.ai/?focus=1708.02702","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1708.02702"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1708.02702\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1708.02702"},"call":"get_concepts_for_paper(arxiv_id=\"1708.02702\")"}],"by_repo":[{"repo":"cvangysel/cuNVSM","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"osirrc/nvsm-docker","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"osirrc2019/nvsm-docker","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"rodgzilla/NVSM_pytorch","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"31b7f1a67bafdd838369d618ddcde59942444b93ec29efda3f1d1d490567065e","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}