{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/texttopicnet-self-supervised-learning-of","title":"TextTopicNet - Self-Supervised Learning of Visual Features Through Embedding Images on Semantic Text Spaces","arxiv_id":"1807.02110","date":"2018-07-04","proceeding":null,"authors":["Yash Patel","Lluis Gomez","Raul Gomez","Marçal Rusiñol","Dimosthenis Karatzas","C. V. Jawahar"],"abstract":"The immense success of deep learning based methods in computer vision heavily\nrelies on large scale training datasets. These richly annotated datasets help\nthe network learn discriminative visual features. Collecting and annotating\nsuch datasets requires a tremendous amount of human effort and annotations are\nlimited to popular set of classes. As an alternative, learning visual features\nby designing auxiliary tasks which make use of freely available\nself-supervision has become increasingly popular in the computer vision\ncommunity.\n  In this paper, we put forward an idea to take advantage of multi-modal\ncontext to provide self-supervision for the training of computer vision\nalgorithms. We show that adequate visual features can be learned efficiently by\ntraining a CNN to predict the semantic textual context in which a particular\nimage is more probable to appear as an illustration. More specifically we use\npopular text embedding techniques to provide the self-supervision for the\ntraining of deep CNN.\n  Our experiments demonstrate state-of-the-art performance in image\nclassification, object detection, and multi-modal retrieval compared to recent\nself-supervised or naturally-supervised approaches.","url_abs":"http://arxiv.org/abs/1807.02110v1","url_pdf":"http://arxiv.org/pdf/1807.02110v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"texttopicnet-self-supervised-learning-of","repo_url":"https://github.com/lluisgomez/TextTopicNet","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"image-classification","task_name":"Image Classification"},{"task_slug":"object-detection","task_name":"Object Detection"},{"task_slug":"retrieval","task_name":"Retrieval"},{"task_slug":"self-supervised-learning","task_name":"Self-Supervised Learning"},{"task_slug":"image-classification","task_name":"image-classification"},{"task_slug":"object-detection-1","task_name":"object-detection"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"lluisgomez/TextTopicNet","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"a5a2e9f37ba5a3b4b664e11437c2880e10b725dccf7e3fb87a127bd690fab7f1","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}