{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/logic-tensor-networks-for-semantic-image","title":"Logic Tensor Networks for Semantic Image Interpretation","arxiv_id":"1705.08968","date":"2017-05-24","proceeding":null,"authors":["Ivan Donadello","Luciano Serafini","Artur d'Avila Garcez"],"abstract":"Semantic Image Interpretation (SII) is the task of extracting structured\nsemantic descriptions from images. It is widely agreed that the combined use of\nvisual data and background knowledge is of great importance for SII. Recently,\nStatistical Relational Learning (SRL) approaches have been developed for\nreasoning under uncertainty and learning in the presence of data and rich\nknowledge. Logic Tensor Networks (LTNs) are an SRL framework which integrates\nneural networks with first-order fuzzy logic to allow (i) efficient learning\nfrom noisy data in the presence of logical constraints, and (ii) reasoning with\nlogical formulas describing general properties of the data. In this paper, we\ndevelop and apply LTNs to two of the main tasks of SII, namely, the\nclassification of an image's bounding boxes and the detection of the relevant\npart-of relations between objects. To the best of our knowledge, this is the\nfirst successful application of SRL to such SII tasks. The proposed approach is\nevaluated on a standard image processing benchmark. Experiments show that the\nuse of background knowledge in the form of logical constraints can improve the\nperformance of purely data-driven approaches, including the state-of-the-art\nFast Region-based Convolutional Neural Networks (Fast R-CNN). Moreover, we show\nthat the use of logical background knowledge adds robustness to the learning\nsystem when errors are present in the labels of the training data.","url_abs":"http://arxiv.org/abs/1705.08968v1","url_pdf":"http://arxiv.org/pdf/1705.08968v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"logic-tensor-networks-for-semantic-image","repo_url":"https://github.com/sbadredd/semantic-pascal-part","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"none","reach":{"status":"unanswered"}}],"tasks":[{"task_slug":"relational-reasoning","task_name":"Relational Reasoning"},{"task_slug":"tensor-networks","task_name":"Tensor Networks"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1705.08968","atlas_url":"https://app.syntology.ai/?focus=1705.08968","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1705.08968"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1705.08968\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1705.08968"},"call":"get_concepts_for_paper(arxiv_id=\"1705.08968\")"}],"by_repo":[{"repo":"sbadredd/semantic-pascal-part","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"2ceb9545cbab5c6b8ea485f82cf43345008c3d016ca9e8d1e482142c858391d1","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}