{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/from-lifestyle-vlogs-to-everyday-interactions","title":"From Lifestyle Vlogs to Everyday Interactions","arxiv_id":"1712.02310","date":"2017-12-06","proceeding":"CVPR 2018 6","authors":["David F. Fouhey","Wei-cheng Kuo","Alexei A. Efros","Jitendra Malik"],"abstract":"A major stumbling block to progress in understanding basic human\ninteractions, such as getting out of bed or opening a refrigerator, is lack of\ngood training data. Most past efforts have gathered this data explicitly:\nstarting with a laundry list of action labels, and then querying search engines\nfor videos tagged with each label. In this work, we do the reverse and search\nimplicitly: we start with a large collection of interaction-rich video data and\nthen annotate and analyze it. We use Internet Lifestyle Vlogs as the source of\nsurprisingly large and diverse interaction data. We show that by collecting the\ndata first, we are able to achieve greater scale and far greater diversity in\nterms of actions and actors. Additionally, our data exposes biases built into\ncommon explicitly gathered data. We make sense of our data by analyzing the\ncentral component of interaction -- hands. We benchmark two tasks: identifying\nsemantic object contact at the video level and non-semantic contact state at\nthe frame level. We additionally demonstrate future prediction of hands.","url_abs":"http://arxiv.org/abs/1712.02310v1","url_pdf":"http://arxiv.org/pdf/1712.02310v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[],"tasks":[{"task_slug":"diversity","task_name":"Diversity"},{"task_slug":"future-prediction","task_name":"Future prediction"}],"methods":[],"datasets_introduced":[{"slug":"vlog-dataset","name":"VLOG Dataset","full_name":""}],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1712.02310","atlas_url":"https://app.syntology.ai/?focus=1712.02310","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1712.02310"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1712.02310\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1712.02310"},"call":"get_concepts_for_paper(arxiv_id=\"1712.02310\")"}],"by_repo":[],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":"the archive holds no code link for this paper","arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"49fa5e73a6ccd3d2ab0b6d8ecc448bbe53f75307d0bbb96266eb2ad525dc1dba","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}