{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/unsupervised-feature-learning-of-human","title":"Unsupervised Feature Learning of Human Actions as Trajectories in Pose Embedding Manifold","arxiv_id":"1812.02592","date":"2018-12-06","proceeding":null,"authors":["Jogendra Nath Kundu","Maharshi Gor","Phani Krishna Uppala","R. Venkatesh Babu"],"abstract":"An unsupervised human action modeling framework can provide useful\npose-sequence representation, which can be utilized in a variety of pose\nanalysis applications. In this work we propose a novel temporal pose-sequence\nmodeling framework, which can embed the dynamics of 3D human-skeleton joints to\na continuous latent space in an efficient manner. In contrast to end-to-end\nframework explored by previous works, we disentangle the task of individual\npose representation learning from the task of learning actions as a trajectory\nin pose embedding space. In order to realize a continuous pose embedding\nmanifold with improved reconstructions, we propose an unsupervised, manifold\nlearning procedure named Encoder GAN, (or EnGAN). Further, we use the pose\nembeddings generated by EnGAN to model human actions using a bidirectional RNN\nauto-encoder architecture, PoseRNN. We introduce first-order gradient loss to\nexplicitly enforce temporal regularity in the predicted motion sequence. A\nhierarchical feature fusion technique is also investigated for simultaneous\nmodeling of local skeleton joints along with global pose variations. We\ndemonstrate state-of-the-art transfer-ability of the learned representation\nagainst other supervisedly and unsupervisedly learned motion embeddings for the\ntask of fine-grained action recognition on SBU interaction dataset. Further, we\nshow the qualitative strengths of the proposed framework by visualizing\nskeleton pose reconstructions and interpolations in pose-embedding space, and\nlow dimensional principal component projections of the reconstructed pose\ntrajectories.","url_abs":"http://arxiv.org/abs/1812.02592v1","url_pdf":"http://arxiv.org/pdf/1812.02592v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"unsupervised-feature-learning-of-human","repo_url":"https://github.com/ThomasDupiereux/ADLproject","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"unsupervised-feature-learning-of-human","repo_url":"https://github.com/ThomasDupiereux/EnGAN","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}},{"paper_slug":"unsupervised-feature-learning-of-human","repo_url":"https://github.com/maharshi95/Pose2vec","is_official":0,"mentioned_in_paper":0,"mentioned_in_github":1,"framework":"tf","reach":{"status":"ok"}}],"tasks":[{"task_slug":"action-recognition-in-videos","task_name":"Action Recognition"},{"task_slug":"fine-grained-action-recognition","task_name":"Fine-grained Action Recognition"},{"task_slug":"representation-learning","task_name":"Representation Learning"},{"task_slug":"action-recognition","task_name":"Temporal Action Localization"}],"methods":[{"method_slug":"convolution","method_name":"Convolution"}],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1812.02592","atlas_url":"https://app.syntology.ai/?focus=1812.02592","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1812.02592"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1812.02592\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1812.02592"},"call":"get_concepts_for_paper(arxiv_id=\"1812.02592\")"}],"by_repo":[{"repo":"ThomasDupiereux/ADLproject","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"ThomasDupiereux/EnGAN","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0},{"repo":"maharshi95/Pose2vec","kind":"listed","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"7673d6353e6f965e1faeadf8226681d4c3062eded013863ff03ab1d2d8574679","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}