{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/salus-fine-grained-gpu-sharing-primitives-for","title":"Salus: Fine-Grained GPU Sharing Primitives for Deep Learning Applications","arxiv_id":"1902.04610","date":"2019-02-12","proceeding":null,"authors":["Peifeng Yu","Mosharaf Chowdhury"],"abstract":"GPU computing is becoming increasingly more popular with the proliferation of\ndeep learning (DL) applications. However, unlike traditional resources such as\nCPU or the network, modern GPUs do not natively support fine-grained sharing\nprimitives. Consequently, implementing common policies such as time sharing and\npreemption are expensive. Worse, when a DL application cannot completely use a\nGPU's resources, the GPU cannot be efficiently shared between multiple\napplications, leading to GPU underutilization.\n  We present Salus to enable two GPU sharing primitives: fast job switching and\nmemory sharing, in order to achieve fine-grained GPU sharing among multiple DL\napplications. Salus implements an efficient, consolidated execution service\nthat exposes the GPU to different DL applications, and enforces fine-grained\nsharing by performing iteration scheduling and addressing associated memory\nmanagement issues. We show that these primitives can then be used to implement\nflexible sharing policies such as fairness, prioritization, and packing for\nvarious use cases. Our integration of Salus with TensorFlow and evaluation on\npopular DL jobs show that Salus can improve the average completion time of DL\ntraining jobs by $3.19\\times$, GPU utilization for hyper-parameter tuning by\n$2.38\\times$, and GPU utilization of DL inference applications by $42\\times$\nover not sharing the GPU and $7\\times$ over NVIDIA MPS with small overhead.","url_abs":"http://arxiv.org/abs/1902.04610v1","url_pdf":"http://arxiv.org/pdf/1902.04610v1.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"salus-fine-grained-gpu-sharing-primitives-for","repo_url":"https://github.com/SymbioticLab/Salus","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":1,"framework":"tf","reach":null}],"tasks":[{"task_slug":null,"task_name":"CPU"},{"task_slug":"deep-learning","task_name":"Deep Learning"},{"task_slug":"fairness","task_name":"Fairness"},{"task_slug":null,"task_name":"GPU"},{"task_slug":"management","task_name":"Management"},{"task_slug":"scheduling","task_name":"Scheduling"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":"https://syntology.ai/paper/1902.04610","atlas_url":"https://app.syntology.ai/?focus=1902.04610","mcp":null,"developers":"https://syntology.ai/developers","held":true,"reason":"arxiv_id_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"agent_calls":[{"tool":"get_citation_path","arguments":{"paper_1":"1902.04610"},"arguments_in":{"paper_2":"another paper's arXiv id or title"},"call":"get_citation_path(paper_1=\"1902.04610\", paper_2=\"…\")"},{"tool":"get_concepts_for_paper","arguments":{"arxiv_id":"1902.04610"},"call":"get_concepts_for_paper(arxiv_id=\"1902.04610\")"}],"by_repo":[{"repo":"SymbioticLab/Salus","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"fe729873db14c254827a5291829ceef32bc4d093e3b44f8940d29ce7d9f5f8f2","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}