{"about":{"non_affiliation":"Code with Papers and Syntology are not affiliated with, endorsed by, or sponsored by Papers with Code, Meta, or the pwc-archive mirror.","site":"https://codewithpapers.app","licence":"CC BY-SA 4.0","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","attribution":"https://codewithpapers.app/attribution","modified":"archive material modified by Syntology; see the attribution page","syntology":{"site":"https://syntology.ai","developers":"https://syntology.ai/developers","mcp":{"server":"https://syntology.ai/mcp","transport":"streamable-http","server_card":"https://syntology.ai/.well-known/mcp/server-card.json","auth":{"type":"trial token, no account","trial_token":"https://syntology.ai/api/oauth/trial/token","method":"POST","docs":"https://syntology.ai/developers"}},"have":"https://syntology.ai/api/graph/have?x=<method, arXiv id or title> (free, answers coverage only)","paper_base":"https://syntology.ai/paper/","atlas_base":"https://app.syntology.ai/?focus="},"machine_readable":[{"url":"https://codewithpapers.app/llms.txt","what":"the machine catalog: every machine-readable file, counted"},{"url":"https://codewithpapers.app/index/manifest.json","what":"paper-to-code index by arXiv id, with Syntology's counts"},{"url":"https://codewithpapers.app/search/manifest.json","what":"site search index (titles, authors) and its files"},{"url":"https://codewithpapers.app/download","what":"bulk files: Syntology's layer, described there"},{"url":"https://codewithpapers.app/build_manifest.json","what":"the build record: inputs, counts, exclusions, probes"}]},"url":"/paper/deep-reinforcement-learning-for-cybersecurity","title":"Deep Reinforcement Learning for Cybersecurity Assessment of Wind Integrated Power Systems","arxiv_id":"2007.03025","date":"2020-11-15","proceeding":null,"authors":[],"abstract":"The integration of renewable energy sources (RES) is rapidly increasing in\nelectric power systems (EPS). While the inclusion of intermittent RES coupled\nwith the wide-scale deployment of communication and sensing devices is\nimportant towards a fully smart grid, it has also expanded the cyber-threat\nlandscape, effectively making power systems vulnerable to cyberattacks. This\npaper proposes a cybersecurity assessment approach designed to assess the\ncyberphysical security of EPS. The work takes into consideration the\nintermittent generation of RES, vulnerabilities introduced by\nmicroprocessor-based electronic information and operational technology (IT/OT)\ndevices, and contingency analysis results. The proposed approach utilizes deep\nreinforcement learning (DRL) and an adapted Common Vulnerability Scoring System\n(CVSS) score tailored to assess vulnerabilities in EPS in order to identify the\noptimal attack transition policy based on N-2 contingency results, i.e., the\nsimultaneous failure of two system elements. The effectiveness of the work is\nvalidated via numerical and real-time simulation experiments performed on\nliterature-based power grid test cases. The results demonstrate how the\nproposed method based on deep Q-network (DQN) performs closely to a\ngraph-search approach in terms of the number of transitions needed to find the\noptimal attack policy, without the need for full observation of the system. In\naddition, the experiments present the method's scalability by showcasing the\nnumber of transitions needed to find the optimal attack transition policy in a\nlarge system such as the Polish 2383 bus test system. The results exhibit how\nthe proposed approach requires one order of magnitude fewer transitions when\ncompared to a random transition policy.","url_abs":"http://arxiv.org/abs/2007.03025v2","url_pdf":"http://arxiv.org/pdf/2007.03025v2.pdf","source":{"archive":"pwc-archive (Hugging Face), CC BY-SA 4.0","snapshot":"2025-07-28","licence_url":"https://creativecommons.org/licenses/by-sa/4.0/legalcode","row_kind":"abstracts"},"code_links":[{"paper_slug":"deep-reinforcement-learning-for-cybersecurity","repo_url":"https://github.com/DSS-lab/DRLCyberAssessment_DQNCode","is_official":1,"mentioned_in_paper":1,"mentioned_in_github":0,"framework":"none","reach":null}],"tasks":[{"task_slug":"deep-reinforcement-learning","task_name":"Deep Reinforcement Learning"},{"task_slug":"reinforcement-learning-1","task_name":"Reinforcement Learning (RL)"},{"task_slug":"reinforcement-learning-2","task_name":"reinforcement-learning"}],"methods":[],"datasets_introduced":[],"methods_introduced":[],"results":[],"syntology":{"syntology_url":null,"atlas_url":null,"mcp":null,"developers":"https://syntology.ai/developers","held":null,"reason":"arxiv_id_not_in_atlas","checked_against":{"atlas_ids":549449,"atlas_ids_sha256":"afd72399dafd9906e9062927f70655952385a3d75488558e1f0484e950ab09b7","read_at":"2026-10-05T01:46:21Z"},"by_repo":[{"repo":"DSS-lab/DRLCyberAssessment_DQNCode","kind":"official","samples":0,"ran":0,"instrument":0,"unverified":0}],"by_repo_is":"one row per repository in the archive's code links, Syntology's graph links or the samples; samples 0 means no sample is linked to this paper, a statement about Syntology's coverage, not about the repository: with harvested_for_other_papers present, Syntology harvested the repository for that many other papers, and without it, Syntology harvested nothing from it; placed_by_identical_code counts samples whose link records no repository, placed here because identical code was harvested from this repository for another paper; ran counts executions on a synthesized input and instrument counts failures of Syntology's instrument, not of the code"},"code_links_note":null,"arxiv_metadata":null,"syntology_extracted_results":null,"record_sha256":"ceacebd42ffc9c7f54a45e482c8d44ebe555a110fe25d32cccb8418a06f3dea0","record_changed_at":"2026-09-28","record_changed_at_basis":"first_hashed"}