PSP: A Framework to Allocate Resources to Power Storage Systems under Cyber-Physical Attacks

This risk assessment of the smart grid focuses on energy storage, which is essential but largely unaddressed by the current literature. This work concentrates on actions (such as decreasing or increasing power reserve and power dispatch, performing load curtailment or load shedding, or repair of nodes) the defender should take to meet power demand at minimum operating cost in the presence of cyber-physical attacks on the power and information infrastructure of the smart grid. In this paper, we formulate a Power Storage Protection (PSP) framework against a fixed opponent (adversary). We fix the strategy for the adversary and model the problem as a Partially Observable Markov Decision Process (POMDP) from the perspective of the defender (power utility) and solve it using POMDP solver. We provide a theoretical framework for formulating the above problem and provide experimental results to support our claim using a simplified PSP scenario in which optimal POMDP policy is computed efficiently.

Content

Author and article information

Contributors

Yatin Wadhawan

Dr. Clifford Neuman

Dr. AlMajali Anas

Conference

Publication date: August 2018

Publication date (Print): August 2018

Pages: 57-66

Affiliations

[1 ]University of Southern California, Los Angeles, CA

[2 ]The Hashemite University, Zarqa, Jordan

Article

DOI: 10.14236/ewic/ICS2018.7

SO-VID: d6b4afa8-2706-4405-8095-1927244dd4cb

License:

This work is licensed under a Creative Commons Attribution 4.0 Unported License. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/

Conference name: 5th International Symposium for ICS & SCADA Cyber Security Research 2018

Conference acronym: ICS-CSR 2018

Conference number: 5

Conference location: University of Hamburg, Germany

Conference date: 29 - 30 August 2018

Conference sponsor: Electronic Workshops in Computing (eWiC)

Conference theme: ICS & SCADA Cyber Security Research

Product

Product Information: 1477-9358BCS Learning & Development

Self URI (article page): https://www.scienceopen.com/hosted-document?doi=10.14236/ewic/ICS2018.7

Self URI (journal page): https://ewic.bcs.org/

REFERENCES

Tao LiMircea EremiaMohammad Shahidehpour “Interdependency of natural gas network and power system security” IEEE Transactions on Power Systems 23 4 2008 1817 1824
Y. WadhawanC. Neuman 2016 October Evaluating Resilience of Gas Pipeline Systems Under Cyber-Physical Attacks: A Function- Based Methodology Proceedings of the 2nd ACM Workshop on Cyber-Physical Systems Security and Privacy 71 80
C. NeumanK. Tan Mediating cyber and physical threat propagation in secure smart grid architectures Smart Grid Communications (SmartGridComm), IEEE International Conference on 238 243 2011
Rui TanHoang Hai NguyenEddy YS FooXinshu DongDavid KY YauZbigniew KalbarczykRavishankar K. IyerHoay Beng Gooi “Optimal False Data Injection Attack against Automatic Generation Control in Power Grids” In 2016 ACM/IEEE 7th International Conference on Cyber-Physical Systems (ICCPS) 1 10 IEEE 2016
Pirathayini SrikanthaDeepa Kundur “A DER Attack-Mitigation Differential Game for Smart Grid Security Analysis” IEEE Transactions on Smart Grid 7 3 2016 1476 1485
SANS E-ISAC 2016 Analysis of the Cyber Attack on the Ukrainian Power Grid March 2016 http://www.nerc.com/pa/CI/ESISAC/Documents/E-ISAC_SANS_Ukraine_DUC_18Mar2016.pdf
Ping YiTing ZhuQingquan ZhangYue WuLi Pan “Puppet attack: A denial of service attack in advanced metering infrastructure network” Journal of Network and Computer Applications 59 2016 325 332
A. AlMajaliE. RiceA. ViswanathanK. TanC. Neuman A systems approach to analysing cyber-physical threats in the Smart Grid 2013 IEEE International Conference on Smart Grid Communications
T. ZhuA. MishraD. IrwinN. SharmaP. ShenoyD. Towsley 2011 November The case for efficient renewable energy management in smart homes Proceedings of the Third ACM Workshop on Embedded Sensing Systems for Energy-Efficiency in Buildings 67 72 ACM
S. F. SantosD. Z. FitiwiM. R. CruzC. M. CabritaJ. P. Catalão 2017 Impacts of optimal energy storage deployment and network reconfiguration on renewable integration level in distribution systems Applied Energy 185 44 55
G. AnderssonP. DonalekR. FarmerN. HatziargyriouI. KamwaP. KundurR. Schulz 2005 Causes of the 2003 major grid blackouts in North America and Europe, and recommended means to improve system dynamic performance IEEE Transactions on Power Systems 20 4 1922 1928
K. PanA. M. TeixeiraM. CvetkovicP. Palensky 2016 November Combined data integrity and availability attacks on state estimation in cyber-physical power grids Smart Grid Communications (SmartGridComm), 2016 IEEE International Conference on 271 277 IEEE
Jun YanHaibo HeXiangnan ZhongYufei Tang “Q-learningbased vulnerability analysis of smart grid against sequential topology attacks” IEEE Transactions on Information Forensics and Security 12 1 2017): 200 210
H. LiL. LaiR. C. Qiu 2011 A denial-of-service jamming game for remote state monitoring in smart grid Information Sciences and Systems (CISS), 2011 45th Annual Conference on 1 6 IEEE
J. ChenQ. Zhu 2017 A game-theoretic framework for resilient and distributed generation control of renewable energies in microgrids IEEE Transactions on Smart Grid 8 1 285 295
Anthony CassandraMichael L. LittmanNevin L. Zhang “Incremental pruning: A simple, fast, exact method for partially observable Markov decision processes” Proceedings of the Thirteenth conference on Uncertainty in artificial intelligence 54 61 Morgan Kaufmann Publishers Inc. 1997
Frans OliehoekMatthijs TJ SpaanNikos Vlassis “Best-response play in partially observable card games” In Proceedings of the 14th annual machine learning conference of Belgium and the Netherlands 45 50 2005
Alpha Guardian 2017 Energy Storage System Vulnerabilities http://www.alphaguardian.net/energy-storage-system-cyber-vulnerabilities/
Anthony R. Casandra 2003-2018 Partially Observable Markov Decision Process http://www.pomdp.org

Comments

Comment on this article

[1] Tao LiMircea EremiaMohammad Shahidehpour “Interdependency of natural gas network and power system security” IEEE Transactions on Power Systems 23 4 2008 1817 1824

[2] Y. WadhawanC. Neuman 2016 October Evaluating Resilience of Gas Pipeline Systems Under Cyber-Physical Attacks: A Function- Based Methodology Proceedings of the 2nd ACM Workshop on Cyber-Physical Systems Security and Privacy 71 80

[3] C. NeumanK. Tan Mediating cyber and physical threat propagation in secure smart grid architectures Smart Grid Communications (SmartGridComm), IEEE International Conference on 238 243 2011

[4] Rui TanHoang Hai NguyenEddy YS FooXinshu DongDavid KY YauZbigniew KalbarczykRavishankar K. IyerHoay Beng Gooi “Optimal False Data Injection Attack against Automatic Generation Control in Power Grids” In 2016 ACM/IEEE 7th International Conference on Cyber-Physical Systems (ICCPS) 1 10 IEEE 2016

[5] Pirathayini SrikanthaDeepa Kundur “A DER Attack-Mitigation Differential Game for Smart Grid Security Analysis” IEEE Transactions on Smart Grid 7 3 2016 1476 1485

[6] SANS E-ISAC 2016 Analysis of the Cyber Attack on the Ukrainian Power Grid March 2016 http://www.nerc.com/pa/CI/ESISAC/Documents/E-ISAC_SANS_Ukraine_DUC_18Mar2016.pdf

[7] Ping YiTing ZhuQingquan ZhangYue WuLi Pan “Puppet attack: A denial of service attack in advanced metering infrastructure network” Journal of Network and Computer Applications 59 2016 325 332

[8] A. AlMajaliE. RiceA. ViswanathanK. TanC. Neuman A systems approach to analysing cyber-physical threats in the Smart Grid 2013 IEEE International Conference on Smart Grid Communications

[9] T. ZhuA. MishraD. IrwinN. SharmaP. ShenoyD. Towsley 2011 November The case for efficient renewable energy management in smart homes Proceedings of the Third ACM Workshop on Embedded Sensing Systems for Energy-Efficiency in Buildings 67 72 ACM

[10] S. F. SantosD. Z. FitiwiM. R. CruzC. M. CabritaJ. P. Catalão 2017 Impacts of optimal energy storage deployment and network reconfiguration on renewable integration level in distribution systems Applied Energy 185 44 55

[11] G. AnderssonP. DonalekR. FarmerN. HatziargyriouI. KamwaP. KundurR. Schulz 2005 Causes of the 2003 major grid blackouts in North America and Europe, and recommended means to improve system dynamic performance IEEE Transactions on Power Systems 20 4 1922 1928

[12] K. PanA. M. TeixeiraM. CvetkovicP. Palensky 2016 November Combined data integrity and availability attacks on state estimation in cyber-physical power grids Smart Grid Communications (SmartGridComm), 2016 IEEE International Conference on 271 277 IEEE

[13] Jun YanHaibo HeXiangnan ZhongYufei Tang “Q-learningbased vulnerability analysis of smart grid against sequential topology attacks” IEEE Transactions on Information Forensics and Security 12 1 2017): 200 210

[14] H. LiL. LaiR. C. Qiu 2011 A denial-of-service jamming game for remote state monitoring in smart grid Information Sciences and Systems (CISS), 2011 45th Annual Conference on 1 6 IEEE

[15] J. ChenQ. Zhu 2017 A game-theoretic framework for resilient and distributed generation control of renewable energies in microgrids IEEE Transactions on Smart Grid 8 1 285 295

[16] Anthony CassandraMichael L. LittmanNevin L. Zhang “Incremental pruning: A simple, fast, exact method for partially observable Markov decision processes” Proceedings of the Thirteenth conference on Uncertainty in artificial intelligence 54 61 Morgan Kaufmann Publishers Inc. 1997

[17] Frans OliehoekMatthijs TJ SpaanNikos Vlassis “Best-response play in partially observable card games” In Proceedings of the 14th annual machine learning conference of Belgium and the Netherlands 45 50 2005

[18] Alpha Guardian 2017 Energy Storage System Vulnerabilities http://www.alphaguardian.net/energy-storage-system-cyber-vulnerabilities/

[19] Anthony R. Casandra 2003-2018 Partially Observable Markov Decision Process http://www.pomdp.org