Detection and Diagnosis of Inter-Turn Short Circuit Faults of PMSM for Electric Vehicles Based on Deep Reinforcement Learning
Abstract
The fault diagnosis of electric vehicle motors is one of the exciting topics, and machine learning-based artificial intelligence proved its worth in this field. The primitive methods of machine learning, such as the support vector machine (SVM) and Artificial nural network (ANN) suffered from feature extraction problems, the efficiency of the system depended on the quality of these extracted features until deep learning and deep neural networks came to solve This problem, Although the efficient performance of the deep neural network, it needs excellent experience in selecting parameters and building the structure of the neural network. The emergence of deep reinforcement learning, capable of handling raw data directly and constructing end-to-end systems to link raw fault data with its corresponding mode, represents a significant advancement in the field of machine learning. Furthermore, deep reinforcement learning exhibits greater intelligence compared to previous methods. In this Research, Deep reinforcement learning will be applied in diagnosing inter-turn short circuit faults and finding the level of fault in the built-in wheel permanent magnet synchronous motor of electric vehicles. The proposed method proved highly effective for detecting faults, with an efficiency of 99.9 % and has a promising future in building a general system capable of predicting faults in the early stages.
References
- B. M. Saied and L. A. Mohammed, Permanent Magnet Synchronous Motor Drive Based on Modified Space Vector Pulse Width Modulation, AL-Rafdain Eng. J., vol. 22, no. 4, pp. 7487, 2014, doi: 10.33899/rengj.2014.100886.
- B. S. Mahmood and S. A. Dawwd, Development and Evaluation of two Memory Architectures for the Hardware Version of CNN Face Recognizer, Al-Rafidain Eng. J., vol. 27, no. 2, pp. 190197, 2022.
- C. S. Wang, I. H. Kao, and J. W. Perng, Fault diagnosis and fault frequency determination of permanent magnet synchronous motor based on deep learning, Sensors, vol. 21, no. 11, Jun. 2021, doi: 10.3390/s21113608.
- D. Silver et al., Mastering the game of Go with deep neural networks and tree search, Nature, vol. 529, no. 7587, pp. 484489, 2016, doi: 10.1038/nature16961.
- F. Pusse and M. Klusch, Hybrid online POMDP planning and deep reinforcement learning for safer self-driving cars, IEEE Intell. Veh. Symp. Proc., vol. 2019-June, no. Iv, pp. 10131020, 2019, doi: 10.1109/IVS.2019.8814125.
- G. Hill, O. Heidrich, F. Creutzig, and P. Blythe, The role of electric vehicles in near-term mitigation pathways and achieving the UKs carbon budget, Appl. Energy, vol. 251, Oct. 2019, doi: 10.1016/j.apenergy.2019.04.107.
- H. Gu, Y. Wang, S. Hong, and G. Gui, Blind channel identification aided generalized automatic modulation recognition based on deep learning, IEEE Access, vol. 7, pp. 110722110729, 2019, doi: 10.1109/ACCESS.2019.2934354.
- H. M. Chung, S. Maharjan, Y. Zhang, and F. Eliassen, Distributed Deep Reinforcement Learning for Intelligent Load Scheduling in Residential Smart Grids, IEEE Trans. Ind. Informatics, vol. 17, no. 4, pp. 27522763, 2021, doi: 10.1109/TII.2020.3007167.
- I. H. Kao, W. J. Wang, Y. H. Lai, and J. W. Perng, Analysis of Permanent Magnet Synchronous Motor Fault Diagnosis Based on Learning, IEEE Trans. Instrum. Meas., vol. 68, no. 2, pp. 310324, Feb. 2019, doi: 10.1109/TIM.2018.2847800.
- I. Kandel and M. Castelli, Transfer learning with convolutional neural networks for diabetic retinopathy image classification. A review, Applied Sciences (Switzerland), vol. 10, no. 6. MDPI AG, Mar. 01, 2020. doi: 10.3390/app10062021.
- IEEE Robotics and Automation Society and Institute of Electrical and Electronics Engineers, ICRA2017: IEEE International Conference on Robotics and Automation: program: May 29-June 3, 2017, Singapore.
- J. A. Sanguesa, V. Torres-Sanz, P. Garrido, F. J. Martinez, and J. M. Marquez-Barja, A review on electric vehicles: Technologies and challenges, Smart Cities, vol. 4, no. 1. MDPI, pp. 372404, Mar. 01, 2021. doi: 10.3390/smartcities4010022.
- J. Feng, M. Huang, L. Zhao, Y. Yang, and X. Zhu, Reinforcement Learning for Relation Classification from Noisy Data. [Online]. Available: www.aaai.org
- K. Arulkumaran, M. P. Deisenroth, M. Brundage, and A. A. Bharath, Deep reinforcement learning: A brief survey, IEEE Signal Processing Magazine, vol. 34, no. 6. Institute of Electrical and Electronics Engineers Inc., pp. 2638, Nov. 01, 2017. doi: 10.1109/MSP.2017.2743240.
- K. Lei, B. Zhang, Y. Li, M. Yang, and Y. Shen, Time-driven feature-aware jointly deep reinforcement learning for financial signal representation and algorithmic trading, Expert Syst. Appl., vol. 140, pp. 114, 2020, doi: 10.1016/j.eswa.2019.112872.
- M. Zafarani, E. Bostanci, Y. Qi, T. Goktas, and B. Akin, Interturn short-circuit faults in permanent magnet synchronous machines: An extended review and comprehensive analysis, IEEE Journal of Emerging and Selected Topics in Power Electronics, vol. 6, no. 4. Institute of Electrical and Electronics Engineers Inc., pp. 21732191, Dec. 01, 2018. doi: 10.1109/JESTPE.2018.2811538.
- R. Zhang and Y. Gu, A Transfer Learning Framework with a One-Dimensional Deep Subdomain Adaptation Network for Bearing Fault Diagnosis under Different Working Conditions, Sensors, vol. 22, no. 4, 2022, doi: 10.3390/s22041624.
- S. Albawi, T. A. Mohammed, and S. Al-Zawi, Understanding of a convolutional neural network, in 2017 International Conference on Engineering and Technology (ICET), IEEE, Aug. 2017, pp. 16. doi: 10.1109/ICEngTechnol.2017.8308186.
- S. Levine, C. Finn, T. Darrell, and P. Abbeel, End-to-end training of deep visuomotor policies, J. Mach. Learn. Res., vol. 17, pp. 140, 2016.
- S. Liang, Y. Chen, H. Liang, and X. Li, Sparse representation and SVM diagnosis method inter-turn short-circuit fault in PMSM, Appl. Sci., vol. 9, no. 2, Jan. 2019, doi: 10.3390/app9020224.
- S. S. Moosavi, Q. Esmaili, A. Djerdir, and Y. A. Amirat, Inter-Turn Fault Detection in Stator Winding of PMSM Using Wavelet Transform, in 2017 IEEE Vehicle Power and Propulsion Conference (VPPC), IEEE, Dec. 2017, pp. 15. doi: 10.1109/VPPC.2017.8330891.
- Universita degli studi Roma tre, European Association for Signal Processing, IEEE Signal Processing Society, and Institute of Electrical and Electronics Engineers, EUSIPCO 2018: 26th European Signal Processing Conference: Rome, Italy, September 3 - 7, 2018.
- V. Mnih et al., Human-level control through deep reinforcement learning, Nature, vol. 518, no. 7540, pp. 529533, Feb. 2015, doi: 10.1038/nature14236.
- V. Mnih et al., Playing Atari with Deep Reinforcement Learning, Dec. 2013, [Online]. Available: http://arxiv.org/abs/1312.5602
- V. Nguyen et al., A Method for Incipient Interturn Fault Detection and Severity Estimation of Induction Motors under Inherent Asymmetry and Voltage Imbalance, IEEE Trans. Transp. Electrif., vol. 3, no. 3, pp. 703715, Sep. 2017, doi: 10.1109/TTE.2017.2726351.
- W. Jung, S. H. Yun, Y. S. Lim, S. Cheong, and Y. H. Park, Vibration and current dataset of three-phase permanent magnet synchronous motors with stator faults, Data Br., vol. 47, p. 108952, 2023, doi: 10.1016/j.dib.2023.108952
- W. Najem, O. Al-Yozbaky, and S. Khudher, Effect of Electric Vehicle Charging Stations on the Performance of Distance Relay, Al-Rafidain Eng. J., vol. 28, no. 1, pp. 133144, 2023, doi: 10.33899/rengj.2022.135233.1194.
- Y. D. Nyanteh, S. K. Srivastava, C. S. Edrington, and D. A. Cartes, Application of artificial intelligence to stator winding fault diagnosis in Permanent Magnet Synchronous Machines, Electr. Power Syst. Res., vol. 103, pp. 201213, 2013, doi: 10.1016/j.epsr.2013.05.018.
- Y. Ding et al., Intelligent fault diagnosis for rotating machinery using deep Q-network based health state classification: A deep reinforcement learning approach, Adv. Eng. Informatics, vol. 42, no. January, p. 100977, 2019, doi: 10.1016/j.aei.2019.100977.
- Y. Zhang, G. Liu, W. Zhao, H. Zhou, Q. Chen, and M. Wei, Online Diagnosis of Slight Interturn Short-Circuit Fault for a Low-Speed Permanent Magnet Synchronous Motor, IEEE Trans. Transp. Electrif., vol. 7, no. 1, pp. 104113, Mar. 2021, doi: 10.1109/TTE.2020.2991271.
- Y.-W. Youn, D.-H. Hwang, S.-J. Song, and Y.-H. Kim, Detection and Classification of Demagnetization and Short-Circuited Turns in Permanent Magnet Synchronous Motors, J Electr Eng Technol, vol. 13, no. 4, pp. 16141622, 2018, doi: 10.5370/JEET.2018.13.4.1614.
- Z. Cao, A. Mahmoudi, S. Kahourzade, and W. L. Soong, An Overview of Electric Motors for Electric Vehicles, in Proceedings of 2021 31st Australasian Universities Power Engineering Conference, AUPEC 2021, Institute of Electrical and Electronics Engineers Inc., 2021. doi: 10.1109/AUPEC52110.2021.9597739.
- Z. Zhang, D. Zhang, and R. C. Qiu, Deep reinforcement learning for power system applications: An overview, CSEE Journal of Power and Energy Systems, vol. 6, no. 1. Institute of Electrical and Electronics Engineers Inc., pp. 213225, Mar. 01, 2020. doi: 10.17775/CSEEJPES.2019.00920.