Intelligent Deep-Q-Network-Based Energy Management for an Isolated Microgrid

Round 1

Reviewer 1 Report

The paper is interesting, but there are a few main concerns that I have with the present manuscript.

First of all, what is the reason why one should consider RL instead of any model-based approach in this study? The problem formulation provided is more akin a standard MILP approach and I don't really see an advantage in using a model-free technique in this setting.

Among all the DRL approaches why use DQN? the nature of the control variables is continuous for the most part (at least battery and diesel) so using a discrete-space control policy seems strange.

The reward design process should be clarified, they seem far too arbitrary in the current version.

The simulations are appropriate and the conclusions are reasonable.

Author Response

Please see the attachment.

Author Response File: Author Response.pdf

Reviewer 2 Report

The authors proposed an isolated hybrid renewable energy system energy management system based on deep learning approach. In here, solar and wind energy are used as the primary resources. Moreover, the electrolyzed hydrogen is utilized to store energy for the operation of fuel cell. Battery and fuel cell are storage systems that supply energy in case of insufficiency, while a diesel generator adds a backup system to fulfill the load demand under bad weather conditions. The results look encouraging and motivating. But there are still some contents, which need be revised in order to meet the requirements of publish. A number of concerns listed as follows:

(1)   The abstract should be narrow down on the problem and highlight the need of the proposed work with experimental results

(2)   In the introduction section, you should give the novelty and the contributions of your works.

(3)   The method/approach in the context of the proposed work should be written in detail.

(4)   How about the computation complexity of the proposed method?

(5)   At Line 100, “There are only some publications focused on RL and DRL based energy management  of a stand-alone microgrid”…. There are some grammatical mistakes and typo errors. Please proof read from native speaker.

(6)   Figure 1. is not clear. Please revise it.

(7)   Figure 4. The framework of our deep Q-network is wrong. Please correct it.

(8)   The literature review is problematic. The authors discussed the importance. In contrast, the review on technical development is insufficient. For example, 10.1109/JSTARS.2021.3059451 ; 10.3390/agriculture12060793;  10.1007/s10489-022-03719-6 ；10.1016/j.engappai.2022.105139 and so on.

(9)   The effectiveness of the proposed method needs to be verified by contrast experiments.

(10) The authors need to interpret the meanings of the variables

(11) Figures quality need to be enhanced to better understanding.

Author Response

Please see the attachment.

Author Response File: Author Response.pdf

Round 2

Reviewer 1 Report

The author's reply was reasonable

Author Response

Please see the attachment.

Author Response File: Author Response.docx

Reviewer 2 Report

According to the revised paper, I have appreciated the deep revision of the contents and the present form of this manuscript.  There is little content, which need be revised according to the comment of reviewer in order to meet the requirements of publish. A number of concerns listed as follows:

(1) Please highlight your contributions in introduction.

 (2) How to determine these parameters? The author should give a detailed explanation.

 

(3) Conclusion: What are the advantages and disadvantages of this study compared to the existing studies in this area?

(4)In order to further highlight the introduction, some suggested references in previous comment should be added to the revised paper for improving the reviews part.

 

(5) Further correct typological mistakes and mathematical errors.

(6) Add the sections of the “Institutional Review Board Statement”, “Informed Consent Statement”.

 

I hope that the authors can carefully and further revise this manuscript according to the reviewer comments in order to meet the requirements of publish.

 

 

Author Response

Please see the attachment.

Author Response File: Author Response.docx