The paper contributes valuable insights to understanding the influence of regularization in policy optimization in MDPs. The reviewers reached a consensus about the paper's results having significant merit, and the paper can be accepted for presentation.