optimizer.state_dict()['param_groups'][0]['lr']
from: https://blog.csdn.net/ftimes/article/details/120975402
PyTorch可视化动态调整学习率lr_scheduler:https://blog.csdn.net/ayiya_Oese/article/details/120704261
或者:scheduler.get_last_lr()[0]