浏览代码

Change the learning rate decay rate

nagadomi 9 年之前
父节点
当前提交
8fec6f1b5a
共有 1 个文件被更改,包括 1 次插入1 次删除
  1. 1 1
      train.lua

+ 1 - 1
train.lua

@@ -302,7 +302,7 @@ local function train()
 	 else
 	 else
 	    lrd_count = lrd_count + 1
 	    lrd_count = lrd_count + 1
 	    if lrd_count > 2 then
 	    if lrd_count > 2 then
-	       adam_config.learningRate = adam_config.learningRate * 0.8
+	       adam_config.learningRate = adam_config.learningRate * 0.874
 	       print("* learning rate decay: " .. adam_config.learningRate)
 	       print("* learning rate decay: " .. adam_config.learningRate)
 	       lrd_count = 0
 	       lrd_count = 0
 	    end
 	    end