Guest User

Untitled

a guest
Mar 9th, 2019
50
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
C++ 0.58 KB | None | 0 0
  1.  if (gradientNorm && sampleVariance && batchSize)
  2.     {
  3.       if (batchSize < function.NumFunctions())
  4.       {
  5.         stepSizeDecay = (1 - (1 / ((double) batchSize - 1) * sampleVariance) /
  6.             (batchSize * gradientNorm)) / batchSize;    
  7.         // Here it should be v in-place of  batchSize. Where v is calcuated using
  8.         // Equation 9 on page 8 of https://arxiv.org/pdf/1610.05792.pdf                  
  9.    
  10.       }
  11.       else
  12.       {
  13.         stepSizeDecay = 1 / function.NumFunctions();
  14.        // similarly here it should be v instead of  function.NumFunctions();
  15.       }
  16.     }
Add Comment
Please, Sign In to add comment