API tools faq
paste
Advertisement
Guest User

Untitled

a guest
Jul 20th, 2015
649
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 8.37 KB | None | 0 0
raw download clone embed print report
  1. [Sunday, 19 July 2015] [23:45:58 BST] |Join| Drew_ (~drew@108.73.27.106) has joined this channel.
  2. [Sunday, 19 July 2015] [23:46:28 BST] |Quit| chris_99 (~chris_99@unaffiliated/chris-99/x-3062929) has left this server (Remote host closed the connection).
  3. [Sunday, 19 July 2015] [23:48:38 BST] |Quit| Havohey (~Havohey@host-92-16-220-239.as13285.net) has left this server (Remote host closed the connection).
  4. [Sunday, 19 July 2015] [23:55:13 BST] |Join| Quitta (~quitta@176.249.188.35) has joined this channel.
  5. [Sunday, 19 July 2015] [23:55:15 BST] |Quit| latk (~textual@97e64c1f.skybroadband.com) has left this server (Quit: Textual IRC Client: www.textualapp.com).
  6. [Sunday, 19 July 2015] [23:58:19 BST] |Join| athinggoingon (~athinggoi@c-68-84-2-219.hsd1.va.comcast.net) has joined this channel.
  7. [Monday, 20 July 2015] [00:00:18 BST] |Quit| Drew_ (~drew@108.73.27.106) has left this server (Read error: Connection reset by peer).
  8. [Monday, 20 July 2015] [00:03:17 BST] |Join| Houshalter (~Houshalte@oh-71-50-60-81.dhcp.embarqhsd.net) has joined this channel.
  9. [Monday, 20 July 2015] [00:05:18 BST] |Join| zeebrah (~zeebrah@unaffiliated/zeebrah) has joined this channel.
  10. [Monday, 20 July 2015] [00:07:37 BST] |Join| Drew_ (~drew@108.73.27.106) has joined this channel.
  11. [21:48] --> You (~henry@176.27.106.220) have joined the channel ##machinelearning.
  12. [21:48] *** The channel topic is "Machine Learning | Stay on topic. No small talk. | Software: https://mloss.org/ https://j.mp/ML-sw | Video: https://j.mp/ML-videos & https://j.mp/SU-ML-lectures | More: https://reddit.com/r/MachineLearning https://stats.stackexchange.com | Competitions: https://kaggle.com | Related: ##nlp #nupic #scikit-learn ##statistics".
  13. [21:48] *** The topic was set by RandIter!sid32215@gateway/web/irccloud.com/x-qaznxvzvivifnxhv on 31/03/2015 04:34.
  14. [21:49] *** Channel modes: F, no colours allowed, g, no messages from outside, topic protection
  15. [21:49] *** This channel was created on 03/01/2010 19:26.
  16. [21:50] <-- pregressive (~pregressi@207.168.94.62) has left this server (Remote host closed the connection).
  17. [21:55] --> Fred_Flintstone (~Fred_Flin@5ec07c06.skybroadband.com) has joined this channel.
  18. [22:01] --> pi- (~Ohmu@cpc69129-oxfd25-2-0-cust987.4-3.cable.virginm.net) has joined this channel.
  19. [22:04] <-- boucher (~boucher@mobile-107-107-184-46.mycingular.net) has left this server (Read error: Connection reset by peer).
  20. [22:04] --> Vsvg (~Vsvg@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has joined this channel.
  21. [22:04] <-- Vsvg (~Vsvg@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has left this server (Excess Flood).
  22. [22:08] <-- ndrei (~avo@83.142.149.227) has left this server (Ping timeout: 256 seconds).
  23. [22:10] --> ndrei (~avo@83.142.149.227) has joined this channel.
  24. [22:16] --> Uyon (~Uyon@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has joined this channel.
  25. [22:16] <-- Uyon (~Uyon@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has left this server (Excess Flood).
  26. [22:18] <-- jenelizabeth (~jenelizab@cpc76794-brmb10-2-0-cust21.1-3.cable.virginm.net) has left this server (Ping timeout: 256 seconds).
  27. [22:19] <-- bojangle (~bojangle@catv-89-133-130-63.catv.broadband.hu) has left this server (Quit: Leaving).
  28. [22:20] --> zaan (~zaan@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has joined this channel.
  29. [22:21] <-- zaan (~zaan@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has left this server (Excess Flood).
  30. [22:23] <Henry_Jia_T60> Hey guys, I'm reading the paper no more pesky learnign rates and could someone tell me what the function bold face E is?
  31. [22:23] <refefer> which one?
  32. [22:24] <refefer> the original or the most recent one?
  33. [22:24] <Henry_Jia_T60> refefer: this is the one I found, is that the recent or the original http://arxiv.org/pdf/1206.1106.pdf ?
  34. [22:26] <refefer> Henry_Jia_T60: yep, this is the older one
  35. [22:26] --> Houshalter (~Houshalte@oh-71-50-60-81.dhcp.embarqhsd.net) has joined this channel.
  36. [22:26] <refefer> Henry_Jia_T60: this is another one that plays off the name: http://arxiv.org/pdf/1506.01186.pdf
  37. [22:26] <efm> Expected value?
  38. [22:27] <efm> that's usually not doublestruck, though
  39. [22:27] <efm> 3 (1) suggests Expected loss
  40. [22:28] <Henry_Jia_T60> refefer: ok, I think I'l lread the older oen and then the newer one
  41. [22:28] <refefer> Henry_Jia_T60: you should, it's a classic
  42. [22:28] <Henry_Jia_T60> But back to my question, what exactly is E?
  43. [22:28] <efm> 3 (1) suggests Expected loss
  44. [22:28] <-- latk (~textual@97e64c1f.skybroadband.com) has left this server (Quit: Textual IRC Client: www.textualapp.com).
  45. [22:29] <Henry_Jia_T60> What exactly is expected loss?
  46. [22:30] <efm> " Learning rates in SGD are generally decreased accord- ing a schedule of the form..."
  47. [22:30] <Henry_Jia_T60> You've confused me efm
  48. [22:30] <efm> so the Expected loss will be the decrease in learning rate at that stage
  49. [22:31] <efm> You start off learning quickly, then the rate declines.
  50. [22:31] <Henry_Jia_T60> ok, but isn't that what the algo for calculating the learning rate is calculating, so I don't see how it can divide by that?
  51. [22:31] --> Nbgg (~Nbgg@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has joined this channel.
  52. [22:32] <-- Nbgg (~Nbgg@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has left this server (Remote host closed the connection).
  53. [22:32] <Henry_Jia_T60> You've confused me efm
  54. [22:32] --> Arvid (~user@unaffiliated/arvid) has joined this channel.
  55. [22:33] <efm> then I don't know what to say
  56. [22:35] <Henry_Jia_T60> Oh wait I misread it says vi ā‰ˆ Eāˆ‡2Īøi
  57. [22:35] <Henry_Jia_T60> is a recent running average of its square.
  58. [22:36] <Henry_Jia_T60> That makes sense now
  59. [22:37] --> Icjwd (~Icjwd@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has joined this channel.
  60. [22:37] <-- Icjwd (~Icjwd@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has left this server (Max SendQ exceeded).
  61. [22:38] <duschendestroyer> hm
  62. [22:39] <duschendestroyer> I skimmed over that 2015 paper. I think it's strange that they mention adam but don't compare with it or other adaptive optimization algorithms
  63. [22:40] <deadbeef> did i hear adaptive optimization ?
  64. [22:40] <deadbeef> which algorithm are you talking about ?
  65. [22:40] <deadbeef> ADAM perhaps ?
  66. [22:41] <deadbeef> ah the guessing one
  67. [22:42] <deadbeef> ah no you're talking about lecun et al.'s ICML one
  68. [22:45] --> uuueh (~uuueh@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has joined this channel.
  69. [22:49] <-- uuueh (~uuueh@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has left this server (Max SendQ exceeded).
  70. [22:53] <refefer> deadbeef: couple of good ones out these last few years
  71. [22:54] <-- Arvid (~user@unaffiliated/arvid) has left this server (Ping timeout: 240 seconds).
  72. [22:54] <refefer> duschendestroyer: that doesn't really bother me. I
  73. [22:54] <refefer> f I recall correctly, Adam beat out the Adas and RMSProp
  74. [22:55] --> esgd (~esgd@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has joined this channel.
  75. [22:55] <refefer> as well as momentum with nesterov
  76. [22:55] <-- esgd (~esgd@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has left this server (Excess Flood).
  77. [22:57] --> Yin (~Yin@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has joined this channel.
  78. [22:58] <-- Yin (~Yin@AClermont-Ferrand-652-1-359-250.w90-4.abo.wanadoo.fr) has left this server (Excess Flood).
  79. [23:07] <-- Fred_Flintstone (~Fred_Flin@5ec07c06.skybroadband.com) has left this server (Quit: Fred_Flintstone).
  80. [23:08] --> Fred_Flintstone (~Fred_Flin@5ec07c06.skybroadband.com) has joined this channel.
  81. [23:14] *** dpaez_ is now known as dpaez.
  82. [23:14] <-- gliese581h (590fec3d@gateway/web/freenode/ip.89.15.236.61) has left this server (Ping timeout: 246 seconds).
  83. [23:23] <-- DEA7TH (~quassel@cpc33-bmly9-2-0-cust124.2-3.cable.virginm.net) has left this server (Ping timeout: 264 seconds).
  84. [23:24] --> boucher (~boucher@72-48-211-18.dyn.grandenetworks.net) has joined this channel.
  85. [23:35] --> diegoaguilar (~diegoagui@189.129.238.179) has joined this channel.
  86. [23:36] <-- Havohey (~Havohey@host-80-41-244-66.as13285.net) has left this server (Quit: Havohey).
  87. [23:40] <-- diegoaguilar (~diegoagui@189.129.238.179) has left this server (Read error: Connection reset by peer).
  88. [23:41] --> diegoaguilar (~diegoagui@189.129.238.179) has joined this channel.
  89. [23:42] <-- Houshalter (~Houshalte@oh-71-50-60-81.dhcp.embarqhsd.net) has left this server (Ping timeout: 248 seconds).
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement
Public Pastes
Advertisement
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!