API tools faq
paste
lamiastella

removing model.init_sims(replace = True)

lamiastella
Oct 4th, 2016
349
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 10.74 KB | None | 0 0
raw download clone embed print report
  1. jalal@klein:~/computer_vision/image_retrieval$ python gensim_test.py
  2. 2016-10-04 18:03:14,414 : INFO : collecting all words and their counts
  3. 2016-10-04 18:03:14,416 : INFO : PROGRESS: at sentence #0, processed 0 words, keeping 0 word types
  4. 2016-10-04 18:03:19,996 : INFO : collected 253854 word types from a corpus of 17005207 raw words and 1701 sentences
  5. 2016-10-04 18:03:20,351 : INFO : min_count=5 retains 71290 unique words (drops 182564)
  6. 2016-10-04 18:03:20,351 : INFO : min_count leaves 16718844 word corpus (98% of original 17005207)
  7. 2016-10-04 18:03:20,544 : INFO : deleting the raw counts dictionary of 253854 items
  8. 2016-10-04 18:03:20,572 : INFO : sample=0.001 downsamples 38 most-common words
  9. 2016-10-04 18:03:20,572 : INFO : downsampling leaves estimated 12506280 word corpus (74.8% of prior 16718844)
  10. 2016-10-04 18:03:20,572 : INFO : estimated required memory for 71290 words and 100 dimensions: 92677000 bytes
  11. 2016-10-04 18:03:20,753 : INFO : resetting layer weights
  12. 2016-10-04 18:03:21,473 : INFO : training model with 3 workers on 71290 vocabulary and 100 features, using sg=0 hs=0 sample=0.001 negative=5
  13. 2016-10-04 18:03:21,473 : INFO : expecting 1701 sentences, matching count from corpus used for vocabulary survey
  14. 2016-10-04 18:03:22,476 : INFO : PROGRESS: at 0.98% examples, 608624 words/s, in_qsize 5, out_qsize 0
  15. 2016-10-04 18:03:23,495 : INFO : PROGRESS: at 2.06% examples, 634025 words/s, in_qsize 6, out_qsize 1
  16. 2016-10-04 18:03:24,495 : INFO : PROGRESS: at 3.14% examples, 645783 words/s, in_qsize 6, out_qsize 0
  17. 2016-10-04 18:03:25,510 : INFO : PROGRESS: at 4.15% examples, 640245 words/s, in_qsize 6, out_qsize 0
  18. 2016-10-04 18:03:26,518 : INFO : PROGRESS: at 5.09% examples, 629858 words/s, in_qsize 6, out_qsize 0
  19. 2016-10-04 18:03:27,525 : INFO : PROGRESS: at 6.13% examples, 633697 words/s, in_qsize 5, out_qsize 1
  20. 2016-10-04 18:03:28,531 : INFO : PROGRESS: at 7.25% examples, 644543 words/s, in_qsize 5, out_qsize 0
  21. 2016-10-04 18:03:29,540 : INFO : PROGRESS: at 8.74% examples, 678940 words/s, in_qsize 5, out_qsize 0
  22. 2016-10-04 18:03:30,545 : INFO : PROGRESS: at 10.16% examples, 702602 words/s, in_qsize 6, out_qsize 1
  23. 2016-10-04 18:03:31,557 : INFO : PROGRESS: at 11.44% examples, 711614 words/s, in_qsize 4, out_qsize 2
  24. 2016-10-04 18:03:32,559 : INFO : PROGRESS: at 12.72% examples, 719998 words/s, in_qsize 6, out_qsize 1
  25. 2016-10-04 18:03:33,566 : INFO : PROGRESS: at 14.12% examples, 732460 words/s, in_qsize 6, out_qsize 0
  26. 2016-10-04 18:03:34,577 : INFO : PROGRESS: at 15.53% examples, 742642 words/s, in_qsize 6, out_qsize 1
  27. 2016-10-04 18:03:35,583 : INFO : PROGRESS: at 16.91% examples, 750049 words/s, in_qsize 6, out_qsize 0
  28. 2016-10-04 18:03:36,587 : INFO : PROGRESS: at 18.25% examples, 755700 words/s, in_qsize 5, out_qsize 1
  29. 2016-10-04 18:03:37,588 : INFO : PROGRESS: at 19.61% examples, 761293 words/s, in_qsize 6, out_qsize 0
  30. 2016-10-04 18:03:38,594 : INFO : PROGRESS: at 20.91% examples, 763946 words/s, in_qsize 6, out_qsize 1
  31. 2016-10-04 18:03:39,593 : INFO : PROGRESS: at 22.23% examples, 766770 words/s, in_qsize 5, out_qsize 0
  32. 2016-10-04 18:03:40,596 : INFO : PROGRESS: at 23.52% examples, 768553 words/s, in_qsize 3, out_qsize 2
  33. 2016-10-04 18:03:41,601 : INFO : PROGRESS: at 24.79% examples, 769845 words/s, in_qsize 5, out_qsize 0
  34. 2016-10-04 18:03:42,606 : INFO : PROGRESS: at 26.26% examples, 777167 words/s, in_qsize 5, out_qsize 0
  35. 2016-10-04 18:03:43,614 : INFO : PROGRESS: at 27.84% examples, 786955 words/s, in_qsize 5, out_qsize 0
  36. 2016-10-04 18:03:44,620 : INFO : PROGRESS: at 29.37% examples, 794234 words/s, in_qsize 6, out_qsize 1
  37. 2016-10-04 18:03:45,629 : INFO : PROGRESS: at 30.63% examples, 793762 words/s, in_qsize 6, out_qsize 0
  38. 2016-10-04 18:03:46,644 : INFO : PROGRESS: at 31.82% examples, 791348 words/s, in_qsize 5, out_qsize 0
  39. 2016-10-04 18:03:47,650 : INFO : PROGRESS: at 33.09% examples, 791355 words/s, in_qsize 6, out_qsize 0
  40. 2016-10-04 18:03:48,658 : INFO : PROGRESS: at 34.33% examples, 790808 words/s, in_qsize 5, out_qsize 0
  41. 2016-10-04 18:03:49,666 : INFO : PROGRESS: at 35.81% examples, 794839 words/s, in_qsize 5, out_qsize 0
  42. 2016-10-04 18:03:50,668 : INFO : PROGRESS: at 37.39% examples, 801210 words/s, in_qsize 5, out_qsize 0
  43. 2016-10-04 18:03:51,676 : INFO : PROGRESS: at 38.82% examples, 804151 words/s, in_qsize 6, out_qsize 1
  44. 2016-10-04 18:03:52,681 : INFO : PROGRESS: at 39.93% examples, 800271 words/s, in_qsize 5, out_qsize 0
  45. 2016-10-04 18:03:53,690 : INFO : PROGRESS: at 41.34% examples, 802401 words/s, in_qsize 6, out_qsize 1
  46. 2016-10-04 18:03:54,694 : INFO : PROGRESS: at 42.74% examples, 804456 words/s, in_qsize 5, out_qsize 1
  47. 2016-10-04 18:03:55,687 : INFO : PROGRESS: at 44.03% examples, 804476 words/s, in_qsize 6, out_qsize 0
  48. 2016-10-04 18:03:56,690 : INFO : PROGRESS: at 45.43% examples, 806615 words/s, in_qsize 6, out_qsize 1
  49. 2016-10-04 18:03:57,694 : INFO : PROGRESS: at 46.88% examples, 809571 words/s, in_qsize 5, out_qsize 0
  50. 2016-10-04 18:03:58,695 : INFO : PROGRESS: at 48.30% examples, 811778 words/s, in_qsize 5, out_qsize 0
  51. 2016-10-04 18:03:59,703 : INFO : PROGRESS: at 49.63% examples, 812234 words/s, in_qsize 5, out_qsize 0
  52. 2016-10-04 18:04:00,705 : INFO : PROGRESS: at 50.83% examples, 810707 words/s, in_qsize 6, out_qsize 0
  53. 2016-10-04 18:04:01,719 : INFO : PROGRESS: at 52.20% examples, 811803 words/s, in_qsize 5, out_qsize 1
  54. 2016-10-04 18:04:02,724 : INFO : PROGRESS: at 53.46% examples, 811032 words/s, in_qsize 6, out_qsize 0
  55. 2016-10-04 18:04:03,732 : INFO : PROGRESS: at 54.79% examples, 811489 words/s, in_qsize 5, out_qsize 0
  56. 2016-10-04 18:04:04,738 : INFO : PROGRESS: at 56.13% examples, 811561 words/s, in_qsize 6, out_qsize 0
  57. 2016-10-04 18:04:05,751 : INFO : PROGRESS: at 57.39% examples, 810692 words/s, in_qsize 5, out_qsize 0
  58. 2016-10-04 18:04:06,755 : INFO : PROGRESS: at 58.61% examples, 809585 words/s, in_qsize 5, out_qsize 0
  59. 2016-10-04 18:04:07,763 : INFO : PROGRESS: at 59.98% examples, 810318 words/s, in_qsize 5, out_qsize 2
  60. 2016-10-04 18:04:08,778 : INFO : PROGRESS: at 61.43% examples, 811995 words/s, in_qsize 5, out_qsize 0
  61. 2016-10-04 18:04:09,779 : INFO : PROGRESS: at 62.55% examples, 809542 words/s, in_qsize 6, out_qsize 0
  62. 2016-10-04 18:04:10,792 : INFO : PROGRESS: at 63.77% examples, 808419 words/s, in_qsize 5, out_qsize 0
  63. 2016-10-04 18:04:11,800 : INFO : PROGRESS: at 65.09% examples, 808699 words/s, in_qsize 5, out_qsize 1
  64. 2016-10-04 18:04:12,813 : INFO : PROGRESS: at 66.20% examples, 806516 words/s, in_qsize 5, out_qsize 0
  65. 2016-10-04 18:04:13,809 : INFO : PROGRESS: at 67.21% examples, 803251 words/s, in_qsize 5, out_qsize 0
  66. 2016-10-04 18:04:14,815 : INFO : PROGRESS: at 68.31% examples, 801071 words/s, in_qsize 6, out_qsize 0
  67. 2016-10-04 18:04:15,818 : INFO : PROGRESS: at 69.48% examples, 799746 words/s, in_qsize 6, out_qsize 0
  68. 2016-10-04 18:04:16,826 : INFO : PROGRESS: at 70.72% examples, 799370 words/s, in_qsize 4, out_qsize 0
  69. 2016-10-04 18:04:17,834 : INFO : PROGRESS: at 71.96% examples, 798803 words/s, in_qsize 5, out_qsize 0
  70. 2016-10-04 18:04:18,836 : INFO : PROGRESS: at 73.35% examples, 799994 words/s, in_qsize 5, out_qsize 0
  71. 2016-10-04 18:04:19,856 : INFO : PROGRESS: at 74.36% examples, 796884 words/s, in_qsize 5, out_qsize 0
  72. 2016-10-04 18:04:20,859 : INFO : PROGRESS: at 75.40% examples, 794226 words/s, in_qsize 5, out_qsize 0
  73. 2016-10-04 18:04:21,878 : INFO : PROGRESS: at 76.53% examples, 792420 words/s, in_qsize 6, out_qsize 2
  74. 2016-10-04 18:04:22,880 : INFO : PROGRESS: at 77.60% examples, 790387 words/s, in_qsize 5, out_qsize 0
  75. 2016-10-04 18:04:23,882 : INFO : PROGRESS: at 78.74% examples, 789075 words/s, in_qsize 6, out_qsize 1
  76. 2016-10-04 18:04:24,894 : INFO : PROGRESS: at 79.96% examples, 788534 words/s, in_qsize 5, out_qsize 0
  77. 2016-10-04 18:04:25,903 : INFO : PROGRESS: at 81.18% examples, 787834 words/s, in_qsize 5, out_qsize 0
  78. 2016-10-04 18:04:26,926 : INFO : PROGRESS: at 82.26% examples, 785919 words/s, in_qsize 5, out_qsize 1
  79. 2016-10-04 18:04:27,913 : INFO : PROGRESS: at 82.68% examples, 778052 words/s, in_qsize 5, out_qsize 0
  80. 2016-10-04 18:04:28,917 : INFO : PROGRESS: at 83.72% examples, 776057 words/s, in_qsize 5, out_qsize 0
  81. 2016-10-04 18:04:29,920 : INFO : PROGRESS: at 84.80% examples, 774638 words/s, in_qsize 5, out_qsize 0
  82. 2016-10-04 18:04:30,930 : INFO : PROGRESS: at 85.75% examples, 772008 words/s, in_qsize 6, out_qsize 0
  83. 2016-10-04 18:04:31,930 : INFO : PROGRESS: at 86.89% examples, 771300 words/s, in_qsize 5, out_qsize 0
  84. 2016-10-04 18:04:32,938 : INFO : PROGRESS: at 87.84% examples, 768791 words/s, in_qsize 5, out_qsize 0
  85. 2016-10-04 18:04:33,955 : INFO : PROGRESS: at 88.90% examples, 767163 words/s, in_qsize 6, out_qsize 0
  86. 2016-10-04 18:04:34,962 : INFO : PROGRESS: at 89.97% examples, 765827 words/s, in_qsize 5, out_qsize 0
  87. 2016-10-04 18:04:35,975 : INFO : PROGRESS: at 91.03% examples, 764403 words/s, in_qsize 5, out_qsize 0
  88. 2016-10-04 18:04:36,981 : INFO : PROGRESS: at 92.19% examples, 763920 words/s, in_qsize 5, out_qsize 1
  89. 2016-10-04 18:04:37,979 : INFO : PROGRESS: at 93.29% examples, 762811 words/s, in_qsize 6, out_qsize 1
  90. 2016-10-04 18:04:38,981 : INFO : PROGRESS: at 94.38% examples, 761810 words/s, in_qsize 5, out_qsize 0
  91. 2016-10-04 18:04:39,995 : INFO : PROGRESS: at 95.50% examples, 760738 words/s, in_qsize 5, out_qsize 1
  92. 2016-10-04 18:04:40,998 : INFO : PROGRESS: at 96.59% examples, 759615 words/s, in_qsize 5, out_qsize 0
  93. 2016-10-04 18:04:42,014 : INFO : PROGRESS: at 97.67% examples, 758448 words/s, in_qsize 5, out_qsize 0
  94. 2016-10-04 18:04:43,028 : INFO : PROGRESS: at 98.75% examples, 757316 words/s, in_qsize 6, out_qsize 0
  95. 2016-10-04 18:04:44,032 : INFO : PROGRESS: at 99.81% examples, 756033 words/s, in_qsize 5, out_qsize 0
  96. 2016-10-04 18:04:44,185 : INFO : worker thread finished; awaiting finish of 2 more threads
  97. 2016-10-04 18:04:44,186 : INFO : worker thread finished; awaiting finish of 1 more threads
  98. 2016-10-04 18:04:44,192 : INFO : worker thread finished; awaiting finish of 0 more threads
  99. 2016-10-04 18:04:44,192 : INFO : training on 85026035 raw words (62532811 effective words) took 82.7s, 755977 effective words/s
  100. 2016-10-04 18:04:44,198 : INFO : Removed 17 and 25 OOV words from document 1 and 2 (respectively).
  101. 2016-10-04 18:04:44,198 : INFO : adding document #0 to Dictionary(0 unique tokens: [])
  102. 2016-10-04 18:04:44,199 : INFO : built Dictionary(59 unique tokens: [u'heart', u'love', u'departed', u'deck', u'within']...) from 2 documents (total 75 corpus positions)
  103. Distance between the two poems is: 9.41556771105
  104. 2016-10-04 18:04:44,213 : INFO : Removed 0 and 1 OOV words from document 1 and 2 (respectively).
  105. 2016-10-04 18:04:44,213 : INFO : adding document #0 to Dictionary(0 unique tokens: [])
  106. 2016-10-04 18:04:44,213 : INFO : built Dictionary(7 unique tokens: [u'chicago', u'media', u'illinois', u'press', u'president']...) from 2 documents (total 7 corpus positions)
  107. Distance between the two sentences is: 15.9683872315
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!