srijiths

Mahout SGD / Bayes prediction results on 20newsgroups

Dec 21st, 2011
168
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 7.71 KB | None | 0 0
  1. Trained and tested using http://people.csail.mit.edu/jrennie/20Newsgroups/20news-bydate.tar.gz
  2.  
  3. Test Case : Using bayes classifier with -ng 2
  4.  
  5. Summary
  6. -------------------------------------------------------
  7. Correctly Classified Instances : 11065 97.7992%
  8. Incorrectly Classified Instances : 249 2.2008%
  9. Total Classified Instances : 11314
  10.  
  11. =======================================================
  12. Confusion Matrix
  13. -------------------------------------------------------
  14. a b c d e f g h i j k l m n o p q r s t <--Classified as
  15. 596 0 1 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 | 597 a = rec.sport.baseball
  16. 0 590 0 0 0 1 0 1 0 0 0 0 0 0 0 0 0 3 0 0 | 595 b = sci.crypt
  17. 0 0 600 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 | 600 c = rec.sport.hockey
  18. 1 1 0 543 0 0 0 1 0 0 0 0 0 0 0 0 0 0 0 0 | 546 d = talk.politics.guns
  19. 0 0 0 0 597 0 0 0 0 0 0 0 0 0 0 1 0 0 0 1 | 599 e = soc.religion.christian
  20. 0 0 0 0 0 585 0 2 0 0 0 0 4 0 0 0 0 0 0 0 | 591 f = sci.electronics
  21. 0 0 0 7 0 0 567 10 0 0 0 0 3 0 0 0 0 4 0 0 | 591 g = comp.os.ms-windows.misc
  22. 0 0 2 0 0 3 0 580 0 0 0 0 0 0 0 0 0 0 0 0 | 585 h = misc.forsale
  23. 1 0 0 12 84 3 0 0 251 17 1 0 0 0 1 4 1 0 0 2 | 377 i = talk.religion.misc
  24. 0 0 0 2 10 0 0 0 0 468 0 0 0 0 0 0 0 0 0 0 | 480 j = alt.atheism
  25. 0 0 0 0 0 0 0 0 0 0 590 0 1 0 0 0 0 2 0 0 | 593 k = comp.windows.x
  26. 0 0 0 0 5 0 0 0 0 0 0 556 0 0 0 1 2 0 0 0 | 564 l = talk.politics.mideast
  27. 0 0 0 0 0 0 0 0 0 0 0 0 589 0 0 0 0 1 0 0 | 590 m = comp.sys.ibm.pc.hardware
  28. 0 0 0 0 0 0 0 1 0 0 0 0 2 575 0 0 0 0 0 0 | 578 n = comp.sys.mac.hardware
  29. 0 0 0 0 0 0 0 0 0 0 0 0 0 0 590 0 0 3 0 0 | 593 o = sci.space
  30. 0 0 0 0 0 0 0 0 0 0 1 0 0 0 1 595 1 0 0 0 | 598 p = rec.motorcycles
  31. 0 0 0 0 0 1 0 0 0 0 0 0 0 0 0 2 591 0 0 0 | 594 q = rec.autos
  32. 0 0 0 0 0 0 0 2 0 0 0 0 1 0 1 0 0 580 0 0 | 584 r = comp.graphics
  33. 2 10 1 8 2 1 0 0 0 0 0 2 0 0 4 1 1 1 431 1 | 465 s = talk.politics.misc
  34. 0 0 0 0 1 0 1 0 0 0 0 0 0 1 0 0 0 0 0 591 | 594 t = sci.med
  35.  
  36.  
  37. Test Case 2 : using SGD , no leakType
  38.  
  39. 7532 test files
  40. =======================================================
  41. Summary
  42. -------------------------------------------------------
  43. Correctly Classified Instances : 4816 63.9405%
  44. Incorrectly Classified Instances : 2716 36.0595%
  45. Total Classified Instances : 7532
  46.  
  47. =======================================================
  48. Confusion Matrix
  49. -------------------------------------------------------
  50. a b c d e f g h i j k l m n o p q r s t u <--Classified as
  51. 119 6 5 13 8 5 16 5 111 14 9 7 6 24 18 1 18 6 3 5 0 | 399 a = rec.sport.hockey
  52. 0 262 6 7 3 3 2 0 3 22 4 1 47 15 1 0 8 0 1 0 0 | 385 b = comp.sys.mac.hardware
  53. 1 11 262 2 2 7 3 5 2 4 22 3 37 9 0 4 14 1 0 5 0 | 394 c = comp.os.ms-windows.misc
  54. 0 16 1 285 4 4 14 11 3 18 2 1 6 17 0 1 8 1 0 4 0 | 396 d = rec.autos
  55. 0 3 2 9 265 6 1 26 5 1 0 3 2 3 2 1 25 3 5 2 0 | 364 e = talk.politics.guns
  56. 0 9 1 11 2 266 5 16 6 20 7 0 8 17 7 1 9 6 2 3 0 | 396 f = sci.med
  57. 0 2 3 20 7 3 323 5 3 4 2 1 7 7 0 3 8 0 0 0 0 | 398 g = rec.motorcycles
  58. 0 4 0 3 92 8 2 146 0 1 2 10 2 3 6 0 11 13 7 0 0 | 310 h = talk.politics.misc
  59. 0 7 3 6 5 4 4 4 306 14 1 2 6 16 5 2 6 4 1 1 0 | 397 i = rec.sport.baseball
  60. 0 31 6 11 3 15 6 9 3 176 21 0 34 14 6 4 40 2 0 12 0 | 393 j = sci.electronics
  61. 1 16 14 4 2 10 2 6 0 10 238 3 24 14 1 15 26 0 1 2 0 | 389 k = comp.graphics
  62. 0 3 1 7 17 17 0 15 5 1 4 82 1 7 45 0 7 33 2 4 0 | 251 l = talk.religion.misc
  63. 0 35 30 9 0 4 4 5 1 28 9 2 240 12 0 1 11 0 0 1 0 | 392 m = comp.sys.ibm.pc.hardware
  64. 4 15 5 6 1 2 3 2 3 13 3 0 24 301 1 1 4 0 0 2 0 | 390 n = misc.forsale
  65. 0 2 1 6 4 10 5 6 2 1 4 39 5 15 263 2 4 27 2 0 0 | 398 o = soc.religion.christian
  66. 0 11 45 5 1 7 2 0 3 8 36 0 11 11 2 232 19 0 1 1 0 | 395 p = comp.windows.x
  67. 0 4 1 0 4 4 0 5 1 2 2 0 4 3 3 0 362 0 0 1 0 | 396 q = sci.crypt
  68. 0 2 1 5 5 17 3 17 2 1 3 38 4 3 39 0 8 166 1 4 0 | 319 r = alt.atheism
  69. 0 1 0 3 9 5 2 50 5 1 0 10 3 2 10 0 15 12 247 1 0 | 376 s = talk.politics.mideast
  70. 0 2 1 2 2 16 5 24 1 19 7 2 4 12 3 1 17 1 0 275 0 | 394 t = sci.space
  71. 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 | 0 u = DEFAULT
  72. Default Category: DEFAULT: 20
Advertisement
Add Comment
Please, Sign In to add comment