API tools faq
paste
Guest User

Untitled

a guest
Jun 21st, 2011
92
0
Never
Add comment
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 13.06 KB | None | 0 0
raw download clone embed print report
  1. 2011-06-21 09:17:22,330 INFO mortbay.log (Slf4jLog.java:info(67)) - Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
  2. 2011-06-21 09:17:22,382 INFO mortbay.log (Slf4jLog.java:info(67)) - jetty-6.1.22
  3. 2011-06-21 09:17:22,399 INFO mortbay.log (Slf4jLog.java:info(67)) - Started [email protected]:55000
  4. 2011-06-21 09:17:22,544 INFO crawl.InjectorJob (InjectorJob.java:inject(265)) - InjectorJob: starting
  5. 2011-06-21 09:17:22,545 INFO crawl.InjectorJob (InjectorJob.java:inject(266)) - InjectorJob: urlDir: build/test/fetch-test/urls
  6. 2011-06-21 09:17:22,562 INFO jvm.JvmMetrics (JvmMetrics.java:init(71)) - Initializing JVM Metrics with processName=JobTracker, sessionId=
  7. 2011-06-21 09:17:22,707 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
  8. 2011-06-21 09:17:22,750 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(661)) - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
  9. 2011-06-21 09:17:22,832 INFO input.FileInputFormat (FileInputFormat.java:listStatus(226)) - Total input paths to process : 1
  10. 2011-06-21 09:17:23,083 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1275)) - Running job: job_local_0001
  11. 2011-06-21 09:17:23,092 INFO input.FileInputFormat (FileInputFormat.java:listStatus(226)) - Total input paths to process : 1
  12. 2011-06-21 09:17:23,284 INFO mapreduce.GoraRecordWriter (GoraRecordWriter.java:<init>(49)) - gora.buffer.write.limit = 10000
  13. 2011-06-21 09:17:23,408 INFO plugin.PluginRepository (PluginManifestParser.java:parsePluginFolder(86)) - Plugins: looking in: /home/mlosoi/eclipse/workspace1/NutchTrunk/build/plugins
  14. 2011-06-21 09:17:24,086 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1288)) - map 0% reduce 0%
  15. 2011-06-21 09:17:24,587 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(313)) - Plugin Auto-activation mode: [true]
  16. 2011-06-21 09:17:24,587 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(314)) - Registered Plugins:
  17. 2011-06-21 09:17:24,588 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - the nutch core extension points (nutch-extensionpoints)
  18. 2011-06-21 09:17:24,588 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - Suffix URL Filter (urlfilter-suffix)
  19. 2011-06-21 09:17:24,588 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - OPIC Scoring Plug-in (scoring-opic)
  20. 2011-06-21 09:17:24,589 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - Tika Parser Plug-in (parse-tika)
  21. 2011-06-21 09:17:24,589 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - HTTP Framework (lib-http)
  22. 2011-06-21 09:17:24,589 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - Http Protocol Plug-in (protocol-http)
  23. 2011-06-21 09:17:24,590 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(324)) - Registered Extension-Points:
  24. 2011-06-21 09:17:24,590 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch URL Normalizer (org.apache.nutch.net.URLNormalizer)
  25. 2011-06-21 09:17:24,590 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch Protocol (org.apache.nutch.protocol.Protocol)
  26. 2011-06-21 09:17:24,590 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Parse Filter (org.apache.nutch.parse.ParseFilter)
  27. 2011-06-21 09:17:24,591 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch URL Filter (org.apache.nutch.net.URLFilter)
  28. 2011-06-21 09:17:24,591 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch Indexing Filter (org.apache.nutch.indexer.IndexingFilter)
  29. 2011-06-21 09:17:24,591 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch Content Parser (org.apache.nutch.parse.Parser)
  30. 2011-06-21 09:17:24,592 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch Scoring (org.apache.nutch.scoring.ScoringFilter)
  31. 2011-06-21 09:17:24,669 INFO conf.Configuration (Configuration.java:getConfResourceAsReader(965)) - suffix-urlfilter.txt not found
  32. 2011-06-21 09:17:24,669 WARN suffix.SuffixURLFilter (SuffixURLFilter.java:readConfiguration(176)) - Missing urlfilter.suffix.file, all URLs will be rejected!
  33. 2011-06-21 09:17:24,898 INFO mapred.TaskRunner (Task.java:done(666)) - Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
  34. 2011-06-21 09:17:24,908 INFO mapred.LocalJobRunner (LocalJobRunner.java:statusUpdate(276)) -
  35. 2011-06-21 09:17:24,914 INFO mapred.TaskRunner (Task.java:sendDone(737)) - Task 'attempt_local_0001_m_000000_0' done.
  36. 2011-06-21 09:17:25,088 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1288)) - map 100% reduce 0%
  37. 2011-06-21 09:17:25,089 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1343)) - Job complete: job_local_0001
  38. 2011-06-21 09:17:25,090 INFO mapred.JobClient (Counters.java:log(514)) - Counters: 5
  39. 2011-06-21 09:17:25,090 INFO mapred.JobClient (Counters.java:log(516)) - FileSystemCounters
  40. 2011-06-21 09:17:25,091 INFO mapred.JobClient (Counters.java:log(518)) - FILE_BYTES_READ=22005
  41. 2011-06-21 09:17:25,091 INFO mapred.JobClient (Counters.java:log(518)) - FILE_BYTES_WRITTEN=44122
  42. 2011-06-21 09:17:25,092 INFO mapred.JobClient (Counters.java:log(516)) - Map-Reduce Framework
  43. 2011-06-21 09:17:25,092 INFO mapred.JobClient (Counters.java:log(518)) - Map input records=6
  44. 2011-06-21 09:17:25,093 INFO mapred.JobClient (Counters.java:log(518)) - Spilled Records=0
  45. 2011-06-21 09:17:25,093 INFO mapred.JobClient (Counters.java:log(518)) - Map output records=0
  46. 2011-06-21 09:17:25,097 INFO jvm.JvmMetrics (JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
  47. 2011-06-21 09:17:25,234 INFO crawl.GeneratorJob (GeneratorJob.java:generate(199)) - GeneratorJob: Selecting best-scoring urls due for fetch.
  48. 2011-06-21 09:17:25,235 INFO crawl.GeneratorJob (GeneratorJob.java:generate(200)) - GeneratorJob: starting
  49. 2011-06-21 09:17:25,235 INFO crawl.GeneratorJob (GeneratorJob.java:generate(201)) - GeneratorJob: filtering: false
  50. 2011-06-21 09:17:25,237 INFO jvm.JvmMetrics (JvmMetrics.java:init(66)) - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized
  51. 2011-06-21 09:17:25,479 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(539)) - Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
  52. 2011-06-21 09:17:25,513 WARN mapred.JobClient (JobClient.java:configureCommandLineOptions(661)) - No job jar file set. User classes may not be found. See JobConf(Class) or JobConf#setJar(String).
  53. 2011-06-21 09:17:25,799 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1275)) - Running job: job_local_0002
  54. 2011-06-21 09:17:26,278 INFO mapreduce.GoraRecordReader (GoraRecordReader.java:<init>(60)) - gora.buffer.read.limit = 10000
  55. 2011-06-21 09:17:26,288 INFO mapred.MapTask (MapTask.java:<init>(776)) - io.sort.mb = 100
  56. 2011-06-21 09:17:26,392 INFO mapred.MapTask (MapTask.java:<init>(788)) - data buffer = 79691776/99614720
  57. 2011-06-21 09:17:26,392 INFO mapred.MapTask (MapTask.java:<init>(789)) - record buffer = 262144/327680
  58. 2011-06-21 09:17:26,401 INFO plugin.PluginRepository (PluginManifestParser.java:parsePluginFolder(86)) - Plugins: looking in: /home/mlosoi/eclipse/workspace1/NutchTrunk/build/plugins
  59. 2011-06-21 09:17:26,532 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(313)) - Plugin Auto-activation mode: [true]
  60. 2011-06-21 09:17:26,532 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(314)) - Registered Plugins:
  61. 2011-06-21 09:17:26,533 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - the nutch core extension points (nutch-extensionpoints)
  62. 2011-06-21 09:17:26,533 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - Suffix URL Filter (urlfilter-suffix)
  63. 2011-06-21 09:17:26,533 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - OPIC Scoring Plug-in (scoring-opic)
  64. 2011-06-21 09:17:26,533 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - Tika Parser Plug-in (parse-tika)
  65. 2011-06-21 09:17:26,534 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - HTTP Framework (lib-http)
  66. 2011-06-21 09:17:26,534 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - Http Protocol Plug-in (protocol-http)
  67. 2011-06-21 09:17:26,534 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(324)) - Registered Extension-Points:
  68. 2011-06-21 09:17:26,535 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch URL Normalizer (org.apache.nutch.net.URLNormalizer)
  69. 2011-06-21 09:17:26,535 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch Protocol (org.apache.nutch.protocol.Protocol)
  70. 2011-06-21 09:17:26,535 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Parse Filter (org.apache.nutch.parse.ParseFilter)
  71. 2011-06-21 09:17:26,535 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch URL Filter (org.apache.nutch.net.URLFilter)
  72. 2011-06-21 09:17:26,536 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch Indexing Filter (org.apache.nutch.indexer.IndexingFilter)
  73. 2011-06-21 09:17:26,536 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch Content Parser (org.apache.nutch.parse.Parser)
  74. 2011-06-21 09:17:26,536 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch Scoring (org.apache.nutch.scoring.ScoringFilter)
  75. 2011-06-21 09:17:26,539 INFO plugin.PluginRepository (PluginManifestParser.java:parsePluginFolder(86)) - Plugins: looking in: /home/mlosoi/eclipse/workspace1/NutchTrunk/build/plugins
  76. 2011-06-21 09:17:26,657 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(313)) - Plugin Auto-activation mode: [true]
  77. 2011-06-21 09:17:26,657 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(314)) - Registered Plugins:
  78. 2011-06-21 09:17:26,657 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - the nutch core extension points (nutch-extensionpoints)
  79. 2011-06-21 09:17:26,658 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - Suffix URL Filter (urlfilter-suffix)
  80. 2011-06-21 09:17:26,658 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - OPIC Scoring Plug-in (scoring-opic)
  81. 2011-06-21 09:17:26,658 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - Tika Parser Plug-in (parse-tika)
  82. 2011-06-21 09:17:26,658 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - HTTP Framework (lib-http)
  83. 2011-06-21 09:17:26,658 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(320)) - Http Protocol Plug-in (protocol-http)
  84. 2011-06-21 09:17:26,659 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(324)) - Registered Extension-Points:
  85. 2011-06-21 09:17:26,659 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch URL Normalizer (org.apache.nutch.net.URLNormalizer)
  86. 2011-06-21 09:17:26,659 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch Protocol (org.apache.nutch.protocol.Protocol)
  87. 2011-06-21 09:17:26,659 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Parse Filter (org.apache.nutch.parse.ParseFilter)
  88. 2011-06-21 09:17:26,660 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch URL Filter (org.apache.nutch.net.URLFilter)
  89. 2011-06-21 09:17:26,660 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch Indexing Filter (org.apache.nutch.indexer.IndexingFilter)
  90. 2011-06-21 09:17:26,660 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch Content Parser (org.apache.nutch.parse.Parser)
  91. 2011-06-21 09:17:26,660 INFO plugin.PluginRepository (PluginRepository.java:displayStatus(329)) - Nutch Scoring (org.apache.nutch.scoring.ScoringFilter)
  92. 2011-06-21 09:17:26,664 INFO conf.Configuration (Configuration.java:getConfResourceAsReader(965)) - suffix-urlfilter.txt not found
  93. 2011-06-21 09:17:26,665 WARN suffix.SuffixURLFilter (SuffixURLFilter.java:readConfiguration(176)) - Missing urlfilter.suffix.file, all URLs will be rejected!
  94. 2011-06-21 09:17:26,766 INFO crawl.FetchScheduleFactory (FetchScheduleFactory.java:getFetchSchedule(39)) - Using FetchSchedule impl: org.apache.nutch.crawl.DefaultFetchSchedule
  95. 2011-06-21 09:17:26,767 INFO crawl.AbstractFetchSchedule (AbstractFetchSchedule.java:setConf(69)) - defaultInterval=2592000
  96. 2011-06-21 09:17:26,767 INFO crawl.AbstractFetchSchedule (AbstractFetchSchedule.java:setConf(70)) - maxInterval=7776000
  97. 2011-06-21 09:17:26,800 INFO mapred.JobClient (JobClient.java:monitorAndPrintJob(1288)) - map 0% reduce 0%
Advertisement
Add Comment
Please, Sign In to add comment
Public Pastes
We use cookies for various purposes including analytics. By continuing to use Pastebin, you agree to our use of cookies as described in the Cookies Policy.  OK, I Understand
Not a member of Pastebin yet?
Sign Up, it unlocks many cool features!