Advertisement
Guest User

Untitled

a guest
Aug 14th, 2017
113
0
Never
Not a member of Pastebin yet? Sign Up, it unlocks many cool features!
text 2.51 KB | None | 0 0
  1. ParserJob: success
  2. ParserJob: finished at 2017-08-14 12:58:06, time elapsed: 00:00:07
  3. CrawlDB update for nutch
  4. /opt/nutch/runtime/local/bin/nutch updatedb -D mapred.reduce.tasks=2 -D mapred.child.java.opts=-Xmx1000m -D mapred.reduce.tasks.speculative.execution=false -D mapred.map.tasks.speculative.execution=false -D mapred.compress.map.output=true 1502715380-25248 -crawlId nutch
  5. DbUpdaterJob: starting at 2017-08-14 12:58:07
  6. DbUpdaterJob: batchId: 1502715380-25248
  7. DbUpdaterJob: finished at 2017-08-14 12:58:16, time elapsed: 00:00:09
  8. Indexing nutch on SOLR index -> http://192.168.56.6:8983/solr/nutch
  9. /opt/nutch/runtime/local/bin/nutch index -D mapred.reduce.tasks=2 -D mapred.child.java.opts=-Xmx1000m -D mapred.reduce.tasks.speculative.execution=false -D mapred.map.tasks.speculative.execution=false -D mapred.compress.map.output=true -D solr.server.url=http://192.168.56.6:8983/solr/nutch -all -crawlId nutch
  10. IndexingJob: starting
  11. Active IndexWriters :
  12. SOLRIndexWriter
  13. solr.server.url : URL of the SOLR instance (mandatory)
  14. solr.commit.size : buffer size when sending to SOLR (default 1000)
  15. solr.mapping.file : name of the mapping file for fields (default solrindex-mapping.xml)
  16. solr.auth : use authentication (default false)
  17. solr.auth.username : username for authentication
  18. solr.auth.password : password for authentication
  19.  
  20.  
  21. IndexingJob: done.
  22. SOLR dedup -> http://192.168.56.6:8983/solr/nutch
  23. /opt/nutch/runtime/local/bin/nutch solrdedup -D mapred.reduce.tasks=2 -D mapred.child.java.opts=-Xmx1000m -D mapred.reduce.tasks.speculative.execution=false -D mapred.map.tasks.speculative.execution=false -D mapred.compress.map.output=true http://192.168.56.6:8983/solr/nutch
  24. Exception in thread "main" java.lang.RuntimeException: job failed: name=apache-nutch-2.3.1.jar, jobid=job_local1379097035_0001
  25. at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:120)
  26. at org.apache.nutch.indexer.solr.SolrDeleteDuplicates.dedup(SolrDeleteDuplicates.java:383)
  27. at org.apache.nutch.indexer.solr.SolrDeleteDuplicates.run(SolrDeleteDuplicates.java:393)
  28. at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
  29. at org.apache.nutch.indexer.solr.SolrDeleteDuplicates.main(SolrDeleteDuplicates.java:403)
  30. Error running:
  31. /opt/nutch/runtime/local/bin/nutch solrdedup -D mapred.reduce.tasks=2 -D mapred.child.java.opts=-Xmx1000m -D mapred.reduce.tasks.speculative.execution=false -D mapred.map.tasks.speculative.execution=false -D mapred.compress.map.output=true http://192.168.56.6:8983/solr/nutch
  32. Failed with exit value 1.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement