Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- ParserJob: success
- ParserJob: finished at 2017-08-14 12:58:06, time elapsed: 00:00:07
- CrawlDB update for nutch
- /opt/nutch/runtime/local/bin/nutch updatedb -D mapred.reduce.tasks=2 -D mapred.child.java.opts=-Xmx1000m -D mapred.reduce.tasks.speculative.execution=false -D mapred.map.tasks.speculative.execution=false -D mapred.compress.map.output=true 1502715380-25248 -crawlId nutch
- DbUpdaterJob: starting at 2017-08-14 12:58:07
- DbUpdaterJob: batchId: 1502715380-25248
- DbUpdaterJob: finished at 2017-08-14 12:58:16, time elapsed: 00:00:09
- Indexing nutch on SOLR index -> http://192.168.56.6:8983/solr/nutch
- /opt/nutch/runtime/local/bin/nutch index -D mapred.reduce.tasks=2 -D mapred.child.java.opts=-Xmx1000m -D mapred.reduce.tasks.speculative.execution=false -D mapred.map.tasks.speculative.execution=false -D mapred.compress.map.output=true -D solr.server.url=http://192.168.56.6:8983/solr/nutch -all -crawlId nutch
- IndexingJob: starting
- Active IndexWriters :
- SOLRIndexWriter
- solr.server.url : URL of the SOLR instance (mandatory)
- solr.commit.size : buffer size when sending to SOLR (default 1000)
- solr.mapping.file : name of the mapping file for fields (default solrindex-mapping.xml)
- solr.auth : use authentication (default false)
- solr.auth.username : username for authentication
- solr.auth.password : password for authentication
- IndexingJob: done.
- SOLR dedup -> http://192.168.56.6:8983/solr/nutch
- /opt/nutch/runtime/local/bin/nutch solrdedup -D mapred.reduce.tasks=2 -D mapred.child.java.opts=-Xmx1000m -D mapred.reduce.tasks.speculative.execution=false -D mapred.map.tasks.speculative.execution=false -D mapred.compress.map.output=true http://192.168.56.6:8983/solr/nutch
- Exception in thread "main" java.lang.RuntimeException: job failed: name=apache-nutch-2.3.1.jar, jobid=job_local1379097035_0001
- at org.apache.nutch.util.NutchJob.waitForCompletion(NutchJob.java:120)
- at org.apache.nutch.indexer.solr.SolrDeleteDuplicates.dedup(SolrDeleteDuplicates.java:383)
- at org.apache.nutch.indexer.solr.SolrDeleteDuplicates.run(SolrDeleteDuplicates.java:393)
- at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
- at org.apache.nutch.indexer.solr.SolrDeleteDuplicates.main(SolrDeleteDuplicates.java:403)
- Error running:
- /opt/nutch/runtime/local/bin/nutch solrdedup -D mapred.reduce.tasks=2 -D mapred.child.java.opts=-Xmx1000m -D mapred.reduce.tasks.speculative.execution=false -D mapred.map.tasks.speculative.execution=false -D mapred.compress.map.output=true http://192.168.56.6:8983/solr/nutch
- Failed with exit value 1.
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement