Advertisement
Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- <(jorge@abril)---(mié abr 30 13:09:13)>
- [pig][6] $ pig -l /tmp/ -x local -v -w sent_counts.pig
- 2014-04-30 13:09:17,533 [main] INFO org.apache.pig.Main - Apache Pig version 0.11.1 (r1459641) compiled Mar 22 2013, 02:13:53
- 2014-04-30 13:09:17,534 [main] INFO org.apache.pig.Main - Logging error messages to: /tmp/pig_1398884957505.log
- 2014-04-30 13:09:17,906 [main] WARN org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... usi
- ng builtin-java classes where applicable
- 2014-04-30 13:09:18,252 [main] INFO org.apache.pig.impl.util.Utils - Default bootup file /home/jorge/.pigbootup not found
- 2014-04-30 13:09:18,372 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine - Connecting to hadoop file system at: f
- ile:///
- 2014-04-30 13:09:18,377 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.used.genericoptionsparser is deprecated. Inst
- ead, use mapreduce.client.genericoptionsparser.used
- 2014-04-30 13:09:18,380 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defau
- ltFS
- 2014-04-30 13:09:18,380 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker is deprecated. Instead, use mapre
- duce.jobtracker.address
- 2014-04-30 13:09:18,496 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - dfs.df.interval is deprecated. Instead, use fs.df.in
- terval
- 2014-04-30 13:09:18,496 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.task.tracker.http.address is deprecated. Inst
- ead, use mapreduce.tasktracker.http.address
- 2014-04-30 13:09:18,496 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.userlog.retain.hours is deprecated. Instead,
- use mapreduce.job.userlog.retain.hours
- 2014-04-30 13:09:18,497 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - hadoop.native.lib is deprecated. Instead, use io.nat
- ive.lib.available
- 2014-04-30 13:09:18,497 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.local.dir.minspacestart is deprecated. Instea
- d, use mapreduce.tasktracker.local.dir.minspacestart
- 2014-04-30 13:09:18,497 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.shuffle.read.timeout is deprecated. Instead,
- use mapreduce.reduce.shuffle.read.timeout
- 2014-04-30 13:09:18,497 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - io.sort.spill.percent is deprecated. Instead, use ma
- preduce.map.sort.spill.percent
- 2014-04-30 13:09:18,497 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.reduce.parallel.copies is deprecated. Instead
- , use mapreduce.reduce.shuffle.parallelcopies
- 2014-04-30 13:09:18,497 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.submit.replication is deprecated. Instead, us
- e mapreduce.client.submit.file.replication
- 2014-04-30 13:09:18,497 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.local.dir.minspacekill is deprecated. Instead
- , use mapreduce.tasktracker.local.dir.minspacekill
- 2014-04-30 13:09:18,497 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.task.profile is deprecated. Instead, use mapr
- educe.task.profile
- 2014-04-30 13:09:18,498 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.heartbeats.in.second is deprecated. Instead,
- use mapreduce.jobtracker.heartbeats.in.second
- 2014-04-30 13:09:18,498 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.output.compress is deprecated. Instead, use m
- apreduce.output.fileoutputformat.compress
- 2014-04-30 13:09:18,498 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.healthChecker.interval is deprecated. Instead
- , use mapreduce.tasktracker.healthchecker.interval
- 2014-04-30 13:09:18,498 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.task.timeout is deprecated. Instead, use mapr
- educe.task.timeout
- 2014-04-30 13:09:18,498 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.temp.dir is deprecated. Instead, use mapreduc
- e.cluster.temp.dir
- 2014-04-30 13:09:18,498 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - jobclient.completion.poll.interval is deprecated. In
- stead, use mapreduce.client.completion.pollinterval
- 2014-04-30 13:09:18,498 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker.persist.jobstatus.active is depre
- cated. Instead, use mapreduce.jobtracker.persist.jobstatus.active
- 2014-04-30 13:09:18,498 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.output.compression.codec is deprecated. Inste
- ad, use mapreduce.output.fileoutputformat.compress.codec
- 2014-04-30 13:09:18,499 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.shuffle.merge.percent is deprecated. Inst
- ead, use mapreduce.reduce.shuffle.merge.percent
- 2014-04-30 13:09:18,499 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.map.max.attempts is deprecated. Instead, use
- mapreduce.map.maxattempts
- 2014-04-30 13:09:18,499 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.reduce.input.buffer.percent is deprecated
- . Instead, use mapreduce.reduce.input.buffer.percent
- 2014-04-30 13:09:18,499 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.task.cache.levels is deprecated. Instead, use
- mapreduce.jobtracker.taskcache.levels
- 2014-04-30 13:09:18,499 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - io.sort.factor is deprecated. Instead, use mapreduce
- .task.io.sort.factor
- 2014-04-30 13:09:18,499 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.jobtracker.instrumentation is deprecated. Ins
- tead, use mapreduce.jobtracker.instrumentation
- 2014-04-30 13:09:18,499 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.userlog.limit.kb is deprecated. Instead, use
- mapreduce.task.userlog.limit.kb
- 2014-04-30 13:09:18,499 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defau
- ltFS
- 2014-04-30 13:09:18,499 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.speculative.execution.slowNodeThreshold is de
- precated. Instead, use mapreduce.job.speculative.slownodethreshold
- 2014-04-30 13:09:18,500 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.skip.map.max.skip.records is deprecated. Inst
- ead, use mapreduce.map.skip.maxrecords
- 2014-04-30 13:09:18,500 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker.jobhistory.lru.cache.size is depr
- ecated. Instead, use mapreduce.jobtracker.jobhistory.lru.cache.size
- 2014-04-30 13:09:18,500 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker.persist.jobstatus.hours is deprec
- ated. Instead, use mapreduce.jobtracker.persist.jobstatus.hours
- 2014-04-30 13:09:18,500 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker.handler.count is deprecated. Inst
- ead, use mapreduce.jobtracker.handler.count
- 2014-04-30 13:09:18,500 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.reduce.markreset.buffer.percent is deprec
- ated. Instead, use mapreduce.reduce.markreset.buffer.percent
- 2014-04-30 13:09:18,500 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - io.sort.mb is deprecated. Instead, use mapreduce.tas
- k.io.sort.mb
- 2014-04-30 13:09:18,501 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.task.profile.maps is deprecated. Instead, use
- mapreduce.task.profile.maps
- 2014-04-30 13:09:18,501 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.map.tasks.speculative.execution is deprecated
- . Instead, use mapreduce.map.speculative
- 2014-04-30 13:09:18,501 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.reduce.tasks is deprecated. Instead, use mapr
- educe.job.reduces
- 2014-04-30 13:09:18,501 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.min.split.size is deprecated. Instead, use ma
- preduce.input.fileinputformat.split.minsize
- 2014-04-30 13:09:18,501 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.tasktracker.dns.nameserver is deprecated. Ins
- tead, use mapreduce.tasktracker.dns.nameserver
- 2014-04-30 13:09:18,501 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.tasktracker.taskmemorymanager.monitoring-inte
- rval is deprecated. Instead, use mapreduce.tasktracker.taskmemorymanager.monitoringinterval
- 2014-04-30 13:09:18,501 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.tasktracker.expiry.interval is deprecated. In
- stead, use mapreduce.jobtracker.expire.trackers.interval
- 2014-04-30 13:09:18,502 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.max.tracker.failures is deprecated. Instead,
- use mapreduce.job.maxtaskfailures.per.tracker
- 2014-04-30 13:09:18,502 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapreduce.jobtracker.split.metainfo.maxsize is depre
- cated. Instead, use mapreduce.job.split.metainfo.maxsize
- 2014-04-30 13:09:18,502 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker.persist.jobstatus.dir is deprecat
- ed. Instead, use mapreduce.jobtracker.persist.jobstatus.dir
- 2014-04-30 13:09:18,502 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - job.end.retry.attempts is deprecated. Instead, use m
- apreduce.job.end-notification.retry.attempts
- 2014-04-30 13:09:18,502 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.reduce.tasks.speculative.execution is depreca
- ted. Instead, use mapreduce.reduce.speculative
- 2014-04-30 13:09:18,502 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapreduce.job.counters.limit is deprecated. Instead,
- use mapreduce.job.counters.max
- 2014-04-30 13:09:18,502 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.task.tracker.task-controller is deprecated. I
- nstead, use mapreduce.tasktracker.taskcontroller
- 2014-04-30 13:09:18,502 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.jobtracker.maxtasks.per.job is deprecated. In
- stead, use mapreduce.jobtracker.maxtasks.perjob
- 2014-04-30 13:09:18,503 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.reduce.child.log.level is deprecated. Instead
- , use mapreduce.reduce.log.level
- 2014-04-30 13:09:18,503 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.reduce.max.attempts is deprecated. Instead, u
- se mapreduce.reduce.maxattempts
- 2014-04-30 13:09:18,503 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.map.output.compression.codec is deprecated. I
- nstead, use mapreduce.map.output.compress.codec
- 2014-04-30 13:09:18,503 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.shuffle.input.buffer.percent is deprecate
- d. Instead, use mapreduce.reduce.shuffle.input.buffer.percent
- 2014-04-30 13:09:18,504 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.task.tracker.report.address is deprecated. In
- stead, use mapreduce.tasktracker.report.address
- 2014-04-30 13:09:18,504 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - keep.failed.task.files is deprecated. Instead, use m
- apreduce.task.files.preserve.failedtasks
- 2014-04-30 13:09:18,504 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - tasktracker.http.threads is deprecated. Instead, use
- mapreduce.tasktracker.http.threads
- 2014-04-30 13:09:18,504 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.speculative.execution.slowTaskThreshold is de
- precated. Instead, use mapreduce.job.speculative.slowtaskthreshold
- 2014-04-30 13:09:18,504 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.acls.enabled is deprecated. Instead, use mapr
- educe.cluster.acls.enabled
- 2014-04-30 13:09:18,504 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.max.tracker.blacklists is deprecated. Instead
- , use mapreduce.jobtracker.tasktracker.maxblacklists
- 2014-04-30 13:09:18,505 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.tasktracker.indexcache.mb is deprecated. Inst
- ead, use mapreduce.tasktracker.indexcache.mb
- 2014-04-30 13:09:18,505 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.skip.attempts.to.start.skipping is deprecated
- . Instead, use mapreduce.task.skip.start.attempts
- 2014-04-30 13:09:18,505 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.tasktracker.reduce.tasks.maximum is deprecate
- d. Instead, use mapreduce.tasktracker.reduce.tasks.maximum
- 2014-04-30 13:09:18,505 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - jobclient.output.filter is deprecated. Instead, use
- mapreduce.client.output.filter
- 2014-04-30 13:09:18,505 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.jobtracker.restart.recover is deprecated. Ins
- tead, use mapreduce.jobtracker.restart.recover
- 2014-04-30 13:09:18,505 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.local.dir is deprecated. Instead, use mapredu
- ce.cluster.local.dir
- 2014-04-30 13:09:18,505 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.speculative.execution.speculativeCap is depre
- cated. Instead, use mapreduce.job.speculative.speculativecap
- 2014-04-30 13:09:18,506 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - jobclient.progress.monitor.poll.interval is deprecat
- ed. Instead, use mapreduce.client.progressmonitor.pollinterval
- 2014-04-30 13:09:18,506 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.map.child.log.level is deprecated. Instead, u
- se mapreduce.map.log.level
- 2014-04-30 13:09:18,506 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.output.compression.type is deprecated. Instea
- d, use mapreduce.output.fileoutputformat.compress.type
- 2014-04-30 13:09:18,506 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker.retiredjobs.cache.size is depreca
- ted. Instead, use mapreduce.jobtracker.retiredjobs.cache.size
- 2014-04-30 13:09:18,506 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.tasktracker.dns.interface is deprecated. Inst
- ead, use mapreduce.tasktracker.dns.interface
- 2014-04-30 13:09:18,506 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.task.profile.reduces is deprecated. Instead,
- use mapreduce.task.profile.reduces
- 2014-04-30 13:09:18,506 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - job.end.retry.interval is deprecated. Instead, use m
- apreduce.job.end-notification.retry.interval
- 2014-04-30 13:09:18,507 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.jobtracker.job.history.block.size is deprecat
- ed. Instead, use mapreduce.jobtracker.jobhistory.block.size
- 2014-04-30 13:09:18,507 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.child.tmp is deprecated. Instead, use mapredu
- ce.task.tmp.dir
- 2014-04-30 13:09:18,507 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.map.tasks is deprecated. Instead, use mapredu
- ce.job.maps
- 2014-04-30 13:09:18,507 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.tasktracker.map.tasks.maximum is deprecated.
- Instead, use mapreduce.tasktracker.map.tasks.maximum
- 2014-04-30 13:09:18,507 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.committer.job.setup.cleanup.needed is depreca
- ted. Instead, use mapreduce.job.committer.setup.cleanup.needed
- 2014-04-30 13:09:18,507 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.queue.name is deprecated. Instead, use ma
- preduce.job.queuename
- 2014-04-30 13:09:18,508 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.jobtracker.taskScheduler is deprecated. Inste
- ad, use mapreduce.jobtracker.taskscheduler
- 2014-04-30 13:09:18,508 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.skip.reduce.max.skip.groups is deprecated. In
- stead, use mapreduce.reduce.skip.maxgroups
- 2014-04-30 13:09:18,508 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.tracker.http.address is deprecated. Inste
- ad, use mapreduce.jobtracker.http.address
- 2014-04-30 13:09:18,508 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.healthChecker.script.timeout is deprecated. I
- nstead, use mapreduce.tasktracker.healthchecker.script.timeout
- 2014-04-30 13:09:18,508 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.tasktracker.instrumentation is deprecated. In
- stead, use mapreduce.tasktracker.instrumentation
- 2014-04-30 13:09:18,508 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.system.dir is deprecated. Instead, use mapred
- uce.jobtracker.system.dir
- 2014-04-30 13:09:18,508 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.job.reuse.jvm.num.tasks is deprecated. Instea
- d, use mapreduce.job.jvm.numtasks
- 2014-04-30 13:09:18,509 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.inmem.merge.threshold is deprecated. Instead,
- use mapreduce.reduce.merge.inmem.threshold
- 2014-04-30 13:09:18,509 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - topology.script.number.args is deprecated. Instead,
- use net.topology.script.number.args
- 2014-04-30 13:09:18,509 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.reduce.slowstart.completed.maps is deprecated
- . Instead, use mapreduce.job.reduce.slowstart.completedmaps
- 2014-04-30 13:09:18,509 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - dfs.umaskmode is deprecated. Instead, use fs.permiss
- ions.umask-mode
- 2014-04-30 13:09:18,509 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - topology.node.switch.mapping.impl is deprecated. Ins
- tead, use net.topology.node.switch.mapping.impl
- 2014-04-30 13:09:18,509 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.tasktracker.tasks.sleeptime-before-sigkill is
- deprecated. Instead, use mapreduce.tasktracker.tasks.sleeptimebeforesigkill
- 2014-04-30 13:09:18,509 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.compress.map.output is deprecated. Instead, u
- se mapreduce.map.output.compress
- 2014-04-30 13:09:18,509 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.merge.recordsBeforeProgress is deprecated. In
- stead, use mapreduce.task.merge.progress.records
- 2014-04-30 13:09:18,509 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.shuffle.connect.timeout is deprecated. Instea
- d, use mapreduce.reduce.shuffle.connect.timeout
- 2014-04-30 13:09:18,510 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - io.bytes.per.checksum is deprecated. Instead, use df
- s.bytes-per-checksum
- 2014-04-30 13:09:18,595 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defau
- ltFS
- 2014-04-30 13:09:18,596 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapreduce.job.counters.limit is deprecated. Instead,
- use mapreduce.job.counters.max
- 2014-04-30 13:09:18,600 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - io.bytes.per.checksum is deprecated. Instead, use df
- s.bytes-per-checksum
- 2014-04-30 13:09:18,700 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defau
- ltFS
- 2014-04-30 13:09:18,702 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapreduce.job.counters.limit is deprecated. Instead,
- use mapreduce.job.counters.max
- 2014-04-30 13:09:18,705 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - io.bytes.per.checksum is deprecated. Instead, use df
- s.bytes-per-checksum
- 2014-04-30 13:09:18,823 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - fs.default.name is deprecated. Instead, use fs.defau
- ltFS
- 2014-04-30 13:09:18,825 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapreduce.job.counters.limit is deprecated. Instead,
- use mapreduce.job.counters.max
- 2014-04-30 13:09:18,828 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - io.bytes.per.checksum is deprecated. Instead, use df
- s.bytes-per-checksum
- 2014-04-30 13:09:20,171 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig features used in the script: GROUP_BY,ORDER_BY,FILTER
- 2014-04-30 13:09:20,231 [main] INFO org.apache.pig.newplan.logical.rules.ColumnPruneVisitor - Columns pruned for messages: $0, $1, $2, $3,
- $4, $5, $8, $9, $10
- 2014-04-30 13:09:20,242 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - mapred.textoutputformat.separator is deprecated. Ins
- tead, use mapreduce.output.textoutputformat.separator
- 2014-04-30 13:09:20,365 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MRCompiler - File concatenation threshold:
- 100 optimistic? false
- 2014-04-30 13:09:20,398 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.CombinerOptimizer - Choosing to move algeb
- raic foreach to combiner
- 2014-04-30 13:09:20,433 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size before
- optimization: 3
- 2014-04-30 13:09:20,433 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MultiQueryOptimizer - MR plan size after o
- ptimization: 3
- 2014-04-30 13:09:20,461 [main] INFO org.apache.hadoop.conf.Configuration.deprecation - session.id is deprecated. Instead, use dfs.metrics.s
- ession-id
- 2014-04-30 13:09:20,462 [main] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Initializing JVM Metrics with processName=JobTracker, sessio
- nId=
- 2014-04-30 13:09:20,488 [main] WARN org.apache.pig.backend.hadoop20.PigJobControl - falling back to default JobControl (not using hadoop 0.
- 20 ?)
- java.lang.NoSuchFieldException: runnerState
- at java.lang.Class.getDeclaredField(Class.java:1901)
- at org.apache.pig.backend.hadoop20.PigJobControl.<clinit>(PigJobControl.java:51)
- at org.apache.pig.backend.hadoop.executionengine.shims.HadoopShims.newJobControl(HadoopShims.java:97)
- at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler.compile(JobControlCompiler.java:285)
- at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher.launchPig(MapReduceLauncher.java:177)
- at org.apache.pig.PigServer.launchPlan(PigServer.java:1264)
- at org.apache.pig.PigServer.executeCompiledLogicalPlan(PigServer.java:1249)
- at org.apache.pig.PigServer.execute(PigServer.java:1239)
- at org.apache.pig.PigServer.executeBatch(PigServer.java:333)
- at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:137)
- at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
- at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
- at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
- at org.apache.pig.Main.run(Main.java:604)
- at org.apache.pig.Main.main(Main.java:157)
- at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
- at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:616)
- at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
- 2014-04-30 13:09:20,492 [main] INFO org.apache.pig.tools.pigstats.ScriptState - Pig script settings are added to the job
- 2014-04-30 13:09:20,501 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - mapred.job.reduce.mar
- kreset.buffer.percent is not set, set to default 0.3
- 2014-04-30 13:09:20,502 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Using reducer estimat
- or: org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator
- 2014-04-30 13:09:20,505 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.InputSizeReducerEstimator - BytesPerReduce
- r=1000000000 maxReducers=999 totalInputFileSize=2191758
- 2014-04-30 13:09:20,505 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting Parallelism t
- o 1
- 2014-04-30 13:09:20,564 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.JobControlCompiler - Setting up single sto
- re job
- 2014-04-30 13:09:20,580 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Key [pig.schematuple] is false, will not generate code.
- 2014-04-30 13:09:20,580 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Starting process to move generated code to distributed cacche
- 2014-04-30 13:09:20,580 [main] INFO org.apache.pig.data.SchemaTupleFrontend - Distributed cache not supported or needed in local mode. Sett
- ing key [pig.schematuple.local.dir] with code temp directory: /tmp/1398884960579-0
- 2014-04-30 13:09:20,719 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 1 map-reduce job(s) wa
- iting for submission.
- 2014-04-30 13:09:20,737 [JobControl] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTrac
- ker, sessionId= - already initialized
- 2014-04-30 13:09:20,746 [JobControl] ERROR org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl - Error while trying to run jobs.
- java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected
- at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.setupUdfEnvAndStores(PigOutputFormat.java:225)
- at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.checkOutputSpecs(PigOutputFormat.java:186)
- at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:456)
- at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:342)
- at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
- at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
- at java.security.AccessController.doPrivileged(Native Method)
- at javax.security.auth.Subject.doAs(Subject.java:416)
- at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
- at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
- at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
- at org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl.run(JobControl.java:240)
- at org.apache.pig.backend.hadoop20.PigJobControl.run(PigJobControl.java:121)
- at java.lang.Thread.run(Thread.java:679)
- at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:257)
- 2014-04-30 13:09:20,925 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 0% complete
- 2014-04-30 13:09:20,931 [main] WARN org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Ooops! Some job has fa
- iled! Specify -stop_on_failure if you want Pig to stop immediately on failure.
- 2014-04-30 13:09:20,932 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - job null has failed! S
- top running all dependent jobs
- 2014-04-30 13:09:20,932 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 100% complete
- 2014-04-30 13:09:20,943 [main] ERROR org.apache.pig.tools.pigstats.SimplePigStats - ERROR 2997: Unable to recreate exception from backend er
- ror: Unexpected System Error Occured: java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but cl
- ass was expected
- at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.setupUdfEnvAndStores(PigOutputFormat.java:225)
- at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.checkOutputSpecs(PigOutputFormat.java:186)
- at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:456)
- at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:342)
- at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
- at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
- at java.security.AccessController.doPrivileged(Native Method)
- at javax.security.auth.Subject.doAs(Subject.java:416)
- at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
- at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
- at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
- at org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl.run(JobControl.java:240)
- at org.apache.pig.backend.hadoop20.PigJobControl.run(PigJobControl.java:121)
- at java.lang.Thread.run(Thread.java:679)
- at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:257)
- 2014-04-30 13:09:20,944 [main] ERROR org.apache.pig.tools.pigstats.PigStatsUtil - 1 map reduce job(s) failed!
- 2014-04-30 13:09:20,944 [main] INFO org.apache.pig.tools.pigstats.SimplePigStats - Detected Local mode. Stats reported below may be incompl
- ete
- 2014-04-30 13:09:20,947 [main] INFO org.apache.pig.tools.pigstats.SimplePigStats - Script Statistics:
- HadoopVersion PigVersion UserId StartedAt FinishedAt Features
- 2.2.0 0.11.1 jorge 2014-04-30 13:09:20 2014-04-30 13:09:20 GROUP_BY,ORDER_BY,FILTER
- Failed!
- Failed Jobs:
- JobId Alias Feature Message Outputs
- N/A addresses,by_from_to,lowers,messages,sent_counts GROUP_BY,COMBINER Message: Unexpected System Error Occured: java.lang.
- IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class was expected
- at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.setupUdfEnvAndStores(PigOutputFormat.java:225)
- at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.checkOutputSpecs(PigOutputFormat.java:186)
- at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:456)
- at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:342)
- at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
- at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
- at java.security.AccessController.doPrivileged(Native Method)
- at javax.security.auth.Subject.doAs(Subject.java:416)
- at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
- at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
- at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
- at org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl.run(JobControl.java:240)
- at org.apache.pig.backend.hadoop20.PigJobControl.run(PigJobControl.java:121)
- at java.lang.Thread.run(Thread.java:679)
- at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:257)
- Input(s):
- Failed to read data from "/home/jorge/coders/practicas/AgileDataScience/Agile_Data_Code/ch03/gmail/email_download/"
- Output(s):
- Job DAG:
- null -> null,
- null -> null,
- null
- 2014-04-30 13:09:20,948 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - Failed!
- 2014-04-30 13:09:20,949 [main] ERROR org.apache.pig.tools.grunt.GruntParser - ERROR 2244: Job failed, hadoop does not return any error message
- 2014-04-30 13:09:20,949 [main] ERROR org.apache.pig.tools.grunt.GruntParser - org.apache.pig.backend.executionengine.ExecException: ERROR 22
- 44: Job failed, hadoop does not return any error message
- at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:145)
- at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
- at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
- at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
- at org.apache.pig.Main.run(Main.java:604)
- at org.apache.pig.Main.main(Main.java:157)
- at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
- at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:616)
- at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
- Details also at logfile: /tmp/pig_1398884957505.log
- 2014-04-30 13:09:20,950 [main] ERROR org.apache.pig.tools.grunt.GruntParser - ERROR 2244: Job failed, hadoop does not return any error message
- 2014-04-30 13:09:20,950 [main] ERROR org.apache.pig.tools.grunt.GruntParser - org.apache.pig.backend.executionengine.ExecException: ERROR 22
- 44: Job failed, hadoop does not return any error message
- at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:145)
- at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
- at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
- at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
- at org.apache.pig.Main.run(Main.java:604)
- at org.apache.pig.Main.main(Main.java:157)
- at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
- at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:616)
- at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
- Details also at logfile: /tmp/pig_1398884957505.log
- 2014-04-30 13:09:20,951 [main] ERROR org.apache.pig.tools.grunt.GruntParser - ERROR 2244: Job failed, hadoop does not return any error messa
- ge
- 2014-04-30 13:09:20,951 [main] ERROR org.apache.pig.tools.grunt.GruntParser - org.apache.pig.backend.executionengine.ExecException: ERROR 22
- 44: Job failed, hadoop does not return any error message
- at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:145)
- at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
- at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
- at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
- at org.apache.pig.Main.run(Main.java:604)
- at org.apache.pig.Main.main(Main.java:157)
- at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
- at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:616)
- at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
- Details also at logfile: /tmp/pig_1398884957505.log
- <(jorge@abril)---(mié abr 30 13:09:21)>
- [pig][7] $ less /tmp/pig
- pig_1398884868315.log pig_1398884957505.log
- <(jorge@abril)---(mié abr 30 13:09:21)>
- [pig][7] $ less /tmp/pig_1398884957505.log
- Backend error message during job submission
- -------------------------------------------
- Unexpected System Error Occured: java.lang.IncompatibleClassChangeError: Found interface org.apache.hadoop.mapreduce.JobContext, but class w
- at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.setupUdfEnvAndStores(PigOutputFormat.java:225)
- at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.PigOutputFormat.checkOutputSpecs(PigOutputFormat.java:186)
- at org.apache.hadoop.mapreduce.JobSubmitter.checkSpecs(JobSubmitter.java:456)
- at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:342)
- at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1268)
- at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1265)
- at java.security.AccessController.doPrivileged(Native Method)
- at javax.security.auth.Subject.doAs(Subject.java:416)
- at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1491)
- at org.apache.hadoop.mapreduce.Job.submit(Job.java:1265)
- at org.apache.hadoop.mapreduce.lib.jobcontrol.ControlledJob.submit(ControlledJob.java:335)
- at org.apache.hadoop.mapreduce.lib.jobcontrol.JobControl.run(JobControl.java:240)
- at org.apache.pig.backend.hadoop20.PigJobControl.run(PigJobControl.java:121)
- at java.lang.Thread.run(Thread.java:679)
- at org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher$1.run(MapReduceLauncher.java:257)
- Pig Stack Trace
- ---------------
- ERROR 2244: Job failed, hadoop does not return any error message
- org.apache.pig.backend.executionengine.ExecException: ERROR 2244: Job failed, hadoop does not return any error message
- at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:145)
- at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
- at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
- at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
- at org.apache.pig.Main.run(Main.java:604)
- at org.apache.pig.Main.main(Main.java:157)
- at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
- at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:616)
- at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
- ================================================================================
- Pig Stack Trace
- ---------------
- ERROR 2244: Job failed, hadoop does not return any error message
- org.apache.pig.backend.executionengine.ExecException: ERROR 2244: Job failed, hadoop does not return any error message
- at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:145)
- at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
- at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
- at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
- at org.apache.pig.Main.run(Main.java:604)
- at org.apache.pig.Main.main(Main.java:157)
- at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
- at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:616)
- at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
- ================================================================================
- Pig Stack Trace
- ---------------
- ERROR 2244: Job failed, hadoop does not return any error message
- org.apache.pig.backend.executionengine.ExecException: ERROR 2244: Job failed, hadoop does not return any error message
- at org.apache.pig.tools.grunt.GruntParser.executeBatch(GruntParser.java:145)
- at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:198)
- at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:170)
- at org.apache.pig.tools.grunt.Grunt.exec(Grunt.java:84)
- at org.apache.pig.Main.run(Main.java:604)
- at org.apache.pig.Main.main(Main.java:157)
- at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
- at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
- at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
- at java.lang.reflect.Method.invoke(Method.java:616)
- at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
- ================================================================================
- <(jorge@abril)---(mié abr 30 13:10:07)>
- [pig][8] $
Advertisement
Add Comment
Please, Sign In to add comment
Advertisement