Not a member of Pastebin yet?
Sign Up,
it unlocks many cool features!
- SLF4J: Class path contains multiple SLF4J bindings.
- SLF4J: Found binding in [jar:file:/usr/games/spark/xt/spark-assembly_2.10-0.9.0-cdh5.0.1-hadoop2.3.0-cdh5.0.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
- SLF4J: Found binding in [jar:file:/usr/lib/zookeeper/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
- SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
- SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
- 14/10/08 09:55:03 INFO slf4j.Slf4jLogger: Slf4jLogger started
- 14/10/08 09:55:03 INFO Remoting: Starting remoting
- 14/10/08 09:55:04 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://[email protected]:56888]
- 14/10/08 09:55:04 INFO Remoting: Remoting now listens on addresses: [akka.tcp://[email protected]:56888]
- 14/10/08 09:55:04 INFO spark.SparkEnv: Registering BlockManagerMaster
- 14/10/08 09:55:04 INFO storage.DiskBlockManager: Created local directory at /tmp/spark-local-20141008095504-a4de
- 14/10/08 09:55:04 INFO storage.MemoryStore: MemoryStore started with capacity 8.4 GB.
- 14/10/08 09:55:04 INFO network.ConnectionManager: Bound socket to port 41705 with id = ConnectionManagerId(a04.jsepc.com,41705)
- 14/10/08 09:55:04 INFO storage.BlockManagerMaster: Trying to register BlockManager
- 14/10/08 09:55:04 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager a04.jsepc.com:41705 with 8.4 GB RAM
- 14/10/08 09:55:04 INFO storage.BlockManagerMaster: Registered BlockManager
- 14/10/08 09:55:04 INFO spark.HttpServer: Starting HTTP Server
- 14/10/08 09:55:04 INFO server.Server: jetty-7.x.y-SNAPSHOT
- 14/10/08 09:55:04 INFO server.AbstractConnector: Started [email protected]:37405
- 14/10/08 09:55:04 INFO broadcast.HttpBroadcast: Broadcast server started at http://10.134.101.104:37405
- 14/10/08 09:55:04 INFO spark.SparkEnv: Registering MapOutputTracker
- 14/10/08 09:55:04 INFO spark.HttpFileServer: HTTP File server directory is /tmp/spark-4b8ca379-4449-448b-81a0-6f5adc8cee56
- 14/10/08 09:55:04 INFO spark.HttpServer: Starting HTTP Server
- 14/10/08 09:55:04 INFO server.Server: jetty-7.x.y-SNAPSHOT
- 14/10/08 09:55:04 INFO server.AbstractConnector: Started [email protected]:57773
- 14/10/08 09:55:04 INFO server.Server: jetty-7.x.y-SNAPSHOT
- 14/10/08 09:55:04 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/storage/rdd,null}
- 14/10/08 09:55:04 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/storage,null}
- 14/10/08 09:55:04 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/stages/stage,null}
- 14/10/08 09:55:04 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/stages/pool,null}
- 14/10/08 09:55:04 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/stages,null}
- 14/10/08 09:55:04 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/environment,null}
- 14/10/08 09:55:04 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/executors,null}
- 14/10/08 09:55:04 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/metrics/json,null}
- 14/10/08 09:55:04 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/static,null}
- 14/10/08 09:55:04 INFO handler.ContextHandler: started o.e.j.s.h.ContextHandler{/,null}
- 14/10/08 09:55:04 INFO server.AbstractConnector: Started [email protected]:4040
- 14/10/08 09:55:04 INFO ui.SparkUI: Started Spark Web UI at http://a04.jsepc.com:4040
- 14/10/08 09:55:04 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
- 14/10/08 09:55:04 INFO spark.SparkContext: Added JAR /usr/games/spark/xt/SparkDemo-0.0.1-SNAPSHOT.jar at http://10.134.101.104:57773/jars/SparkDemo-0.0.1-SNAPSHOT.jar with timestamp 1412733304810
- 14/10/08 09:55:04 INFO spark.SparkContext: Added JAR /usr/games/spark/xt/spark-assembly_2.10-0.9.0-cdh5.0.1-hadoop2.3.0-cdh5.0.1.jar at http://10.134.101.104:57773/jars/spark-assembly_2.10-0.9.0-cdh5.0.1-hadoop2.3.0-cdh5.0.1.jar with timestamp 1412733304934
- 14/10/08 09:55:04 INFO spark.SparkContext: Added JAR /usr/games/spark/xt/hbase-client-0.96.1.1-cdh5.0.1.jar at http://10.134.101.104:57773/jars/hbase-client-0.96.1.1-cdh5.0.1.jar with timestamp 1412733304935
- 14/10/08 09:55:04 INFO spark.SparkContext: Added JAR /usr/games/spark/xt/hbase-common-0.96.1.1-cdh5.0.1.jar at http://10.134.101.104:57773/jars/hbase-common-0.96.1.1-cdh5.0.1.jar with timestamp 1412733304936
- 14/10/08 09:55:04 INFO spark.SparkContext: Added JAR /usr/games/spark/xt/hbase-server-0.96.1.1-cdh5.0.1.jar at http://10.134.101.104:57773/jars/hbase-server-0.96.1.1-cdh5.0.1.jar with timestamp 1412733304942
- 14/10/08 09:55:04 INFO spark.SparkContext: Added JAR /usr/games/spark/xt/hbase-protocol-0.96.0-hadoop2.jar at http://10.134.101.104:57773/jars/hbase-protocol-0.96.0-hadoop2.jar with timestamp 1412733304947
- 14/10/08 09:55:04 INFO spark.SparkContext: Added JAR /usr/games/spark/xt/htrace-core-2.01.jar at http://10.134.101.104:57773/jars/htrace-core-2.01.jar with timestamp 1412733304947
- 14/10/08 09:55:05 INFO client.RMProxy: Connecting to ResourceManager at a03.jsepc.com/10.134.101.103:8032
- 14/10/08 09:55:05 INFO yarn.Client: Got Cluster metric info from ApplicationsManager (ASM), number of NodeManagers: 16
- 14/10/08 09:55:05 INFO yarn.Client: Queue info ... queueName: root.default, queueCurrentCapacity: 0.0, queueMaxCapacity: -1.0,
- queueApplicationCount = 0, queueChildQueueCount = 0
- 14/10/08 09:55:05 INFO yarn.Client: Max mem capabililty of a single resource in this cluster 8192
- 14/10/08 09:55:05 INFO yarn.Client: Preparing Local resources
- 14/10/08 09:55:05 INFO yarn.Client: Uploading file:/usr/games/spark/xt/spark-assembly_2.10-0.9.0-cdh5.0.1-hadoop2.3.0-cdh5.0.1.jar to hdfs://jsepc-ns/user/root/.sparkStaging/application_1412731028648_0157/spark-assembly_2.10-0.9.0-cdh5.0.1-hadoop2.3.0-cdh5.0.1.jar
- 14/10/08 09:55:07 INFO yarn.Client: Setting up the launch environment
- 14/10/08 09:55:07 INFO yarn.Client: Setting up container launch context
- 14/10/08 09:55:07 INFO yarn.Client: Command for starting the Spark ApplicationMaster: $JAVA_HOME/bin/java -server -Xmx512m -Djava.io.tmpdir=$PWD/tmp org.apache.spark.deploy.yarn.WorkerLauncher --class notused --jar null --args 'a04.jsepc.com:56888' --worker-memory 1024 --worker-cores 1 --num-workers 2 1> <LOG_DIR>/stdout 2> <LOG_DIR>/stderr
- 14/10/08 09:55:07 INFO yarn.Client: Submitting application to ASM
- 14/10/08 09:55:07 INFO impl.YarnClientImpl: Submitted application application_1412731028648_0157
- 14/10/08 09:55:07 INFO cluster.YarnClientSchedulerBackend: Application report from ASM:
- appMasterRpcPort: -1
- appStartTime: 1412733358877
- yarnAppState: ACCEPTED
- 14/10/08 09:55:08 INFO cluster.YarnClientSchedulerBackend: Application report from ASM:
- appMasterRpcPort: -1
- appStartTime: 1412733358877
- yarnAppState: ACCEPTED
- 14/10/08 09:55:09 INFO cluster.YarnClientSchedulerBackend: Application report from ASM:
- appMasterRpcPort: -1
- appStartTime: 1412733358877
- yarnAppState: ACCEPTED
- 14/10/08 09:55:10 INFO cluster.YarnClientSchedulerBackend: Application report from ASM:
- appMasterRpcPort: -1
- appStartTime: 1412733358877
- yarnAppState: ACCEPTED
- 14/10/08 09:55:11 INFO cluster.YarnClientSchedulerBackend: Application report from ASM:
- appMasterRpcPort: -1
- appStartTime: 1412733358877
- yarnAppState: ACCEPTED
- 14/10/08 09:55:12 INFO cluster.YarnClientSchedulerBackend: Application report from ASM:
- appMasterRpcPort: -1
- appStartTime: 1412733358877
- yarnAppState: ACCEPTED
- 14/10/08 09:55:13 INFO cluster.YarnClientSchedulerBackend: Application report from ASM:
- appMasterRpcPort: -1
- appStartTime: 1412733358877
- yarnAppState: ACCEPTED
- 14/10/08 09:55:14 INFO cluster.YarnClientSchedulerBackend: Application report from ASM:
- appMasterRpcPort: -1
- appStartTime: 1412733358877
- yarnAppState: ACCEPTED
- 14/10/08 09:55:15 INFO cluster.YarnClientSchedulerBackend: Application report from ASM:
- appMasterRpcPort: -1
- appStartTime: 1412733358877
- yarnAppState: ACCEPTED
- 14/10/08 09:55:16 INFO cluster.YarnClientSchedulerBackend: Application report from ASM:
- appMasterRpcPort: -1
- appStartTime: 1412733358877
- yarnAppState: ACCEPTED
- 14/10/08 09:55:17 INFO cluster.YarnClientSchedulerBackend: Application report from ASM:
- appMasterRpcPort: 0
- appStartTime: 1412733358877
- yarnAppState: RUNNING
- 14/10/08 09:55:19 INFO cluster.YarnClientClusterScheduler: YarnClientClusterScheduler.postStartHook done
- 14/10/08 09:55:19 INFO storage.MemoryStore: ensureFreeSpace(56696) called with curMem=0, maxMem=9003781324
- 14/10/08 09:55:19 INFO storage.MemoryStore: Block broadcast_0 stored as values to memory (estimated size 55.4 KB, free 8.4 GB)
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:zookeeper.version=3.4.5-cdh5.0.1--1, built on 05/06/2014 18:50 GMT
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:host.name=a04.jsepc.com
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:java.version=1.6.0_31
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:java.vendor=Sun Microsystems Inc.
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:java.home=/usr/jdk64/jdk1.6.0_31/jre
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:java.class.path=:/usr/games/spark/xt/SparkDemo-0.0.1-SNAPSHOT.jar:/usr/games/spark/xt/spark-assembly_2.10-0.9.0-cdh5.0.1-hadoop2.3.0-cdh5.0.1.jar:/usr/games/spark/xt/hadoop-common-2.3.0-cdh5.0.1.jar:/usr/games/spark/xt/hbase-client-0.96.1.1-cdh5.0.1.jar:/usr/games/spark/xt/hbase-common-0.96.1.1-cdh5.0.1.jar:/usr/games/spark/xt/hbase-server-0.96.1.1-cdh5.0.1.jar:/usr/games/spark/xt/hbase-protocol-0.96.0-hadoop2.jar:/usr/games/spark/xt/htrace-core-2.01.jar:/usr/lib/hbase/bin/../conf:
- ... ... (other classpath)
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:java.library.path=/usr/jdk64/jdk1.6.0_31/jre/lib/amd64/server:/usr/jdk64/jdk1.6.0_31/jre/lib/amd64:/usr/jdk64/jdk1.6.0_31/jre/../lib/amd64:/usr/java/packages/lib/amd64:/usr/lib64:/lib64:/lib:/usr/lib
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:java.io.tmpdir=/tmp
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:java.compiler=<NA>
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:os.name=Linux
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:os.arch=amd64
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:os.version=2.6.32-431.el6.x86_64
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:user.name=root
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:user.home=/root
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Client environment:user.dir=/usr/games/spark/xt
- 14/10/08 09:55:19 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=a04.jsepc.com:2181,a09.jsepc.com:2181,b06.jsepc.com:2181,b04.jsepc.com:2181,a05.jsepc.com:2181 sessionTimeout=60000 watcher=hconnection-0x5127a6bc, quorum=a04.jsepc.com:2181,a09.jsepc.com:2181,b06.jsepc.com:2181,b04.jsepc.com:2181,a05.jsepc.com:2181, baseZNode=/hbase
- 14/10/08 09:55:19 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x5127a6bc connecting to ZooKeeper ensemble=a04.jsepc.com:2181,a09.jsepc.com:2181,b06.jsepc.com:2181,b04.jsepc.com:2181,a05.jsepc.com:2181
- 14/10/08 09:55:19 INFO zookeeper.ClientCnxn: Opening socket connection to server a04.jsepc.com/10.134.101.104:2181. Will not attempt to authenticate using SASL (java.lang.SecurityException: Unable to locate a login configuration)
- 14/10/08 09:55:19 INFO zookeeper.ClientCnxn: Socket connection established to a04.jsepc.com/10.134.101.104:2181, initiating session
- 14/10/08 09:55:19 INFO zookeeper.ClientCnxn: Session establishment complete on server a04.jsepc.com/10.134.101.104:2181, sessionid = 0x548ed5237730779, negotiated timeout = 60000
- 14/10/08 09:55:20 INFO spark.SparkContext: Starting job: count at HBaseApp.scala:60
- 14/10/08 09:55:20 INFO scheduler.DAGScheduler: Got job 0 (count at HBaseApp.scala:60) with 86 output partitions (allowLocal=false)
- 14/10/08 09:55:20 INFO scheduler.DAGScheduler: Final stage: Stage 0 (count at HBaseApp.scala:60)
- 14/10/08 09:55:20 INFO scheduler.DAGScheduler: Parents of final stage: List()
- 14/10/08 09:55:20 INFO scheduler.DAGScheduler: Missing parents: List()
- 14/10/08 09:55:20 INFO scheduler.DAGScheduler: Submitting Stage 0 (NewHadoopRDD[0] at newAPIHadoopRDD at HBaseApp.scala:57), which has no missing parents
- 14/10/08 09:55:20 INFO scheduler.DAGScheduler: Submitting 86 missing tasks from Stage 0 (NewHadoopRDD[0] at newAPIHadoopRDD at HBaseApp.scala:57)
- 14/10/08 09:55:20 INFO cluster.YarnClientClusterScheduler: Adding task set 0.0 with 86 tasks
- 14/10/08 09:55:23 INFO cluster.YarnClientSchedulerBackend: Registered executor: Actor[akka.tcp://[email protected]:40235/user/Executor#-974730228] with ID 1
- 14/10/08 09:55:23 INFO scheduler.TaskSetManager: Starting task 0.0:0 as TID 0 on executor 1: a04.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:55:23 INFO scheduler.TaskSetManager: Serialized task 0.0:0 as 1750 bytes in 19 ms
- 14/10/08 09:55:23 INFO cluster.YarnClientSchedulerBackend: Registered executor: Actor[akka.tcp://[email protected]:58390/user/Executor#-1047648090] with ID 2
- 14/10/08 09:55:23 INFO scheduler.TaskSetManager: Starting task 0.0:1 as TID 1 on executor 2: b06.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:55:23 INFO scheduler.TaskSetManager: Serialized task 0.0:1 as 1762 bytes in 0 ms
- 14/10/08 09:55:23 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager a04.jsepc.com:49017 with 589.2 MB RAM
- 14/10/08 09:55:23 INFO storage.BlockManagerMasterActor$BlockManagerInfo: Registering block manager b06.jsepc.com:35974 with 589.2 MB RAM
- 14/10/08 09:55:26 INFO scheduler.TaskSetManager: Starting task 0.0:2 as TID 2 on executor 1: a04.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:55:26 INFO scheduler.TaskSetManager: Serialized task 0.0:2 as 1762 bytes in 1 ms
- 14/10/08 09:55:26 INFO scheduler.TaskSetManager: Finished TID 0 in 3449 ms on a04.jsepc.com (progress: 0/86)
- 14/10/08 09:55:26 INFO scheduler.DAGScheduler: Completed ResultTask(0, 0)
- 14/10/08 09:55:50 INFO scheduler.TaskSetManager: Starting task 0.0:3 as TID 3 on executor 1: a04.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:55:50 INFO scheduler.TaskSetManager: Serialized task 0.0:3 as 1762 bytes in 0 ms
- 14/10/08 09:55:50 INFO scheduler.TaskSetManager: Finished TID 2 in 23163 ms on a04.jsepc.com (progress: 1/86)
- 14/10/08 09:55:50 INFO scheduler.DAGScheduler: Completed ResultTask(0, 2)
- 14/10/08 09:56:08 INFO scheduler.TaskSetManager: Starting task 0.0:4 as TID 4 on executor 2: b06.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:56:08 INFO scheduler.TaskSetManager: Serialized task 0.0:4 as 1762 bytes in 0 ms
- 14/10/08 09:56:08 INFO scheduler.TaskSetManager: Finished TID 1 in 44756 ms on b06.jsepc.com (progress: 2/86)
- 14/10/08 09:56:08 INFO scheduler.DAGScheduler: Completed ResultTask(0, 1)
- 14/10/08 09:56:12 INFO scheduler.TaskSetManager: Starting task 0.0:5 as TID 5 on executor 1: a04.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:56:12 INFO scheduler.TaskSetManager: Serialized task 0.0:5 as 1762 bytes in 1 ms
- 14/10/08 09:56:12 INFO scheduler.TaskSetManager: Finished TID 3 in 22466 ms on a04.jsepc.com (progress: 3/86)
- 14/10/08 09:56:12 INFO scheduler.DAGScheduler: Completed ResultTask(0, 3)
- 14/10/08 09:56:46 INFO scheduler.TaskSetManager: Starting task 0.0:6 as TID 6 on executor 2: b06.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:56:46 INFO scheduler.TaskSetManager: Serialized task 0.0:6 as 1762 bytes in 0 ms
- 14/10/08 09:56:46 INFO scheduler.TaskSetManager: Finished TID 4 in 38420 ms on b06.jsepc.com (progress: 4/86)
- 14/10/08 09:56:46 INFO scheduler.DAGScheduler: Completed ResultTask(0, 4)
- 14/10/08 09:57:08 INFO scheduler.TaskSetManager: Starting task 0.0:7 as TID 7 on executor 1: a04.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:57:08 INFO scheduler.TaskSetManager: Serialized task 0.0:7 as 1762 bytes in 0 ms
- 14/10/08 09:57:08 INFO scheduler.TaskSetManager: Finished TID 5 in 55644 ms on a04.jsepc.com (progress: 5/86)
- 14/10/08 09:57:08 INFO scheduler.DAGScheduler: Completed ResultTask(0, 5)
- 14/10/08 09:57:26 INFO scheduler.TaskSetManager: Starting task 0.0:8 as TID 8 on executor 1: a04.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:57:26 INFO scheduler.TaskSetManager: Serialized task 0.0:8 as 1762 bytes in 1 ms
- 14/10/08 09:57:26 INFO scheduler.TaskSetManager: Finished TID 7 in 18316 ms on a04.jsepc.com (progress: 6/86)
- 14/10/08 09:57:26 INFO scheduler.DAGScheduler: Completed ResultTask(0, 7)
- 14/10/08 09:57:47 INFO scheduler.TaskSetManager: Starting task 0.0:9 as TID 9 on executor 2: b06.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:57:47 INFO scheduler.TaskSetManager: Serialized task 0.0:9 as 1762 bytes in 0 ms
- 14/10/08 09:57:47 INFO scheduler.TaskSetManager: Finished TID 6 in 60944 ms on b06.jsepc.com (progress: 7/86)
- 14/10/08 09:57:47 INFO scheduler.DAGScheduler: Completed ResultTask(0, 6)
- 14/10/08 09:57:53 INFO scheduler.TaskSetManager: Starting task 0.0:10 as TID 10 on executor 1: a04.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:57:53 INFO scheduler.TaskSetManager: Serialized task 0.0:10 as 1762 bytes in 1 ms
- 14/10/08 09:57:53 INFO scheduler.TaskSetManager: Finished TID 8 in 27319 ms on a04.jsepc.com (progress: 8/86)
- 14/10/08 09:57:53 INFO scheduler.DAGScheduler: Completed ResultTask(0, 8)
- 14/10/08 09:58:10 INFO scheduler.TaskSetManager: Starting task 0.0:11 as TID 11 on executor 2: b06.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:58:10 INFO scheduler.TaskSetManager: Serialized task 0.0:11 as 1762 bytes in 1 ms
- 14/10/08 09:58:10 INFO scheduler.TaskSetManager: Finished TID 9 in 22928 ms on b06.jsepc.com (progress: 9/86)
- 14/10/08 09:58:10 INFO scheduler.DAGScheduler: Completed ResultTask(0, 9)
- 14/10/08 09:58:15 INFO scheduler.TaskSetManager: Starting task 0.0:12 as TID 12 on executor 1: a04.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:58:15 INFO scheduler.TaskSetManager: Serialized task 0.0:12 as 1762 bytes in 1 ms
- 14/10/08 09:58:15 INFO scheduler.TaskSetManager: Finished TID 10 in 22043 ms on a04.jsepc.com (progress: 10/86)
- 14/10/08 09:58:15 INFO scheduler.DAGScheduler: Completed ResultTask(0, 10)
- 14/10/08 09:58:30 INFO scheduler.TaskSetManager: Starting task 0.0:13 as TID 13 on executor 1: a04.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:58:30 INFO scheduler.TaskSetManager: Serialized task 0.0:13 as 1762 bytes in 1 ms
- 14/10/08 09:58:30 INFO scheduler.TaskSetManager: Finished TID 12 in 15069 ms on a04.jsepc.com (progress: 11/86)
- 14/10/08 09:58:30 INFO scheduler.DAGScheduler: Completed ResultTask(0, 12)
- 14/10/08 09:58:34 INFO scheduler.TaskSetManager: Starting task 0.0:14 as TID 14 on executor 2: b06.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:58:34 INFO scheduler.TaskSetManager: Serialized task 0.0:14 as 1762 bytes in 0 ms
- 14/10/08 09:58:34 INFO scheduler.TaskSetManager: Finished TID 11 in 23500 ms on b06.jsepc.com (progress: 12/86)
- 14/10/08 09:58:34 INFO scheduler.DAGScheduler: Completed ResultTask(0, 11)
- 14/10/08 09:59:01 INFO scheduler.TaskSetManager: Starting task 0.0:15 as TID 15 on executor 1: a04.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:59:01 INFO scheduler.TaskSetManager: Serialized task 0.0:15 as 1762 bytes in 0 ms
- 14/10/08 09:59:01 INFO scheduler.TaskSetManager: Finished TID 13 in 30418 ms on a04.jsepc.com (progress: 13/86)
- 14/10/08 09:59:01 INFO scheduler.DAGScheduler: Completed ResultTask(0, 13)
- 14/10/08 09:59:02 INFO scheduler.TaskSetManager: Starting task 0.0:16 as TID 16 on executor 2: b06.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:59:02 INFO scheduler.TaskSetManager: Serialized task 0.0:16 as 1762 bytes in 1 ms
- 14/10/08 09:59:02 INFO scheduler.TaskSetManager: Finished TID 14 in 28437 ms on b06.jsepc.com (progress: 14/86)
- 14/10/08 09:59:02 INFO scheduler.DAGScheduler: Completed ResultTask(0, 14)
- 14/10/08 09:59:26 INFO scheduler.TaskSetManager: Starting task 0.0:17 as TID 17 on executor 1: a04.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:59:26 INFO scheduler.TaskSetManager: Serialized task 0.0:17 as 1762 bytes in 1 ms
- 14/10/08 09:59:26 INFO scheduler.TaskSetManager: Finished TID 15 in 25638 ms on a04.jsepc.com (progress: 15/86)
- 14/10/08 09:59:26 INFO scheduler.DAGScheduler: Completed ResultTask(0, 15)
- 14/10/08 09:59:28 INFO scheduler.TaskSetManager: Starting task 0.0:18 as TID 18 on executor 2: b06.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:59:28 INFO scheduler.TaskSetManager: Serialized task 0.0:18 as 1762 bytes in 1 ms
- 14/10/08 09:59:28 INFO scheduler.TaskSetManager: Finished TID 16 in 25887 ms on b06.jsepc.com (progress: 16/86)
- 14/10/08 09:59:28 INFO scheduler.DAGScheduler: Completed ResultTask(0, 16)
- 14/10/08 09:59:53 INFO scheduler.TaskSetManager: Starting task 0.0:19 as TID 19 on executor 1: a04.jsepc.com (PROCESS_LOCAL)
- 14/10/08 09:59:53 INFO scheduler.TaskSetManager: Serialized task 0.0:19 as 1762 bytes in 0 ms
- 14/10/08 09:59:53 INFO scheduler.TaskSetManager: Finished TID 17 in 26404 ms on a04.jsepc.com (progress: 17/86)
- 14/10/08 09:59:53 INFO scheduler.DAGScheduler: Completed ResultTask(0, 17)
- ... ... (others )
Advertisement
Add Comment
Please, Sign In to add comment