ITPub博客

首页 > 大数据 > 数据分析 > sparksql限制一(多表join问题)

sparksql限制一(多表join问题)

原创 数据分析 作者:jack22220613 时间:2015-03-10 15:08:46 0 删除 编辑
1、sqlContext中3个表不能同时join,需要两两join后再join一次;---经验证,此版本没这个限制(cdh5.3)
scala> sqlContext.sql("select a.name,a.age,b.age from rddTable a join parquetTable b on a.name=b.name").collect().foreach(pri
ntln)
15/03/10 13:56:28 INFO MemoryStore: ensureFreeSpace(262982) called with curMem=280173, maxMem=278302556
.....省去...................
15/03/10 13:56:31 INFO DAGScheduler: Stage 2 (collect at SparkPlan.scala:84) finished in 1.002 s
15/03/10 13:56:31 INFO TaskSchedulerImpl: Removed TaskSet 2.0, whose tasks have all completed, from pool
15/03/10 13:56:31 INFO DAGScheduler: Job 0 finished: collect at SparkPlan.scala:84, took 2.891577 s
[andy,30,30]
[mechel,29,30]
[mechel,29,29]
[mechel,30,30]
[mechel,30,29]
[jusdin,19,19]

scala>

scala>

scala> sqlContext.sql("select a.name,a.age,b.age,c.age from rddTable a join parquetTable b join parquetTable c on a.name=b.na
me and a.name=c.name").collect().foreach(println)
15/03/10 14:00:51 INFO MemoryStore: ensureFreeSpace(262982) called with curMem=599409, maxMem=278302556
15/03/10 14:00:51 INFO MemoryStore: Block broadcast_5 stored as values in memory (estimated size 256.8 KB, free 264.6 MB)
15/03/10 14:00:51 INFO MemoryStore: ensureFreeSpace(21789) called with curMem=862391, maxMem=278302556
15/03/10 14:00:51 INFO MemoryStore: Block broadcast_5_piece0 stored as bytes in memory (estimated size 21.3 KB, free 264.6 MB)
15/03/10 14:00:51 INFO BlockManagerInfo: Added broadcast_5_piece0 in memory on localhost:51252 (size: 21.3 KB, free: 265.3 MB)
15/03/10 14:00:51 INFO BlockManagerMaster: Updated info of block broadcast_5_piece0
15/03/10 14:00:51 INFO SparkContext: Created broadcast 5 from NewHadoopRDD at ParquetTableOperations.scala:120
15/03/10 14:00:51 INFO MemoryStore: ensureFreeSpace(262982) called with curMem=884180, maxMem=278302556
15/03/10 14:00:51 INFO MemoryStore: Block broadcast_6 stored as values in memory (estimated size 256.8 KB, free 264.3 MB)
15/03/10 14:00:51 INFO MemoryStore: ensureFreeSpace(21789) called with curMem=1147162, maxMem=278302556
15/03/10 14:00:51 INFO MemoryStore: Block broadcast_6_piece0 stored as bytes in memory (estimated size 21.3 KB, free 264.3 MB)
15/03/10 14:00:51 INFO BlockManagerInfo: Added broadcast_6_piece0 in memory on localhost:51252 (size: 21.3 KB, free: 265.3 MB)
15/03/10 14:00:51 INFO BlockManagerMaster: Updated info of block broadcast_6_piece0
15/03/10 14:00:51 INFO SparkContext: Created broadcast 6 from NewHadoopRDD at ParquetTableOperations.scala:120
15/03/10 14:00:51 INFO SparkContext: Starting job: collect at SparkPlan.scala:84
15/03/10 14:00:51 INFO DAGScheduler: Registering RDD 30 (mapPartitions at Exchange.scala:64)
15/03/10 14:00:51 INFO FileInputFormat: Total input paths to process : 2
15/03/10 14:00:51 INFO ParquetInputFormat: Total input paths to process : 2
15/03/10 14:00:51 INFO ParquetFileReader: Initiating action with parallelism: 5
15/03/10 14:00:51 INFO ParquetFileReader: reading summary file: hdfs://cdh0:8020/user/hive/warehouse/db1.db/spark_person/people.parquet/_metadata
15/03/10 14:00:51 INFO ParquetInputFormat: There were no row groups that could be dropped due to filter predicates
15/03/10 14:00:51 INFO DAGScheduler: Registering RDD 27 (mapPartitions at Exchange.scala:64)
15/03/10 14:00:51 INFO FileInputFormat: Total input paths to process : 2
15/03/10 14:00:51 INFO ParquetInputFormat: Total input paths to process : 2
15/03/10 14:00:51 INFO ParquetFileReader: Initiating action with parallelism: 5
15/03/10 14:00:51 INFO ParquetFileReader: reading summary file: hdfs://cdh0:8020/user/hive/warehouse/db1.db/spark_person/people.parquet/_metadata
15/03/10 14:00:51 INFO ParquetInputFormat: There were no row groups that could be dropped due to filter predicates
15/03/10 14:00:51 INFO DAGScheduler: Registering RDD 22 (mapPartitions at Exchange.scala:64)
15/03/10 14:00:51 INFO DAGScheduler: Got job 1 (collect at SparkPlan.scala:84) with 200 output partitions (allowLocal=false)
15/03/10 14:00:51 INFO DAGScheduler: Final stage: Stage 6(collect at SparkPlan.scala:84)
15/03/10 14:00:51 INFO DAGScheduler: Parents of final stage: List(Stage 5, Stage 3, Stage 4)
15/03/10 14:00:51 INFO DAGScheduler: Missing parents: List(Stage 5, Stage 3, Stage 4)
15/03/10 14:00:51 INFO DAGScheduler: Submitting Stage 3 (MapPartitionsRDD[30] at mapPartitions at Exchange.scala:64), which has no missing parents
15/03/10 14:00:51 INFO MemoryStore: ensureFreeSpace(6608) called with curMem=1168951, maxMem=278302556
15/03/10 14:00:51 INFO MemoryStore: Block broadcast_7 stored as values in memory (estimated size 6.5 KB, free 264.3 MB)
15/03/10 14:00:51 INFO MemoryStore: ensureFreeSpace(3665) called with curMem=1175559, maxMem=278302556
15/03/10 14:00:51 INFO MemoryStore: Block broadcast_7_piece0 stored as bytes in memory (estimated size 3.6 KB, free 264.3 MB)
15/03/10 14:00:51 INFO BlockManagerInfo: Added broadcast_7_piece0 in memory on localhost:51252 (size: 3.6 KB, free: 265.3 MB)
15/03/10 14:00:51 INFO BlockManagerMaster: Updated info of block broadcast_7_piece0
15/03/10 14:00:51 INFO SparkContext: Created broadcast 7 from broadcast at DAGScheduler.scala:838
15/03/10 14:00:51 INFO DAGScheduler: Submitting 2 missing tasks from Stage 3 (MapPartitionsRDD[30] at mapPartitions at Exchange.scala:64)
15/03/10 14:00:51 INFO TaskSchedulerImpl: Adding task set 3.0 with 2 tasks
15/03/10 14:00:51 INFO TaskSetManager: Starting task 0.0 in stage 3.0 (TID 204, localhost, ANY, 1320 bytes)
15/03/10 14:00:51 INFO DAGScheduler: Submitting Stage 4 (MapPartitionsRDD[27] at mapPartitions at Exchange.scala:64), which has no missing parents
15/03/10 14:00:51 INFO TaskSetManager: Starting task 1.0 in stage 3.0 (TID 205, localhost, ANY, 1320 bytes)
15/03/10 14:00:51 INFO Executor: Running task 0.0 in stage 3.0 (TID 204)
15/03/10 14:00:51 INFO Executor: Running task 1.0 in stage 3.0 (TID 205)
15/03/10 14:00:51 INFO MemoryStore: ensureFreeSpace(6216) called with curMem=1179224, maxMem=278302556
15/03/10 14:00:51 INFO MemoryStore: Block broadcast_8 stored as values in memory (estimated size 6.1 KB, free 264.3 MB)
15/03/10 14:00:51 INFO MemoryStore: ensureFreeSpace(3528) called with curMem=1185440, maxMem=278302556
15/03/10 14:00:51 INFO MemoryStore: Block broadcast_8_piece0 stored as bytes in memory (estimated size 3.4 KB, free 264.3 MB)
15/03/10 14:00:51 INFO BlockManagerInfo: Added broadcast_8_piece0 in memory on localhost:51252 (size: 3.4 KB, free: 265.3 MB)
15/03/10 14:00:51 INFO BlockManagerMaster: Updated info of block broadcast_8_piece0
15/03/10 14:00:51 INFO HadoopRDD: Input split: hdfs://cdh0:8020/user/hive/warehouse/db1.db/spark_person/people.txt:0+19
15/03/10 14:00:51 INFO HadoopRDD: Input split: hdfs://cdh0:8020/user/hive/warehouse/db1.db/spark_person/people.txt:19+19
15/03/10 14:00:51 INFO SparkContext: Created broadcast 8 from broadcast at DAGScheduler.scala:838
15/03/10 14:00:51 INFO DAGScheduler: Submitting 2 missing tasks from Stage 4 (MapPartitionsRDD[27] at mapPartitions at Exchange.scala:64)
15/03/10 14:00:51 INFO TaskSchedulerImpl: Adding task set 4.0 with 2 tasks
15/03/10 14:00:51 INFO DAGScheduler: Submitting Stage 5 (MapPartitionsRDD[22] at mapPartitions at Exchange.scala:64), which has no missing parents
15/03/10 14:00:51 INFO TaskSetManager: Starting task 0.0 in stage 4.0 (TID 206, localhost, ANY, 2263 bytes)
15/03/10 14:00:51 INFO MemoryStore: ensureFreeSpace(6216) called with curMem=1188968, maxMem=278302556
15/03/10 14:00:51 INFO MemoryStore: Block broadcast_9 stored as values in memory (estimated size 6.1 KB, free 264.3 MB)
15/03/10 14:00:51 INFO TaskSetManager: Starting task 1.0 in stage 4.0 (TID 207, localhost, ANY, 2263 bytes)
15/03/10 14:00:51 INFO MemoryStore: ensureFreeSpace(3525) called with curMem=1195184, maxMem=278302556
15/03/10 14:00:51 INFO MemoryStore: Block broadcast_9_piece0 stored as bytes in memory (estimated size 3.4 KB, free 264.3 MB)
15/03/10 14:00:51 INFO Executor: Running task 0.0 in stage 4.0 (TID 206)
15/03/10 14:00:51 INFO Executor: Running task 1.0 in stage 4.0 (TID 207)
15/03/10 14:00:51 INFO BlockManagerInfo: Added broadcast_9_piece0 in memory on localhost:51252 (size: 3.4 KB, free: 265.3 MB)
15/03/10 14:00:51 INFO BlockManagerMaster: Updated info of block broadcast_9_piece0
15/03/10 14:00:51 INFO SparkContext: Created broadcast 9 from broadcast at DAGScheduler.scala:838
15/03/10 14:00:51 INFO DAGScheduler: Submitting 2 missing tasks from Stage 5 (MapPartitionsRDD[22] at mapPartitions at Exchange.scala:64)
15/03/10 14:00:51 INFO TaskSchedulerImpl: Adding task set 5.0 with 2 tasks
15/03/10 14:00:51 INFO NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://cdh0:8020/user/hive/warehouse/db1.db/spark_person/people.parquet/part-r-2.parquet start: 0 length: 128 hosts: [] blocks: 1 requestedSchema: same as file fileSchema: message root {
  optional binary name (UTF8);
  required int32 age;
}
 extraMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"name","type":"string","nullable":true,"metadata":{}},{"name":"age","type":"integer","nullable":false,"metadata":{}}]}} readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"name","type":"string","nullable":true,"metadata":{}},{"name":"age","type":"integer","nullable":false,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[{"name":"name","type":"string","nullable":true,"metadata":{}},{"name":"age","type":"integer","nullable":false,"metadata":{}}]}}}
15/03/10 14:00:51 INFO NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://cdh0:8020/user/hive/warehouse/db1.db/spark_person/people.parquet/part-r-1.parquet start: 0 length: 146 hosts: [] blocks: 1 requestedSchema: same as file fileSchema: message root {
  optional binary name (UTF8);
  required int32 age;
}
 extraMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"name","type":"string","nullable":true,"metadata":{}},{"name":"age","type":"integer","nullable":false,"metadata":{}}]}} readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"name","type":"string","nullable":true,"metadata":{}},{"name":"age","type":"integer","nullable":false,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[{"name":"name","type":"string","nullable":true,"metadata":{}},{"name":"age","type":"integer","nullable":false,"metadata":{}}]}}}
15/03/10 14:00:51 WARN ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/10 14:00:51 WARN ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/10 14:00:51 INFO TaskSetManager: Starting task 0.0 in stage 5.0 (TID 208, localhost, ANY, 2263 bytes)
15/03/10 14:00:51 INFO TaskSetManager: Starting task 1.0 in stage 5.0 (TID 209, localhost, ANY, 2263 bytes)
15/03/10 14:00:51 INFO Executor: Running task 0.0 in stage 5.0 (TID 208)
15/03/10 14:00:51 INFO InternalParquetRecordReader: RecordReader initialized will read a total of 1 records.
15/03/10 14:00:51 INFO Executor: Running task 1.0 in stage 5.0 (TID 209)
15/03/10 14:00:51 INFO InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
15/03/10 14:00:51 INFO InternalParquetRecordReader: at row 0. reading next block
15/03/10 14:00:51 INFO InternalParquetRecordReader: at row 0. reading next block
15/03/10 14:00:51 INFO NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://cdh0:8020/user/hive/warehouse/db1.db/spark_person/people.parquet/part-r-1.parquet start: 0 length: 146 hosts: [] blocks: 1 requestedSchema: same as file fileSchema: message root {
  optional binary name (UTF8);
  required int32 age;
}
 extraMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"name","type":"string","nullable":true,"metadata":{}},{"name":"age","type":"integer","nullable":false,"metadata":{}}]}} readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"name","type":"string","nullable":true,"metadata":{}},{"name":"age","type":"integer","nullable":false,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[{"name":"name","type":"string","nullable":true,"metadata":{}},{"name":"age","type":"integer","nullable":false,"metadata":{}}]}}}
15/03/10 14:00:51 INFO NewHadoopRDD: Input split: ParquetInputSplit{part: hdfs://cdh0:8020/user/hive/warehouse/db1.db/spark_person/people.parquet/part-r-2.parquet start: 0 length: 128 hosts: [] blocks: 1 requestedSchema: same as file fileSchema: message root {
  optional binary name (UTF8);
  required int32 age;
}
 extraMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"name","type":"string","nullable":true,"metadata":{}},{"name":"age","type":"integer","nullable":false,"metadata":{}}]}} readSupportMetadata: {org.apache.spark.sql.parquet.row.metadata={"type":"struct","fields":[{"name":"name","type":"string","nullable":true,"metadata":{}},{"name":"age","type":"integer","nullable":false,"metadata":{}}]}, org.apache.spark.sql.parquet.row.requested_schema={"type":"struct","fields":[{"name":"name","type":"string","nullable":true,"metadata":{}},{"name":"age","type":"integer","nullable":false,"metadata":{}}]}}}
15/03/10 14:00:51 WARN ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/10 14:00:51 WARN ParquetRecordReader: Can not initialize counter due to context is not a instance of TaskInputOutputContext, but is org.apache.hadoop.mapreduce.task.TaskAttemptContextImpl
15/03/10 14:00:51 INFO InternalParquetRecordReader: block read in memory in 3 ms. row count = 1
15/03/10 14:00:51 INFO InternalParquetRecordReader: block read in memory in 4 ms. row count = 3
15/03/10 14:00:51 INFO InternalParquetRecordReader: RecordReader initialized will read a total of 3 records.
15/03/10 14:00:51 INFO InternalParquetRecordReader: RecordReader initialized will read a total of 1 records.
15/03/10 14:00:51 INFO InternalParquetRecordReader: at row 0. reading next block
15/03/10 14:00:51 INFO InternalParquetRecordReader: at row 0. reading next block
15/03/10 14:00:51 INFO CodecPool: Got brand-new decompressor [.gz]
15/03/10 14:00:51 INFO CodecPool: Got brand-new decompressor [.gz]
15/03/10 14:00:51 INFO InternalParquetRecordReader: block read in memory in 4 ms. row count = 3
15/03/10 14:00:51 INFO InternalParquetRecordReader: block read in memory in 3 ms. row count = 1
15/03/10 14:00:52 INFO BlockManager: Removing broadcast 4
15/03/10 14:00:52 INFO BlockManager: Removing block broadcast_4
15/03/10 14:00:52 INFO MemoryStore: Block broadcast_4 of size 9528 dropped from memory (free 277113375)
15/03/10 14:00:52 INFO BlockManager: Removing block broadcast_4_piece0
15/03/10 14:00:52 INFO MemoryStore: Block broadcast_4_piece0 of size 5039 dropped from memory (free 277118414)
15/03/10 14:00:52 INFO BlockManagerInfo: Removed broadcast_4_piece0 on localhost:51252 in memory (size: 4.9 KB, free: 265.3 MB)
15/03/10 14:00:52 INFO BlockManagerMaster: Updated info of block broadcast_4_piece0
15/03/10 14:00:52 INFO ContextCleaner: Cleaned broadcast 4
15/03/10 14:00:52 INFO BlockManager: Removing broadcast 3
15/03/10 14:00:52 INFO BlockManager: Removing block broadcast_3_piece0
15/03/10 14:00:52 INFO MemoryStore: Block broadcast_3_piece0 of size 3529 dropped from memory (free 277121943)
15/03/10 14:00:52 INFO BlockManagerInfo: Removed broadcast_3_piece0 on localhost:51252 in memory (size: 3.4 KB, free: 265.3 MB)
15/03/10 14:00:52 INFO BlockManagerMaster: Updated info of block broadcast_3_piece0
15/03/10 14:00:52 INFO BlockManager: Removing block broadcast_3
15/03/10 14:00:52 INFO MemoryStore: Block broadcast_3 of size 6216 dropped from memory (free 277128159)
15/03/10 14:00:52 INFO ContextCleaner: Cleaned broadcast 3
15/03/10 14:00:52 INFO BlockManager: Removing broadcast 2
15/03/10 14:00:52 INFO BlockManager: Removing block broadcast_2
15/03/10 14:00:52 INFO MemoryStore: Block broadcast_2 of size 6536 dropped from memory (free 277134695)
15/03/10 14:00:52 INFO BlockManager: Removing block broadcast_2_piece0
15/03/10 14:00:52 INFO MemoryStore: Block broadcast_2_piece0 of size 3617 dropped from memory (free 277138312)
15/03/10 14:00:52 INFO BlockManagerInfo: Removed broadcast_2_piece0 on localhost:51252 in memory (size: 3.5 KB, free: 265.3 MB)
15/03/10 14:00:52 INFO BlockManagerMaster: Updated info of block broadcast_2_piece0
15/03/10 14:00:52 INFO ContextCleaner: Cleaned broadcast 2
15/03/10 14:00:52 INFO ContextCleaner: Cleaned shuffle 1
15/03/10 14:00:52 INFO ContextCleaner: Cleaned shuffle 0
15/03/10 14:00:52 INFO BlockManager: Removing broadcast 1
15/03/10 14:00:52 INFO BlockManager: Removing block broadcast_1_piece0
15/03/10 14:00:52 INFO MemoryStore: Block broadcast_1_piece0 of size 21789 dropped from memory (free 277160101)
15/03/10 14:00:52 INFO BlockManagerInfo: Removed broadcast_1_piece0 on localhost:51252 in memory (size: 21.3 KB, free: 265.3 MB)
15/03/10 14:00:52 INFO BlockManagerMaster: Updated info of block broadcast_1_piece0
15/03/10 14:00:52 INFO BlockManager: Removing block broadcast_1
15/03/10 14:00:52 INFO MemoryStore: Block broadcast_1 of size 262982 dropped from memory (free 277423083)
15/03/10 14:00:52 INFO ContextCleaner: Cleaned broadcast 1
15/03/10 14:00:52 INFO Executor: Finished task 0.0 in stage 3.0 (TID 204). 2152 bytes result sent to driver
15/03/10 14:00:52 INFO TaskSetManager: Finished task 0.0 in stage 3.0 (TID 204) in 1418 ms on localhost (1/2)
15/03/10 14:00:52 INFO Executor: Finished task 0.0 in stage 4.0 (TID 206). 2152 bytes result sent to driver
15/03/10 14:00:52 INFO Executor: Finished task 1.0 in stage 4.0 (TID 207). 2152 bytes result sent to driver
15/03/10 14:00:52 INFO TaskSetManager: Finished task 0.0 in stage 4.0 (TID 206) in 1414 ms on localhost (1/2)
15/03/10 14:00:52 INFO TaskSetManager: Finished task 1.0 in stage 4.0 (TID 207) in 1412 ms on localhost (2/2)
15/03/10 14:00:52 INFO DAGScheduler: Stage 4 (mapPartitions at Exchange.scala:64) finished in 1.417 s
15/03/10 14:00:52 INFO TaskSchedulerImpl: Removed TaskSet 4.0, whose tasks have all completed, from pool
15/03/10 14:00:52 INFO DAGScheduler: looking for newly runnable stages
15/03/10 14:00:52 INFO DAGScheduler: running: Set(Stage 5, Stage 3)
15/03/10 14:00:52 INFO DAGScheduler: waiting: Set(Stage 6)
15/03/10 14:00:52 INFO DAGScheduler: failed: Set()
15/03/10 14:00:52 INFO Executor: Finished task 1.0 in stage 3.0 (TID 205). 2152 bytes result sent to driver
15/03/10 14:00:52 INFO TaskSetManager: Finished task 1.0 in stage 3.0 (TID 205) in 1447 ms on localhost (2/2)
15/03/10 14:00:52 INFO TaskSchedulerImpl: Removed TaskSet 3.0, whose tasks have all completed, from pool
15/03/10 14:00:52 INFO DAGScheduler: Missing parents for Stage 6: List(Stage 5, Stage 3)
15/03/10 14:00:52 INFO Executor: Finished task 1.0 in stage 5.0 (TID 209). 2152 bytes result sent to driver
15/03/10 14:00:52 INFO DAGScheduler: Stage 3 (mapPartitions at Exchange.scala:64) finished in 1.453 s
15/03/10 14:00:52 INFO DAGScheduler: looking for newly runnable stages
15/03/10 14:00:52 INFO DAGScheduler: running: Set(Stage 5)
15/03/10 14:00:52 INFO DAGScheduler: waiting: Set(Stage 6)
15/03/10 14:00:52 INFO DAGScheduler: failed: Set()
15/03/10 14:00:52 INFO TaskSetManager: Finished task 1.0 in stage 5.0 (TID 209) in 1425 ms on localhost (1/2)
15/03/10 14:00:52 INFO Executor: Finished task 0.0 in stage 5.0 (TID 208). 2152 bytes result sent to driver
15/03/10 14:00:52 INFO TaskSetManager: Finished task 0.0 in stage 5.0 (TID 208) in 1436 ms on localhost (2/2)
15/03/10 14:00:52 INFO TaskSchedulerImpl: Removed TaskSet 5.0, whose tasks have all completed, from pool
15/03/10 14:00:52 INFO DAGScheduler: Missing parents for Stage 6: List(Stage 5)
15/03/10 14:00:52 INFO DAGScheduler: Stage 5 (mapPartitions at Exchange.scala:64) finished in 1.457 s
15/03/10 14:00:52 INFO DAGScheduler: looking for newly runnable stages
15/03/10 14:00:52 INFO DAGScheduler: running: Set()
15/03/10 14:00:52 INFO DAGScheduler: waiting: Set(Stage 6)
15/03/10 14:00:52 INFO DAGScheduler: failed: Set()
15/03/10 14:00:52 INFO DAGScheduler: Missing parents for Stage 6: List()
15/03/10 14:00:52 INFO DAGScheduler: Submitting Stage 6 (MappedRDD[37] at map at SparkPlan.scala:84), which is now runnable
15/03/10 14:00:52 INFO MemoryStore: ensureFreeSpace(10616) called with curMem=879473, maxMem=278302556
15/03/10 14:00:52 INFO MemoryStore: Block broadcast_10 stored as values in memory (estimated size 10.4 KB, free 264.6 MB)
15/03/10 14:00:52 INFO MemoryStore: ensureFreeSpace(5581) called with curMem=890089, maxMem=278302556
15/03/10 14:00:52 INFO MemoryStore: Block broadcast_10_piece0 stored as bytes in memory (estimated size 5.5 KB, free 264.6 MB)
15/03/10 14:00:52 INFO BlockManagerInfo: Added broadcast_10_piece0 in memory on localhost:51252 (size: 5.5 KB, free: 265.3 MB)
15/03/10 14:00:52 INFO BlockManagerMaster: Updated info of block broadcast_10_piece0
15/03/10 14:00:52 INFO SparkContext: Created broadcast 10 from broadcast at DAGScheduler.scala:838
15/03/10 14:00:53 INFO DAGScheduler: Submitting 200 missing tasks from Stage 6 (MappedRDD[37] at map at SparkPlan.scala:84)
15/03/10 14:00:53 INFO TaskSchedulerImpl: Adding task set 6.0 with 200 tasks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 0.0 in stage 6.0 (TID 210, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 1.0 in stage 6.0 (TID 211, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 2.0 in stage 6.0 (TID 212, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 3.0 in stage 6.0 (TID 213, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 4.0 in stage 6.0 (TID 214, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 5.0 in stage 6.0 (TID 215, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 6.0 in stage 6.0 (TID 216, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 7.0 in stage 6.0 (TID 217, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 8.0 in stage 6.0 (TID 218, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 9.0 in stage 6.0 (TID 219, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 10.0 in stage 6.0 (TID 220, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 11.0 in stage 6.0 (TID 221, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 12.0 in stage 6.0 (TID 222, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 13.0 in stage 6.0 (TID 223, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 14.0 in stage 6.0 (TID 224, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 15.0 in stage 6.0 (TID 225, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 16.0 in stage 6.0 (TID 226, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 17.0 in stage 6.0 (TID 227, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 18.0 in stage 6.0 (TID 228, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 19.0 in stage 6.0 (TID 229, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 20.0 in stage 6.0 (TID 230, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 21.0 in stage 6.0 (TID 231, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 22.0 in stage 6.0 (TID 232, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 23.0 in stage 6.0 (TID 233, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 0.0 in stage 6.0 (TID 210)
15/03/10 14:00:53 INFO Executor: Running task 5.0 in stage 6.0 (TID 215)
15/03/10 14:00:53 INFO Executor: Running task 2.0 in stage 6.0 (TID 212)
15/03/10 14:00:53 INFO Executor: Running task 3.0 in stage 6.0 (TID 213)
15/03/10 14:00:53 INFO Executor: Running task 4.0 in stage 6.0 (TID 214)
15/03/10 14:00:53 INFO Executor: Running task 1.0 in stage 6.0 (TID 211)
15/03/10 14:00:53 INFO Executor: Running task 6.0 in stage 6.0 (TID 216)
15/03/10 14:00:53 INFO Executor: Running task 7.0 in stage 6.0 (TID 217)
15/03/10 14:00:53 INFO Executor: Running task 8.0 in stage 6.0 (TID 218)
15/03/10 14:00:53 INFO Executor: Running task 9.0 in stage 6.0 (TID 219)
15/03/10 14:00:53 INFO Executor: Running task 10.0 in stage 6.0 (TID 220)
15/03/10 14:00:53 INFO Executor: Running task 11.0 in stage 6.0 (TID 221)
15/03/10 14:00:53 INFO Executor: Running task 12.0 in stage 6.0 (TID 222)
15/03/10 14:00:53 INFO Executor: Running task 13.0 in stage 6.0 (TID 223)
15/03/10 14:00:53 INFO Executor: Running task 14.0 in stage 6.0 (TID 224)
15/03/10 14:00:53 INFO Executor: Running task 15.0 in stage 6.0 (TID 225)
15/03/10 14:00:53 INFO Executor: Running task 16.0 in stage 6.0 (TID 226)
15/03/10 14:00:53 INFO Executor: Running task 17.0 in stage 6.0 (TID 227)
15/03/10 14:00:53 INFO Executor: Running task 18.0 in stage 6.0 (TID 228)
15/03/10 14:00:53 INFO Executor: Running task 19.0 in stage 6.0 (TID 229)
15/03/10 14:00:53 INFO Executor: Running task 20.0 in stage 6.0 (TID 230)
15/03/10 14:00:53 INFO Executor: Running task 21.0 in stage 6.0 (TID 231)
15/03/10 14:00:53 INFO Executor: Running task 22.0 in stage 6.0 (TID 232)
15/03/10 14:00:53 INFO Executor: Running task 23.0 in stage 6.0 (TID 233)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 4 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
15/03/10 14:00:53 INFO Executor: Finished task 5.0 in stage 6.0 (TID 215). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 3 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 3 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 3 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 3 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 3 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
15/03/10 14:00:53 INFO Executor: Finished task 13.0 in stage 6.0 (TID 223). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 2.0 in stage 6.0 (TID 212). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 24.0 in stage 6.0 (TID 234, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 8.0 in stage 6.0 (TID 218). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 5.0 in stage 6.0 (TID 215) in 51 ms on localhost (1/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 24.0 in stage 6.0 (TID 234)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 9.0 in stage 6.0 (TID 219). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 25.0 in stage 6.0 (TID 235, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 7.0 in stage 6.0 (TID 217). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 3.0 in stage 6.0 (TID 213). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 13.0 in stage 6.0 (TID 223) in 49 ms on localhost (2/200)
15/03/10 14:00:53 INFO Executor: Finished task 1.0 in stage 6.0 (TID 211). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 25.0 in stage 6.0 (TID 235)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 26.0 in stage 6.0 (TID 236, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 2.0 in stage 6.0 (TID 212) in 60 ms on localhost (3/200)
15/03/10 14:00:53 INFO Executor: Running task 26.0 in stage 6.0 (TID 236)
15/03/10 14:00:53 INFO Executor: Finished task 4.0 in stage 6.0 (TID 214). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 27.0 in stage 6.0 (TID 237, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 15.0 in stage 6.0 (TID 225). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 27.0 in stage 6.0 (TID 237)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 8.0 in stage 6.0 (TID 218) in 57 ms on localhost (4/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 28.0 in stage 6.0 (TID 238, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 28.0 in stage 6.0 (TID 238)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 9.0 in stage 6.0 (TID 219) in 58 ms on localhost (5/200)
15/03/10 14:00:53 INFO Executor: Finished task 10.0 in stage 6.0 (TID 220). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 18.0 in stage 6.0 (TID 228). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 0.0 in stage 6.0 (TID 210). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 14.0 in stage 6.0 (TID 224). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 29.0 in stage 6.0 (TID 239, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 21.0 in stage 6.0 (TID 231). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 6.0 in stage 6.0 (TID 216). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 7.0 in stage 6.0 (TID 217) in 62 ms on localhost (6/200)
15/03/10 14:00:53 INFO Executor: Running task 29.0 in stage 6.0 (TID 239)
15/03/10 14:00:53 INFO Executor: Finished task 17.0 in stage 6.0 (TID 227). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 11.0 in stage 6.0 (TID 221). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 22.0 in stage 6.0 (TID 232). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 30.0 in stage 6.0 (TID 240, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 30.0 in stage 6.0 (TID 240)
15/03/10 14:00:53 INFO Executor: Finished task 16.0 in stage 6.0 (TID 226). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 3.0 in stage 6.0 (TID 213) in 67 ms on localhost (7/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 20.0 in stage 6.0 (TID 230). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 12.0 in stage 6.0 (TID 222). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 19.0 in stage 6.0 (TID 229). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 31.0 in stage 6.0 (TID 241, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 31.0 in stage 6.0 (TID 241)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 1.0 in stage 6.0 (TID 211) in 71 ms on localhost (8/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 23.0 in stage 6.0 (TID 233). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 32.0 in stage 6.0 (TID 242, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 32.0 in stage 6.0 (TID 242)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 4.0 in stage 6.0 (TID 214) in 71 ms on localhost (9/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 33.0 in stage 6.0 (TID 243, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 33.0 in stage 6.0 (TID 243)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 15.0 in stage 6.0 (TID 225) in 64 ms on localhost (10/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 34.0 in stage 6.0 (TID 244, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 34.0 in stage 6.0 (TID 244)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 10.0 in stage 6.0 (TID 220) in 70 ms on localhost (11/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 35.0 in stage 6.0 (TID 245, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 35.0 in stage 6.0 (TID 245)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 18.0 in stage 6.0 (TID 228) in 66 ms on localhost (12/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 36.0 in stage 6.0 (TID 246, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 36.0 in stage 6.0 (TID 246)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 0.0 in stage 6.0 (TID 210) in 83 ms on localhost (13/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 37.0 in stage 6.0 (TID 247, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 37.0 in stage 6.0 (TID 247)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 14.0 in stage 6.0 (TID 224) in 73 ms on localhost (14/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 38.0 in stage 6.0 (TID 248, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 38.0 in stage 6.0 (TID 248)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 21.0 in stage 6.0 (TID 231) in 69 ms on localhost (15/200)
15/03/10 14:00:53 INFO Executor: Finished task 25.0 in stage 6.0 (TID 235). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 26.0 in stage 6.0 (TID 236). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 39.0 in stage 6.0 (TID 249, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 39.0 in stage 6.0 (TID 249)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 6.0 in stage 6.0 (TID 216) in 84 ms on localhost (16/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 40.0 in stage 6.0 (TID 250, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 40.0 in stage 6.0 (TID 250)
15/03/10 14:00:53 INFO Executor: Finished task 24.0 in stage 6.0 (TID 234). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 17.0 in stage 6.0 (TID 227) in 77 ms on localhost (17/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 41.0 in stage 6.0 (TID 251, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 41.0 in stage 6.0 (TID 251)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 11.0 in stage 6.0 (TID 221) in 84 ms on localhost (18/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 42.0 in stage 6.0 (TID 252, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 42.0 in stage 6.0 (TID 252)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 22.0 in stage 6.0 (TID 232) in 76 ms on localhost (19/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 43.0 in stage 6.0 (TID 253, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 30.0 in stage 6.0 (TID 240). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 43.0 in stage 6.0 (TID 253)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 27.0 in stage 6.0 (TID 237). 1090 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 16.0 in stage 6.0 (TID 226) in 83 ms on localhost (20/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 44.0 in stage 6.0 (TID 254, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 44.0 in stage 6.0 (TID 254)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 20.0 in stage 6.0 (TID 230) in 82 ms on localhost (21/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 45.0 in stage 6.0 (TID 255, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 45.0 in stage 6.0 (TID 255)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 12.0 in stage 6.0 (TID 222) in 91 ms on localhost (22/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 46.0 in stage 6.0 (TID 256, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 46.0 in stage 6.0 (TID 256)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 19.0 in stage 6.0 (TID 229) in 87 ms on localhost (23/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 31.0 in stage 6.0 (TID 241). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 47.0 in stage 6.0 (TID 257, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 47.0 in stage 6.0 (TID 257)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 23.0 in stage 6.0 (TID 233) in 87 ms on localhost (24/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 28.0 in stage 6.0 (TID 238). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 29.0 in stage 6.0 (TID 239). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 48.0 in stage 6.0 (TID 258, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 25.0 in stage 6.0 (TID 235) in 51 ms on localhost (25/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 48.0 in stage 6.0 (TID 258)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 49.0 in stage 6.0 (TID 259, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 26.0 in stage 6.0 (TID 236) in 51 ms on localhost (26/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 49.0 in stage 6.0 (TID 259)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 34.0 in stage 6.0 (TID 244). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 50.0 in stage 6.0 (TID 260, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 50.0 in stage 6.0 (TID 260)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 24.0 in stage 6.0 (TID 234) in 61 ms on localhost (27/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 32.0 in stage 6.0 (TID 242). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 33.0 in stage 6.0 (TID 243). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 51.0 in stage 6.0 (TID 261, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 51.0 in stage 6.0 (TID 261)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 30.0 in stage 6.0 (TID 240) in 46 ms on localhost (28/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 35.0 in stage 6.0 (TID 245). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 52.0 in stage 6.0 (TID 262, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 52.0 in stage 6.0 (TID 262)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 27.0 in stage 6.0 (TID 237) in 55 ms on localhost (29/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 53.0 in stage 6.0 (TID 263, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 53.0 in stage 6.0 (TID 263)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 31.0 in stage 6.0 (TID 241) in 49 ms on localhost (30/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 38.0 in stage 6.0 (TID 248). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 36.0 in stage 6.0 (TID 246). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 54.0 in stage 6.0 (TID 264, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 54.0 in stage 6.0 (TID 264)
15/03/10 14:00:53 INFO Executor: Finished task 37.0 in stage 6.0 (TID 247). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 28.0 in stage 6.0 (TID 238) in 57 ms on localhost (31/200)
15/03/10 14:00:53 INFO Executor: Finished task 39.0 in stage 6.0 (TID 249). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 55.0 in stage 6.0 (TID 265, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 55.0 in stage 6.0 (TID 265)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 29.0 in stage 6.0 (TID 239) in 57 ms on localhost (32/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 56.0 in stage 6.0 (TID 266, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 56.0 in stage 6.0 (TID 266)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 34.0 in stage 6.0 (TID 244) in 49 ms on localhost (33/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 57.0 in stage 6.0 (TID 267, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 57.0 in stage 6.0 (TID 267)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 32.0 in stage 6.0 (TID 242) in 56 ms on localhost (34/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 40.0 in stage 6.0 (TID 250). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 58.0 in stage 6.0 (TID 268, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 58.0 in stage 6.0 (TID 268)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 33.0 in stage 6.0 (TID 243) in 56 ms on localhost (35/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 41.0 in stage 6.0 (TID 251). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 59.0 in stage 6.0 (TID 269, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 42.0 in stage 6.0 (TID 252). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 35.0 in stage 6.0 (TID 245) in 54 ms on localhost (36/200)
15/03/10 14:00:53 INFO Executor: Running task 59.0 in stage 6.0 (TID 269)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 43.0 in stage 6.0 (TID 253). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 60.0 in stage 6.0 (TID 270, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 60.0 in stage 6.0 (TID 270)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 38.0 in stage 6.0 (TID 248) in 506 ms on localhost (37/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 61.0 in stage 6.0 (TID 271, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 61.0 in stage 6.0 (TID 271)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 36.0 in stage 6.0 (TID 246) in 512 ms on localhost (38/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 62.0 in stage 6.0 (TID 272, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 62.0 in stage 6.0 (TID 272)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 37.0 in stage 6.0 (TID 247) in 511 ms on localhost (39/200)
15/03/10 14:00:53 INFO Executor: Finished task 44.0 in stage 6.0 (TID 254). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 63.0 in stage 6.0 (TID 273, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 63.0 in stage 6.0 (TID 273)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 39.0 in stage 6.0 (TID 249) in 510 ms on localhost (40/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 47.0 in stage 6.0 (TID 257). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 64.0 in stage 6.0 (TID 274, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 46.0 in stage 6.0 (TID 256). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 40.0 in stage 6.0 (TID 250) in 510 ms on localhost (41/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 64.0 in stage 6.0 (TID 274)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 65.0 in stage 6.0 (TID 275, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 65.0 in stage 6.0 (TID 275)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 41.0 in stage 6.0 (TID 251) in 510 ms on localhost (42/200)
15/03/10 14:00:53 INFO BlockManager: Removing broadcast 9
15/03/10 14:00:53 INFO BlockManager: Removing block broadcast_9
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO MemoryStore: Block broadcast_9 of size 6216 dropped from memory (free 277413102)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO BlockManager: Removing block broadcast_9_piece0
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 66.0 in stage 6.0 (TID 276, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO MemoryStore: Block broadcast_9_piece0 of size 3525 dropped from memory (free 277416627)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 66.0 in stage 6.0 (TID 276)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 42.0 in stage 6.0 (TID 252) in 510 ms on localhost (43/200)
15/03/10 14:00:53 INFO Executor: Finished task 45.0 in stage 6.0 (TID 255). 1353 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO BlockManagerInfo: Removed broadcast_9_piece0 on localhost:51252 in memory (size: 3.4 KB, free: 265.3 MB)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 48.0 in stage 6.0 (TID 258). 853 bytes result sent to driver
15/03/10 14:00:53 INFO BlockManagerMaster: Updated info of block broadcast_9_piece0
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 67.0 in stage 6.0 (TID 277, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ContextCleaner: Cleaned broadcast 9
15/03/10 14:00:53 INFO Executor: Running task 67.0 in stage 6.0 (TID 277)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 43.0 in stage 6.0 (TID 253) in 511 ms on localhost (44/200)
15/03/10 14:00:53 INFO BlockManager: Removing broadcast 8
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO BlockManager: Removing block broadcast_8
15/03/10 14:00:53 INFO MemoryStore: Block broadcast_8 of size 6216 dropped from memory (free 277422843)
15/03/10 14:00:53 INFO BlockManager: Removing block broadcast_8_piece0
15/03/10 14:00:53 INFO MemoryStore: Block broadcast_8_piece0 of size 3528 dropped from memory (free 277426371)
15/03/10 14:00:53 INFO Executor: Finished task 50.0 in stage 6.0 (TID 260). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 68.0 in stage 6.0 (TID 278, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO BlockManagerInfo: Removed broadcast_8_piece0 on localhost:51252 in memory (size: 3.4 KB, free: 265.3 MB)
15/03/10 14:00:53 INFO Executor: Running task 68.0 in stage 6.0 (TID 278)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 44.0 in stage 6.0 (TID 254) in 511 ms on localhost (45/200)
15/03/10 14:00:53 INFO Executor: Finished task 49.0 in stage 6.0 (TID 259). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO BlockManagerMaster: Updated info of block broadcast_8_piece0
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ContextCleaner: Cleaned broadcast 8
15/03/10 14:00:53 INFO TaskSetManager: Starting task 69.0 in stage 6.0 (TID 279, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 69.0 in stage 6.0 (TID 279)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 47.0 in stage 6.0 (TID 257) in 507 ms on localhost (46/200)
15/03/10 14:00:53 INFO BlockManager: Removing broadcast 7
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO BlockManager: Removing block broadcast_7
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO MemoryStore: Block broadcast_7 of size 6608 dropped from memory (free 277432979)
15/03/10 14:00:53 INFO BlockManager: Removing block broadcast_7_piece0
15/03/10 14:00:53 INFO MemoryStore: Block broadcast_7_piece0 of size 3665 dropped from memory (free 277436644)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO BlockManagerInfo: Removed broadcast_7_piece0 on localhost:51252 in memory (size: 3.6 KB, free: 265.3 MB)
15/03/10 14:00:53 INFO BlockManagerMaster: Updated info of block broadcast_7_piece0
15/03/10 14:00:53 INFO ContextCleaner: Cleaned broadcast 7
15/03/10 14:00:53 INFO TaskSetManager: Starting task 70.0 in stage 6.0 (TID 280, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 70.0 in stage 6.0 (TID 280)
15/03/10 14:00:53 INFO Executor: Finished task 51.0 in stage 6.0 (TID 261). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 46.0 in stage 6.0 (TID 256) in 513 ms on localhost (47/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 71.0 in stage 6.0 (TID 281, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 71.0 in stage 6.0 (TID 281)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 45.0 in stage 6.0 (TID 255) in 517 ms on localhost (48/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 72.0 in stage 6.0 (TID 282, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 72.0 in stage 6.0 (TID 282)
15/03/10 14:00:53 INFO Executor: Finished task 55.0 in stage 6.0 (TID 265). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 48.0 in stage 6.0 (TID 258) in 513 ms on localhost (49/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 73.0 in stage 6.0 (TID 283, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 50.0 in stage 6.0 (TID 260) in 510 ms on localhost (50/200)
15/03/10 14:00:53 INFO Executor: Running task 73.0 in stage 6.0 (TID 283)
15/03/10 14:00:53 INFO Executor: Finished task 53.0 in stage 6.0 (TID 263). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 54.0 in stage 6.0 (TID 264). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 49.0 in stage 6.0 (TID 259) in 514 ms on localhost (51/200)
15/03/10 14:00:53 INFO Executor: Finished task 52.0 in stage 6.0 (TID 262). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 2 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 74.0 in stage 6.0 (TID 284, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 74.0 in stage 6.0 (TID 284)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 75.0 in stage 6.0 (TID 285, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 56.0 in stage 6.0 (TID 266). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 51.0 in stage 6.0 (TID 261) in 514 ms on localhost (52/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 75.0 in stage 6.0 (TID 285)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 76.0 in stage 6.0 (TID 286, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 76.0 in stage 6.0 (TID 286)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 55.0 in stage 6.0 (TID 265) in 508 ms on localhost (53/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 77.0 in stage 6.0 (TID 287, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 60.0 in stage 6.0 (TID 270). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 77.0 in stage 6.0 (TID 287)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 53.0 in stage 6.0 (TID 263) in 514 ms on localhost (54/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 78.0 in stage 6.0 (TID 288, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 78.0 in stage 6.0 (TID 288)
15/03/10 14:00:53 INFO Executor: Finished task 59.0 in stage 6.0 (TID 269). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 54.0 in stage 6.0 (TID 264) in 514 ms on localhost (55/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 57.0 in stage 6.0 (TID 267). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 79.0 in stage 6.0 (TID 289, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 58.0 in stage 6.0 (TID 268). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 79.0 in stage 6.0 (TID 289)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 62.0 in stage 6.0 (TID 272). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 52.0 in stage 6.0 (TID 262) in 521 ms on localhost (56/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 63.0 in stage 6.0 (TID 273). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 80.0 in stage 6.0 (TID 290, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 80.0 in stage 6.0 (TID 290)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 56.0 in stage 6.0 (TID 266) in 514 ms on localhost (57/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 81.0 in stage 6.0 (TID 291, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 81.0 in stage 6.0 (TID 291)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 60.0 in stage 6.0 (TID 270) in 508 ms on localhost (58/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 59.0 in stage 6.0 (TID 269) in 511 ms on localhost (59/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 61.0 in stage 6.0 (TID 271). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 82.0 in stage 6.0 (TID 292, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 82.0 in stage 6.0 (TID 292)
15/03/10 14:00:53 INFO Executor: Finished task 65.0 in stage 6.0 (TID 275). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 57.0 in stage 6.0 (TID 267) in 521 ms on localhost (60/200)
15/03/10 14:00:53 INFO Executor: Finished task 66.0 in stage 6.0 (TID 276). 1092 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 83.0 in stage 6.0 (TID 293, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 83.0 in stage 6.0 (TID 293)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 84.0 in stage 6.0 (TID 294, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 84.0 in stage 6.0 (TID 294)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 58.0 in stage 6.0 (TID 268) in 521 ms on localhost (61/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 85.0 in stage 6.0 (TID 295, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 85.0 in stage 6.0 (TID 295)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 62.0 in stage 6.0 (TID 272) in 59 ms on localhost (62/200)
15/03/10 14:00:53 INFO Executor: Finished task 68.0 in stage 6.0 (TID 278). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 67.0 in stage 6.0 (TID 277). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 86.0 in stage 6.0 (TID 296, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 63.0 in stage 6.0 (TID 273) in 58 ms on localhost (63/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 86.0 in stage 6.0 (TID 296)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 87.0 in stage 6.0 (TID 297, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 61.0 in stage 6.0 (TID 271) in 65 ms on localhost (64/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 87.0 in stage 6.0 (TID 297)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 69.0 in stage 6.0 (TID 279). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 88.0 in stage 6.0 (TID 298, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 88.0 in stage 6.0 (TID 298)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 65.0 in stage 6.0 (TID 275) in 60 ms on localhost (65/200)
15/03/10 14:00:53 INFO Executor: Finished task 70.0 in stage 6.0 (TID 280). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 89.0 in stage 6.0 (TID 299, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 71.0 in stage 6.0 (TID 281). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 89.0 in stage 6.0 (TID 299)
15/03/10 14:00:53 INFO Executor: Finished task 64.0 in stage 6.0 (TID 274). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 66.0 in stage 6.0 (TID 276) in 60 ms on localhost (66/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 90.0 in stage 6.0 (TID 300, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 90.0 in stage 6.0 (TID 300)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 68.0 in stage 6.0 (TID 278) in 57 ms on localhost (67/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 73.0 in stage 6.0 (TID 283). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 72.0 in stage 6.0 (TID 282). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 91.0 in stage 6.0 (TID 301, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 67.0 in stage 6.0 (TID 277) in 63 ms on localhost (68/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 91.0 in stage 6.0 (TID 301)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 92.0 in stage 6.0 (TID 302, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 92.0 in stage 6.0 (TID 302)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 69.0 in stage 6.0 (TID 279) in 60 ms on localhost (69/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 74.0 in stage 6.0 (TID 284). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 93.0 in stage 6.0 (TID 303, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 93.0 in stage 6.0 (TID 303)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 75.0 in stage 6.0 (TID 285). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 70.0 in stage 6.0 (TID 280) in 59 ms on localhost (70/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 76.0 in stage 6.0 (TID 286). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 94.0 in stage 6.0 (TID 304, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 71.0 in stage 6.0 (TID 281) in 59 ms on localhost (71/200)
15/03/10 14:00:53 INFO Executor: Running task 94.0 in stage 6.0 (TID 304)
15/03/10 14:00:53 INFO Executor: Finished task 77.0 in stage 6.0 (TID 287). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 95.0 in stage 6.0 (TID 305, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 95.0 in stage 6.0 (TID 305)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 64.0 in stage 6.0 (TID 274) in 79 ms on localhost (72/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 79.0 in stage 6.0 (TID 289). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 96.0 in stage 6.0 (TID 306, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 78.0 in stage 6.0 (TID 288). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 96.0 in stage 6.0 (TID 306)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 73.0 in stage 6.0 (TID 283) in 58 ms on localhost (73/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 97.0 in stage 6.0 (TID 307, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 80.0 in stage 6.0 (TID 290). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 97.0 in stage 6.0 (TID 307)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 72.0 in stage 6.0 (TID 282) in 62 ms on localhost (74/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 81.0 in stage 6.0 (TID 291). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 98.0 in stage 6.0 (TID 308, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 98.0 in stage 6.0 (TID 308)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 74.0 in stage 6.0 (TID 284) in 59 ms on localhost (75/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 99.0 in stage 6.0 (TID 309, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 75.0 in stage 6.0 (TID 285) in 58 ms on localhost (76/200)
15/03/10 14:00:53 INFO Executor: Running task 99.0 in stage 6.0 (TID 309)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 100.0 in stage 6.0 (TID 310, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 100.0 in stage 6.0 (TID 310)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 76.0 in stage 6.0 (TID 286) in 58 ms on localhost (77/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 101.0 in stage 6.0 (TID 311, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 82.0 in stage 6.0 (TID 292). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 77.0 in stage 6.0 (TID 287) in 59 ms on localhost (78/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 101.0 in stage 6.0 (TID 311)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 83.0 in stage 6.0 (TID 293). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 102.0 in stage 6.0 (TID 312, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 85.0 in stage 6.0 (TID 295). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 102.0 in stage 6.0 (TID 312)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 84.0 in stage 6.0 (TID 294). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 79.0 in stage 6.0 (TID 289) in 59 ms on localhost (79/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 87.0 in stage 6.0 (TID 297). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 86.0 in stage 6.0 (TID 296). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 103.0 in stage 6.0 (TID 313, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 103.0 in stage 6.0 (TID 313)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 78.0 in stage 6.0 (TID 288) in 64 ms on localhost (80/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 104.0 in stage 6.0 (TID 314, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 104.0 in stage 6.0 (TID 314)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 80.0 in stage 6.0 (TID 290) in 61 ms on localhost (81/200)
15/03/10 14:00:53 INFO Executor: Finished task 89.0 in stage 6.0 (TID 299). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 105.0 in stage 6.0 (TID 315, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 105.0 in stage 6.0 (TID 315)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 81.0 in stage 6.0 (TID 291) in 61 ms on localhost (82/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 106.0 in stage 6.0 (TID 316, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 106.0 in stage 6.0 (TID 316)
15/03/10 14:00:53 INFO Executor: Finished task 91.0 in stage 6.0 (TID 301). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 90.0 in stage 6.0 (TID 300). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 88.0 in stage 6.0 (TID 298). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 82.0 in stage 6.0 (TID 292) in 57 ms on localhost (83/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 6 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 107.0 in stage 6.0 (TID 317, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 107.0 in stage 6.0 (TID 317)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 83.0 in stage 6.0 (TID 293) in 58 ms on localhost (84/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 108.0 in stage 6.0 (TID 318, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 85.0 in stage 6.0 (TID 295) in 57 ms on localhost (85/200)
15/03/10 14:00:53 INFO Executor: Finished task 92.0 in stage 6.0 (TID 302). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 108.0 in stage 6.0 (TID 318)
15/03/10 14:00:53 INFO Executor: Finished task 94.0 in stage 6.0 (TID 304). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 109.0 in stage 6.0 (TID 319, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 109.0 in stage 6.0 (TID 319)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 84.0 in stage 6.0 (TID 294) in 60 ms on localhost (86/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 110.0 in stage 6.0 (TID 320, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 93.0 in stage 6.0 (TID 303). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 87.0 in stage 6.0 (TID 297) in 56 ms on localhost (87/200)
15/03/10 14:00:53 INFO Executor: Running task 110.0 in stage 6.0 (TID 320)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 111.0 in stage 6.0 (TID 321, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 111.0 in stage 6.0 (TID 321)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 86.0 in stage 6.0 (TID 296) in 60 ms on localhost (88/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 112.0 in stage 6.0 (TID 322, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 112.0 in stage 6.0 (TID 322)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 89.0 in stage 6.0 (TID 299) in 53 ms on localhost (89/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 113.0 in stage 6.0 (TID 323, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 95.0 in stage 6.0 (TID 305). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 113.0 in stage 6.0 (TID 323)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 91.0 in stage 6.0 (TID 301) in 51 ms on localhost (90/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 96.0 in stage 6.0 (TID 306). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 114.0 in stage 6.0 (TID 324, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 98.0 in stage 6.0 (TID 308). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 90.0 in stage 6.0 (TID 300) in 57 ms on localhost (91/200)
15/03/10 14:00:53 INFO Executor: Running task 114.0 in stage 6.0 (TID 324)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 115.0 in stage 6.0 (TID 325, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 115.0 in stage 6.0 (TID 325)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 88.0 in stage 6.0 (TID 298) in 63 ms on localhost (92/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 92.0 in stage 6.0 (TID 302) in 55 ms on localhost (93/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 116.0 in stage 6.0 (TID 326, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 116.0 in stage 6.0 (TID 326)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 94.0 in stage 6.0 (TID 304) in 52 ms on localhost (94/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 117.0 in stage 6.0 (TID 327, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 117.0 in stage 6.0 (TID 327)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 97.0 in stage 6.0 (TID 307). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 118.0 in stage 6.0 (TID 328, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 99.0 in stage 6.0 (TID 309). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 93.0 in stage 6.0 (TID 303) in 59 ms on localhost (95/200)
15/03/10 14:00:53 INFO Executor: Running task 118.0 in stage 6.0 (TID 328)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 101.0 in stage 6.0 (TID 311). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 100.0 in stage 6.0 (TID 310). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 119.0 in stage 6.0 (TID 329, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 103.0 in stage 6.0 (TID 313). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 119.0 in stage 6.0 (TID 329)
15/03/10 14:00:53 INFO Executor: Finished task 102.0 in stage 6.0 (TID 312). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 95.0 in stage 6.0 (TID 305) in 56 ms on localhost (96/200)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 96.0 in stage 6.0 (TID 306) in 55 ms on localhost (97/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 120.0 in stage 6.0 (TID 330, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 120.0 in stage 6.0 (TID 330)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 121.0 in stage 6.0 (TID 331, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 121.0 in stage 6.0 (TID 331)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 98.0 in stage 6.0 (TID 308) in 54 ms on localhost (98/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 122.0 in stage 6.0 (TID 332, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 122.0 in stage 6.0 (TID 332)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 97.0 in stage 6.0 (TID 307) in 58 ms on localhost (99/200)
15/03/10 14:00:53 INFO Executor: Finished task 104.0 in stage 6.0 (TID 314). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 105.0 in stage 6.0 (TID 315). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 106.0 in stage 6.0 (TID 316). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 123.0 in stage 6.0 (TID 333, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 123.0 in stage 6.0 (TID 333)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 107.0 in stage 6.0 (TID 317). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 99.0 in stage 6.0 (TID 309) in 61 ms on localhost (100/200)
15/03/10 14:00:53 INFO Executor: Finished task 110.0 in stage 6.0 (TID 320). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 124.0 in stage 6.0 (TID 334, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 124.0 in stage 6.0 (TID 334)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 101.0 in stage 6.0 (TID 311) in 58 ms on localhost (101/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 112.0 in stage 6.0 (TID 322). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 109.0 in stage 6.0 (TID 319). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 108.0 in stage 6.0 (TID 318). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 111.0 in stage 6.0 (TID 321). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 125.0 in stage 6.0 (TID 335, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 125.0 in stage 6.0 (TID 335)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 100.0 in stage 6.0 (TID 310) in 66 ms on localhost (102/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 126.0 in stage 6.0 (TID 336, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 113.0 in stage 6.0 (TID 323). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 126.0 in stage 6.0 (TID 336)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 103.0 in stage 6.0 (TID 313) in 56 ms on localhost (103/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 127.0 in stage 6.0 (TID 337, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 127.0 in stage 6.0 (TID 337)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 102.0 in stage 6.0 (TID 312) in 65 ms on localhost (104/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 114.0 in stage 6.0 (TID 324). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 128.0 in stage 6.0 (TID 338, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 128.0 in stage 6.0 (TID 338)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 104.0 in stage 6.0 (TID 314) in 60 ms on localhost (105/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 129.0 in stage 6.0 (TID 339, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 129.0 in stage 6.0 (TID 339)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 105.0 in stage 6.0 (TID 315) in 59 ms on localhost (106/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 130.0 in stage 6.0 (TID 340, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 130.0 in stage 6.0 (TID 340)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 106.0 in stage 6.0 (TID 316) in 59 ms on localhost (107/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 116.0 in stage 6.0 (TID 326). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 107.0 in stage 6.0 (TID 317) in 58 ms on localhost (108/200)
15/03/10 14:00:53 INFO Executor: Finished task 115.0 in stage 6.0 (TID 325). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 131.0 in stage 6.0 (TID 341, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 131.0 in stage 6.0 (TID 341)
15/03/10 14:00:53 INFO Executor: Finished task 117.0 in stage 6.0 (TID 327). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 132.0 in stage 6.0 (TID 342, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 132.0 in stage 6.0 (TID 342)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 110.0 in stage 6.0 (TID 320) in 56 ms on localhost (109/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 118.0 in stage 6.0 (TID 328). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 120.0 in stage 6.0 (TID 330). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 133.0 in stage 6.0 (TID 343, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 133.0 in stage 6.0 (TID 343)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 112.0 in stage 6.0 (TID 322) in 54 ms on localhost (110/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 119.0 in stage 6.0 (TID 329). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 134.0 in stage 6.0 (TID 344, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 134.0 in stage 6.0 (TID 344)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 109.0 in stage 6.0 (TID 319) in 61 ms on localhost (111/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 135.0 in stage 6.0 (TID 345, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 135.0 in stage 6.0 (TID 345)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 108.0 in stage 6.0 (TID 318) in 64 ms on localhost (112/200)
15/03/10 14:00:53 INFO Executor: Finished task 124.0 in stage 6.0 (TID 334). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 136.0 in stage 6.0 (TID 346, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 136.0 in stage 6.0 (TID 346)
15/03/10 14:00:53 INFO Executor: Finished task 121.0 in stage 6.0 (TID 331). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 111.0 in stage 6.0 (TID 321) in 61 ms on localhost (113/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 122.0 in stage 6.0 (TID 332). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 137.0 in stage 6.0 (TID 347, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 137.0 in stage 6.0 (TID 347)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 113.0 in stage 6.0 (TID 323) in 59 ms on localhost (114/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 123.0 in stage 6.0 (TID 333). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 138.0 in stage 6.0 (TID 348, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 138.0 in stage 6.0 (TID 348)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 114.0 in stage 6.0 (TID 324) in 58 ms on localhost (115/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 139.0 in stage 6.0 (TID 349, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 139.0 in stage 6.0 (TID 349)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 116.0 in stage 6.0 (TID 326) in 55 ms on localhost (116/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 140.0 in stage 6.0 (TID 350, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 140.0 in stage 6.0 (TID 350)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 115.0 in stage 6.0 (TID 325) in 62 ms on localhost (117/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 141.0 in stage 6.0 (TID 351, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 141.0 in stage 6.0 (TID 351)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 117.0 in stage 6.0 (TID 327) in 57 ms on localhost (118/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 142.0 in stage 6.0 (TID 352, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 142.0 in stage 6.0 (TID 352)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 118.0 in stage 6.0 (TID 328) in 57 ms on localhost (119/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 143.0 in stage 6.0 (TID 353, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 125.0 in stage 6.0 (TID 335). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 143.0 in stage 6.0 (TID 353)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 120.0 in stage 6.0 (TID 330) in 53 ms on localhost (120/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 144.0 in stage 6.0 (TID 354, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 144.0 in stage 6.0 (TID 354)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 127.0 in stage 6.0 (TID 337). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 126.0 in stage 6.0 (TID 336). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 145.0 in stage 6.0 (TID 355, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 145.0 in stage 6.0 (TID 355)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 146.0 in stage 6.0 (TID 356, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 121.0 in stage 6.0 (TID 331) in 58 ms on localhost (121/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 146.0 in stage 6.0 (TID 356)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 124.0 in stage 6.0 (TID 334) in 48 ms on localhost (122/200)
15/03/10 14:00:53 INFO Executor: Finished task 128.0 in stage 6.0 (TID 338). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 119.0 in stage 6.0 (TID 329) in 63 ms on localhost (123/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 130.0 in stage 6.0 (TID 340). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 129.0 in stage 6.0 (TID 339). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 122.0 in stage 6.0 (TID 332) in 62 ms on localhost (124/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 147.0 in stage 6.0 (TID 357, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 147.0 in stage 6.0 (TID 357)
15/03/10 14:00:53 INFO Executor: Finished task 131.0 in stage 6.0 (TID 341). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 136.0 in stage 6.0 (TID 346). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 132.0 in stage 6.0 (TID 342). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 148.0 in stage 6.0 (TID 358, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 148.0 in stage 6.0 (TID 358)
15/03/10 14:00:53 INFO Executor: Finished task 133.0 in stage 6.0 (TID 343). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 123.0 in stage 6.0 (TID 333) in 64 ms on localhost (125/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 149.0 in stage 6.0 (TID 359, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 149.0 in stage 6.0 (TID 359)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 125.0 in stage 6.0 (TID 335) in 56 ms on localhost (126/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 135.0 in stage 6.0 (TID 345). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 150.0 in stage 6.0 (TID 360, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 134.0 in stage 6.0 (TID 344). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 150.0 in stage 6.0 (TID 360)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 127.0 in stage 6.0 (TID 337) in 53 ms on localhost (127/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 151.0 in stage 6.0 (TID 361, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 151.0 in stage 6.0 (TID 361)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 126.0 in stage 6.0 (TID 336) in 58 ms on localhost (128/200)
15/03/10 14:00:53 INFO Executor: Finished task 137.0 in stage 6.0 (TID 347). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 152.0 in stage 6.0 (TID 362, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 152.0 in stage 6.0 (TID 362)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 128.0 in stage 6.0 (TID 338) in 56 ms on localhost (129/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 153.0 in stage 6.0 (TID 363, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 153.0 in stage 6.0 (TID 363)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 130.0 in stage 6.0 (TID 340) in 54 ms on localhost (130/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 154.0 in stage 6.0 (TID 364, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 154.0 in stage 6.0 (TID 364)
15/03/10 14:00:53 INFO Executor: Finished task 143.0 in stage 6.0 (TID 353). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 129.0 in stage 6.0 (TID 339) in 58 ms on localhost (131/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 139.0 in stage 6.0 (TID 349). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 155.0 in stage 6.0 (TID 365, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 155.0 in stage 6.0 (TID 365)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 131.0 in stage 6.0 (TID 341) in 55 ms on localhost (132/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 156.0 in stage 6.0 (TID 366, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 156.0 in stage 6.0 (TID 366)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 136.0 in stage 6.0 (TID 346) in 48 ms on localhost (133/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 157.0 in stage 6.0 (TID 367, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 157.0 in stage 6.0 (TID 367)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 132.0 in stage 6.0 (TID 342) in 57 ms on localhost (134/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 146.0 in stage 6.0 (TID 356). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 140.0 in stage 6.0 (TID 350). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 158.0 in stage 6.0 (TID 368, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 158.0 in stage 6.0 (TID 368)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 141.0 in stage 6.0 (TID 351). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 133.0 in stage 6.0 (TID 343) in 58 ms on localhost (135/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 138.0 in stage 6.0 (TID 348). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 159.0 in stage 6.0 (TID 369, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 142.0 in stage 6.0 (TID 352). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 135.0 in stage 6.0 (TID 345) in 57 ms on localhost (136/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 159.0 in stage 6.0 (TID 369)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 144.0 in stage 6.0 (TID 354). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 134.0 in stage 6.0 (TID 344) in 60 ms on localhost (137/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 160.0 in stage 6.0 (TID 370, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 160.0 in stage 6.0 (TID 370)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 161.0 in stage 6.0 (TID 371, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 145.0 in stage 6.0 (TID 355). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 161.0 in stage 6.0 (TID 371)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 137.0 in stage 6.0 (TID 347) in 58 ms on localhost (138/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 149.0 in stage 6.0 (TID 359). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 162.0 in stage 6.0 (TID 372, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 162.0 in stage 6.0 (TID 372)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 143.0 in stage 6.0 (TID 353) in 57 ms on localhost (139/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 163.0 in stage 6.0 (TID 373, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 163.0 in stage 6.0 (TID 373)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 139.0 in stage 6.0 (TID 349) in 67 ms on localhost (140/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 164.0 in stage 6.0 (TID 374, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 164.0 in stage 6.0 (TID 374)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 146.0 in stage 6.0 (TID 356) in 57 ms on localhost (141/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 165.0 in stage 6.0 (TID 375, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 165.0 in stage 6.0 (TID 375)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 140.0 in stage 6.0 (TID 350) in 68 ms on localhost (142/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 166.0 in stage 6.0 (TID 376, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 141.0 in stage 6.0 (TID 351) in 68 ms on localhost (143/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 138.0 in stage 6.0 (TID 348) in 77 ms on localhost (144/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 147.0 in stage 6.0 (TID 357). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 148.0 in stage 6.0 (TID 358). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 166.0 in stage 6.0 (TID 376)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 167.0 in stage 6.0 (TID 377, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 167.0 in stage 6.0 (TID 377)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 168.0 in stage 6.0 (TID 378, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 168.0 in stage 6.0 (TID 378)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 142.0 in stage 6.0 (TID 352) in 71 ms on localhost (145/200)
15/03/10 14:00:53 INFO Executor: Finished task 151.0 in stage 6.0 (TID 361). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 169.0 in stage 6.0 (TID 379, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 169.0 in stage 6.0 (TID 379)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 152.0 in stage 6.0 (TID 362). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 144.0 in stage 6.0 (TID 354) in 71 ms on localhost (146/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 170.0 in stage 6.0 (TID 380, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 145.0 in stage 6.0 (TID 355) in 71 ms on localhost (147/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 154.0 in stage 6.0 (TID 364). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 170.0 in stage 6.0 (TID 380)
15/03/10 14:00:53 INFO Executor: Finished task 150.0 in stage 6.0 (TID 360). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 149.0 in stage 6.0 (TID 359) in 58 ms on localhost (148/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 157.0 in stage 6.0 (TID 367). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 171.0 in stage 6.0 (TID 381, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 171.0 in stage 6.0 (TID 381)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 156.0 in stage 6.0 (TID 366). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 155.0 in stage 6.0 (TID 365). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 153.0 in stage 6.0 (TID 363). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 172.0 in stage 6.0 (TID 382, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 147.0 in stage 6.0 (TID 357) in 67 ms on localhost (149/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 172.0 in stage 6.0 (TID 382)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 173.0 in stage 6.0 (TID 383, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 173.0 in stage 6.0 (TID 383)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 148.0 in stage 6.0 (TID 358) in 67 ms on localhost (150/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 174.0 in stage 6.0 (TID 384, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 158.0 in stage 6.0 (TID 368). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 174.0 in stage 6.0 (TID 384)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 151.0 in stage 6.0 (TID 361) in 64 ms on localhost (151/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 159.0 in stage 6.0 (TID 369). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 175.0 in stage 6.0 (TID 385, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 175.0 in stage 6.0 (TID 385)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 152.0 in stage 6.0 (TID 362) in 62 ms on localhost (152/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 160.0 in stage 6.0 (TID 370). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 176.0 in stage 6.0 (TID 386, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 176.0 in stage 6.0 (TID 386)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 154.0 in stage 6.0 (TID 364) in 61 ms on localhost (153/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 177.0 in stage 6.0 (TID 387, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 161.0 in stage 6.0 (TID 371). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 177.0 in stage 6.0 (TID 387)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 150.0 in stage 6.0 (TID 360) in 71 ms on localhost (154/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 178.0 in stage 6.0 (TID 388, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 178.0 in stage 6.0 (TID 388)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 157.0 in stage 6.0 (TID 367) in 59 ms on localhost (155/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 179.0 in stage 6.0 (TID 389, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 179.0 in stage 6.0 (TID 389)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 156.0 in stage 6.0 (TID 366) in 64 ms on localhost (156/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 180.0 in stage 6.0 (TID 390, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 162.0 in stage 6.0 (TID 372). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 180.0 in stage 6.0 (TID 390)
15/03/10 14:00:53 INFO Executor: Finished task 164.0 in stage 6.0 (TID 374). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 155.0 in stage 6.0 (TID 365) in 67 ms on localhost (157/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 165.0 in stage 6.0 (TID 375). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 181.0 in stage 6.0 (TID 391, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 181.0 in stage 6.0 (TID 391)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 163.0 in stage 6.0 (TID 373). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 153.0 in stage 6.0 (TID 363) in 74 ms on localhost (158/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 182.0 in stage 6.0 (TID 392, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 182.0 in stage 6.0 (TID 392)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 158.0 in stage 6.0 (TID 368) in 66 ms on localhost (159/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 159.0 in stage 6.0 (TID 369) in 64 ms on localhost (160/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 166.0 in stage 6.0 (TID 376). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 183.0 in stage 6.0 (TID 393, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 167.0 in stage 6.0 (TID 377). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 183.0 in stage 6.0 (TID 393)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 184.0 in stage 6.0 (TID 394, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 184.0 in stage 6.0 (TID 394)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 160.0 in stage 6.0 (TID 370) in 65 ms on localhost (161/200)
15/03/10 14:00:53 INFO Executor: Finished task 170.0 in stage 6.0 (TID 380). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 171.0 in stage 6.0 (TID 381). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 185.0 in stage 6.0 (TID 395, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 185.0 in stage 6.0 (TID 395)
15/03/10 14:00:53 INFO Executor: Finished task 168.0 in stage 6.0 (TID 378). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 161.0 in stage 6.0 (TID 371) in 66 ms on localhost (162/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 186.0 in stage 6.0 (TID 396, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 186.0 in stage 6.0 (TID 396)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 162.0 in stage 6.0 (TID 372) in 65 ms on localhost (163/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 173.0 in stage 6.0 (TID 383). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 187.0 in stage 6.0 (TID 397, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Running task 187.0 in stage 6.0 (TID 397)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 164.0 in stage 6.0 (TID 374) in 54 ms on localhost (164/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 169.0 in stage 6.0 (TID 379). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 188.0 in stage 6.0 (TID 398, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 165.0 in stage 6.0 (TID 375) in 54 ms on localhost (165/200)
15/03/10 14:00:53 INFO Executor: Running task 188.0 in stage 6.0 (TID 398)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 189.0 in stage 6.0 (TID 399, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 189.0 in stage 6.0 (TID 399)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 163.0 in stage 6.0 (TID 373) in 60 ms on localhost (166/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 166.0 in stage 6.0 (TID 376) in 57 ms on localhost (167/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 172.0 in stage 6.0 (TID 382). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 190.0 in stage 6.0 (TID 400, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 177.0 in stage 6.0 (TID 387). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 174.0 in stage 6.0 (TID 384). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 190.0 in stage 6.0 (TID 400)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 191.0 in stage 6.0 (TID 401, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 167.0 in stage 6.0 (TID 377) in 58 ms on localhost (168/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 191.0 in stage 6.0 (TID 401)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 192.0 in stage 6.0 (TID 402, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 192.0 in stage 6.0 (TID 402)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 170.0 in stage 6.0 (TID 380) in 54 ms on localhost (169/200)
15/03/10 14:00:53 INFO Executor: Finished task 180.0 in stage 6.0 (TID 390). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 176.0 in stage 6.0 (TID 386). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Finished task 175.0 in stage 6.0 (TID 385). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Starting task 193.0 in stage 6.0 (TID 403, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO Executor: Running task 193.0 in stage 6.0 (TID 403)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 171.0 in stage 6.0 (TID 381) in 53 ms on localhost (170/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 194.0 in stage 6.0 (TID 404, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Finished task 178.0 in stage 6.0 (TID 388). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Running task 194.0 in stage 6.0 (TID 404)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 168.0 in stage 6.0 (TID 378) in 63 ms on localhost (171/200)
15/03/10 14:00:53 INFO TaskSetManager: Starting task 195.0 in stage 6.0 (TID 405, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 173.0 in stage 6.0 (TID 383) in 53 ms on localhost (172/200)
15/03/10 14:00:53 INFO Executor: Running task 195.0 in stage 6.0 (TID 405)
15/03/10 14:00:53 INFO Executor: Finished task 183.0 in stage 6.0 (TID 393). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO Executor: Finished task 179.0 in stage 6.0 (TID 389). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 181.0 in stage 6.0 (TID 391). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 196.0 in stage 6.0 (TID 406, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 196.0 in stage 6.0 (TID 406)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 169.0 in stage 6.0 (TID 379) in 66 ms on localhost (173/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 197.0 in stage 6.0 (TID 407, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 197.0 in stage 6.0 (TID 407)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 172.0 in stage 6.0 (TID 382) in 59 ms on localhost (174/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Starting task 198.0 in stage 6.0 (TID 408, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO Executor: Running task 198.0 in stage 6.0 (TID 408)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 177.0 in stage 6.0 (TID 387) in 49 ms on localhost (175/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Starting task 199.0 in stage 6.0 (TID 409, localhost, PROCESS_LOCAL, 1514 bytes)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Running task 199.0 in stage 6.0 (TID 409)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 174.0 in stage 6.0 (TID 384) in 58 ms on localhost (176/200)
15/03/10 14:00:53 INFO Executor: Finished task 182.0 in stage 6.0 (TID 392). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 187.0 in stage 6.0 (TID 397). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 180.0 in stage 6.0 (TID 390) in 48 ms on localhost (177/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 184.0 in stage 6.0 (TID 394). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 176.0 in stage 6.0 (TID 386) in 57 ms on localhost (178/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 175.0 in stage 6.0 (TID 385) in 59 ms on localhost (179/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 185.0 in stage 6.0 (TID 395). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 178.0 in stage 6.0 (TID 388) in 55 ms on localhost (180/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO TaskSetManager: Finished task 183.0 in stage 6.0 (TID 393) in 44 ms on localhost (181/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO Executor: Finished task 186.0 in stage 6.0 (TID 396). 853 bytes result sent to driver
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 179.0 in stage 6.0 (TID 389) in 55 ms on localhost (182/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 181.0 in stage 6.0 (TID 391) in 51 ms on localhost (183/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 182.0 in stage 6.0 (TID 392) in 50 ms on localhost (184/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 1 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 187.0 in stage 6.0 (TID 397) in 40 ms on localhost (185/200)
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Getting 2 non-empty blocks out of 2 blocks
15/03/10 14:00:53 INFO ShuffleBlockFetcherIterator: Started 0 remote fetches in 0 ms
15/03/10 14:00:53 INFO TaskSetManager: Finished task 184.0 in stage 6.0 (TID 394) in 47 ms on localhost (186/200)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 185.0 in stage 6.0 (TID 395) in 45 ms on localhost (187/200)
15/03/10 14:00:53 INFO Executor: Finished task 188.0 in stage 6.0 (TID 398). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 186.0 in stage 6.0 (TID 396) in 44 ms on localhost (188/200)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 188.0 in stage 6.0 (TID 398) in 40 ms on localhost (189/200)
15/03/10 14:00:53 INFO Executor: Finished task 189.0 in stage 6.0 (TID 399). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 189.0 in stage 6.0 (TID 399) in 39 ms on localhost (190/200)
15/03/10 14:00:53 INFO Executor: Finished task 190.0 in stage 6.0 (TID 400). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 191.0 in stage 6.0 (TID 401). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 190.0 in stage 6.0 (TID 400) in 40 ms on localhost (191/200)
15/03/10 14:00:53 INFO Executor: Finished task 192.0 in stage 6.0 (TID 402). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 191.0 in stage 6.0 (TID 401) in 40 ms on localhost (192/200)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 192.0 in stage 6.0 (TID 402) in 38 ms on localhost (193/200)
15/03/10 14:00:53 INFO Executor: Finished task 196.0 in stage 6.0 (TID 406). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 196.0 in stage 6.0 (TID 406) in 29 ms on localhost (194/200)
15/03/10 14:00:53 INFO Executor: Finished task 193.0 in stage 6.0 (TID 403). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 193.0 in stage 6.0 (TID 403) in 38 ms on localhost (195/200)
15/03/10 14:00:53 INFO Executor: Finished task 198.0 in stage 6.0 (TID 408). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 194.0 in stage 6.0 (TID 404). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 198.0 in stage 6.0 (TID 408) in 30 ms on localhost (196/200)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 194.0 in stage 6.0 (TID 404) in 39 ms on localhost (197/200)
15/03/10 14:00:53 INFO Executor: Finished task 199.0 in stage 6.0 (TID 409). 853 bytes result sent to driver
15/03/10 14:00:53 INFO Executor: Finished task 195.0 in stage 6.0 (TID 405). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 199.0 in stage 6.0 (TID 409) in 30 ms on localhost (198/200)
15/03/10 14:00:53 INFO TaskSetManager: Finished task 195.0 in stage 6.0 (TID 405) in 39 ms on localhost (199/200)
15/03/10 14:00:53 INFO Executor: Finished task 197.0 in stage 6.0 (TID 407). 853 bytes result sent to driver
15/03/10 14:00:53 INFO TaskSetManager: Finished task 197.0 in stage 6.0 (TID 407) in 36 ms on localhost (200/200)
15/03/10 14:00:53 INFO TaskSchedulerImpl: Removed TaskSet 6.0, whose tasks have all completed, from pool
15/03/10 14:00:53 INFO DAGScheduler: Stage 6 (collect at SparkPlan.scala:84) finished in 0.959 s
15/03/10 14:00:53 INFO DAGScheduler: Job 1 finished: collect at SparkPlan.scala:84, took 2.663473 s
[andy,30,30,30]
[mechel,29,30,30]
[mechel,29,30,29]
[mechel,29,29,30]
[mechel,29,29,29]
[mechel,30,30,30]
[mechel,30,30,29]
[mechel,30,29,30]
[mechel,30,29,29]
[jusdin,19,19,19]

scala>

scala>

scala>

scala>

scala> sqlContext.sql("select a.name,a.age,b.age,c.age from rddTable a,parquetTable b, parquetTable c where a.name=b.name and
 a.name=c.name").collect().foreach(println)
............省去。。。。
15/03/10 14:02:56 INFO DAGScheduler: Stage 10 (collect at SparkPlan.scala:84) finished in 0.322 s
15/03/10 14:02:56 INFO TaskSchedulerImpl: Removed TaskSet 10.0, whose tasks have all completed, from pool
15/03/10 14:02:56 INFO DAGScheduler: Job 2 finished: collect at SparkPlan.scala:84, took 0.930760 s
[andy,30,30,30]
[mechel,29,30,30]
[mechel,29,30,29]
[mechel,29,29,30]
[mechel,29,29,29]
[mechel,30,30,30]
[mechel,30,30,29]
[mechel,30,29,30]
[mechel,30,29,29]
[jusdin,19,19,19]


来自 “ ITPUB博客 ” ,链接:http://blog.itpub.net/10037372/viewspace-1454812/,如需转载,请注明出处,否则将追究法律责任。

上一篇: sparksql应用样例
请登录后发表评论 登录
全部评论

注册时间:2009-05-13

  • 博文量
    94
  • 访问量
    351418