RDD Storage Info for SortAggregate(key=[demandChannel#15989, shardId#445, qty#16009, worklistShardItemId#446L, demandStream#15990], functions=[first(kpis#16018, false)], output=[shardId#445, worklistShardItemId#446L, qty#16009, demandChannel#15989, demandStream#15990, kpis#16151]) +- *(8) Sort [demandChannel#15989 ASC NULLS FIRST, shardId#445 ASC NULLS FIRST, qty#16009 ASC NULLS FIRST, worklistShardItemId#446L ASC NULLS FIRST, demandStream#15990 ASC NULLS FIRST], false, 0 +- Exchange hashpartitioning(demandChannel#15989, shardId#445, qty#16009, worklistShardItemId#446L, demandStream#15990, 37), ENSURE_REQUIREMENTS, [plan_id=115377] +- SortAggregate(key=[demandChannel#15989, shardId#445, knownfloatingpointnormalized(normalizenanandzero(qty#16009)) AS qty#16009, worklistShardItemId#446L, demandStream#15990], functions=[partial_first(kpis#16018, false)], output=[demandChannel#15989, shardId#445, qty#16009, worklistShardItemId#446L, demandStream#15990, first#16227, valueSet#16228]) +- *(7) Sort [demandChannel#159...

  • Storage Level: Disk Memory Serialized 2x Replicated
  • Cached Partitions: 37
  • Total Partitions: 37
  • Memory Size: 1152.3 KiB
  • Disk Size: 0.0 B

Data Distribution on 3 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
10.96.20.131:7079 296.0 KiB (5.8 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.0.111:7079 529.6 KiB (5.8 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.7.66:7079 326.7 KiB (5.8 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B

37 Partitions

Page:
Block Name Storage Level Size in Memory Size on Disk Executors ▴
rdd_1078_1 Memory Serialized 2x Replicated 30.9 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_3 Memory Serialized 2x Replicated 31.2 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_4 Memory Serialized 2x Replicated 31.9 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_6 Memory Serialized 2x Replicated 29.9 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_10 Memory Serialized 2x Replicated 31.3 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_12 Memory Serialized 2x Replicated 30.0 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_2 Memory Serialized 2x Replicated 31.4 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_16 Memory Serialized 2x Replicated 31.3 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_20 Memory Serialized 2x Replicated 32.4 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_21 Memory Serialized 2x Replicated 31.0 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_22 Memory Serialized 2x Replicated 31.0 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_23 Memory Serialized 2x Replicated 30.8 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_24 Memory Serialized 2x Replicated 33.6 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_33 Memory Serialized 2x Replicated 30.8 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_34 Memory Serialized 2x Replicated 31.0 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_35 Memory Serialized 2x Replicated 30.5 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1078_0 Memory Serialized 2x Replicated 31.6 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_5 Memory Serialized 2x Replicated 31.1 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_8 Memory Serialized 2x Replicated 32.9 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_7 Memory Serialized 2x Replicated 31.0 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_9 Memory Serialized 2x Replicated 30.7 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_11 Memory Serialized 2x Replicated 31.6 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_13 Memory Serialized 2x Replicated 29.8 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_14 Memory Serialized 2x Replicated 31.3 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_15 Memory Serialized 2x Replicated 32.4 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_17 Memory Serialized 2x Replicated 31.0 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_18 Memory Serialized 2x Replicated 31.4 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_19 Memory Serialized 2x Replicated 32.6 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_25 Memory Serialized 2x Replicated 30.7 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_27 Memory Serialized 2x Replicated 29.7 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_28 Memory Serialized 2x Replicated 29.8 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_30 Memory Serialized 2x Replicated 30.9 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_31 Memory Serialized 2x Replicated 30.9 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_36 Memory Serialized 2x Replicated 30.8 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1078_26 Memory Serialized 2x Replicated 32.9 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1078_29 Memory Serialized 2x Replicated 30.6 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1078_32 Memory Serialized 2x Replicated 29.6 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
Page: