RDD Storage Info for *(6) Project [shardId#445, worklistShardItemId#446L, version#22420, qty#452, demandChannel#19011, demandStream#19012, kpis#19046] +- *(6) SortMergeJoin [shardId#445, worklistShardItemId#446L], [shardId#22517, worklistShardItemId#22518L], Inner :- *(3) Sort [shardId#445 ASC NULLS FIRST, worklistShardItemId#446L ASC NULLS FIRST], false, 0 : +- Exchange hashpartitioning(shardId#445, worklistShardItemId#446L, 37), ENSURE_REQUIREMENTS, [plan_id=117132] : +- Union : :- *(1) Project [shardId#445, worklistShardItemId#446L, qty#452, demandChannel#19011, demandStream#19012, kpis#19046] : : +- *(1) Filter ((NOT isNewlyCalculated#19014 AND isnotnull(shardId#445)) AND isnotnull(worklistShardItemId#446L)) : : +- InMemoryTableScan [demandChannel#19011, demandStream#19012, isNewlyCalculated#19014, kpis#19046, qty#452, shardId#445, worklistShardItemId#446L], [NOT isNewlyCalculated#19014, isnotnull(shardId#445), isnotnull(worklistShardItemId#446L)] : : +- ...

  • Storage Level: Disk Memory Serialized 2x Replicated
  • Cached Partitions: 37
  • Total Partitions: 37
  • Memory Size: 1867.3 KiB
  • Disk Size: 0.0 B

Data Distribution on 3 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
10.96.20.131:7079 758.0 KiB (5.8 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.0.111:7079 578.2 KiB (5.8 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.7.66:7079 531.2 KiB (5.8 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B

37 Partitions

Page:
Block Name Storage Level Size in Memory Size on Disk ▴ Executors
rdd_1412_33 Memory Serialized 2x Replicated 50.3 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1412_22 Memory Serialized 2x Replicated 48.4 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1412_17 Memory Serialized 2x Replicated 50.2 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1412_3 Memory Serialized 2x Replicated 50.0 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1412_5 Memory Serialized 2x Replicated 49.4 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1412_2 Memory Serialized 2x Replicated 52.7 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1412_7 Memory Serialized 2x Replicated 53.1 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1412_9 Memory Serialized 2x Replicated 48.7 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1412_0 Memory Serialized 2x Replicated 50.7 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1412_14 Memory Serialized 2x Replicated 49.8 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_13 Memory Serialized 2x Replicated 48.0 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_15 Memory Serialized 2x Replicated 52.7 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_11 Memory Serialized 2x Replicated 53.0 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_12 Memory Serialized 2x Replicated 50.2 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1412_10 Memory Serialized 2x Replicated 52.6 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1412_8 Memory Serialized 2x Replicated 53.1 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_4 Memory Serialized 2x Replicated 50.7 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1412_6 Memory Serialized 2x Replicated 47.8 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_1 Memory Serialized 2x Replicated 48.4 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1412_16 Memory Serialized 2x Replicated 50.2 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1412_19 Memory Serialized 2x Replicated 55.7 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1412_18 Memory Serialized 2x Replicated 51.1 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_21 Memory Serialized 2x Replicated 49.6 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_25 Memory Serialized 2x Replicated 48.1 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_24 Memory Serialized 2x Replicated 54.5 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_23 Memory Serialized 2x Replicated 49.6 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1412_28 Memory Serialized 2x Replicated 49.8 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1412_29 Memory Serialized 2x Replicated 50.8 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_20 Memory Serialized 2x Replicated 52.4 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_26 Memory Serialized 2x Replicated 52.9 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1412_27 Memory Serialized 2x Replicated 45.1 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_30 Memory Serialized 2x Replicated 50.4 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1412_31 Memory Serialized 2x Replicated 49.5 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_32 Memory Serialized 2x Replicated 47.7 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_34 Memory Serialized 2x Replicated 51.8 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1412_35 Memory Serialized 2x Replicated 50.3 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1412_36 Memory Serialized 2x Replicated 48.3 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
Page: