RDD Storage Info for Union :- *(8) Project [shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449, qty#452, null AS demandChannel#24687, null AS demandStream#24688, [] AS kpis#24722, true AS isNewlyCalculated#24690] : +- *(8) SortMergeJoin [coalesce(shardId#445, ), isnull(shardId#445), coalesce(worklistShardItemId#446L, 0), isnull(worklistShardItemId#446L), coalesce(version#447, 0), isnull(version#447), coalesce(product#448, ), isnull(product#448), coalesce(plant#449, ), isnull(plant#449), knownfloatingpointnormalized(normalizenanandzero(coalesce(qty#452, 0.0))), isnull(qty#452)], [coalesce(shardId#24679, ), isnull(shardId#24679), coalesce(worklistShardItemId#24680L, 0), isnull(worklistShardItemId#24680L), coalesce(version#24681, 0), isnull(version#24681), coalesce(product#24682, ), isnull(product#24682), coalesce(plant#24683, ), isnull(plant#24683), knownfloatingpointnormalized(normalizenanandzero(coalesce(qty#24454, 0.0))), isnull(qty#24454)], LeftAnti : :- *(1) Sort [coalesce(shardId#445, ) ASC NUL...

  • Storage Level: Disk Memory Serialized 2x Replicated
  • Cached Partitions: 74
  • Total Partitions: 74
  • Memory Size: 2.4 MiB
  • Disk Size: 0.0 B

Data Distribution on 3 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
10.96.20.131:7079 934.8 KiB (5.8 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.0.111:7079 816.2 KiB (5.8 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.7.66:7079 695.9 KiB (5.8 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B

74 Partitions

Page:
Block Name ▾ Storage Level Size in Memory Size on Disk Executors
rdd_1539_9 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_8 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_73 Memory Serialized 2x Replicated 68.2 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_72 Memory Serialized 2x Replicated 65.3 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_71 Memory Serialized 2x Replicated 65.2 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_70 Memory Serialized 2x Replicated 70.2 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_7 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_69 Memory Serialized 2x Replicated 62.0 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_68 Memory Serialized 2x Replicated 65.2 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_67 Memory Serialized 2x Replicated 68.4 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_66 Memory Serialized 2x Replicated 65.3 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_65 Memory Serialized 2x Replicated 63.6 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_64 Memory Serialized 2x Replicated 59.2 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_63 Memory Serialized 2x Replicated 62.0 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_62 Memory Serialized 2x Replicated 59.5 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_61 Memory Serialized 2x Replicated 68.4 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_60 Memory Serialized 2x Replicated 73.7 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_6 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_59 Memory Serialized 2x Replicated 66.0 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_58 Memory Serialized 2x Replicated 63.7 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_57 Memory Serialized 2x Replicated 62.0 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_56 Memory Serialized 2x Replicated 67.8 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_55 Memory Serialized 2x Replicated 65.9 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_54 Memory Serialized 2x Replicated 68.7 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_53 Memory Serialized 2x Replicated 56.8 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_52 Memory Serialized 2x Replicated 63.2 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_51 Memory Serialized 2x Replicated 64.7 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_50 Memory Serialized 2x Replicated 58.1 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_5 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_49 Memory Serialized 2x Replicated 67.9 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_48 Memory Serialized 2x Replicated 70.8 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_47 Memory Serialized 2x Replicated 70.8 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_46 Memory Serialized 2x Replicated 69.4 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_45 Memory Serialized 2x Replicated 75.6 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_44 Memory Serialized 2x Replicated 69.5 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_43 Memory Serialized 2x Replicated 65.0 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_42 Memory Serialized 2x Replicated 59.8 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_41 Memory Serialized 2x Replicated 65.8 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_40 Memory Serialized 2x Replicated 68.1 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_4 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_39 Memory Serialized 2x Replicated 67.6 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_38 Memory Serialized 2x Replicated 73.7 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1539_37 Memory Serialized 2x Replicated 68.1 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_36 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_35 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_34 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_33 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_32 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_31 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_30 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_3 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_29 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_28 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_27 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_26 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_25 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_24 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_23 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_22 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_21 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_20 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_2 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_19 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_18 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_17 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_16 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_15 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_14 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_13 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_12 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_11 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_10 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1539_1 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1539_0 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.20.131:7079
Page: