RDD Storage Info for Union :- *(8) Project [shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449, qty#452, null AS demandChannel#19011, null AS demandStream#19012, [] AS kpis#19046, true AS isNewlyCalculated#19014] : +- *(8) SortMergeJoin [coalesce(shardId#445, ), isnull(shardId#445), coalesce(worklistShardItemId#446L, 0), isnull(worklistShardItemId#446L), coalesce(version#447, 0), isnull(version#447), coalesce(product#448, ), isnull(product#448), coalesce(plant#449, ), isnull(plant#449), knownfloatingpointnormalized(normalizenanandzero(coalesce(qty#452, 0.0))), isnull(qty#452)], [coalesce(shardId#19003, ), isnull(shardId#19003), coalesce(worklistShardItemId#19004L, 0), isnull(worklistShardItemId#19004L), coalesce(version#19005, 0), isnull(version#19005), coalesce(product#19006, ), isnull(product#19006), coalesce(plant#19007, ), isnull(plant#19007), knownfloatingpointnormalized(normalizenanandzero(coalesce(qty#18778, 0.0))), isnull(qty#18778)], LeftAnti : :- *(1) Sort [coalesce(shardId#445, ) ASC NUL...

  • Storage Level: Disk Memory Serialized 2x Replicated
  • Cached Partitions: 74
  • Total Partitions: 74
  • Memory Size: 2.4 MiB
  • Disk Size: 0.0 B

Data Distribution on 3 Executors

HostOn Heap Memory UsageOff Heap Memory UsageDisk Usage
10.96.20.131:7079 736.3 KiB (5.8 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.0.111:7079 882.1 KiB (5.8 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B
10.96.7.66:7079 824.7 KiB (5.8 GiB Remaining) 0.0 B (0.0 B Remaining) 0.0 B

74 Partitions

Page:
Block Name ▾ Storage Level Size in Memory Size on Disk Executors
rdd_1254_9 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_8 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_73 Memory Serialized 2x Replicated 68.1 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_72 Memory Serialized 2x Replicated 65.5 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_71 Memory Serialized 2x Replicated 65.5 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_70 Memory Serialized 2x Replicated 70.8 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_7 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_69 Memory Serialized 2x Replicated 61.9 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_68 Memory Serialized 2x Replicated 65.3 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_67 Memory Serialized 2x Replicated 68.6 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_66 Memory Serialized 2x Replicated 65.1 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_65 Memory Serialized 2x Replicated 63.1 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_64 Memory Serialized 2x Replicated 59.2 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_63 Memory Serialized 2x Replicated 62.9 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_62 Memory Serialized 2x Replicated 58.5 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_61 Memory Serialized 2x Replicated 68.3 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_60 Memory Serialized 2x Replicated 73.4 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_6 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_59 Memory Serialized 2x Replicated 65.8 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_58 Memory Serialized 2x Replicated 63.4 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_57 Memory Serialized 2x Replicated 61.6 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_56 Memory Serialized 2x Replicated 68.2 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_55 Memory Serialized 2x Replicated 65.4 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_54 Memory Serialized 2x Replicated 68.6 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_53 Memory Serialized 2x Replicated 56.9 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_52 Memory Serialized 2x Replicated 63.7 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_51 Memory Serialized 2x Replicated 64.8 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_50 Memory Serialized 2x Replicated 58.4 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_5 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_49 Memory Serialized 2x Replicated 67.6 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_48 Memory Serialized 2x Replicated 70.0 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_47 Memory Serialized 2x Replicated 70.1 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_46 Memory Serialized 2x Replicated 69.3 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_45 Memory Serialized 2x Replicated 75.5 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_44 Memory Serialized 2x Replicated 68.9 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_43 Memory Serialized 2x Replicated 65.1 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_42 Memory Serialized 2x Replicated 60.0 KiB 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_41 Memory Serialized 2x Replicated 65.5 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_40 Memory Serialized 2x Replicated 68.1 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_4 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_39 Memory Serialized 2x Replicated 67.8 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_38 Memory Serialized 2x Replicated 73.3 KiB 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_37 Memory Serialized 2x Replicated 67.4 KiB 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_36 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_35 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_34 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_33 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_32 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_31 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_30 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_3 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_29 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_28 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_27 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_26 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_25 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_24 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.20.131:7079
rdd_1254_23 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_22 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_21 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_20 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_2 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_19 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_18 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_17 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_16 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_15 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_14 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_13 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_12 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_11 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_10 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
rdd_1254_1 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.20.131:7079 10.96.7.66:7079
rdd_1254_0 Memory Serialized 2x Replicated 42.0 B 0.0 B 10.96.0.111:7079 10.96.7.66:7079
Page: