Storage

RDDs (31)

ID RDD Name Storage Level Cached Partitions Fraction Cached Size in Memory Size on Disk
145 Delta Table State #5 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-product-productplant/_delta_log Disk Memory Serialized 1x Replicated 45 90.00% 3.6 KiB 0.0 B
164 Delta Table State #4 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-product-product-v2/_delta_log Disk Memory Serialized 1x Replicated 45 90.00% 2.2 KiB 0.0 B
168 Delta Table State with Stats #4 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-product-product-v2/_delta_log Disk Memory Serialized 1x Replicated 45 90.00% 1640.0 B 0.0 B
232 Delta Table State with Stats #5 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-product-productplant/_delta_log Disk Memory Serialized 1x Replicated 45 90.00% 2.1 KiB 0.0 B
283 Delta Table State #20 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-inventory-inventorysnapshot-v2/_delta_log Disk Memory Serialized 1x Replicated 27 54.00% 567.0 B 0.0 B
287 Delta Table State with Stats #20 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-inventory-inventorysnapshot-v2/_delta_log Disk Memory Serialized 1x Replicated 27 54.00% 567.0 B 0.0 B
300 Delta Table State #1 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log Disk Memory Serialized 1x Replicated 29 58.00% 1736.0 B 0.0 B
304 Delta Table State with Stats #1 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/prp/market-unit/_delta_log Disk Memory Serialized 1x Replicated 29 58.00% 609.0 B 0.0 B
317 Delta Table State #4 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-plant-plant/_delta_log Disk Memory Serialized 1x Replicated 25 50.00% 2021.0 B 0.0 B
336 Delta Table State #3 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-procurement-purchaseorder/_delta_log Disk Memory Serialized 1x Replicated 30 60.00% 2.2 KiB 0.0 B
340 Delta Table State with Stats #3 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-dl-stream-service/cornerstone/sap-cic-procurement-purchaseorder/_delta_log Disk Memory Serialized 1x Replicated 30 60.00% 1141.0 B 0.0 B
878 Delta Table State #0 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/internal/data-snapshot/10000000004/0_1_10000000004/_delta_log Disk Memory Serialized 1x Replicated 14 28.00% 294.0 B 0.0 B
882 Delta Table State with Stats #0 - hdlfs://7da5304c-1f57-47fa-b75a-0f0b4349c280.files.hdl.prod-eu20.hanacloud.ondemand.com:443/crp-order-quantity-kpi-service/internal/data-snapshot/10000000004/0_1_10000000004/_delta_log Disk Memory Serialized 1x Replicated 14 28.00% 294.0 B 0.0 B
920 *(8) Project [shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449, cachedQty#13010 AS qty#13012, demandChannel#13005, demandStream#13006, cachedKpis#13011 AS kpis#13013] +- *(8) SortMergeJoin [worklistShardItemId#446L, shardId#445], [cachedWorklistShardItemId#13009L, cachedShardId#13008], Inner :- *(5) Sort [worklistShardItemId#446L ASC NULLS FIRST, shardId#445 ASC NULLS FIRST], false, 0 : +- *(5) HashAggregate(keys=[plant#449, shardId#445, version#447, worklistShardItemId#446L, product#448], functions=[], output=[shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449]) : +- *(5) HashAggregate(keys=[plant#449, shardId#445, version#447, worklistShardItemId#446L, product#448], functions=[], output=[plant#449, shardId#445, version#447, worklistShardItemId#446L, product#448]) : +- *(5) Project [shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449] : +- *(5) SortMergeJoin [worklistShardItemId#446L, shardId#445]... Disk Memory Serialized 2x Replicated 37 100.00% 1554.0 B 0.0 B
949 Union :- *(8) Project [shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449, qty#452, null AS demandChannel#13245, null AS demandStream#13246, [] AS kpis#13280, true AS isNewlyCalculated#13248] : +- *(8) SortMergeJoin [coalesce(shardId#445, ), isnull(shardId#445), coalesce(worklistShardItemId#446L, 0), isnull(worklistShardItemId#446L), coalesce(version#447, 0), isnull(version#447), coalesce(product#448, ), isnull(product#448), coalesce(plant#449, ), isnull(plant#449), knownfloatingpointnormalized(normalizenanandzero(coalesce(qty#452, 0.0))), isnull(qty#452)], [coalesce(shardId#13237, ), isnull(shardId#13237), coalesce(worklistShardItemId#13238L, 0), isnull(worklistShardItemId#13238L), coalesce(version#13239, 0), isnull(version#13239), coalesce(product#13240, ), isnull(product#13240), coalesce(plant#13241, ), isnull(plant#13241), knownfloatingpointnormalized(normalizenanandzero(coalesce(qty#13012, 0.0))), isnull(qty#13012)], LeftAnti : :- *(1) Sort [coalesce(shardId#445, ) ASC NUL... Disk Memory Serialized 2x Replicated 74 100.00% 631.3 KiB 0.0 B
1021 MapPartitionsRDD Disk Memory Serialized 2x Replicated 37 100.00% 1975.8 KiB 0.0 B
1041 *(1) Generate explode(prodPlantResults#15956), false, [prodPlantResults#15963] +- *(1) Project [prodPlantResults#15956] +- *(1) Filter ((size(prodPlantResults#15956, true) > 0) AND isnotnull(prodPlantResults#15956)) +- *(1) SerializeFromObject [mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), if (isnull(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), StructField(measuredUnit,StringType,true), StructField(numberOfCalls,LongType,false), StructField(parent,StringType,true), StructField(runtime,LongType,false), ObjectType(class com.sap.s4hana.eureka.business.crporderquantitykpicalculation.dto.PerformanceMeasurement)))) null else named_struct(measuredUnit, static_invoke(UTF8String.fromString(invoke(knownnotnull(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), StructField(measuredUnit,StringType,true), StructField(numberOfCalls,LongType,false), StructField(parent,StringType,true)... Disk Memory Serialized 2x Replicated 37 100.00% 2.7 MiB 0.0 B
1078 SortAggregate(key=[demandChannel#15989, shardId#445, qty#16009, worklistShardItemId#446L, demandStream#15990], functions=[first(kpis#16018, false)], output=[shardId#445, worklistShardItemId#446L, qty#16009, demandChannel#15989, demandStream#15990, kpis#16151]) +- *(8) Sort [demandChannel#15989 ASC NULLS FIRST, shardId#445 ASC NULLS FIRST, qty#16009 ASC NULLS FIRST, worklistShardItemId#446L ASC NULLS FIRST, demandStream#15990 ASC NULLS FIRST], false, 0 +- Exchange hashpartitioning(demandChannel#15989, shardId#445, qty#16009, worklistShardItemId#446L, demandStream#15990, 37), ENSURE_REQUIREMENTS, [plan_id=115377] +- SortAggregate(key=[demandChannel#15989, shardId#445, knownfloatingpointnormalized(normalizenanandzero(qty#16009)) AS qty#16009, worklistShardItemId#446L, demandStream#15990], functions=[partial_first(kpis#16018, false)], output=[demandChannel#15989, shardId#445, qty#16009, worklistShardItemId#446L, demandStream#15990, first#16227, valueSet#16228]) +- *(7) Sort [demandChannel#159... Disk Memory Serialized 2x Replicated 37 100.00% 1152.3 KiB 0.0 B
1127 *(5) Project [shardId#445, worklistShardItemId#446L, version#16822, qty#452, demandChannel#13245, demandStream#13246, kpis#13280] +- *(5) BroadcastHashJoin [shardId#445, worklistShardItemId#446L], [shardId#16919, worklistShardItemId#16920L], Inner, BuildRight, false :- Union : :- *(1) Project [shardId#445, worklistShardItemId#446L, qty#452, demandChannel#13245, demandStream#13246, kpis#13280] : : +- *(1) Filter ((NOT isNewlyCalculated#13248 AND isnotnull(shardId#445)) AND isnotnull(worklistShardItemId#446L)) : : +- InMemoryTableScan [demandChannel#13245, demandStream#13246, isNewlyCalculated#13248, kpis#13280, qty#452, shardId#445, worklistShardItemId#446L], [NOT isNewlyCalculated#13248, isnotnull(shardId#445), isnotnull(worklistShardItemId#446L)] : : +- InMemoryRelation [shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449, qty#452, demandChannel#13245, demandStream#13246, kpis#13280, isNewlyCalculated#13248], StorageLevel(disk, memory, 2 replicas) ... Disk Memory Serialized 2x Replicated 111 100.00% 1157.3 KiB 0.0 B
1223 *(8) Project [shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449, cachedQty#18776 AS qty#18778, demandChannel#18771, demandStream#18772, cachedKpis#18777 AS kpis#18779] +- *(8) SortMergeJoin [worklistShardItemId#446L, shardId#445], [cachedWorklistShardItemId#18775L, cachedShardId#18774], Inner :- *(5) Sort [worklistShardItemId#446L ASC NULLS FIRST, shardId#445 ASC NULLS FIRST], false, 0 : +- *(5) HashAggregate(keys=[plant#449, shardId#445, version#447, worklistShardItemId#446L, product#448], functions=[], output=[shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449]) : +- *(5) HashAggregate(keys=[plant#449, shardId#445, version#447, worklistShardItemId#446L, product#448], functions=[], output=[plant#449, shardId#445, version#447, worklistShardItemId#446L, product#448]) : +- *(5) Project [shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449] : +- *(5) SortMergeJoin [worklistShardItemId#446L, shardId#445]... Disk Memory Serialized 2x Replicated 37 100.00% 2.4 MiB 0.0 B
1254 Union :- *(8) Project [shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449, qty#452, null AS demandChannel#19011, null AS demandStream#19012, [] AS kpis#19046, true AS isNewlyCalculated#19014] : +- *(8) SortMergeJoin [coalesce(shardId#445, ), isnull(shardId#445), coalesce(worklistShardItemId#446L, 0), isnull(worklistShardItemId#446L), coalesce(version#447, 0), isnull(version#447), coalesce(product#448, ), isnull(product#448), coalesce(plant#449, ), isnull(plant#449), knownfloatingpointnormalized(normalizenanandzero(coalesce(qty#452, 0.0))), isnull(qty#452)], [coalesce(shardId#19003, ), isnull(shardId#19003), coalesce(worklistShardItemId#19004L, 0), isnull(worklistShardItemId#19004L), coalesce(version#19005, 0), isnull(version#19005), coalesce(product#19006, ), isnull(product#19006), coalesce(plant#19007, ), isnull(plant#19007), knownfloatingpointnormalized(normalizenanandzero(coalesce(qty#18778, 0.0))), isnull(qty#18778)], LeftAnti : :- *(1) Sort [coalesce(shardId#445, ) ASC NUL... Disk Memory Serialized 2x Replicated 74 100.00% 2.4 MiB 0.0 B
1319 MapPartitionsRDD Disk Memory Serialized 2x Replicated 37 100.00% 1554.0 B 0.0 B
1323 *(1) Generate explode(prodPlantResults#21554), false, [prodPlantResults#21561] +- *(1) Project [prodPlantResults#21554] +- *(1) Filter ((size(prodPlantResults#21554, true) > 0) AND isnotnull(prodPlantResults#21554)) +- *(1) SerializeFromObject [mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), if (isnull(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), StructField(measuredUnit,StringType,true), StructField(numberOfCalls,LongType,false), StructField(parent,StringType,true), StructField(runtime,LongType,false), ObjectType(class com.sap.s4hana.eureka.business.crporderquantitykpicalculation.dto.PerformanceMeasurement)))) null else named_struct(measuredUnit, static_invoke(UTF8String.fromString(invoke(knownnotnull(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), StructField(measuredUnit,StringType,true), StructField(numberOfCalls,LongType,false), StructField(parent,StringType,true)... Disk Memory Serialized 2x Replicated 37 100.00% 1554.0 B 0.0 B
1360 SortAggregate(key=[demandChannel#21587, shardId#445, qty#21607, worklistShardItemId#446L, demandStream#21588], functions=[first(kpis#21616, false)], output=[shardId#445, worklistShardItemId#446L, qty#21607, demandChannel#21587, demandStream#21588, kpis#21749]) +- *(8) Sort [demandChannel#21587 ASC NULLS FIRST, shardId#445 ASC NULLS FIRST, qty#21607 ASC NULLS FIRST, worklistShardItemId#446L ASC NULLS FIRST, demandStream#21588 ASC NULLS FIRST], false, 0 +- Exchange hashpartitioning(demandChannel#21587, shardId#445, qty#21607, worklistShardItemId#446L, demandStream#21588, 37), ENSURE_REQUIREMENTS, [plan_id=116966] +- SortAggregate(key=[demandChannel#21587, shardId#445, knownfloatingpointnormalized(normalizenanandzero(qty#21607)) AS qty#21607, worklistShardItemId#446L, demandStream#21588], functions=[partial_first(kpis#21616, false)], output=[demandChannel#21587, shardId#445, qty#21607, worklistShardItemId#446L, demandStream#21588, first#21825, valueSet#21826]) +- *(7) Sort [demandChannel#215... Disk Memory Serialized 2x Replicated 37 100.00% 1554.0 B 0.0 B
1412 *(6) Project [shardId#445, worklistShardItemId#446L, version#22420, qty#452, demandChannel#19011, demandStream#19012, kpis#19046] +- *(6) SortMergeJoin [shardId#445, worklistShardItemId#446L], [shardId#22517, worklistShardItemId#22518L], Inner :- *(3) Sort [shardId#445 ASC NULLS FIRST, worklistShardItemId#446L ASC NULLS FIRST], false, 0 : +- Exchange hashpartitioning(shardId#445, worklistShardItemId#446L, 37), ENSURE_REQUIREMENTS, [plan_id=117132] : +- Union : :- *(1) Project [shardId#445, worklistShardItemId#446L, qty#452, demandChannel#19011, demandStream#19012, kpis#19046] : : +- *(1) Filter ((NOT isNewlyCalculated#19014 AND isnotnull(shardId#445)) AND isnotnull(worklistShardItemId#446L)) : : +- InMemoryTableScan [demandChannel#19011, demandStream#19012, isNewlyCalculated#19014, kpis#19046, qty#452, shardId#445, worklistShardItemId#446L], [NOT isNewlyCalculated#19014, isnotnull(shardId#445), isnotnull(worklistShardItemId#446L)] : : +- ... Disk Memory Serialized 2x Replicated 37 100.00% 1867.3 KiB 0.0 B
1510 *(8) Project [shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449, cachedQty#24452 AS qty#24454, demandChannel#24447, demandStream#24448, cachedKpis#24453 AS kpis#24455] +- *(8) SortMergeJoin [worklistShardItemId#446L, shardId#445], [cachedWorklistShardItemId#24451L, cachedShardId#24450], Inner :- *(5) Sort [worklistShardItemId#446L ASC NULLS FIRST, shardId#445 ASC NULLS FIRST], false, 0 : +- *(5) HashAggregate(keys=[plant#449, shardId#445, version#447, worklistShardItemId#446L, product#448], functions=[], output=[shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449]) : +- *(5) HashAggregate(keys=[plant#449, shardId#445, version#447, worklistShardItemId#446L, product#448], functions=[], output=[plant#449, shardId#445, version#447, worklistShardItemId#446L, product#448]) : +- *(5) Project [shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449] : +- *(5) SortMergeJoin [worklistShardItemId#446L, shardId#445]... Disk Memory Serialized 2x Replicated 37 100.00% 2.4 MiB 0.0 B
1539 Union :- *(8) Project [shardId#445, worklistShardItemId#446L, version#447, product#448, plant#449, qty#452, null AS demandChannel#24687, null AS demandStream#24688, [] AS kpis#24722, true AS isNewlyCalculated#24690] : +- *(8) SortMergeJoin [coalesce(shardId#445, ), isnull(shardId#445), coalesce(worklistShardItemId#446L, 0), isnull(worklistShardItemId#446L), coalesce(version#447, 0), isnull(version#447), coalesce(product#448, ), isnull(product#448), coalesce(plant#449, ), isnull(plant#449), knownfloatingpointnormalized(normalizenanandzero(coalesce(qty#452, 0.0))), isnull(qty#452)], [coalesce(shardId#24679, ), isnull(shardId#24679), coalesce(worklistShardItemId#24680L, 0), isnull(worklistShardItemId#24680L), coalesce(version#24681, 0), isnull(version#24681), coalesce(product#24682, ), isnull(product#24682), coalesce(plant#24683, ), isnull(plant#24683), knownfloatingpointnormalized(normalizenanandzero(coalesce(qty#24454, 0.0))), isnull(qty#24454)], LeftAnti : :- *(1) Sort [coalesce(shardId#445, ) ASC NUL... Disk Memory Serialized 2x Replicated 74 100.00% 2.4 MiB 0.0 B
1606 MapPartitionsRDD Disk Memory Serialized 2x Replicated 37 100.00% 1554.0 B 0.0 B
1610 *(1) Generate explode(prodPlantResults#27230), false, [prodPlantResults#27237] +- *(1) Project [prodPlantResults#27230] +- *(1) Filter ((size(prodPlantResults#27230, true) > 0) AND isnotnull(prodPlantResults#27230)) +- *(1) SerializeFromObject [mapobjects(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), if (isnull(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), StructField(measuredUnit,StringType,true), StructField(numberOfCalls,LongType,false), StructField(parent,StringType,true), StructField(runtime,LongType,false), ObjectType(class com.sap.s4hana.eureka.business.crporderquantitykpicalculation.dto.PerformanceMeasurement)))) null else named_struct(measuredUnit, static_invoke(UTF8String.fromString(invoke(knownnotnull(validateexternaltype(lambdavariable(MapObject, ObjectType(class java.lang.Object), true, -1), StructField(measuredUnit,StringType,true), StructField(numberOfCalls,LongType,false), StructField(parent,StringType,true)... Disk Memory Serialized 2x Replicated 37 100.00% 1554.0 B 0.0 B
1647 SortAggregate(key=[demandChannel#27263, shardId#445, qty#27283, worklistShardItemId#446L, demandStream#27264], functions=[first(kpis#27292, false)], output=[shardId#445, worklistShardItemId#446L, qty#27283, demandChannel#27263, demandStream#27264, kpis#27425]) +- *(8) Sort [demandChannel#27263 ASC NULLS FIRST, shardId#445 ASC NULLS FIRST, qty#27283 ASC NULLS FIRST, worklistShardItemId#446L ASC NULLS FIRST, demandStream#27264 ASC NULLS FIRST], false, 0 +- Exchange hashpartitioning(demandChannel#27263, shardId#445, qty#27283, worklistShardItemId#446L, demandStream#27264, 37), ENSURE_REQUIREMENTS, [plan_id=118557] +- SortAggregate(key=[demandChannel#27263, shardId#445, knownfloatingpointnormalized(normalizenanandzero(qty#27283)) AS qty#27283, worklistShardItemId#446L, demandStream#27264], functions=[partial_first(kpis#27292, false)], output=[demandChannel#27263, shardId#445, qty#27283, worklistShardItemId#446L, demandStream#27264, first#27501, valueSet#27502]) +- *(7) Sort [demandChannel#272... Disk Memory Serialized 2x Replicated 37 100.00% 1554.0 B 0.0 B
1699 *(6) Project [shardId#445, worklistShardItemId#446L, version#28096, qty#452, demandChannel#24687, demandStream#24688, kpis#24722] +- *(6) SortMergeJoin [shardId#445, worklistShardItemId#446L], [shardId#28193, worklistShardItemId#28194L], Inner :- *(3) Sort [shardId#445 ASC NULLS FIRST, worklistShardItemId#446L ASC NULLS FIRST], false, 0 : +- Exchange hashpartitioning(shardId#445, worklistShardItemId#446L, 37), ENSURE_REQUIREMENTS, [plan_id=118723] : +- Union : :- *(1) Project [shardId#445, worklistShardItemId#446L, qty#452, demandChannel#24687, demandStream#24688, kpis#24722] : : +- *(1) Filter ((NOT isNewlyCalculated#24690 AND isnotnull(shardId#445)) AND isnotnull(worklistShardItemId#446L)) : : +- InMemoryTableScan [demandChannel#24687, demandStream#24688, isNewlyCalculated#24690, kpis#24722, qty#452, shardId#445, worklistShardItemId#446L], [NOT isNewlyCalculated#24690, isnotnull(shardId#445), isnotnull(worklistShardItemId#446L)] : : +- ... Disk Memory Serialized 2x Replicated 37 100.00% 1867.2 KiB 0.0 B