4.0.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-quantity-kpi-service
application UI
Details for Stage 218 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3.1 min
Locality Level Summary:
Process local: 37
Input Size / Records:
0.0 B / 15976839
Shuffle Write Size / Records:
2.2 GiB / 15976839
Spill (Memory):
4.4 GiB
Spill (Disk):
927.8 MiB
Associated Job Ids:
103
DAG Visualization
digraph G { id="graph_218"; subgraph graph_stage_218 { id="graph_stage_218"; isCluster="true"; label="Stage 218"; subgraph cluster_1202 { id="cluster_1202"; isCluster="true"; label="Scan parquet "; 476 [id="node_476" labelType="html" label="FileScanRDD [476]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; 478 [id="node_478" labelType="html" label="MapPartitionsRDD [478]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_1120 { id="cluster_1120"; isCluster="true"; label="WholeStageCodegen (21)"; 483 [id="node_483" labelType="html" label="MapPartitionsRDD [483]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_1119 { id="cluster_1119"; isCluster="true"; label="Exchange"; 484 [id="node_484" labelType="html" label="MapPartitionsRDD [484]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; 485 [id="node_485" labelType="html" label="MapPartitionsRDD [485]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } } 476->478; 478->483; 483->484; 484->485; }
Event Timeline
Enable zooming
Tasks: 37. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time