4.0.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-quantity-kpi-service
application UI
Details for Stage 206 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3.7 min
Locality Level Summary:
Process local: 37
Input Size / Records:
0.0 B / 15976839
Shuffle Write Size / Records:
2.2 GiB / 15976839
Spill (Memory):
5.5 GiB
Spill (Disk):
1159.8 MiB
Associated Job Ids:
91
DAG Visualization
digraph G { id="graph_206"; subgraph graph_stage_206 { id="graph_stage_206"; isCluster="true"; label="Stage 206"; subgraph cluster_1221 { id="cluster_1221"; isCluster="true"; label="Scan parquet "; 428 [id="node_428" labelType="html" label="FileScanRDD [428]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; 429 [id="node_429" labelType="html" label="MapPartitionsRDD [429]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_1172 { id="cluster_1172"; isCluster="true"; label="WholeStageCodegen (5)"; 432 [id="node_432" labelType="html" label="MapPartitionsRDD [432]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_1171 { id="cluster_1171"; isCluster="true"; label="Exchange"; 433 [id="node_433" labelType="html" label="MapPartitionsRDD [433]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; 434 [id="node_434" labelType="html" label="MapPartitionsRDD [434]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } } 428->429; 429->432; 432->433; 433->434; }
Event Timeline
Enable zooming
Tasks: 37. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time