4.0.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-quantity-kpi-service
application UI
Details for Stage 53 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
42 s
Locality Level Summary:
Process local: 37
Input Size / Records:
0.0 B / 15976839
Shuffle Write Size / Records:
774.4 MiB / 15976839
Associated Job Ids:
31
DAG Visualization
digraph G { id="graph_53"; subgraph graph_stage_53 { id="graph_stage_53"; isCluster="true"; label="Stage 53"; subgraph cluster_451 { id="cluster_451"; isCluster="true"; label="Scan parquet "; 178 [id="node_178" labelType="html" label="FileScanRDD [178]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; 180 [id="node_180" labelType="html" label="MapPartitionsRDD [180]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_442 { id="cluster_442"; isCluster="true"; label="WholeStageCodegen (2)"; 181 [id="node_181" labelType="html" label="MapPartitionsRDD [181]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_441 { id="cluster_441"; isCluster="true"; label="Exchange"; 184 [id="node_184" labelType="html" label="MapPartitionsRDD [184]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; 185 [id="node_185" labelType="html" label="MapPartitionsRDD [185]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } } 178->180; 180->181; 181->184; 184->185; }
Event Timeline
Enable zooming
Tasks: 37. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time