4.0.1
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
crp-order-quantity-kpi-service
application UI
Details for Stage 467 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
51 s
Locality Level Summary:
Process local: 37
Input Size / Records:
0.0 B / 15976839
Shuffle Write Size / Records:
774.4 MiB / 15976839
Associated Job Ids:
171
DAG Visualization
digraph G { id="graph_467"; subgraph graph_stage_467 { id="graph_stage_467"; isCluster="true"; label="Stage 467"; subgraph cluster_2363 { id="cluster_2363"; isCluster="true"; label="Scan parquet "; 810 [id="node_810" labelType="html" label="FileScanRDD [810]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; 812 [id="node_812" labelType="html" label="MapPartitionsRDD [812]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_2344 { id="cluster_2344"; isCluster="true"; label="WholeStageCodegen (2)"; 817 [id="node_817" labelType="html" label="MapPartitionsRDD [817]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } subgraph cluster_2343 { id="cluster_2343"; isCluster="true"; label="Exchange"; 821 [id="node_821" labelType="html" label="MapPartitionsRDD [821]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; 824 [id="node_824" labelType="html" label="MapPartitionsRDD [824]<br>$anonfun$withThreadLocalCaptured$2 at <unknown>:0}"]; } } 810->812; 812->817; 817->821; 821->824; }
Event Timeline
Enable zooming
Tasks: 37. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time