Repository navigation

Spark 4.1: Add per-task scanDuration metric - #17562

Merged

nastra merged 6 commits into

apache:mainfrom

venkata91:spark-task-scan-duration-metric

Nov 2, 2026

Merged

Spark 4.1: Add per-task scanDuration metric#17562
nastra merged 6 commits into
apache:mainfrom
venkata91:spark-task-scan-duration-metric

Commits on Nov 1, 2026
- Spark 4.1: Add per-task scanDuration metric
  
  Venkata Krishnan Sowrirajan
  authored and
  vsowrirajan_microsoft
  committed
  7cc6ef4
- Spark 4.1: Cover RowDataReader in scanDuration test
  vsowrirajan_microsoft
  committed
  042dab4
- Spark 4.1: Trim comments, add aggregate and formatting tests
  vsowrirajan_microsoft
  committed
  7b18068
- Spark 4.1: Use Locale.ROOT when formatting the scan duration aggregate
  vsowrirajan_microsoft
  committed
  9ff40e2
- Spark 4.1: Report scan duration as total (min, med, max)
  vsowrirajan_microsoft
  committed
  69aed84
- Spark 4.1: Drop test prefix from newly added scan duration tests
  vsowrirajan_microsoft
  committed
  901bf2b