-
Notifications
You must be signed in to change notification settings - Fork 28.9k
Pull requests: apache/spark
Author
Label
Projects
Milestones
Reviews
Assignee
Sort
Pull requests list
[SPARK-53967][PYTHON] Avoid intermediate pandas dataframe creation in
df.toPandas
PYTHON
SQL
#52680
opened Oct 21, 2025 by
zhengruifeng
Loading…
[DO-NOT-MERGE] Prototype: runtime profiling of Python workers
CORE
PYTHON
SQL
STRUCTURED STREAMING
#52679
opened Oct 21, 2025 by
HyukjinKwon
•
Draft
[SPARK-53966][CORE] Reduce default page size by LONG_ARRAY_OFFSET if ZGC and ON_HEAP are used
CORE
#52678
opened Oct 21, 2025 by
wankunde
Loading…
[SPARK-53965][CONNECT][SS][PYTHON] Upgrade buf plugins to
v29.5
CONNECT
PYTHON
SQL
STRUCTURED STREAMING
#52677
opened Oct 21, 2025 by
LuciferYang
Loading…
[SPARK-53964][BUILD] Correct Java Home finding for SBT unidoc
BUILD
#52676
opened Oct 21, 2025 by
pan3793
Loading…
[SPARK-53960][SQL] Let approx_top_k_accumulate/combine/estimate handle NULLs
SQL
#52673
opened Oct 20, 2025 by
yhuang-db
Loading…
[SPARK-52578][SQL] Add
numSourceRows
metric for MergeIntoExec
SQL
#52669
opened Oct 20, 2025 by
asl3
Loading…
[SPARK-53958][BUILD] Simplify Jackson deps management by using BOM
BUILD
#52668
opened Oct 20, 2025 by
pan3793
Loading…
[SPARK-53957][Geo][SQL] Support GEOGRAPHY and GEOMETRY in the SpatialReferenceSystemMapper
SQL
#52667
opened Oct 20, 2025 by
uros-db
Loading…
[SPARK-53955][CORE][3.5] Prefer to detect Java Home from env JAVA_HOME on finding jmap
AVRO
BUILD
CONNECT
CORE
DEPLOY
DOCS
DSTREAM
EXAMPLES
GRAPHX
INFRA
KUBERNETES
ML
MLLIB
PANDAS API ON SPARK
PROTOBUF
PYTHON
R
SPARK SHELL
SQL
STRUCTURED STREAMING
WEB UI
YARN
#52665
opened Oct 20, 2025 by
pan3793
Loading…
[SPARK-53952][INFRA] Balance GHA CI jobs by shifting connect tests
INFRA
#52661
opened Oct 20, 2025 by
pan3793
Loading…
[SPARK-53927][BUILD][DSTREAM][4.0] Upgrade kinesis client and fix kinesis integration tests
BUILD
DSTREAM
#52654
opened Oct 18, 2025 by
vrozov
Loading…
[WIP] [SPARK-XXXXX][SQL] Optimize memory usage in session cloning with ref-counted cached local relations
CONNECT
SQL
#52651
opened Oct 17, 2025 by
pranavdev022
Loading…
[SPARK-38117][CORE] Expose stage level metrics in prometheus endpoint
CORE
#52649
opened Oct 17, 2025 by
azsefi
Loading…
[SPARK-53446][CORE] Optimize BlockManager remove operations with cached block mappings
CORE
#52646
opened Oct 17, 2025 by
zml1206
Loading…
[SPARK-53942][SS] Support changing stateless shuffle partitions upon restart of streaming query
SQL
STRUCTURED STREAMING
#52645
opened Oct 17, 2025 by
HeartSaVioR
Loading…
[SPARK-53941][SS] Support AQE in stateless streaming workloads
DOCS
SQL
STRUCTURED STREAMING
#52642
opened Oct 17, 2025 by
HeartSaVioR
Loading…
[SPARK-53940][SQL] Function version() should return full spark version instead of short version
SQL
#52641
opened Oct 17, 2025 by
pan3793
Loading…
[SPARK-53573][SQL] Allow coalescing string literals everywhere
SQL
#52638
opened Oct 16, 2025 by
srielau
Loading…
Previous Next
ProTip!
Filter pull requests by the default branch with base:master.