Search results

Spark 4.1: native_datafusion bytesRead task metric off by 6-14x vs Spark

bugSomething isn't workingSomething isn't working

requires-triage

Status: Open.

#4194 In apache/datafusion-comet;

· andygrove opened on May 3, 2026

Spark 4.1: bloom filter result mismatch (might_contain returns wrong answers)

bugSomething isn't workingSomething isn't working

correctness

requires-triage

Status: Open.

#4193 In apache/datafusion-comet;

· andygrove opened on May 3, 2026

Spark 4.1: native parquet reader returns wrong rows for user-defined struct schema

bugSomething isn't workingSomething isn't working

correctness

requires-triage

Status: Open.

#4192 In apache/datafusion-comet;

· andygrove opened on May 3, 2026

Spark 4.1: SPARK-52921 union output partitioning tests fail because Comet replaces UnionExec/ShuffleExchangeExec

bugSomething isn't workingSomething isn't working

requires-triage

testTesting relatedTesting related

Status: Open.

#4191 In apache/datafusion-comet;

· andygrove opened on May 3, 2026

Native scan path doesn't honour Parquet field-ID matching when spark.sql.parquet.fieldId.read.enabled=true

requires-triage

Status: Open.

#4189 In apache/datafusion-comet;

· schenksj opened on May 3, 2026

Set up process for auditing all Spark commits to assess impact on Comet

enhancementNew feature or requestNew feature or request

requires-triage

Status: Open.

#4188 In apache/datafusion-comet;

· andygrove opened on May 3, 2026

·  

1.0.0

Audit Spark SQL configs that affect query semantics and ensure Comet honors them (or falls back)

enhancementNew feature or requestNew feature or request

requires-triage

Status: Open.

#4180 In apache/datafusion-comet;

· andygrove opened on May 1, 2026

·  

1.0.0

Add support for scalar UDFs that operate on Arrow data

enhancementNew feature or requestNew feature or request

requires-triage

Status: Open.

#4177 In apache/datafusion-comet;

· andygrove opened on May 1, 2026

·  

1.0.0

Add metrics and logging to JVM-scalar-UDF dispatch path

requires-triage

Status: Open.

#4176 In apache/datafusion-comet;

· andygrove opened on May 1, 2026

Make JVM-scalar-UDF dispatch responsive to task cancellation

requires-triage

Status: Open.

#4175 In apache/datafusion-comet;

· andygrove opened on May 1, 2026

Register CometArrowAllocator as a Spark MemoryConsumer for JVM-UDF dispatch

requires-triage

Status: Open.

#4174 In apache/datafusion-comet;

· andygrove opened on May 1, 2026

Tighten CometUDF API with input/return type validation at registration

requires-triage

Status: Open.

#4173 In apache/datafusion-comet;

· andygrove opened on May 1, 2026