[SPARK-54355][CONNECT] Make spark.connect.session.planCompression.defaultAlgorithm to support NONE

[dongjoon-hyun]

What changes were proposed in this pull request?

This PR aims to make spark.connect.session.planCompression.defaultAlgorithm to support NONE additionally.

Why are the changes needed?

BEFORE

$ bin/spark-connect-shell -c spark.connect.session.planCompression.defaultAlgorithm=NONE
...
$ scala> spark.range(1).count()
...
Caused by: org.apache.spark.SparkIllegalArgumentException:
[INVALID_CONF_VALUE.OUT_OF_RANGE_OF_OPTIONS]
The value 'NONE' in the config "spark.connect.session.planCompression.defaultAlgorithm" is invalid.
It should be one of 'ZSTD'. SQLSTATE: 22022

AFTER

$ bin/spark-connect-shell -c spark.connect.session.planCompression.defaultAlgorithm=NONE
...
scala> spark.range(1).count()
val res0: Long = 1

Does this PR introduce any user-facing change?

No behavior change because this is a new option for a new feature.

How was this patch tested?

Pass the CIs.

Was this patch authored or co-authored using generative AI tooling?

No.

[dongjoon-hyun]

Could you review this PR, please, @xi-db and @hvanhovell ?

[dongjoon-hyun]

Could you review this when you have some time, @sryza ?

[dongjoon-hyun]

Could you review this, @dtenedor ?

[dongjoon-hyun]

Could you review this when you have some time, @cloud-fan ?

[dongjoon-hyun]

Could you review this, @gengliangwang ?

[gengliangwang]

@dongjoon-hyun I’m not familiar with the related changes, so I’ll defer to other committers.

[dongjoon-hyun]

No problem. Thank you for spending your time here, @gengliangwang .