[DOP-29498] Allow overriding Spark session config #1515

Job	Run time
Clickhouse tests / Run Clickhouse tests	5m 5s
Oracle tests / Run Oracle tests	7m 36s
MySQL tests / Run MySQL tests	3m 57s
HDFS tests / Run HDFS tests	7m 52s
Iceberg tests / Run Iceberg tests	5m 20s
S3 tests / Run S3 tests	11m 29s
Samba tests / Run Samba tests	4m 49s
FTPS tests / Run FTPS tests	4m 0s
SFTP tests / Run SFTP tests	3m 59s
FTP tests / Run FTP tests	7m 18s
Hive tests / Run Hive tests	4m 31s
MSSQL tests / Run MSSQL tests	7m 43s
WebDAV tests / Run WebDAV tests	4m 4s
Scheduler tests / Run Scheduler tests	2m 14s
Unit tests / Run unit tests	3m 35s
Tests done	18s
	1h 23m 50s

Provide feedback