Remove iceberg-azure v1.5.0 package loading

[jcamachor]

Summary

This PR addresses an issue encountered during smoke tests for the OpenHouse deployment, specifically related to Iceberg ADLS dependencies. The issue is caused by the inclusion of the iceberg-azure package 1.5.0 in the Spark client script, which pulled in conflicting dependencies and caused java.io.InvalidClassException errors in the workers.

The fix involves removing the org.apache.iceberg:iceberg-azure:1.5.0 dependency from the script, as OpenHouse already has the necessary ADLS file IO implementation bundled within the project. This resolves the incompatibility and allows the deployment to proceed without errors.

Changes

• Client-facing API Changes
• Internal API Changes
• Bug Fixes
• New Features
• Performance Improvements
• Code Style
• Refactoring
• Documentation
• Tests

Removed the org.apache.iceberg:iceberg-azure:1.5.0 package from the Spark client script.

Testing Done

• Manually Tested on local docker setup. Please include commands ran, and their output.
• Added new tests for the changes made.
• Updated existing tests to reflect the changes made.
• No tests added or updated. Please explain why. If unsure, please feel free to ask for help.
• Some other form of testing like staging or soak time in production. Please explain.

Tested in Azure deployment.