Add env variables to configure manifest cache #7845

Job	Run time
integration-test-gcs	1m 18s
integration-test-adls	1m 28s
integration-test	10m 32s
integration-test-s3	1m 12s
lint-and-unit-test (3.13)	3m 1s
lint-and-unit-test (3.11)	2m 45s
lint-and-unit-test (3.12)	3m 2s
lint-and-unit-test (3.10)	3m 7s
integration-coverage-report	29s
	26m 54s

Provide feedback