soundwire: fix programing unattached BUSCLOCK_SCALE issue #8200

Job	Run time
GCC build X86_64 with W=1 allmodconfig	1m 44s
Sparse check	3m 17s
GCC build i386	16m 54s
GCC build arm64 allmodconfig	1m 49s
GCC static -fanalyzer	4m 2s
GCC build X86_64 with W=1	3m 3s
Clang build x86_64	4m 57s
GCC build arm64	22m 26s
GCC build X86_64	18m 16s
	1h 16m 28s

Provide feedback