soundwire: only compute port params in specific stream states #7531

Job	Run time
GCC build X86_64 with W=1	2m 49s
GCC static -fanalyzer	3m 49s
GCC build X86_64	17m 21s
GCC build arm64 allmodconfig	1m 36s
Clang build x86_64	4m 5s
GCC build arm64	19m 28s
GCC build i386	15m 24s
GCC build X86_64 with W=1 allmodconfig	2m 23s
Sparse check	3m 52s
	1h 10m 47s

Provide feedback