soundwire: stream: Prepare ports in parallel to reduce stream start l… #7978

Job	Run time
GCC build arm64 allmodconfig	2m 35s
Clang build x86_64	4m 54s
GCC build X86_64 with W=1 allmodconfig	2m 5s
GCC static -fanalyzer	3m 20s
GCC build i386	17m 14s
Sparse check	3m 19s
GCC build X86_64	25m 49s
GCC build arm64	24m 57s
GCC build X86_64 with W=1	3m 22s
	1h 27m 35s

Provide feedback