[Bug]: Datastream-to-Bigquery Dataflow v2 template does not perform merge on CDC data from SQLServer because of incorrect mapping of SQL Server primary key field

[sandesh-jagdale-tp]

Related Template(s)

Cloud_Datastream_to_BigQuery

Template Version

2026-05-12-00_RC00

What happened?

Cloud_Datastream_to_BigQuery Dataflow v2 template, recently added support for SQLServer CDC data as part of feature request - #3410.
This support has missed handling of reading of SQL Server primary keys. SQL Server primary keys have to be read from "replication_index" metadata field instead of the usual "primary_keys" field as is the case with PostgreSQL, MySQL etc.
This does not result in any error, but the Merge Dataset does not have any records populated into them, as there is no Primary key found for the tables.

Relevant log output