You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I have searched the existing issues, and I could not find an existing issue for this bug
Current Behavior
show table extended in {{relation.shema}} like * fails if any other dbt model is running on {{relation.shema}} same time.
Expected Behavior
Please change show table extended in {{relation.schema}} like '*' with below implementation to avoid parallel running model issue in same database.
for table in spark.catalog.listTables({{relation.schema}}):
spark.sql("show table extended in {{relation.schema}} like '{table.name}'")
Hello @rahulgoyal2987 , you're currently on a EOL supported dbt core version. Could you update to 1.8 for both core and adapters and let me know if you're still experiencing this issue? We have made some significant changes with our metadata queries since 1.0.
Is this a new bug in dbt-spark?
Current Behavior
show table extended in {{relation.shema}} like * fails if any other dbt model is running on {{relation.shema}} same time.
Expected Behavior
Please change show table extended in {{relation.schema}} like '*' with below implementation to avoid parallel running model issue in same database.
for table in spark.catalog.listTables({{relation.schema}}):
spark.sql("show table extended in {{relation.schema}} like '{table.name}'")
Steps To Reproduce
Run two model parallel in same database
Relevant log output
No response
Environment
Additional Context
No response
The text was updated successfully, but these errors were encountered: