Releases: databricks/dbt-databricks
v1.9.0b1
What's Changed
- Add support for Serverless jobs / refactor api usage by @benc-db in #706
- Extend Merge Capabilities by @mi-volodin in #739
- Upgrade PySql to 3.4.0 by @benc-db in #790
- Add custom constraint option by @roydobbe in #792
- Behavior: Get column info from information_schema Part I by @benc-db in #808
- Simple Iceberg support by @benc-db in #815
- Implement python workflow submissions by @kdazzle in #762
- Behavior for external path by @benc-db in #823
- Implement microbatch incremental strategy by @benc-db in #825
New Contributors
- @mi-volodin made their first contribution in #739
- @roydobbe made their first contribution in #792
- @kdazzle made their first contribution in #762
Full Changelog: v1.8.7...v1.9.0b1
Contributors
Assets 2
v1.8.7
dbt-databricks 1.8.7 (October 10, 2024)
Features
- Add config for generating unique tmp table names for enabling parallel replace-where (thanks @huangxingyi-git!) (811)
Fixes
- Stop setting 'cluster by' to None. If you want to drop liquid clustering, you will need to full-refresh ([806]#806)
- Don't define table properties on snapshot staging views (thanks @jelmerk!) (820)
New Contributors
- @huangxingyi-git made their first contribution in #811
- @jelmerk made their first contribution in #820
Full Changelog: v1.8.6...v1.8.7
Contributors
Assets 2
v1.8.6
What's Changed
- Fix table comment updates by @henlue in #750
- Update tblproperties on incremental runs by @benc-db in #765
- Change oauth default scope by @eric-wang-1990 in #776
- Fix issue 747: primary key autoname by @elca-anh in #774
- Fix foreign key constraints by by switching from
parenttotoandparent_columnstoto_columnsby @benc-db in #789 - Handle external shallow clone type by @benc-db in #795
New Contributors
- @henlue made their first contribution in #750
- @eric-wang-1990 made their first contribution in #776
- @elca-anh made their first contribution in #774
Full Changelog: v1.8.5...v1.8.6
Contributors
Assets 2
v1.8.5
What's Changed
- #676 pk constraint by @frankivo in #731
- Fix capitalization issue by @benc-db in #742
- When we persist doc, for python lets remember to add a comment by @benc-db in #743
- Backport warning prevention from 1.9 by @benc-db in #744
- Update setup.py to allow for dbt-adapters ~1.3 by @colin-rogers-dbt in #748
- fix: race condition on cluster creation by @jurasan in #751
- Allow auth type to be configured for tests by @benc-db in #754
- Allow configuring port for tests by @benc-db in #755
- Prep for 1.8.5 release by @yunbodeng-db in #757
New Contributors
- @frankivo made their first contribution in #731
- @jurasan made their first contribution in #751
- @yunbodeng-db made their first contribution in #757
Full Changelog: v1.8.4...v1.8.5
Contributors
Assets 2
v1.7.17
v1.8.4
What's Changed
- Fix dbt seed command error when seed file is partially defined in the config file by @kass-artur in #724
- Readd external type by @benc-db in #728
- Adding more tblproperties to ignore list for streaming tables by @benc-db in #736
New Contributors
- @kass-artur made their first contribution in #724
Full Changelog: v1.8.3...v1.8.4
Contributors
Assets 2
v1.8.3
v1.8.2
What's Changed
- Reverting the decision to remove 'spark.sql.sources.partitionOverwriteMode = DYNAMIC' for insert_overwrite by @benc-db in #688
- Liquid clustering is now responsive to config changes with incremental models by @benc-db in #686
- Cancel running python jobs on Ctrl-C by @benc-db (thanks @gaoshihang for kicking this off!) in #693
- Change over to
systemcatalog for metadata gathering to fix bug with renamed catalogs by @benc-db in #692 - Fix insert_overwrite replacement when changing from a different partition strategy by @benc-db in #697
- Feature/issue640 refresh spa token no longer writes error log by (thanks @thijs-nijhuis!) in #700
- Migrate remaining unit tests to pytest by @benc-db in #701
- Change default redirect_url and scopes of client dbt-databricks by @jackyhu-db in #704
- Fix serialization issue detected by dbt Labs by @benc-db in #708
New Contributors
- @jackyhu-db made their first contribution in #704
Full Changelog: v1.8.1...v1.8.2
Contributors
Assets 2
v1.8.1
What's New?
Features
- Support Liquid Clustering for python models (663)
Fixes
- Rerunning seed with external location + persist_doc now more resilient (662)
- Fix issue with running while a refresh is in progress with MV/ST (674)
- Fix issue with running a refresh with MV/ST that need names to be escaped (674)
Under the Hood
- Delay loading of agate library to improve startup (thanks @dwreeves for getting this started!) (661)
- Updating to dbt-adapters~=1.2.0 (683)
Full Changelog: v1.8.0...v1.8.1
Contributors
Assets 2
v1.8.0
This release carries a substantial structural change as it is the first release after moving to the new 'decoupled' dbt architecture; while today we retain a dependence on dbt-core so that users do not need to install/specify versions for both libraries, we have moved to depending on a shared abstraction layer between the adapter and dbt-core. As a result, we no longer need to match our feature version to that of dbt-core, and are free to adopt semantic versioning. No more releasing significant features like 'compute-per-model` as a patch version!
This release also brings improvements to the declaration and operation of Materialized Views and Streaming Tables, including the ability to schedule automatic refreshes.
A new feature introduced in this release is support for tags. To distinguish from dbt tags, which are metadata that is often used for selecting models in a dbt operation, these tags are named as databricks_tags in the model configuration.
Big thanks to dbt Labs for significant help during the development and testing of this release.
What's Changed
Features
- Support
on_config_changefor materialized views, expand the supported config options (536) - Support
on_config_changefor streaming tables, expand the supported config options (569) - Support insert overwrite on SQL Warehouses (623)
- Support Databricks tags at model level for tables/views/incrementals (631)