Add Elsayed91/dbt-subzero - #435
Open
elsayed91 wants to merge 1 commit into
Open
Conversation
Contributor
|
@elsayed91 I've added the checklist to the PR description. Could you fill it out to help us to review your package submission? |
Author
|
hi @dbeatty10 It has not been running in production long enough but I am satisfied with the behavior, tbh the premise is rather simple it is just calculating some data quality tests by querying iceberg table metadata rather that doing full scans. there is no state, and no dependency beyond metadata tables that are exposed by the engines. We can let it simmer for some time however if you feel like that is the right call |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Adds dbt-subzero: data quality tests for Apache Iceberg tables answered from table metadata (manifest statistics, snapshots) instead of scanning data. Supports dbt-trino and dbt-spark. First release v0.1.0 is published.
Checklist
This checklist is a cut down version of the best practices that we have identified as the package hub has grown. Although meeting these checklist items is not a prerequisite to being added to the Hub, we have found that packages which don't conform provide a worse user experience.
Real world usage
Using coding agents to help you build your package is totally fine, but please don't submit it to the package hub until you've used it in your own production environment for an extended period of time.
First run experience
Customisability
Packages for data transformation (delete if not relevant):
Dependencies
Dependencies on dbt Core
Zero dependencies
Interoperability
{{ dbt.except() }}and{{ dbt.type_string() }}.users.Versioning
hubcap/version.py(examples).