Added dbt-streams-task to hub - #414
Open
AidanHarveyNelson wants to merge 1 commit into
Open
Conversation
Contributor
|
@AidanHarveyNelson thanks for submitting! Have you been using this in a production environment for a while? How has it gone? |
Contributor
|
@AidanHarveyNelson could you answer the questions above? That will help us review your package submission. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Description
This package is aimed at helping users manage streams and tasks within DBT. User's can declare there table SQL normally and the package will create a merge task that will ensure that the data is loaded in on a schedule they define. They are also able to create streams to better facilitate incremental loads and have these streams mentioned previously reference them.
No more managing these objects in a different repo it will now be possible to do it all inside DBT
Link to your package's repository: https://github.com/AidanHarveyNelson/dbt-streams-tasks
Checklist
This checklist is a cut down version of the best practices that we have identified as the package hub has grown. Although meeting these checklist items is not a prerequisite to being added to the Hub, we have found that packages which don't conform provide a worse user experience.
First run experience
Customisability
Packages for data transformation (delete if not relevant):
Dependencies
Dependencies on dbt Core
require-dbt-versionrange indbt_project.yml. Example: A package which depends on functionality added in dbt Core 1.2 should set itsrequire-dbt-versionproperty to[">=1.2.0", "<2.0.0"].Dependencies on other packages defined in packages.yml:
Interoperability
{{ dbt.except() }}and{{ dbt.type_string() }}.users.Versioning
hubcap/version.py(examples).