Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add a window join operation with as-of support #3

Open
jacques-n opened this issue Sep 8, 2021 · 1 comment
Open

Add a window join operation with as-of support #3

jacques-n opened this issue Sep 8, 2021 · 1 comment
Labels
enhancement New feature or request help wanted No one is currently implementing but it seems like a good idea

Comments

@jacques-n
Copy link
Contributor

I was talking with @cpcloud about supporting asof. During that discussion it generally felt as if it shouldn't be implemented/conceived of as a traditional join operator because the condition cannot be expressed as a scalar condition. Instead, it requires an expression it really has a window function like partition of analysis that then leads to a return of a set of matching rows given an input row.

As we discussed this, Phillip pointed out that asof is an example of this but not the only one (and there are several variations of as-of). As such, we think creating a new "window join" operation with a new kind of "window join function" or similar probably makes the most sense (with as-of variations being the first window join function to define). For reference, here is the window join operation in KDB: https://code.kx.com/q/ref/wj/

@wesm
Copy link

wesm commented Oct 5, 2021

To add extra quick context for readers who do not dig into the KDB documentation, a window-join is sort of a combination of a range-join and an aggregation:

Each row in the "t" table corresponds to a variable window of data (determined by an expression, e.g. t.timestamp >= q.timestamp - interval '5 minutes' in the "q" table), and an aggregation function is applied to the data in the window — e.g. one might compute the min, max, mean, or median value from the "q" table

@westonpace westonpace added help wanted No one is currently implementing but it seems like a good idea enhancement New feature or request labels Mar 1, 2023
rkondakov pushed a commit to rkondakov/substrait that referenced this issue Nov 21, 2023
- Add gradle action and use for build.
- Update wrapper to gradle 7.4.2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request help wanted No one is currently implementing but it seems like a good idea
Projects
None yet
Development

No branches or pull requests

3 participants