Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

refactor(fuzzer): Refactor joins with table scan in JoinFuzzer to allow for multi-join plan generation #12250

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

DanielHunte
Copy link

Summary: This change updates the makeXXJoinWithTableScan methods to generate multi-join plans. This required many changes elsewhere. The old APIs with the long parameter lists were also removed.

Differential Revision: D69084385

@facebook-github-bot facebook-github-bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Feb 3, 2025
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69084385

Copy link

netlify bot commented Feb 3, 2025

Deploy Preview for meta-velox canceled.

Name Link
🔨 Latest commit 5aad1b3
🔍 Latest deploy log https://app.netlify.com/sites/meta-velox/deploys/67a2741dbf133a000815c9d7

DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Feb 4, 2025
…ow for multi-join plan generation (facebookincubator#12250)

Summary:

This change updates the makeXXJoinWithTableScan methods to generate multi-join plans. This required many changes elsewhere. The old APIs with the long parameter lists were also removed.

Differential Revision: D69084385
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69084385

DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Feb 4, 2025
…ow for multi-join plan generation (facebookincubator#12250)

Summary:

This change updates the makeXXJoinWithTableScan methods to generate multi-join plans. This required many changes elsewhere. The old APIs with the long parameter lists were also removed.

Differential Revision: D69084385
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69084385

DanielHunte pushed a commit to DanielHunte/velox that referenced this pull request Feb 4, 2025
…ow for multi-join plan generation (facebookincubator#12250)

Summary:

This change updates the makeXXJoinWithTableScan methods to generate multi-join plans. This required many changes elsewhere. The old APIs with the long parameter lists were also removed.

Differential Revision: D69084385
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69084385

Daniel Hunte added 3 commits February 4, 2025 12:09
…cebookincubator#12246)

Summary:

Joins operators with filters on one side are not currently supported in Velox. It is expected that such a filter would be pushed down to the table scan and therefore not show up in the join operator.

The fix to support this would be disabling filter pushdown when filtering only one side of a join.

Alternatively, filters within join operators can be checked to ensure that the filter contains keys from both sides, else throw an exception. This change will require testing in production to see if Presto produces such plans.

For now, changing the join fuzzer filter creation to include keys from both sides will avoid this type of failure completely.

Differential Revision: D69079267
…bookincubator#12198)

Summary:

Generates a cascading multi-join from left to right with the inputs to the join being values nodes.

[t1, t2, t3, t4]
```
t1  t2
 \  /
  a   t3
   \  /
     b   t4
      \  /
        c
```

Reviewed By: kagamiori

Differential Revision: D68797355
…ow for multi-join plan generation (facebookincubator#12250)

Summary:

This change updates the makeXXJoinWithTableScan methods to generate multi-join plans. This required many changes elsewhere. The old APIs with the long parameter lists were also removed.

Differential Revision: D69084385
@facebook-github-bot
Copy link
Contributor

This pull request was exported from Phabricator. Differential Revision: D69084385

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. fb-exported
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants