Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[WIP][SYSTEMDS-3468] Adding the outline for the survey of builtin functions #1735

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

BACtaki
Copy link
Contributor

@BACtaki BACtaki commented Nov 23, 2022

This patch proposes a comparison of builtin functions based on a grouping by ML lifecycle phase and ML task. This patch presents only the basic outline- subsequent patches will do the actual comparison.

@j143
Copy link
Contributor

j143 commented Nov 23, 2022

Thanks Badrul! Although this is a good idea, try to be familiar with the end to end pipelines or a single phase of the cycle with SystemDS. A plenty of working examples are here:
https://github.com/damslab/reproducibility

Keep posting any updates here though!

@Baunsgaard
Copy link
Contributor

what i think would be really useful in this direction.

  • run experiments that evaluate performance over time of key algorithms and operations
  • automatically plot these, and provide graphs in GitHub actions.

This can also compare to other systems implementations automatically, to include in the graphs.
Optionally it can be an action we run weekly, or monthly?

@j143 j143 changed the title [SYSTEMDS-3468] Adding the outline for the survey of builtin functions [WIP][SYSTEMDS-3468] Adding the outline for the survey of builtin functions Feb 5, 2023
@j143 j143 added this to the next-release milestone Feb 8, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Unplanned
Development

Successfully merging this pull request may close these issues.

3 participants