Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Implement VideoMAE2 #5

Open
jaredb1011 opened this issue Apr 1, 2023 · 0 comments
Open

Implement VideoMAE2 #5

jaredb1011 opened this issue Apr 1, 2023 · 0 comments
Labels
help wanted Extra attention is needed
Milestone

Comments

@jaredb1011
Copy link
Contributor

jaredb1011 commented Apr 1, 2023

Description:

Implement the VideoMAE2 model on a dataset of videogame gameplay clips.
See the following papers:

Code for VideoMAE2 was recently released

Requirements:

Test the video masked autoencoder model on a small test dataset.
Evaluate the model's performance using appropriate metrics (e.g., reconstruction error, SSIM, etc.).
Provide proper attribution.
Provide clear documentation on how to use the model, including training, evaluation, and any customization options.

Acceptance Criteria:

Successfully implement VideoMAE2 into our codebase.
Test the video masked autoencoder model on the prepared dataset, achieving satisfactory performance as indicated by appropriate metrics.
Ensure compliance with the license and provide proper attribution.
Clear documentation provided on how to use the model, including training, evaluation, and any customization options.

Notes:

Be sure to preprocess the dataset appropriately, including resizing, normalization, and data augmentation if necessary.

@jaredb1011 jaredb1011 added this to the Pre-Training milestone Apr 1, 2023
@jaredb1011 jaredb1011 moved this to Todo in Models & Analysis Apr 1, 2023
@evoreign evoreign assigned evoreign and unassigned evoreign Apr 16, 2023
@jaredb1011 jaredb1011 added the help wanted Extra attention is needed label May 2, 2023
@jaredb1011 jaredb1011 changed the title Implement or Adapt a MAE Model Implement VideoMAE2 May 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed
Projects
Status: Todo
Development

No branches or pull requests

2 participants