Skip to content

submissions analysis + webpage rendering#101

Merged
wenting-zhao merged 16 commits intomainfrom
analysis_in_docs
Dec 7, 2024
Merged

submissions analysis + webpage rendering#101
wenting-zhao merged 16 commits intomainfrom
analysis_in_docs

Conversation

@celine-lee
Copy link
Collaborator

@celine-lee celine-lee commented Nov 27, 2024

Script to clone, evaluate, and present all submissions in celinelee/commit0_submissions on webpage.

Instructions to analyze submissions then render webpages are in docs/README.md:

Update HF dataset:

python docs/update_submissions_dataset.py

Run submissions analysis on SPLIT

python docs/render_submissions.py 
                       --do_setup --get_blank_details --get_reference_details # only once, at beginning of setting up environment
                       --analyze_submissions 
                       --split SPLIT

Render webpages on submissions.

python docs/render_submissions.py --render_webpages --overwrite_previous_eval

Deploy to website.

cd ../commit-0.github.io
mkdocs gh-deploy --config-file ../commit0/mkdocs.yml --remote-branch main

@wenting-zhao
Copy link
Collaborator

Hi @celine-lee thanks for the PR. Can you document in this PR how to run your code?

@wenting-zhao
Copy link
Collaborator

Also can you resolve the conflicts before I review?

@celine-lee celine-lee changed the title [WIP] submissions analysis + webpage rendering submissions analysis + webpage rendering Dec 6, 2024
@wenting-zhao
Copy link
Collaborator

This is awesome!

@wenting-zhao wenting-zhao merged commit df0dc34 into main Dec 7, 2024
@wenting-zhao wenting-zhao deleted the analysis_in_docs branch December 7, 2024 01:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants