Skip to content

Complete docs and code tests.#37

Merged
sheldonresearch merged 9 commits into
sheldonresearch:mainfrom
River177:main
Jun 2, 2026
Merged

Complete docs and code tests.#37
sheldonresearch merged 9 commits into
sheldonresearch:mainfrom
River177:main

Conversation

@River177

Copy link
Copy Markdown
Contributor

No description provided.

River177 and others added 9 commits May 28, 2026 14:53
Pin CPU torch in CI and install torch_scatter/torch_sparse from the matching PyG wheel index so import smoke can load all registered strategies.\n\nRun ruff format across the repository to satisfy the existing format check.\n\nCo-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
…tion and LinkTask

- Add `bench_paper_grid.sh` script to perform a comprehensive benchmark sweep across various datasets, shot numbers, prompt types, and pretraining methods.
- Extend `bootstrap_excel_full.py` to generate templates for LinkTask results, including a new row index for LinkTask metrics.
- Introduce `export_final_matrices.py` to export benchmark results into a structured report format.
- Update `merge_result_excels.py` to handle merging of LinkTask results alongside Node and Graph results.
- Modify `pretrain_paper_grid.sh` to clarify its role in the paper-scope benchmark experiment.
- Add unit tests in `test_link_task.py` to validate LinkTask functionality and ensure proper handling of supported and unsupported prompts.
Regenerate results/link-prediction-gcn/ from the heavy AMLT rerun
(epochs=50, task_num=3 folds, All-in-one caps 128/1/24), replacing the
earlier under-fit fast report.

Improvements vs fast run:
- Degenerate AUROC=0.5 cells: 43 -> 13 (epochs 10->50 fixed under-fitting;
  remaining 13 are genuine constant-predictor cases on PROTEINS/MUTAG).
- Cells with real std: 0 -> 2901 / 2912 (task_num 1->3 yields mean+/-std).
- AUROC median 0.6482 -> 0.6719, max 0.9507; full coverage (2912 combos).

Also prune empty Graph/Node/Link placeholder matrices that were never
populated by the link-only sweep, and add a Run configuration note to the
report README.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
Export assets/logo.excalidraw and assets/prog-v2-pipeline-draft.excalidraw
to images and replace assets/logo.jpg and assets/prog-pipeline.jpg. README
references are unchanged.

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
… Learning'

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@sheldonresearch
sheldonresearch merged commit e0b8021 into sheldonresearch:main Jun 2, 2026
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants