-
Notifications
You must be signed in to change notification settings - Fork 4
Open
Labels
benchmarkthis issue benchmarks the library for a specific taskthis issue benchmarks the library for a specific taskhelp wantedExtra attention is neededExtra attention is neededpriority: medium
Description
Description
Create a comprehensive benchmark to evaluate SheafNN performance against standard Graph Neural Network (GNN) architectures on graph-structured datasets. Following the insights provided by the original Sheaf Neural Networks paper, its expected that Koho will outperform typical GNNs on heterophilic datasets or graphs with asymmetric relationships between nodes. This can most easily be benched with learnable restrictions, in which case this will likely require significant data. essentially instead of
Details
- pick a dataset with known GNN benchmarks, and implement a preprocess using
Graphbuilder pattern fromfeat: implementGraphwith canonical orientations #12 - choose a hyperparameter optimization method to derive a good start point, and split the data for training and testing
- write a benchmark module using the mini-batch training from
feat: implement mini-batch training support #11 over the preprocessed dataset
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
benchmarkthis issue benchmarks the library for a specific taskthis issue benchmarks the library for a specific taskhelp wantedExtra attention is neededExtra attention is neededpriority: medium