Skip to content

Commit 78b742d

Browse files
committed
do_benchmark_pepper.sh script uploaded
1 parent d761719 commit 78b742d

File tree

3 files changed

+403
-5
lines changed

3 files changed

+403
-5
lines changed

README.md

+11-3
Original file line numberDiff line numberDiff line change
@@ -2,19 +2,27 @@
22

33
This repository acompanies a publication and provides shell scripts to measure the performance of different network filesystems. It contains two types of experiments.
44

5+
56
## Type 1: Random read speed for one large artificial file
67

7-
TODO
8+
1. Install sysbench, SSHFS, NFS, HTTPDirFS.
9+
2. Setup data sources for the network filesystems.
10+
3. Adapt paths in the `do_benchmark_pepper.sh` bash script.
11+
4. Run the script.
12+
13+
```bash
14+
./do_benchmark_pepper.sh
15+
```
16+
817

918
## Type 2: Performance of containerized CNN training, with NFS or SSD storage mounted in the container
1019

1120
1. Install Docker and Nvidia-Docker2.
1221
2. Generate a large `merged.hdf5` dataset as described in [camelyon-experiments-v2](https://github.com/deep-projects/camelyon-experiments-v2).
1322
3. Store the file on a local SSD or on a remote NFS share.
14-
4. Adapt paths in the `run_training_experiments`.
23+
4. Adapt paths in the `run_training_experiments` bash script.
1524
5. Run the script.
1625

17-
1826
```bash
1927
./run_training_experiments
2028
```

0 commit comments

Comments
 (0)