From c0a0cb14c6c1961379f711e865eb5aad9e6ec69a Mon Sep 17 00:00:00 2001 From: Marshall Wang Date: Thu, 28 Aug 2025 13:09:30 -0400 Subject: [PATCH 1/2] Update SSH tunnel guide for Killarney --- README.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/README.md b/README.md index f8d2ffb..fe7aa72 100644 --- a/README.md +++ b/README.md @@ -124,6 +124,6 @@ Once the inference server is ready, you can start sending in inference requests. ## SSH tunnel from your local device If you want to run inference from your local device, you can open a SSH tunnel to your cluster environment like the following: ```bash -ssh -L 8081:172.17.8.29:8081 username@v.vectorinstitute.ai -N +ssh -L 8081:10.1.1.29:8081 username@v.vectorinstitute.ai -N ``` -Where the last number in the URL is the GPU number (gpu029 in this case). The example provided above is for the vector cluster, change the variables accordingly for your environment +The example provided above is for the Vector Killarney cluster, change the variables accordingly for your environment. The IP address for the compute nodes on Killarney follow `10.1.1.XX` pattern, where `XX` is the GPU number (`kn029` -> `29` in this example). From 4826e596427d24f947e9f678141cc55df8ff6b73 Mon Sep 17 00:00:00 2001 From: XkunW Date: Thu, 28 Aug 2025 16:04:19 -0400 Subject: [PATCH 2/2] Update SSH tunnel in docs --- docs/user_guide.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/docs/user_guide.md b/docs/user_guide.md index d16b0ce..3be64e1 100644 --- a/docs/user_guide.md +++ b/docs/user_guide.md @@ -334,9 +334,9 @@ Once the inference server is ready, you can start sending in inference requests. If you want to run inference from your local device, you can open a SSH tunnel to your cluster environment like the following: ```bash -ssh -L 8081:172.17.8.29:8081 username@v.vectorinstitute.ai -N +ssh -L 8081:10.1.1.29:8081 username@v.vectorinstitute.ai -N ``` -Where the last number in the URL is the GPU number (gpu029 in this case). The example provided above is for the vector cluster, change the variables accordingly for your environment +The example provided above is for the Vector Killarney cluster, change the variables accordingly for your environment. The IP address for the compute nodes on Killarney follow `10.1.1.XX` pattern, where `XX` is the GPU number (`kn029` -> `29` in this example). Similarly, for Bon Echo it's `172.17.8.XX`, where `XX` is from `gpuXX`. ## Python API Usage