Skip to content

Commit c8a9c97

Browse files
committed
fix rpc doc
1 parent 2c6cd9b commit c8a9c97

1 file changed

Lines changed: 7 additions & 7 deletions

File tree

docs/rpc.md

Lines changed: 7 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -131,14 +131,14 @@ If you want to allow connections from other machines on the network:
131131

132132
> **Drivers & Hardware:** Ensure the Server machine has the necessary drivers installed and functional (e.g., Nvidia Drivers for CUDA, Vulkan SDK, or Metal). If no devices are found, the server will simply fallback to CPU usage.
133133

134-
### Step B: Check if the client is able to connect to the server and see the available devices
134+
<!-- ### Step B: Check if the client is able to connect to the server and see the available devices
135135

136136
We're assuming the server is running on your local machine, and listening on the default port `50052`. If it's running on a different machine, you can replace `localhost` with the IP address of the server.
137137

138138
**On the Client:**
139139

140140
```bash
141-
./sd-cli --rpc localhost:50052 --list-devices
141+
./sd-cli --rpc-servers localhost:50052 --list-devices
142142
```
143143

144144
If the server is running and the client is able to connect, you should see `RPC0 localhost:50052` in the list of devices.
@@ -153,16 +153,16 @@ Name Description
153153
CPU AMD Ryzen 9 5900X 12-Core Processor
154154
RPC0 localhost:50052
155155
RPC1 localhost:50052
156-
```
156+
``` -->
157157
158-
### Step C: Run with RPC device
158+
### Step B: Run with RPC device
159159
160160
If everything is working correctly, you can now run the client while offloading some or all of the work to the RPC server.
161161
162162
Example: Setting the main backend to the RPC0 device for doing all the work on the server.
163163
164164
```bash
165-
./sd-cli -m models/sd1.5.safetensors -p "A cat" --rpc localhost:50052 --main-backend-device RPC0
165+
./sd-cli -m models/sd1.5.safetensors -p "A cat" --rpc-servers localhost:50052 --backend RPC0
166166
```
167167

168168
---
@@ -208,7 +208,7 @@ cd ./build/bin/Release
208208
Pass multiple server addresses separated by commas.
209209

210210
```bash
211-
./sd-cli --rpc 192.168.1.10:50052,192.168.1.10:50053,192.168.1.11:50052 --list-devices
211+
./sd-cli --rpc-servers 192.168.1.10:50052,192.168.1.10:50053,192.168.1.11:50052 [...]
212212
```
213213

214214
The client will map these servers to sequential device IDs (e.g., RPC0 from the first server, RPC2, RPC3 from the second, and RPC4 from the third). With this setup, you could for example use RPC0 for the main backend, RPC1 and RPC2 for the text encoders, and RPC3 for the VAE.
@@ -217,4 +217,4 @@ The client will map these servers to sequential device IDs (e.g., RPC0 from the
217217

218218
## 6. Performance Considerations
219219

220-
RPC performance is heavily dependent on network bandwidth, as large weights and activations must be transferred back and forth over the network, especially for large models, or when using high resolutions. For best results, ensure your network connection is stable and has sufficient bandwidth (>1Gbps recommended).
220+
RPC performance is heavily dependent on network bandwidth, as large weights and activations must be transferred back and forth over the network, especially for large models, or when using high resolutions. For best results, ensure your network connection is stable and has sufficient bandwidth (>1Gbps recommended). This shoumd not be a concern if you are running the server and client on the same machine, as the data transfer will happen over the loopback interface.

0 commit comments

Comments
 (0)