Skip to content

Commit

Permalink
Update distributed_inferencing.md
Browse files Browse the repository at this point in the history
Signed-off-by: Ettore Di Giacinto <[email protected]>
  • Loading branch information
mudler authored Jun 22, 2024
1 parent dda5b9f commit 070fd1b
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docs/content/docs/features/distributed_inferencing.md
Original file line number Diff line number Diff line change
Expand Up @@ -95,6 +95,6 @@ The server logs should indicate that new workers are being discovered.

## Notes

- If running in p2p mode, make sure you start the container with `--net host` or `network_mode: host` in the docker-compose file.
- If running in p2p mode with container images, make sure you start the container with `--net host` or `network_mode: host` in the docker-compose file.
- Only a single model is supported currently.
- Ensure the server detects new workers before starting inference. Currently, additional workers cannot be added once inference has begun.

0 comments on commit 070fd1b

Please sign in to comment.