There are three recommended methods for deploying OpenVINO Model Server in Kubernetes:
- helm chart - deploys Model Server instances using the helm package manager for Kubernetes
- Kubernetes Operator - manages Model Server using a Kubernetes Operator
- OpenShift Operator - manages Model Server instances in Red Hat OpenShift
For operators mentioned in 2. and 3. see the description of the deployment process
- Start the server
- Try the model server features
- Explore the model server demos