Skip to content

Latest commit

 

History

History
41 lines (33 loc) · 1.47 KB

writing_app.md

File metadata and controls

41 lines (33 loc) · 1.47 KB

Write a Client Application {#ovms_docs_server_app}

---
maxdepth: 1
hidden:
---

Generative AI Use Cases <ovms_docs_clients_genai>
TensorFlow Serving API <ovms_docs_clients_tfs>
KServe API <ovms_docs_clients_kfs>
OpenVINO Model Server C-API <ovms_docs_c_api>

OpenVINO™ Model Server supports multiple APIs, for easy integration with systems using one of them for inference. The APIs are:

  • one compatible with TensorFlow Serving,
  • KServe API for inference
  • OpenAI API for text generation.
  • OpenAI API for embeddings
  • Cohere API for reranking

Both TFS and KServe APIs work on gRPC and REST interfaces. The REST API endpoints for generative use cases support both streamed and unary responses.

Check the following articles to learn more about the supported APIs:

In this section you can find short code samples to interact with OpenVINO Model Server endpoints via: