- Serving Quick Start - Basic server usage tutorial
- Model Archive Quick Start - Tutorial that shows you how to package a model archive file.
- Installation - Installation procedures and troubleshooting
- Serving Models - Explains how to use
torchserve.- REST API - Specification on the API endpoint for TorchServe
- Packaging Model Archive - Explains how to package model archive file, use
model-archiver. - Logging - How to configure logging
- Metrics - How to configure metrics
- Advanced settings - Describes advanced TorchServe configurations.
- Custom Model Service - Describes how to develop custom inference services.
- Unit Tests - Housekeeping unit tests for TorchServe.
- Benchmark - Use JMeter to run TorchServe through the paces and collect benchmark data.