CSGHub is an open-source large model platform just like on-premise version of Hugging Face. You can easily manage models and datasets, deploy model applications and setup model finetune or inferenc…

This repository provides installation scripts and configuration files for deploying the CSGHub instance, includes Helm charts and Docker Compose scripts to streamline the deployment process in vari…

LLM scheduler user interface

csghub-server is the backend server for CSGHub which helps user to manage datasets, modes, and also run Model Inference, Finetune and Application Spaces.

llm-inference is a platform for publishing and managing llm inference, providing a wide range of out-of-the-box features for model deployment, such as UI, RESTful API, auto-scaling, computing resou…

LLM 推理服务性能测试