how to run with local LLM

[viegoxu01]

I have run a vllm proxy server with my fine-tuned local llm, and have the URL for the vLLM proxy server. How can I use it within Knowleadge-Table in the same way as OpenAI servers. THX

[daboe01]

ollama-support would be fine.

[WR-CREATOR]

ollama-support would be fine.

Can you share your fork? I tried using ollama but it gives me a validation error when I run it.