A Cheshire Cat plugin for fix Langchain's Ollama class
The langchain integrations is a very mess, espcialy with Ollama where they Hard coded the list of stop strings!
This creates problems with the inference by generating endless tokens .-.
generated from cheshire-cat-ai/plugin-template
-
Notifications
You must be signed in to change notification settings - Fork 0
valentimarco/Ollama-Fix
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
A CheshireCat plugin to fix stop inference strings
Resources
Stars
Watchers
Forks
Packages 0
No packages published