Skip to content

Commit

Permalink
fix(tinyllama): adjust ctx+maxtok
Browse files Browse the repository at this point in the history
  • Loading branch information
hahuyhoang411 committed Dec 15, 2023
1 parent 2d63efd commit a09a486
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions models/tinyllama-1.1b/model.json
Original file line number Diff line number Diff line change
Expand Up @@ -7,11 +7,11 @@
"description": "The TinyLlama project, featuring a 1.1B parameter Llama model, is pretrained on an expansive 3 trillion token dataset. Its design ensures easy integration with various Llama-based open-source projects. Despite its smaller size, it efficiently utilizes lower computational and memory resources, drawing on GPT-4's analytical prowess to enhance its conversational abilities and versatility.",
"format": "gguf",
"settings": {
"ctx_len": 4096,
"ctx_len": 2048,
"prompt_template": "<|system|>\n{system_message}<|user|>\n{prompt}<|assistant|>"
},
"parameters": {
"max_tokens": 4096
"max_tokens": 2048
},
"metadata": {
"author": "TinyLlama",
Expand Down

0 comments on commit a09a486

Please sign in to comment.