Skip to content
Snippets Groups Projects
Commit b7c6666e authored by Martin Forell's avatar Martin Forell
Browse files

Update file dev-phi-3-medium.yaml

parent db884ce4
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
Showing
with 2 additions and 2 deletions
dev-phi-3-medium.yaml
+ 2
− 2
View file @ b7c6666e
...@@ -5,11 +5,11 @@ description: | ...@@ -5,11 +5,11 @@ description: |
config_file: | config_file: |
name: dev-phi-3-medium name: dev-phi-3-medium
context_size: 40000 context_size: 20000
f16: true f16: true
backend: llama backend: llama
mmap: true mmap: true
threads: 12 threads: 64
gpu_layers: 40 gpu_layers: 40
parameters: parameters:
model: "downloads/llama_backend/Phi-3-medium-128k-instruct-Q6_K.gguf" model: "downloads/llama_backend/Phi-3-medium-128k-instruct-Q6_K.gguf"
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment

Help | Imprint | Privacy policy | Accessibility | Contact