Skip to content
Snippets Groups Projects
Commit 884e1954 authored by Jacob Hoffmann's avatar Jacob Hoffmann
Browse files

Updated THREADS to 16

parent 1568f996
Branches main
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
dev-code-gemma-small.yaml
+ 1
− 1
View file @ 884e1954
...@@ -8,7 +8,7 @@ config_file: | ...@@ -8,7 +8,7 @@ config_file: |
backend: llama backend: llama
f16: true f16: true
gpu_layers: 35 gpu_layers: 35
threads: 12 threads: 16
parameters: parameters:
model: downloads/llama_backend/codegemma-7b-it-f16.gguf model: downloads/llama_backend/codegemma-7b-it-f16.gguf
roles: roles:
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment

Help | Imprint | Privacy policy | Accessibility | Contact