Skip to content
Snippets Groups Projects
Commit 884e1954 authored by Jacob Hoffmann's avatar Jacob Hoffmann
Browse files

Updated THREADS to 16

parent 1568f996
No related branches found
No related tags found
No related merge requests found
Hide whitespace changes
Inline Side-by-side
dev-code-gemma-small.yaml
+ 1
− 1
View file @ 884e1954
......@@ -8,7 +8,7 @@ config_file: |
backend: llama
f16: true
gpu_layers: 35
threads: 12
threads: 16
parameters:
model: downloads/llama_backend/codegemma-7b-it-f16.gguf
roles:
......
0% or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment

Help | Imprint | Privacy policy | Accessibility | Contact