Skip to content
Snippets Groups Projects
Commit 81df9d30 authored by Martin Forell's avatar Martin Forell
Browse files

Update dev-llama-3-large.yaml

parent 3db8e5e0
No related branches found
No related tags found
No related merge requests found
......@@ -9,7 +9,7 @@ config_file: |
f16: true
gpu_layers: 85
parameters:
model: downloads/llama_backend/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K
model: downloads/llama_backend/Llama-3.1-Nemotron-70B-Instruct-HF-Q6_K.gguf
template:
chat_message: |
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Finish editing this message first!
Please register or to comment