Skip to content
Snippets Groups Projects
Commit 1568f996 authored by Jacob Hoffmann's avatar Jacob Hoffmann
Browse files

halved the context size to 30000

parent cea11a57
No related branches found
No related tags found
No related merge requests found
...@@ -5,7 +5,7 @@ description: | ...@@ -5,7 +5,7 @@ description: |
config_file: | config_file: |
name: dev-phi-3-mini name: dev-phi-3-mini
context_size: 60000 context_size: 30000
f16: true f16: true
backend: llama backend: llama
mmap: true mmap: true
......
0% Loading or .
You are about to add 0 people to the discussion. Proceed with caution.
Please register or to comment