Replies: 1 comment
-
Hi @pwyang123 |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
nomic-embed-text-v1.5.Q8_0.gguf claims to reach 8192 context length, but AutoGGUFEmbeddings loaded with this model still have only 512 context length even model was setNCtx(8191) and model attribute nCtx has 8191 as value. any advice on how to config model to be able to increase context length would be appreciated, thanks.
pipeline snippet:
Beta Was this translation helpful? Give feedback.
All reactions