Parcourir la source

docs: ollama num_ctx (#3111)

Aiden Cline il y a 6 mois
Parent
commit
83afcb9c42
1 fichiers modifiés avec 4 ajouts et 0 suppressions
  1. 4 0
      packages/web/src/content/docs/providers.mdx

+ 4 - 0
packages/web/src/content/docs/providers.mdx

@@ -526,6 +526,10 @@ In this example:
 - `options.baseURL` is the endpoint for the local server.
 - `models` is a map of model IDs to their configurations. The model name will be displayed in the model selection list.
 
+:::tip
+If tool calls aren't working, try increasing num_ctx in Ollama. Start around 16k-32k.
+:::
+
 ---
 
 ### OpenAI