Skip to content

Commit d6dfee4

Browse files
committed
Add support for tool calling for models returned by ollama local
1 parent 961faeb commit d6dfee4

1 file changed

Lines changed: 1 addition & 0 deletions

File tree

llms/main.py

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1400,6 +1400,7 @@ async def load_models(self):
14001400
"id": k,
14011401
"name": v.replace(":", " "),
14021402
"modalities": {"input": ["text"], "output": ["text"]},
1403+
"tool_call": True,
14031404
"cost": {
14041405
"input": 0,
14051406
"output": 0,

0 commit comments

Comments
 (0)