Skip to content

llama.cpp model provider support #585

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 12 commits into from
Sep 10, 2025
Merged

llama.cpp model provider support #585

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
12 commits
Select commit Hold shift + click to select a range
cc26ba7
Initial commit with llamacpp module;
westonbrown Jul 30, 2025
71e80d2
Updated llamacpp integration to better align with ollama implementation;
westonbrown Jul 31, 2025
edf445d
fixed ruff liniting, black formatting and refined grammar support;
westonbrown Jul 31, 2025
abbc460
fixed tool calling bug;
westonbrown Jul 31, 2025
0fe0249
fix to bug 565;
westonbrown Aug 4, 2025
aed40e2
Revert "fix to bug 565;"
westonbrown Aug 4, 2025
e654cdc
Merge upstream main branch
westonbrown Aug 14, 2025
9cf8e25
Removed public grammar/schema methods, now use standard params pattern;
westonbrown Aug 18, 2025
02e5553
cleaned up README per feedback;
westonbrown Aug 18, 2025
7a9e462
Removed LlamaCppModel from models/__init__.py;
westonbrown Aug 18, 2025
5fd3c35
Refactor integration tests to flat functions matching other provider …
westonbrown Aug 18, 2025
11e6c11
Grammar constraints via params example refined;
westonbrown Aug 18, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -129,6 +129,7 @@ from strands import Agent
from strands.models import BedrockModel
from strands.models.ollama import OllamaModel
from strands.models.llamaapi import LlamaAPIModel
from strands.models.llamacpp import LlamaCppModel

# Bedrock
bedrock_model = BedrockModel(
Expand Down Expand Up @@ -159,6 +160,7 @@ Built-in providers:
- [Amazon Bedrock](https://strandsagents.com/latest/user-guide/concepts/model-providers/amazon-bedrock/)
- [Anthropic](https://strandsagents.com/latest/user-guide/concepts/model-providers/anthropic/)
- [LiteLLM](https://strandsagents.com/latest/user-guide/concepts/model-providers/litellm/)
- [llama.cpp](https://strandsagents.com/latest/user-guide/concepts/model-providers/llamacpp/)
- [LlamaAPI](https://strandsagents.com/latest/user-guide/concepts/model-providers/llamaapi/)
- [Ollama](https://strandsagents.com/latest/user-guide/concepts/model-providers/ollama/)
- [OpenAI](https://strandsagents.com/latest/user-guide/concepts/model-providers/openai/)
Expand Down
Loading
Loading