docs: add LLM Models example entry#282
Merged
mathieu-benoit merged 2 commits intoscore-spec:mainfrom Apr 24, 2026
Merged
Conversation
Signed-off-by: Abhishek <abhishekup082@gmail.com>
Abhishek9639
force-pushed
the
add-llm-models-example
branch
from
c2e2799 to
815fee6
Compare
Contributor
Author
|
Hi @matthieu-benoit, |
mathieu-benoit
requested changes
Apr 24, 2026
Contributor
mathieu-benoit
left a comment
mathieu-benoit
left a comment
There was a problem hiding this comment.
LGTM, thanks @Abhishek9639!
Just provided a few edit to do before merging please, thanks!
Signed-off-by: Abhishek <abhishekup082@gmail.com>
Contributor
Author
|
Hi @mathieu-benoit, |
Contributor
|
Now deployed there https://docs.score.dev/docs/examples/llm-models/ 🚀 
|
Contributor
Author
|
Hi @mathieu-benoit, |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Thank you for submitting this pull request! We appreciate you spending the time to work on these changes.
What is the motivation?
The Examples section currently doesn't have an entry for LLM Models. As discussed in #281, it would be helpful to show how to deploy local LLM models using score-compose, covering both Ollama and Docker Model Runner scenarios.
What does this change do?
Adds a new "LLM Models" example entry under
content/en/docs/examples/with three files:llm-models.md- Main page with overview, mermaid diagram, and score.yaml files for both scenariosincluded/llm-models-ollama.md- Step-by-step guide for the Ollama approachincluded/llm-models-dmr.md- Step-by-step guide for the Docker Model Runner approachThe content is ported from this blog post: https://medium.com/google-cloud/score-docker-compose-to-deploy-your-local-llm-models-10aff89686ce in a simpler format, following the same structure as the existing examples (Nginx, Backstage, etc.).
What is your testing strategy?
Verified the markdown structure matches the existing examples. Confirmed that the provisioner and patcher URLs point to valid files in the community-provisioners and community-patchers repos.
Is this related to any issues?
Closes #281
Have you read the Contributing Guidelines?