🐳 🐙 Docker Compose Tip #60
LLMs as first-class citizens in Compose!
models:
smollm:
model: ai/smollm2
services:
app:
models:
- smollm
Endpoint URL injected automatically.
Guide: lours.me/posts/compose-tip-060-models-section/
#Docker #Compose #AI #LLM
lours.me
Docker Compose Tip #60: Declaring LLMs with the models section
Declare and connect LLMs to your services using the new Compose models top-level key