Installation

Using pip

The easiest way to install llms.py is via pip:

pip install llms-py

Using Docker

Quick Start

Run the server on port 8000:

docker run -p 8000:8000 -e GROQ_API_KEY=$GROQ_API_KEY \
    ghcr.io/servicestack/llms:latest

Get the latest version:

docker pull ghcr.io/servicestack/llms:latest

Using Docker Compose (Recommended)

Download the docker-compose.yml file:

curl -O https://raw.githubusercontent.com/ServiceStack/llms/refs/heads/main/docker-compose.yml

Update API Keys in docker-compose.yml then start the server:

docker-compose up -d

Build from Source

git clone https://github.com/ServiceStack/llms
docker compose -f docker-compose.local.yml up -d --build

After the container starts, you can access the UI and API at http://localhost:8000.

Verify Installation

After installation, verify that llms.py is working:

# Check version
llms --help

# Initialize configuration
llms --init

This will create a default configuration file at ~/.llms/llms.json.

Next Steps

• Quick Start Guide - Get up and running quickly
• Configuration - Configure providers and models
• API Keys - Set up your API keys