What is SillyTavern (docs.ST.app)?

Updated

SillyTavern (ST) is a locally installed user interface for interacting with text-generation LLMs, image-generation engines, and TTS voice models. It is aimed at power users who want maximum control over LLM prompts and are willing to accept a steep learning curve. According to the official documentation at docs.ST.app, it is a community-driven passion project that is always free and open-source, and it began in February 2023 as a fork of TavernAI 1.2.8.

What SillyTavern actually is

SillyTavern is a frontend only. It does not provide inference by itself — you connect it to an LLM backend. The docs describe it as a locally installed interface whose goal is to give users as much utility and control over prompts as possible.

It works with three kinds of models:

  • Text generation LLMs — the core use case
  • Image generation engines
  • TTS voice models

Who it is for

The documentation is explicit that SillyTavern embraces a steep learning curve "as part of the fun." It positions itself for savvy AI hobbyists rather than casual users. If you want a simple chat box, this is more machinery than you need; if you want fine-grained control over prompts and backends, that is the point.

What you need besides SillyTavern

Because ST is only an interface, you need access to an LLM backend for inference. The docs list these options:

Backend option Notes from the docs
AI Horde Instant out-of-the-box chatting
OpenAI-compatible API Supported
KoboldAI Supported
Tabby Supported
Others "many more" — see the API Connections section

Installation requirements

The hardware bar is low: it runs on anything that can run NodeJS 20 or higher. If you plan to run LLM inference on your own machine, the docs recommend a 3000-series NVIDIA graphics card with at least 6GB of VRAM.

Installation guides are provided per platform: Windows, Linux and Mac, Android, and Docker.

Branches: which one to use

SillyTavern develops on a two-branch system:

  • release — Recommended for most users. The most stable branch, updated only when major releases are pushed, typically once a month.
  • staging — Not recommended for casual use. Latest features, but may break at any time. For power users and enthusiasts; updates several times daily.

If you just want it to work, use release.

Character cards

SillyTavern is built around character cards. A character card is a collection of prompts that set the behavior of the LLM, and it is required for persistent conversations in SillyTavern. The docs compare them to ChatGPT's GPTs or Poe's bots. Card content can be anything: an abstract scenario, a task-specific assistant, a famous personality, or a fictional character.

Project status and cost

  • Free and open-source, per the official docs ("will always be free and open-sourced")
  • Started February 2023 as a fork of TavernAI 1.2.8
  • Over 300 contributors and 3 years of independent development, as stated on the page
  • Maintained by a dedicated community of LLM enthusiasts

Where to go next

docs.ST.app is the reference site: it hosts the "What is SillyTavern?" overview, screenshots, installation requirements, branch descriptions, and the API Connections section for supported backends. Start there if you need the current, authoritative version of any of the details above.