Model families

SD 1.5, SDXL, Pony, Flux, Wan and the rest: what a family is, and the ones the app knows.

In plain words

A family (or base model) is a model architecture and its original training: SD 1.5, SDXL, Flux.1, Wan 2.2. Thousands of fine-tuned models and LoRAs are built on top of a few families. Everything inside one family shares the same latent format, the same text encoders and the same VAE, which is why its parts fit together, and why parts of different families do not (see Why families do not mix).

The family of a file tells you:

  • which loader nodes it needs (one checkpoint, or separate model, text encoder and VAE files);
  • which empty latent node and sizes;
  • which CFG and steps;
  • how to write the prompt (tags or sentences);
  • which LoRAs, ControlNets and VAEs fit.

The families the app knows

FamilyKindLoadingPrompt style
SD 1.5Pictures, 512 pxCheckpointTags
SDXLPictures, 1024 pxCheckpointTags, short phrases
PonyPictures, SDXL-basedCheckpointTags with score tags
IllustriousPictures, SDXL-based, animeCheckpointBooru tags
SD 3 / 3.5PicturesCheckpoint or separate, three encodersSentences
Flux.1PicturesSeparate: model, clip_l + t5xxl, ae VAESentences
Krea 2Pictures, its own architecture (FLUX.1 Krea [dev] is Flux.1)Separate: model, qwen3vl_4b, qwen_image_vaeSee the template
Flux.2Pictures and editingSeparate, its own encoder and VAESentences
ChromaPictures, from Flux.1 schnellSeparate, T5 onlySentences
Qwen-ImagePictures, text in pictures, editingSeparate, Qwen2.5-VL encoderSentences
Z-ImagePictures, fastSeparate, Qwen3 encoderSentences
KolorsPicturesIts own loaders (ChatGLM)Sentences
AuraFlowPicturesCheckpointSentences
Stable CascadePictures, in stagesStage checkpointsTags or phrases
Wan 2.1VideoSeparate, umt5 encoderSentences
Wan 2.2VideoSeparate; 14B as a pair of expertsSentences
HunyuanVideoVideoSeparate, clip_l + LLaVA-Llama3Sentences
LTX-2Video with soundIts own templateSentences

The app also recognises SD 2.x and PixArt files by name, without built-in texts about them.

How to tell a file's family

The file's name often says it (sdxl, flux1-dev, wan2.2). Many .safetensors files also carry metadata that names the base model. Download pages name it too.

How the app helps

The Models tab shows each file's Family (read from its header, or guessed from its name and marked as a guess); it can filter by family, and the card of a LoRA lists which of your models it fits. Check warns when files of different families meet in one path.

See also

This page is imported from the application repository's wiki (docs/wiki/concepts/Model-Families.md, revision b8e3f71). The same guide is built into the app: Help ▸ User guide.

To refresh it, run npm run import and then npm run build in the website folder.