Data types

MODEL, CLIP, VAE, LATENT, IMAGE, CONDITIONING and the other kinds of data a link carries.

In plain words

Every link carries one kind of data, its type. The type decides which input can take the link. This page lists the types a newcomer meets in built-in nodes. Packs add their own.

The common types

TypeWhat it carriesComes fromGoes to
MODELThe diffusion model, the part that removes noise and drawsLoad Checkpoint, Load Diffusion Model, LoRA loaders, model tuning nodesSamplers, LoRA loaders, ModelSampling nodes
CLIPThe text encoder, the part that reads the promptLoad Checkpoint, Load CLIP, DualCLIPLoader, Load LoRACLIP Text Encode and other text nodes
VAEThe model that turns pixels into a latent and backLoad Checkpoint, Load VAEVAE Decode, VAE Encode, inpainting and video start nodes
CONDITIONINGAn encoded prompt plus any hints attached to it (ControlNet, area, guidance)Text nodes, ControlNet, guidance and combine nodespositive and negative inputs of samplers
LATENTA picture or video in compressed form; a video latent is compressed in time tooEmpty latent nodes (a video one has a length), VAE Encode, video start nodes, samplersSamplers, latent upscale, VAE Decode
IMAGEOrdinary pictures in pixels, always a batch (one or more)Load Image, VAE Decode, image nodesSave Image, Preview Image, VAE Encode, upscalers, ControlNet
MASKA black and white map of what to changeLoad Image, mask nodes, the mask editorInpainting nodes, SetLatentNoiseMask
CONTROL_NETA loaded ControlNet modelLoad ControlNet ModelApply ControlNet
UPSCALE_MODELA loaded upscale modelLoad Upscale ModelUpscale Image (using Model)
CLIP_VISION, CLIP_VISION_OUTPUTAn image encoder, and one picture encoded by itLoad CLIP Vision, CLIP Vision EncodeStyle, unCLIP and image to video nodes
SIGMAS, SAMPLER, GUIDER, NOISEThe parts of an assembled sampler: the noise schedule, the algorithm, the guidance, the starting noiseBasicScheduler, KSamplerSelect, CFGGuider or BasicGuider, RandomNoiseSamplerCustom, SamplerCustomAdvanced
VIDEO, AUDIOA finished clip, a soundCreate Video, Load Video, Load AudioSave Video, Get Video Components, audio nodes
INT, FLOAT, STRING, BOOLEAN, COMBOField values: whole number, decimal, text, yes or no, a choice from a listPrimitive and math nodesAny field of that type turned into an input

Typical mistakes

  • Trying to save a LATENT: decode it first with VAE Decode.
  • Feeding a video sampler the empty latent of a picture: the type is the same LATENT, so the link attaches, but a video needs a latent with a length. Use the empty latent or start node of the video family.
  • Plugging a CONDITIONING meant for negative into positive: the sampler then moves away from what you asked for.
  • Expecting a pack's type to fit a built-in input: WANVIDEOMODEL is not MODEL.

How the app helps

Select a link on the canvas and the Explain tab describes its type in plain words. Check names any link whose types do not match.

See also

This page is imported from the application repository's wiki (docs/wiki/concepts/Data-Types.md, revision b8e3f71). The same guide is built into the app: Help ▸ User guide.

To refresh it, run npm run import and then npm run build in the website folder.