DeepFloyd IF: A Novel State-of-the-Art Open-Source Text-to-Image Model by StabilityAI

DeepFloyd IF is a modular, state-of-the-art open-source text-to-image model composed of a frozen text encoder and three cascaded pixel diffusion modules. It generates highly photorealistic images based on a given text prompt, utilizing a UNet architecture enhanced with cross-attention and attention pooling. The model is highly efficient and outperforms current state-of-the-art models, achieving a zero-shot FID score of 6.66 on the COCO dataset. The IF model has multiple modes such as Dream, Style Transfer, Super Resolution, Inpainting and more. The model is available for use with certain minimum requirements and the code is released under a bespoke license with known limitations and biases.