STABLE DIFFUSION GUIDANCE SCALE

Have you ever felt like your AI-generated images just weren't quite hitting the mark?Like they were missing that special something to truly capture the vision in your head?Chances are, the answer lies within a deceptively simple setting called the Guidance Scale, also known as the Classifier-Free Guidance (CFG) scale. Guidance scale controls how similar the generated image will be to the prompt. A higher guidance scale means the model will try to generate an image that follows the prompt more strictly. A lower guidance scale means the model will have more creativity.This seemingly small parameter wields immense power, acting as the conductor of an orchestra, harmonizing the balance between creative freedom and prompt adherence in Stable Diffusion.It’s the knob you need to turn to fine-tune the magic.Imagine it as a volume control for your prompt – crank it up to force the AI to follow your instructions to the letter, or dial it down to let its imagination run wild. This paragraph delves into the practical application of the guidance scale (CFG scale) for refining the output of stable diffusion models. It instructs viewers on how to use the XYZ plot script in the Automatic 1111 interface to systematically test different CFG scale values and observe the impact on the generated images.But where do you start?What numbers do you use?And what even *is* Classifier-Free Guidance anyway? Stable Diffusionにおいて、「guidance_scale」というパラメーターが画像生成にどのような影響を与えるのか、興味がある方も多いのではないでしょうか？This comprehensive guide will demystify the Stable Diffusion guidance scale, providing you with the knowledge and practical steps to unlock the full potential of your AI art creation. Best way to find out what scale does is to look at some examples! Here's a good resource about SD, you can find some information about CFG scale in studies section. Also, here's a more technical explanation .We’ll explore its function, optimal ranges, and how to use it to achieve the exact results you desire, transforming your creative vision into stunning visual realities.

What is the Stable Diffusion Guidance Scale (CFG)?

The guidance scale, or CFG scale, is a crucial parameter within Stable Diffusion that controls how closely the generated image adheres to the text prompt you provide. CFG（Classifier-Free Guidance） 用于控制Stable Diffusion在采样期间应遵循提示词的严格程度。几乎所有稳定扩散 AI 图像生成器都提供了此参数设置。今天我们重点来看看在Stable Diffusion中CFG参数相关内容。 一. CFG是什么. 我们先以一个实例来看看CFG在不同参数值时的效果。Think of it as the dial that dictates the relationship between your instructions and the AI's interpretation. Guidance scale Stable Diffusion, or classifier-free guidance scale (CFG), is a parameter used in artificial intelligence (AI) to determine how much an AI art generation process adheres to the text prompt. It is a specific number, or value, that represents the importance of a text prompt or description of an image that is generated with AI.It dictates the extent to which Stable Diffusion considers the text prompt during the image generation process. The Classifier-Free Guidance (CFG) scale controls how closely a prompt should be followed during sampling in Stable Diffusion. It is a setting available in nearly all Stable Diffusion AI image generators.Essentially, it's the lever that controls the ""creativity vs. prompt"" balance.

A higher guidance scale encourages the model to create an image that very closely mirrors your prompt.This can be extremely useful when you have a specific image in mind and need the AI to follow your instructions precisely.On the other hand, a lower guidance scale gives the model more creative liberty. guidance_scale 前面的所有示例统称为guidance_scale。guidance_scale是一种增加对指导生成（如文本）以及总体样本质量的条件信号的依从性的方法。它也被称为无分类器引导，简单地说，调整它可以更好的使用图像质量更好或更具备多样性。It allows for more artistic interpretation, leading to potentially more diverse and unexpected results.

In short, the CFG scale allows you to fine-tune the image generation process and achieve the perfect balance between precision and creativity.

How Does the Guidance Scale Work?

The technical details behind the guidance scale involve complex mathematical processes within the diffusion model.However, the core concept is relatively straightforward. What is the CFG Scale? Like Seed, the classifier-free guidance scale (CFG Scale) is one of the additional settings found in the Stable Diffusion model. The CFG scale adjusts how much the image looks closer to the prompt and/ or input image.It works by influencing the sampling process during image generation.

Classifier-Free Guidance (CFG) is a technique used to improve the quality and controllability of generated images. 什么是Guidance Scale？ Guidance Scale（引导比例）是指在生成图像时，生成图像与输入提示之间的紧密程度和输入多样性之间的权衡。它是用来调整生成图像的质量和多样性之间的平衡点的参数。Guidance Scale的典型值约为7.5。 Guidance Scale的作用Without CFG, the model simply generates images based on the training data, which can lead to unpredictable and often undesirable results. In Stable Diffusion, CFG stands for Classifier Free Guidance scale. CFG is the setting that controls how closely Stable Diffusion should follow your text prompt . It is applied in text-to-image (txt2img) and image-to-image (img2img) generations.CFG addresses this issue by training the model to generate images both with and without the text prompt. Scale is the strength of the guidance scale parameter you apply to the prompt. The higher the value it is, the more you tell the computer to literally follow your text prompt. The lower it is, the more you give creative freedom to the randomness.This allows the model to understand the difference between a guided and unguided generation.

The guidance scale then acts as a multiplier, amplifying the difference between the guided and unguided generations.This effectively ""steers"" the generation process towards the desired outcome, as defined by the prompt. 在Stable Diffusion攻略中，Guidance Scale是一个用于衡量生成的图像与输入提示之间的紧密程度和输入的多样性的权衡因素。这个值的典型范围在7.5左右。 Guidance Scale的作用是控制生成图像的质量和多样性之间的平衡。A higher scale means a stronger steering force, resulting in an image that is more closely aligned with the prompt.

The formula below is a mathematical representaiton on the idea:

Total guidance = CFG scale + PAG scale

Finding the Right Guidance Scale: Examples and Best Practices

The ideal guidance scale value varies depending on the specific prompt, the desired outcome, and even the version of Stable Diffusion you are using.However, some general guidelines can help you find the sweet spot.

• Default Values: Many Stable Diffusion implementations use a default guidance scale of around 7 or 7.5.OpenArt also uses 7 as their default CFG, which they claim gives the best balance.This value often provides a good balance between prompt adherence and creative freedom, serving as a great starting point for your explorations.
• General Range: A common range for the guidance scale is between 7 and 15.However, don't be afraid to experiment outside of this range to discover what works best for your specific needs.Some users have found success with values as low as 3 or as high as 20, depending on their artistic goals.
• Low Guidance Scale (e.g., 3-6): Use lower values when you want the AI to have more creative freedom and generate more diverse results. Guidance Scale. The Guidance Scale, or Classifier-Free Guidance (CFG) scale, influences the degree to which Stable Diffusion adheres to the provided text prompt during image generation. A higher value on the Guidance Scale indicates stricter adherence to the input text. However, it also limits creative liberty, potentially yielding less diverseThis is great for generating abstract art, stylized images, or when you're not entirely sure what you want the final image to look like. Guidance Scale是Stable Diffusion中一个重要的概念，用于衡量生成的图像与输入提示之间的紧密程度和输入的多样性之间的权衡关系。 在使用Stable Diffusion进行图像生成时，用户可以通过调整Guidance Scale的值来控制生成图像的质量和多样性。It gives the AI greater freedom to add elements, interpret details, and deviate from the prompt in surprising ways.
• High Guidance Scale (e.g., 10-15): Opt for higher values when you need the AI to follow your prompt very closely.This is useful for generating realistic images, replicating specific styles, or when you have a very clear vision in mind.Be cautious, though, as excessively high values can lead to unnatural looking images with oversaturated colors or other artifacts.

Practical Examples:

Let's consider a few examples to illustrate the impact of the guidance scale:

1. Prompt: ""A majestic castle on a hilltop, surrounded by a lush forest.""
   • Guidance Scale 3: The generated image might feature a castle, but it could be stylized, abstract, or even blended into the landscape in unexpected ways.The forest might be more fantastical or dreamlike.
   • Guidance Scale 7: You'll likely get a recognizable castle on a hilltop, with a realistic-looking forest. guidance_scale (float, optional, defaults to 7.5) Guidance scale as defined in Classifier-Free Diffusion Guidance. guidance_scale is defined as w of equation 2. of Imagen Paper. Guidance scale is enabled by setting guidance_scale 1.The image will closely resemble the prompt, but the AI will still have some room for interpretation.
   • Guidance Scale 12: The image will very precisely reflect the prompt. Le CFG Scale, ou Classifier-Free Guidance Scale, est donc param tre crucial pour exploiter pleinement le potentiel de Stable Diffusion. J esp res qu en vous aidant mieux comprendre son fonctionnement du CFG Scale et son impact sur la g n ration d image, vous pourrez affiner votre utilisation de Stable Diffusion et cr er des imagesThe castle will be highly detailed and realistic, and the forest will accurately depict a lush environment. 什么是Guidance Scale？ Guidance Scale，或者称为指导尺度，是在生成图像和输入提示之间取得平衡的关键参数。这个概念在深度学习生成模型中扮演着重要的角色，尤其在稳定扩散（Stable Diffusion）领域中。 达到平衡. Guidance Scale决定了生成图像的质量与多样性之间的However, the image might lack originality or have a somewhat artificial feel.
2. Prompt: ""A cyberpunk cityscape at night, neon lights, flying cars.""
   • Guidance Scale 3: The image could be a colorful, abstract representation of a city, possibly with hints of neon and futuristic elements. The Guidance Scale, also known as the Classifier-Free Guidance (CFG) scale, controls how closely Stable Diffusion adheres to the provided text prompt during the image generation process. In other words, it determines the extent to which the generated image reflects the input text.The flying cars might be subtly implied or absent altogether.
   • Guidance Scale 7: A clearly defined cyberpunk cityscape with prominent neon lights and identifiable flying cars. Best Settings for SDXL 1.0: Guidance, Schedulers, and Steps. To harness the full potential of SDXL 1.0, it's crucial to understand its optimal settings: Guidance Scale. Understanding Classifier-Free Diffusion Guidance. Diffusion models are powerful tools for generating samples, but controlling their quality and diversity can be challenging.The image would capture the essence of the prompt while allowing for some artistic interpretation in the details.
   • Guidance Scale 12: The generated image will present a highly detailed and realistic cyberpunk city with vibrant neon signs, meticulously rendered flying cars, and a strong adherence to the specific elements mentioned in the prompt. 在Stable Diffusion中，guidance_scale的值通常介于7和8.5之间，这被认为是稳定扩散的较好选择。 通过增加guidance_scale的值，可以提高生成文本的多样性，使生成的文本更具有创造性和变化性。However, it might appear somewhat generic or lack a unique artistic flair.

Testing Different CFG Scales with XYZ Plot

One of the best ways to understand how the guidance scale affects your images is to experiment with different values and compare the results. 下图为 guidance_scale 为 1 ， 3 ， 5 ， 7 ， 9 和 11 下生成的图像对比，可以看到当 guidance_scale 较低时生成的图像效果是比较差的，当 guidance_scale 在 7 ～ 9 时，生成的图像效果是可以的，当采用更大的 guidance_scale 比如 11 ，图像的色彩过饱和而看起来不自然，所以 SDA convenient tool for this is the XYZ plot script, available in popular Stable Diffusion interfaces like Automatic1111.

The XYZ plot script allows you to automatically generate a grid of images with varying parameters. 日々Stable Diffusionで2次元美少女の錬成に精を出しているみなさん向け記事です。 前記事でSampling Stepsについて書きましたが、今回はもう一つのプロパティ、Guidance Scaleについて確認していきます。 Guidance Scaleってなんなのさ？ 説明を直訳すると「画像がプロンプトにどの程度従うべきかYou can set the X-axis to the guidance scale, and then specify a range of values you want to test. 在Stable Diffusion中，Guidance Scale（引导比例）是指生成的图像与输入提示的紧密程度与输入的多样性之间的权衡。 它的典型值在7.5左右。 Guidance Scale的作用是调整生成图像的质量和多样性之间的平衡。The script will then generate images for each value in the range, allowing you to easily compare the effects of different guidance scales.

Here's how to use the XYZ plot script:

1. Open your Stable Diffusion interface (e.g., Automatic1111).
2. Navigate to the ""Script"" dropdown menu.
3. Select ""XYZ plot.""
4. In the ""X type"" dropdown, choose ""CFG Scale.""
5. Enter the desired range of CFG scale values in the ""X values"" field, separated by commas (e.g., 3, 5, 7, 9, 11).
6. Enter your desired prompt in the prompt box.
7. Adjust the other parameters as needed (e.g., sampling method, steps).
8. Click ""Generate.""

The script will generate a grid of images, with each image corresponding to a different CFG scale value.You can then visually compare the images and identify the value that produces the best results for your specific prompt and artistic vision.

Guidance Scale and Other Parameters: Finding the Perfect Synergy

The guidance scale doesn't operate in isolation.It interacts with other parameters in Stable Diffusion, such as the sampling method, the number of sampling steps, and the prompt itself. The guidance scale, also known as the Classifier-Free Guidance (CFG) scale, is a setting within Stable Diffusion that determines how closely the generated image adheres to the text prompt. Essentially, it acts as a control knob that adjusts the level of adherence between the AI-generated image and your written description.Understanding these interactions can help you achieve even better results.

• Sampling Steps: Increasing the number of sampling steps can improve the quality and detail of the generated image.However, it also increases the processing time. Mathematically, the total guidance during sampling is: Total guidance = CFG scale PAG scale. That s why the default setting is a CFG scale of 4 and PAG scale of 3, summing up to 7, a widely used CFG value. Use PAG on ComfyUI. ComfyUI has native support for the Perturbed Attention Guidance node.When using a higher guidance scale, you might need to increase the number of sampling steps to avoid artifacts or unnatural-looking results.
• Sampling Method: Different sampling methods can produce different results, even with the same guidance scale and prompt.Experiment with different sampling methods to find the one that works best for your specific needs.
• Prompt Engineering: The quality and clarity of your prompt have a significant impact on the final image.A well-written and detailed prompt will allow the guidance scale to work more effectively, leading to more accurate and desirable results. CFG scale, or Classifier Free Guidance scale, is a parameter that controls the guidance provided to stable diffusion processes. It is used in different applications, including text-to-image (txt2img) and image-to-image (img2img) generations.Use descriptive language, specific details, and keywords relevant to your desired image.
• Seed: Using a specific seed allows you to reproduce the same image multiple times, which is useful for fine-tuning parameters like the guidance scale.By keeping the seed constant, you can isolate the effect of the guidance scale and accurately assess its impact on the image.

Common Mistakes to Avoid

While the guidance scale is a powerful tool, it's easy to make mistakes that can hinder your results.Here are some common pitfalls to avoid:

• Using an excessively high guidance scale: As mentioned earlier, using a very high guidance scale can lead to unnatural-looking images with oversaturated colors or other artifacts. CFG guidance scale. This parameter can be seen as the Creativity vs. Prompt scale. Lower numbers give the AI more freedom to be creative, while higher numbers force it to stick more to the prompt. The default CFG used on OpenArt is 7, which gives the best balance between creativity and generating what you want.It can also stifle the AI's creativity and result in generic or uninspired images.
• Using an excessively low guidance scale: Conversely, using a very low guidance scale can result in images that are too abstract or deviate too far from the prompt. はじめにこの記事は、Stable DiffusionのClassifier Free Guidance(以下、CFG)の簡単な仕組みの説明記事です。対象読者Stable Diffusionで普This can be frustrating if you have a specific vision in mind.
• Ignoring the prompt: The guidance scale cannot compensate for a poorly written or unclear prompt.Make sure your prompt is well-defined and includes all the necessary details to guide the AI effectively.
• Not experimenting: The best way to learn how to use the guidance scale is to experiment with different values and observe the results.Don't be afraid to try different settings and see what works best for your specific needs.
• Not considering other parameters: The guidance scale interacts with other parameters, such as the sampling method and the number of steps. CFGスケール（Classifier Free Guidance Scale）は、近年話題のStable Diffusionという画像生成モデルにおいて重要な概念です。このスケールは、生成される画像がどの程度入力されたプロンプトや画像に忠実になるかを決定するパラメータです。Make sure to adjust these parameters in conjunction with the guidance scale to achieve optimal results.

Guidance Scale in Different Stable Diffusion Implementations

The guidance scale parameter is available in virtually all Stable Diffusion AI image generators. The Classifier-Free Guidance (CFG) scale controls how closely a prompt should be followed during sampling in Stable Diffusion. It is a setting available in nearly all Stable Diffusion AI image generators. This post will teach you everything about the CFG scale in Stable Diffusion.While the core function remains the same, the specific implementation and user interface may vary slightly depending on the software you are using.

Popular Stable Diffusion implementations include:

• Automatic1111: A widely used and highly customizable web UI for Stable Diffusion. 在使用Stable Diffusion web UI、ComfyUI等进行生图的时候，提示词引导系数 (CFG Scale)是常用设置参数之一，那么你了解过CFG Scale是什么吗？今天就代大家了解一下CFG Scale，让大家以后在SD生图的时候更容易设置该参数。 提示词引导系数 (CFG ScIt offers a wide range of features and extensions, including the XYZ plot script for easy experimentation with different parameters.
• ComfyUI: A node-based interface for Stable Diffusion that provides a more visual and flexible workflow.It offers powerful control over the image generation process and allows for complex workflows.
• Web-based platforms: Numerous web-based platforms offer Stable Diffusion image generation services. Optimize your Stable Diffusion results with the CFG scale (guidance scale). Learn the best practices for using guidance scale from our step-by-step guide.These platforms often provide a simplified interface and are a convenient option for users who don't want to install and configure Stable Diffusion locally.

Regardless of the implementation you are using, the key principles of the guidance scale remain the same. The image generated from Stable Diffusion v1.5 under different guidance scale. Image source: you may check this line of stable diffusion pipeline from Hugging Face diffusers.Experiment with different values, observe the results, and find the settings that work best for your specific artistic vision.

Advanced Techniques with Guidance Scale

Once you have a solid understanding of the basics, you can explore more advanced techniques to further refine your image generation process.

• Dynamic CFG Scale: Some advanced workflows allow you to dynamically adjust the CFG scale during the image generation process.This can be used to create images with varying levels of detail or to achieve specific artistic effects.
• Attention Guidance: Techniques like Perturbed Attention Guidance (PAG), especially in ComfyUI, can be used in conjunction with the CFG scale to further refine the image generation process.PAG allows you to influence the AI's attention during image generation, leading to more precise control over the final output.
• Combining with other ControlNets: Use with other control nets, can give very specific control over the image generated.

Conclusion: Mastering the Stable Diffusion Guidance Scale

The Stable Diffusion guidance scale is a powerful tool that allows you to fine-tune the balance between prompt adherence and creative freedom in your AI-generated images.By understanding how the guidance scale works, experimenting with different values, and considering its interactions with other parameters, you can unlock the full potential of Stable Diffusion and bring your creative visions to life.Remember that the ideal guidance scale is subjective and depends on your specific goals.There’s no single “right” answer; the best value is the one that produces the results you desire.

Key Takeaways:

• The guidance scale (CFG scale) controls how closely Stable Diffusion adheres to your text prompt.
• A higher guidance scale results in images that closely match the prompt, while a lower scale allows for more creative freedom.
• The common range for the guidance scale is between 7 and 15, but you should experiment to find the optimal value for your needs.
• Use the XYZ plot script to easily compare the effects of different guidance scales.
• The guidance scale interacts with other parameters, such as the sampling method and the number of steps.
• Avoid using excessively high or low guidance scales, as this can lead to undesirable results.

So, go forth and experiment!Explore the possibilities, and discover the perfect guidance scale to unlock your artistic potential with Stable Diffusion.What you discover may surprise you!