科技感SDXL config ComfyUI Fast generation 4GB vRAM (refiner)

此模型的原作者为「@Pechista」,我们致力于推动原创模型的分享和交流,因此转载了该模型、供大家非商用地交流、学习使用。请使用该模型的用户,遵守原作者所声明的使用许可。

如果您是该模型的原作者,请与我们联系,我们期待您入驻、并将第一时间把模型转移至您的账号中。如您不希望在 分享该模型,我们也将遵循您的意愿在第一时间下架您的模型。

我们尊重每一位模型原创作者,更期待与每一位模型作者共同成长!

声明:若该转载模型引发知识产权纠纷或其他侵权行为,我们将立即下架模型,并不会向原作者追责。

Hey guys,

I was trying SDXL 1.0 but my laptop with a RTX 3050 Laptop 4GB vRAM was not able to generate in less than 3 minutes, so I spent some time to get a good configuration in ComfyUI, now I get can generate in 55s (batch images) - 70s (new prompt detected) getting a great images after the refiner kicks in.

Is the best balanced I could find between image size (1024x720), models, steps (10+5 refiner), samplers/schedulers, so we can use SDXL on our laptops without those expensive/bulky desktop GPUs.

I wanted to share my configuration for ComfyUI, since many of us are using our laptops most of the time. I think this is the best balanced I could find.

Add params in "run_nvidia_gpu.bat" --normalvram --fp16-vae

Face fix fast version?:

SDXL has many problems for faces when the face is away from the "camera" (small faces), so this version fixes faces detected and takes 5 extra steps only for the face.

Face fix no fast version?:
For fix face (no fast version), faces will be fixed after the upscaler, better results, specially for very small faces, but adds 20 seconds compared to fast version.

If the face fix output does not generate a different image (maybe you are using a 4x upscaler), and console prints " segment skip [determined upscale factor=0.9875809267424535] " , in module "FaceDetailer" increase "guide_size" from 1280 to 1408 or more until it activates the FaceDetailer.

Difference between LORA and LORA fast?:

If you choose LORA fast, you can save 20-30 seconds.

The LORA fast does not have 3 extra steps after refiner to retouch the LORA effect, refiner dims the effect of the LORAs, in some cases for LORA with custom styles is needed the last 3 steps to add again the effect. Not needed in most cases, recommended for LORAs with custom styles were styles changes a lot the image.

Generation time (after first image):

No LORA: 55-60 seconds

With LORA: 85-115 seconds

With LORA Fast: 75-80 seconds

With face fix: 80 seconds (fix faces FAST) - 110 seconds (Fix faces slow version)


Files to Download:

  • Refiner SDXL 1.0 : https://huggingface.co/stabilityai/stable-diffusion-xl-refiner-1.0

  • Model Dreamshaper SDXL 1.0 (or any other) : https://civitai.com/models/112902/dreamshaper-xl10

  • Fixed SDXL VAE 16FP: https://huggingface.co/madebyollin/sdxl-vae-fp16-fix ( config.json , diffusion_pytorch_model.safetensors and sdxl_vae.safetensors files inside the same folder under VAE/).

  • Upscale model (RealESRGAN or Swin2SR):
    https://github.com/xinntao/Real-ESRGAN/releases/download/v0.2.1/RealESRGAN_x2plus.pth

    https://github.com/mv-lab/swin2sr/releases/download/v0.0.1/Swin2SR_Lightweight_X2_64.pth

  • For the LORA version: https://civitai.com/models/117635/greg-rutkowski-style-lora-sdxl

  • For face fix version ( FaceDetailer ):
    ComfyUI/models/sams: https://dl.fbaipublicfiles.com/segment_anything/sam_vit_b_01ec64.pth



This version is faster, fixes faces before upscale.

AI模型详情

模型类型:Other
基础算法:基础算法 XL
触发词:
文件格式: zip
最近更新:2024-02-10 01:27
创作相关
允许下载:
严禁转载:
会员专享下载:
作者原创:
转载来源: liblib
转载说明: 该模型及相关图片信息可能涉及来源于其他开源社区或由用户自行上传发布,非原创作者,如需商业使用请联系原作者。
郑重声明:本模型仅用于练习使用模型,如需商业请与原作者联系获取版权许可等,互联网鼓励用户分享作品,并坚决保护创作者的版权信息,模型、图片、素材资源的版权均为原创作者所有。
免责声明: 您基于本模型服务生成的文本内容由您自行维护并对其独立判断后使用,您需在遵守适用法律法规和本服务条款的条件下使用,基于本服务生成内容产生的任何知识产权问题由您自行处理,您需对生成内容负责,本网站对由此造成的任何损失不负责任。除法律法规另有规定外。
版权说明: 本网站部分素材、模型、图片等信息基于用户自行上传和分享,此资源来源于网络,如涉及版权问题,请及时与本网站联系,如需删除收到通知响应后,会在处理后下架删除。

讨论列表 共有 0 条讨论

暂无评论信息...
为用户提供AI模型下载、AI模型训练、AI模型学习、AI模型教程。
AI模型分享社区,基于Stable Diffusion潜在扩散的机器学习模型。