SDXL LoRA DreamBooth - henrysun9074/north-atlantic-right-whale-lora-mk2

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, facing down, callosities, clear water

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, clear blue water, breathing, visible tail, callosities

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, mostly submerged, obscured, rippling water

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, breathing, bright blue water, submerged tail, splashes

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, dark water, mostly submerged, facing down

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, clear, visible tail, submerged, callosities, still water

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, blue water, facing down, skinny

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, rippling water, realistic, callosities, reflection

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, blue water, still water, birds-eye view, submerged tail

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, mostly submerged, deep blue water, ripples, callosities, breathing

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, visible tail, realistic, clear blue water, exposed

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, facing up, callosities, splashes, clear blue water

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, dark water, facing down, callosities, submerged

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, clear blue water, exposed, facing down, realistic

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, sideways, callosities, ripples, exposed midsection

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, callosities, facing down, ripples, realistic

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, submerged tail, clear water, still, realistic

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, visible tail, still water, ripples, exposed, realistic

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, splashes, sideways, visible tail, realistic

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, dark water, very obscured, submerged, facing up

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, sideways, clear water, blowhole, tail fluke

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, callosities, rippling water

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, callosities, still water, submerged pectoral fins, small

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, breathing, visible submerged fluke, callosities

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, splashes, partially submerged, deep blue water

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, obscured, dark water

Prompt

A realistic aerial drone image of a <s0><s1> swimming in the ocean, out of water, dark water, still water

Model description

These are henrysun9074/north-atlantic-right-whale-lora-mk2 LoRA adaption weights for stabilityai/stable-diffusion-xl-base-1.0.

Download model

Use it with UIs such as AUTOMATIC1111, Comfy UI, SD.Next, Invoke

• LoRA: download north-atlantic-right-whale-lora-mk2.safetensors here 💾.
  • Place it on your models/Lora folder.
  • On AUTOMATIC1111, load the LoRA by adding <lora:north-atlantic-right-whale-lora-mk2:1> to your prompt. On ComfyUI just load it as a regular LoRA.
• Embeddings: download north-atlantic-right-whale-lora-mk2_emb.safetensors here 💾.
  • Place it on it on your embeddings folder
  • Use it by adding north-atlantic-right-whale-lora-mk2_emb to your prompt. For example, A realistic aerial drone image of a north-atlantic-right-whale-lora-mk2_emb swimming in the ocean (you need both the LoRA and the embeddings as they were trained together for this LoRA)

Use it with the 🧨 diffusers library

from diffusers import AutoPipelineForText2Image
import torch
from huggingface_hub import hf_hub_download
from safetensors.torch import load_file
        
pipeline = AutoPipelineForText2Image.from_pretrained('stabilityai/stable-diffusion-xl-base-1.0', torch_dtype=torch.float16).to('cuda')
pipeline.load_lora_weights('henrysun9074/north-atlantic-right-whale-lora-mk2', weight_name='pytorch_lora_weights.safetensors')
embedding_path = hf_hub_download(repo_id='henrysun9074/north-atlantic-right-whale-lora-mk2', filename='north-atlantic-right-whale-lora-mk2_emb.safetensors' repo_type="model")
state_dict = load_file(embedding_path)
pipeline.load_textual_inversion(state_dict["clip_l"], token=["<s0>", "<s1>"], text_encoder=pipeline.text_encoder, tokenizer=pipeline.tokenizer)
pipeline.load_textual_inversion(state_dict["clip_g"], token=["<s0>", "<s1>"], text_encoder=pipeline.text_encoder_2, tokenizer=pipeline.tokenizer_2)
        
image = pipeline('A realistic aerial drone image of a <s0><s1> swimming in the ocean').images[0]

For more details, including weighting, merging and fusing LoRAs, check the documentation on loading LoRAs in diffusers

Trigger words

To trigger image generation of trained concept(or concepts) replace each concept identifier in you prompt with the new inserted tokens:

to trigger concept TOK → use <s0><s1> in your prompt

Details

All Files & versions.

The weights were trained using 🧨 diffusers Advanced Dreambooth Training Script.

LoRA for the text encoder was enabled. False.

Pivotal tuning was enabled: True.

Special VAE used for training: madebyollin/sdxl-vae-fp16-fix.