Description

Purpose

I wanted to see how Pony Realism would handle a depth map from a 2d illustration. It went well, I’ll start using that technique in the future.
I also wanted to see how Kling would handle a reflection on glass. Horrible results, would not recommend.

Tutorial and Prompts

Music

First Pass (Suno v5):
surreal floating reggae electro-dub with Memphis influence, Hypnotic pulsing and delay, Deep 808 bass, Surreal atmospheric pads and effects add to the floating feeling, Lush hypnotic atmosphere
Weirdness 57%
Style Influence 65%
Second Pass (Suno Studio v1.2):
Extract stems, EQ out that annoying fucking hissing noise which Suno can’t help but generate
medium

Keyframe Image

Workflow Diagram:
large

Step 1: Posing

Model: Prefect illustrious XL v7.0
Set up the character, pose, and composition during this step.
Prompt: (anthro pony : 0.9), [natural breasts, reasonably sized], Fluttershy, inviting, seductive, inside bedroom, small bra,
Negative prompt: sketch, (text, speech_bubble),
Size: 768x1344,
Seed: 1158644178,
Model: prefectIllustriousXL_v70,
Steps: 20,
CFG scale: 5,
Sampler: Euler a,
KSampler: euler_ancestral,
Schedule: normal,
Guidance: 3.5,
VAE: sdxl_vae.safetensors,
Denoising strength: 0,
Clip skip: 2

Step 2: Depth Estimation

Model: depth_midas
Run the image through a depth processor to guide the next step

Step 3: Detailing

Model: Pony Realism 2.2
ControlNet Model: xinsir/controlnet-depth-sdxl-1.0.safetensors
Use this step for lighting and detailing. Apply the ControlNet model using Step 2 as the input. I used Strength: 0.15, Control Steps: 0-0.9.
Prompt: score_9, score_8_up, score_7_up, score_6_up, furry, unguligrade anthro pony, fur_tuft, Fluttershy, [curvy, reasonably_sized] wings, inviting, looking up at you, black bra, panties, standing in doorway, [fluffy] AND [[amateur photograph of a wings cosplayer natural female with freckles]] AND [[[backlit spread pegasus wings, feathers, mlp]]] BREAK inside sunlit bedroom, rim light,
Negative prompt: ,
Size: 720x1280,
Seed: 759287114,
Model: ponyRealism_v22MainVAE,
Steps: 35,
CFG scale: 5,
Sampler: DPM++ 2M SDE Heun Karras,
KSampler: dpmpp_2m_sde_gpu,
Schedule: karras,
Guidance: 3.5,
VAE: Automatic,
Denoising strength: 0,
Clip skip: 2,
LoRA: CinDarEff_v1_Epoch_5_lora:0.80

Step 4: Background

Model: FLUX.2 Klein 9B
Throw together a background.
Prompt: The photograph was taken with a 35mm camera. Change the background to sunlit cozy forest cottage bedroom doorway. Posted to Instagram,
Negative prompt: ,
Size: 720x1280,
Seed: 2287512852,
Model: FLUX.2 Klein 9B,
Steps: 4,
CFG scale: 1,
Sampler: Euler,
KSampler: euler,
Schedule: normal,
Guidance: 3.5,
VAE: Automatic,
Denoising strength: 1,
Clip skip: 2

Step 5: Upscaling and cleanup

Model: R-ESRGAN 4x+
Parameters:
Denoising strength: 0.2
Hires resize: 1388x2464
Hires steps: 17
Hires upscaler: R-ESRGAN 4x+
Did some color grading in a photo editor as well.

Video Generation

Model: Kling 3.0
Input the keyframes in frames mode and link a character asset if you’ve generated one.
shy furry anthropomorphic pony with wings, cat-like ears, and tail stands in doorway of sunny forest cabin bedroom. She glances aside and reaches behind the doorframe, lights a rolled blunt with a lighter, inhales, then coughs and exhales. Wind sways trees sunlight filters through window. Intimate atmosphere. Camera follows her face. Raw live action.
shy furry anthropomorphic pony with wings, cat-like ears, and tail stands in doorway of sunny forest cabin bedroom. She glances aside and runs her fingers through her hair as she peacefully flaps her wings, then walks to bedroom window then looks at you. Wind sways trees sunlight filters through window. Intimate atmosphere. Camera follows her face. Raw live action.
shy furry anthropomorphic pony with wings, cat-like ears, and tail stands at window of sunny forest cabin bedroom. She poses shyly and adjusts her top, then walks to bedroom door while swaying her hips then looks at you. Wind sways trees sunlight filters through window. Intimate atmosphere. Camera follows her face. Raw live action.

Final Steps

Used a video editor to splice everything together, mix sound, and enhance the framerate.
large

Tags
Source

Comments

Syntax quick reference: **bold** *italic* ||hide text|| `code` __underline__ ~~strike~~ ^sup^ ~sub~

Detailed syntax guide