Creating an uber-realistic video animation from an avatar with Stable Diffusion
Render Realm Render Realm
2.7K subscribers
73,298 views
0

 Published On Mar 22, 2023

This tutorial will guide you through the process of creating an avatar with ReadyPlayerMe, animating it in Mixamo, building a 3d scene around it in Blender and feeding this scene into StableDiffusion Automatic1111 to create a video animation, using an uber-realistic custom model with the Deforum and ControlNet extensions.

To watch some more great music videos created with StableDiffusion, Unreal Engine and Blender, visit our YouTube music channel:
   / @-vero-  

----------------------------

Chapters:
00:00 Intro
00:20 Creating an avatar with ReadyPlayerMe
01:45 Preparing the avatar for uploading it to Mixamo
03:00 Animating the avatar in Mixamo and importing it into Blender
05:41 Importing a 3d background scene from Sketchfab into blender and render the scene
10:19 Preparing Automatic1111 for a hyper-realistic render
12:13 Using the Deforum and ControlNet extension for rendering the animation
14:47 Creating the final video

Link to the ReadyPlayerMe website for creating free 3d avatars:
https://readyplayer.me/

Link to the Mixamo website:
https://www.mixamo.com/

Link to Sketchfab for downloading free 3d models:
https://sketchfab.com/feed

Downloading custom models for Stable Diffusion:
https://civitai.com/

Deforum Extension - download and infos:
https://github.com/deforum-art/deforu...

Controlnet Extension - download and infos:
https://github.com/Mikubill/sd-webui-...

Downloading models for the Controlnet extension:
https://huggingface.co/lllyasviel/Con...

Download Blender:
https://www.blender.org/download/

-----------------------------------------

Local installation guide for Automatic1111 on a Windows-PC:
https://stable-diffusion-art.com/inst...
and on a Mac with Apple Silicon:
https://stable-diffusion-art.com/inst...


Some great Youtube channels, covering Stable Diffusion:
   / @oliviosarikas  
   / @nerdyrodent  
   / @sebastiankamph  
   / @promptmuse  


#stablediffusion #automatic1111 #deforum #controlnet #blender #mixamo #tutorial #readyplayerme

show more

Share/Embed