Published On Mar 22, 2023
This tutorial will guide you through the process of creating an avatar with ReadyPlayerMe, animating it in Mixamo, building a 3d scene around it in Blender and feeding this scene into StableDiffusion Automatic1111 to create a video animation, using an uber-realistic custom model with the Deforum and ControlNet extensions.
To watch some more great music videos created with StableDiffusion, Unreal Engine and Blender, visit our YouTube music channel:
/ @-vero-
----------------------------
Chapters:
00:00 Intro
00:20 Creating an avatar with ReadyPlayerMe
01:45 Preparing the avatar for uploading it to Mixamo
03:00 Animating the avatar in Mixamo and importing it into Blender
05:41 Importing a 3d background scene from Sketchfab into blender and render the scene
10:19 Preparing Automatic1111 for a hyper-realistic render
12:13 Using the Deforum and ControlNet extension for rendering the animation
14:47 Creating the final video
Link to the ReadyPlayerMe website for creating free 3d avatars:
https://readyplayer.me/
Link to the Mixamo website:
https://www.mixamo.com/
Link to Sketchfab for downloading free 3d models:
https://sketchfab.com/feed
Downloading custom models for Stable Diffusion:
https://civitai.com/
Deforum Extension - download and infos:
https://github.com/deforum-art/deforu...
Controlnet Extension - download and infos:
https://github.com/Mikubill/sd-webui-...
Downloading models for the Controlnet extension:
https://huggingface.co/lllyasviel/Con...
Download Blender:
https://www.blender.org/download/
-----------------------------------------
Local installation guide for Automatic1111 on a Windows-PC:
https://stable-diffusion-art.com/inst...
and on a Mac with Apple Silicon:
https://stable-diffusion-art.com/inst...
Some great Youtube channels, covering Stable Diffusion:
/ @oliviosarikas
/ @nerdyrodent
/ @sebastiankamph
/ @promptmuse
#stablediffusion #automatic1111 #deforum #controlnet #blender #mixamo #tutorial #readyplayerme