Tech Update: Building a YouTube Cohost - Real-time conversation with AI Assistant in Unreal Engine
Solomon King Benge Solomon King Benge
2.6K subscribers
394 views
0

 Published On Feb 22, 2023

I've been building a more interactive YouTube Cohost for my channel.
( Check out the initial entertainment only version    • Artificial Intelligence: An Epic Jour...   )

The current goal is a full interactive AI with a (possible) cyber punk/afrofuturism design with chatbot conversational capabilities.

I started off working with Python + OpenAI Whisper plugging into OpenAI's apis for the conversational aspect, but quickly noticed lots of issues, specifically around the vision I wanted for the visual aspect of the character.

So I switched over to learning Unreal Engine 5 over the past few weeks. This is the first result.

Current workflow is: Azure Speech Engine (Azure Cognitive) + OpenAI GPT3 + Unreal Engine powered by BluePrints. Character basic design is from MetaHuman.

Next steps will be lip sync, holographic texturing and interface design.

After than, I want to package the entire thing into a CyberDeck for portability. We'll see how that goes.

show more

Share/Embed