Offline AI on iOS and Android
Siraj Raval Siraj Raval
767K subscribers
20,597 views
0

 Published On Sep 20, 2023

I compiled a PyTorch AI model to run locally on iOS & Android! This keeps conversations private, free, & data compliant (both GDPR & HIPAA). In this video tutorial, i'll show you exactly how I did this for my ongoing healthcare project titled Doctor Dignity (previously titled DoctorGPT) so that you can do the same thing for any AI model, particularly Large Language Models. We start by building a simple language model in Python that runs on an Intel CPU, then accelerate it using CUDA for Nvidia GPUs, Metal for iOS GPUs, Vulkan for Android GPUs, and finally the Tensor Virtual Machine for both iOS and Android. We have a lot to GPU Programming cover in this video, comparing and contrasting different GPU programming techniques (computation vs allocation, abstraction vs transformation, stochastic optimization vs gradient based optimization). My next goal is to get a 3 billion parameter model to pass the US Medical Licensing exam and run on mobile devices. Don't worry if you're a beginner to all this, just sit back relax and enjoy the ride, I tried to make this as accessible as possible to all developers.

Star Doctor Dignity on GitHub:
https://github.com/llSourcell/Doctor-...

Please Subscribe! That's what keeps me going.

Want more AI/ML education? Connect with me here:
X: https://x.com/sirajraval
Instagram:   / sirajraval  
Facebook:   / sirajology  
Linkedin:   / sirajraval  
Tiktok:   / sirajraval  

Doctor Dignity Original Video:
   • DoctorGPT: Offline & Passes Medical E...  

Doctor Dignity iOS app: (Warning: this is a beta with bugs, please do not have high expectations, i promise it will get a lot better next month)
https://apps.apple.com/us/app/doctor-...

I Built a Trading bot with Bing and ChatGPT:
   • I Built a Trading Bot with Bing and C...  

I Built a Sports Betting Bot with ChatGPT:
   • I Built a Sports Betting Bot with Cha...  

I Built a Trading Bot with ChatGPT:
   • I Built a Trading Bot with ChatGPT  

Watch ChatGPT Build an AI Startup:
   • Watch ChatGPT Build an AI Startup  

Watch ChatGPT Build a Finance Startup:
   • Watch ChatGPT Build a Finance Startup  

Learn Machine Learning in 3 Months:
   • Learn Machine Learning in 3 Months (P...  

Join my AI community:
http://gptschool.app Sign up for my AI Sports betting Bot, WagerGPT! (500 spots available):
https://www.wagergpt.co

show more

Share/Embed