We use Jeeliz deep learning engine to detect the face, its orientation and its lighting for a glasses virtual try-on application.

The neural network runs on the GPU using the WebGL API. Glasses are rendered by a custom Physically based rendering engine and high end rendering algorithm like deferred shading, raytraced shadows and image bases lighting.

We are able to reproduce the ambient and directionnal lighting on the glasses, and to simulate the lens deformations (not in this video).

We have built a demonstration web application available on https://jeeliz.com/sunglasses . It is linked with Amazon, Flipkart, Aliexpress and Rayban official website using NodeJS microservices so you can check the price and buy the glasses you have tried.

Enjoy !