In this article, we provide some context related to our project of virtual mirror for eyewear, highlight our main goals, share a demo, and finally mention some of the results we got…
Why did Jeeliz try to fix the problem of glasses virtual try-on? Most of the current solutions of virtual try-on in augmented reality and real-time (virtual mirrors) were designed in the 2010’s. At that time, there was a lot of hype around Adobe Flash and consumers were not mobile-first…
Few people cared about interoperability and a trivial combination of desktop web app + native mobile app (for the most motivated users) was widely accepted. Deep-learning algorithms got improved since 2012 and now undoubtedly outperform Stasm-like algorithms for facial detection in real time in the browser. Deep-learning models are 100x faster than the previous the state-of-the-art and allow a real face detection on each frame of the webcam video feed. With these algorithms, no key-point tracking is required anymore (in most of the solutions, key-point tracking was involved to take over the real face detection on the video feed, to compensate a weakness, a lack of efficiency) … Users habits, when visiting a website with a huge catalog, changed drastically. Their level of expectation in term of UI/UX is much higher. And since Tinder released its innovative and famous swipe left/right, in a lot of cases swiping is the new browsing… GPU is improving like crazy! Using hardware accelerated workflows for deep-learning & real-time 3D renders of glasses in the browser is definitely a good bet.
What did Jeeliz want to achieve in the optical e-commerce space? With this project, we wanted to:
- Build a virtual mirror from a new technology stack, which is faster than the state-of-the-art and most of all a working solution supported by mobile browsers, obviously in real time.
- Enhance the 3D renders of items to be tried on (here sunglasses) to improve the realism of the virtual trial.
- Create a UX that matches the users’ new habits, and helps finding the right pair of glasses quickly.
Jeeliz virtual mirror as a web app powered by webGL and deep-learning technologies. Progressive web apps are the future; our demos were progressive from the beginning. Note: in 2018, major actors/tech companies confirmed it might be the good place to be in the future. See these recent and interesting articles:
Some results of the commercial test of a sunglasses version of our webapp Jeeliz sunglasses is currently linked to Amazon, Flipkart and AliExpress through their APIs (a good way to have a huge offer for free…). It can be connected to any existing platform. Over few weeks, with sponsored traffic mainly from Adwords it recorded over 3000+ unique visitors (at less than 20 cents per acquired visitor). Here is what we recorded in terms of:
- engagement: 15 items tried out per session.
- conversion: 15% of visitors redirected towards Amazon, 30% conversion on Amazon.