I gave a talk entitled Deep Learning using WebGL the 29th of October 2018 at the University of Pennsylvania. I was invited by Patrick Cozzi, who leads the development of Cesium and who have written various amazing books about WebGL and 3D programming. I explained to Master2 students in computer graphics how to use the GPU to do computations with WebGL, then how to code the specific computations required for deep learning. I detailed some Read more…
I have written a book about deep learning in the web browser. It is available on Amazon here. I wrote it with 3 co-authors, Kai Sasaki Christoph Körner, Reiichiro Nakano. It focuses on client-side deep learning implementations using JavaScript and WebGL. It deals both with using mainstream deep learning frameworks like TensorFlow.js and building deep neural networks from scratch with vanilla JavaScript/WebGL. The Github repository of the book is available here: github.com/backstopmedia/deep-learning-browser. All sample codes Read more…
At a first glance, it may seems strange to use Jeeliz technology for embedded systems. Indeed, its favorite environment is the web browser. But web programming seeps everywhere: in mobile applications with PWA (Progressive Web Apps), in desktop applications with Electron, server-side with Node.js, and even in blockchain based decentralized applications with Lisk for example. So why embedded systems? In this article we describe the main advantages of our technology compared to the use of Read more…
ARCore and ARKit The augmented reality frameworks ARCore and ARKit, released respectively by Google and Apple, have popularized the use of augmented reality. They rely on the computing power and the 3D scanning capabilities of latest high end mobile devices to provide a smooth experience. The main technological breakthrough is their SLAM (Simultaneous Localization and Mapping) algorithms which reconstructs the 3D environment and concomitantly computes the position and orientation of the device. They prepare the Read more…
We will participate in the Paris Aéroport Startup Day. It will happen on October the 17th of 2018 in Paris Orly airport. All the informations are available on the official website of the event: startupday.parisaeroport.fr. On this occasion, we will show the JeelizBox working into a large JCDecaux 70 inches full HD advertisement display. The JeelizBox is so small that it can be embedded into an advertisement display, it’s a plug-and-play solution, and allows augmented-reality Read more…
In this tutorial you will learn how to build this webcam face filter : You can try it yourself by clicking here! Introduction Some native mobile applications such Snapchat, Facebook Lenses or MSQRD have popularized webcam face filters. There are even creative studio softwares to easily create face filters without requiring special computer development knowledge. It’s still time for you to take the blue pill proposed by Morpheus by launching Facebook AR Studio and stopping Read more…
We explain the advantages of Jeeliz technology in this lightening talk, followed by a question session. Various demonstrations will be shown: face detection and tracking, expression detection, sunglasses virtual tryon and pupillometry. Our long term goals in augmented reality object recognition were also mentioned. The page of Meetup event is here: https://www.meetup.com/en-US/ARKit-NYC/events/251906845/ We will come back at another NYC ARKit meetups because they are simply awesome! The page of the Meetup group is here: https://www.meetup.com/en-US/ARKit-NYC/
Web programming is getting closer and closer to native programming. This is due to the performance increase of JavaScript engines and to the new functionalities brought by new APIs. There are among others : WebSockets for real time data transfer, MediaStream API to get the webcam video stream and to send it in peer to peer, WebGL to use the GPU for rendering or computing, WebAudio to use advanced audio features. Web programming has many Read more…
In this talk, we will explain how to get started to build your own JavaScript face filter. We present an interactive tutorial on WebGL Academy to understand step by step the different aspect of the final program (getting the webcam video feed, create the 3D scene, importing the 3D meshes, color harmonization…) The slideshow of the talk is available here: jeeliz.com/talks/2018-05-23_creativeCoding The tutorial about building a Statue of Liberty face filter is available on WebGL Read more…