WebGL MNIST learning improved
We have improved the previous MNIST implementation in order to make this implementation faster than the Python/Numpy one. We still use our WGLMatrix library to process all linear algebra computations.
The full learning may take a few tens of minutes.
Controls :
The whole dataset may be too large for you graphic card memory. If it overflows, the WebGL context is killed. You need to refresh this webpage and to try again with a reduced version of the dataset.
Network hyperparameters :
- Input layer : 784 neurons (28x28 pixel digit image)
- Hidden layers : 256, 64 neurons
- Output layer : 10 neurons (1 per digit)
SIGMOID
fully connected
Learning parameters :
50000
10000
20
8
1.0
Monitoring :
Logging console :
References :
- Chapter 1 (Using neural nets to recognize handwritten digits) of Michael Nielsen's online book, Neural networks and deep learning : It details the neural network used,
- Direct download link to the MNIST neural network written with Python/Numpy on which this example is based (MIT license).
- We use JSON converted MNIST data from ConvnetJS repository (MIT license)