<< Chapter < Page Chapter >> Page >
After tinkering with hyper-parameters, various cost functions, and different activation functions, we built a convolutional neural network ourselves using Python's Theano library and trained it to recognize handwritten digits from 0-9.

Overview

We built our network to detect handwritten digits between 0 and 9, comprised of 6 total layers (seen below). We trained and tested our network using the MNIST data set of handwritten digits (50,000 training images, 10,000 test images). During the training, the weights and biases of each neuron in each layer were adjusted to minimize the cost function we used in the stochastic gradient descent algorithm. The first layer in our network is a convolutional layer that takes a 28x28 image and convolves it with 20 different 5x5 filters creating 20 24x24 feature maps. The second layer – a pooling layer – samples the 24x24 feature maps down to 12x12 feature maps. The third layer is another convolutional layer that convolves 40 different 4x4 filters, tuned to detect higher- level features, into 40 8x8 feature maps. The fourth layer pools the output of the second convolutional layer into 4x4 maps. The fifth layer is a fully connected layer of 100 neurons that detects the presence of features in the 4x4 feature maps. Finally the 6th layer is a softmax layer that maps combinations of features from the 5th layer into the output, a length-10 vector where the index of the largest entry was the digit our network guessed.

Our convolutional neural network

neural network
The CNN we structured to recognize handwritten digits

We also designed an applet that allows a user to visualize the flow of data in our network. It lets the user see the effect of our network on an input image (either an image in the MNIST dataset or an image drawn on the screen) and see the output of each layer of our network in real-time. We also designed the GUI to display the trained filters of each convolutional layer and the outputs of each neuron in every layer. This allowed us to gain a visual understanding of how the filters in our network were trained, which characteristics the filters were trained to detect, and how the filters used convolution to recognize the different features of the digits. Additionally it allowed us to test and prove just how accurate our network was, as well as easily identify and fix any cases where our network did not successfully classify digits.

Our image recognition app

applet
The applet we created to visualize the flow of data through our CNN

Questions & Answers

how does Neisseria cause meningitis
Nyibol Reply
what is microbiologist
Muhammad Reply
what is errata
Muhammad
is the branch of biology that deals with the study of microorganisms.
Ntefuni Reply
What is microbiology
Mercy Reply
studies of microbes
Louisiaste
when we takee the specimen which lumbar,spin,
Ziyad Reply
How bacteria create energy to survive?
Muhamad Reply
Bacteria doesn't produce energy they are dependent upon their substrate in case of lack of nutrients they are able to make spores which helps them to sustain in harsh environments
_Adnan
But not all bacteria make spores, l mean Eukaryotic cells have Mitochondria which acts as powerhouse for them, since bacteria don't have it, what is the substitution for it?
Muhamad
they make spores
Louisiaste
what is sporadic nd endemic, epidemic
Aminu Reply
the significance of food webs for disease transmission
Abreham
food webs brings about an infection as an individual depends on number of diseased foods or carriers dully.
Mark
explain assimilatory nitrate reduction
Esinniobiwa Reply
Assimilatory nitrate reduction is a process that occurs in some microorganisms, such as bacteria and archaea, in which nitrate (NO3-) is reduced to nitrite (NO2-), and then further reduced to ammonia (NH3).
Elkana
This process is called assimilatory nitrate reduction because the nitrogen that is produced is incorporated in the cells of microorganisms where it can be used in the synthesis of amino acids and other nitrogen products
Elkana
Examples of thermophilic organisms
Shu Reply
Give Examples of thermophilic organisms
Shu
advantages of normal Flora to the host
Micheal Reply
Prevent foreign microbes to the host
Abubakar
they provide healthier benefits to their hosts
ayesha
They are friends to host only when Host immune system is strong and become enemies when the host immune system is weakened . very bad relationship!
Mark
what is cell
faisal Reply
cell is the smallest unit of life
Fauziya
cell is the smallest unit of life
Akanni
ok
Innocent
cell is the structural and functional unit of life
Hasan
is the fundamental units of Life
Musa
what are emergency diseases
Micheal Reply
There are nothing like emergency disease but there are some common medical emergency which can occur simultaneously like Bleeding,heart attack,Breathing difficulties,severe pain heart stock.Hope you will get my point .Have a nice day ❣️
_Adnan
define infection ,prevention and control
Innocent
I think infection prevention and control is the avoidance of all things we do that gives out break of infections and promotion of health practices that promote life
Lubega
Heyy Lubega hussein where are u from?
_Adnan
en français
Adama
which site have a normal flora
ESTHER Reply
Many sites of the body have it Skin Nasal cavity Oral cavity Gastro intestinal tract
Safaa
skin
Asiina
skin,Oral,Nasal,GIt
Sadik
How can Commensal can Bacteria change into pathogen?
Sadik
How can Commensal Bacteria change into pathogen?
Sadik
all
Tesfaye
by fussion
Asiina
what are the advantages of normal Flora to the host
Micheal
what are the ways of control and prevention of nosocomial infection in the hospital
Micheal
what is inflammation
Shelly Reply
part of a tissue or an organ being wounded or bruised.
Wilfred
what term is used to name and classify microorganisms?
Micheal Reply
Binomial nomenclature
adeolu
Got questions? Join the online conversation and get instant answers!
Jobilize.com Reply

Get Jobilize Job Search Mobile App in your pocket Now!

Get it on Google Play Download on the App Store Now




Source:  OpenStax, Elec 301 projects fall 2015. OpenStax CNX. Jan 04, 2016 Download for free at https://legacy.cnx.org/content/col11950/1.1
Google Play and the Google Play logo are trademarks of Google Inc.

Notification Switch

Would you like to follow the 'Elec 301 projects fall 2015' conversation and receive update notifications?

Ask