|
|
Character Recognition: Constant and Linear Models
The neural network toolbox application demo on the
mathworks website
http://www.mathworks.com/access/helpdesk/help/toolbox/nnet/applica6.html
concerns designing a neural network with 25
(non-optimal) hidden nodes to recognize 26 7-by-5
binary images of the capital letters A-Z. The letters
are downloaded from the function PRPROB ("P"attern
"R"ecognition "PROB"lem) by using the command
[alphabet26 targets] = prprob;
Details can be obtained in the usual way:
help prprob
doc prprob
type prprob
edit prprob % WARNING change the name before editing!
The demo can be run by either using the website code
or calling the function APPCR1.
help appcr1
doc appcr1
type appcr1
edit appcr1 % WARNING change the name before editing!
There is a final remark about increasing the number of
hidden nodes for the recognition of very noisy images.
Recently, the CSSM thread
"Character Recognition using neural networks"
http://groups.google.com/group/comp.soft-sys.matlab/msg/743504fa7932322e
concerns designing a neural network with 36 (non-
optimal) hidden nodes to recognize 36 7-by-5 binary
images of the 10 digits 0-9 and the 26 capital letters
A-Z. The letters are different than those obtained
from the PRPROB function and, except for the letter A,
appear to be more recognizable by sight.
The reason for the current thread is to emphasize that
although the optimal number of hidden nodes can be
obtained by arduous brute force trial and error, it
is worthwhile to first consider two simpler models.
THE NAIVE CONSTANT MODEL
The Naive Constant Model outputs the average of the
training target examples (independent of input) and,
consequently, obtains a mean-square-error (MSE00)
that is approximately equal to the mean of the 36 target
variances. The importance of MSE00 is that it sets
a scale for the performance of more complicated models
that can be judged by using either the normalized MSE
or the corresponding R-square (R^2) statistic.
NMSE = MSE/MSE00
R2 = 1-NMSE
THE LINEAR MODEL
The Linear Model is usually obtained by QR via the
BACKSLASH operator or REGRESS function. However,
in ill-conditioned cases pseudoinversion via the
PINV function can be used. The model results in the
normalized mean-square-error MSE0 and corresponding
R-square statistic R20. The importance of MSE0 is
that the linear model is a special case of a neural
net with no hidden nodes. Therefore, it can serve
as the 1st candidate in the search for the optimal
number of hidden nodes.
EXAMPLE
For the 36 character example in the above recent
thread,
MSE00 = 0.027778
PctErr00 = 97.222 % (35/36 misclassifications)
whereas
MSE0 = 0.0007716
NMSE0 = 0.027777
R20 = 0.97222
PctErr0 = 0 % Perfect Recognition!
When training images are noiseless but test images
are contaminated with Gaussian noise, the correct
recognition rate vs signal-to-noise ratio (dB) is
SNRdB 100%-PctErr
0 13.9
5 19.4
10 25.0
15 41.7
20 80.6
25 97.2
30 100.0
The corresponding outputs for each character are
tabulated below:
0 9T09000
1 1Y19111
2 F9O8222
3 Y983333
4 94E4444
5 Y8Y8555
6 98O8666
7 YU8P877
8 8888888
9 999M999
A 8M88AAA
B 88OBPBB
C 8J9CCCC
D J88GDDD
E 18OEEEE
F EFG9FFF
G MMG8GGG
H E998HHH
I IY89IYI
J 8M9J8JJ
K 8E9EKKK
L 8888LLL
M M8MMMMM
N E6NNYNN
O 8899OOO
P U99P8PP
Q 9899QQQ
R EYRRRRR
S 8RS9SSS
T 9898TTT
U 899UUUU
V 8VYVVVV
W 98988WW
X TX8YXXX
Y OYEYYYY
Z 9O8Z8ZZ
Including noisy images in the training set
should improve performance. However, it is
not clear to me at what point hidden nodes
are necessary for improvement.
Hope this helps.
Greg
|
|
0
|
|
|
|
Reply
|
Greg
|
9/2/2010 12:07:45 PM |
|
This one seems interesting!
http://jackieevanchos.org/
|
|
0
|
|
|
|
Reply
|
John
|
9/2/2010 8:14:12 AM
|
|
|
1 Replies
310 Views
(page loaded in 0.135 seconds)
Similiar Articles: Character Recognition: Constant and Linear Models - comp.soft-sys ...Calculating propagation delay & transmission delay - comp.dcom.sys ... optimac character recognition using back propogation - comp.soft ... ... soft-sys.matlab ... classified results vs targets Neural network - comp.soft-sys ...Character Recognition: Constant and Linear Models - comp.soft-sys ... The neural network toolbox application demo on the mathworks ... is approximately equal to the mean ... Neural Network Toolbox - pattern recognition in images - comp.soft ...optimac character recognition using back propogation - comp.soft ... Neural Network Toolbox - pattern recognition in images - comp.soft ... optimac character recognition ... Advantech PCI-1711 Card with MATLAB - comp.soft-sys.matlab ...Character Recognition: Constant and Linear Models - comp.soft-sys ... Matlab with card PCI-1711? - comp.soft-sys.matlab When I input a constant voltage of 5V in AD ... ... any classifier for digit recognition is needed - comp.soft-sys ...... fitness function for a linear array ... any classifier for digit recognition ... to use Hidden Markov Models as a classifier. ... every file is divided on 5 frames (constant ... Neural network using matlab - comp.ai.neural-netsFor a baseline start with design linear and ... prone to overtraining, The simplest model is to assume the output is constant ... project on face recognition using artificial ... Text Compression With Abductive Logic Programming? - comp ...Convert from db to Linear scale and vice versa. - comp ... How can I add an extra character or symbol to an existing ... any classifier for digit recognition is needed - comp.soft ... improve strlen - comp.lang.asm.x86... of the whole tree is known at evaluation time in linear ... in cheek as usual, welcome to the world of mixed model ... the compiler implements don't suck, such as constant ... Could anyone give me the spice-mode.el - comp.emacsHi, All I am new to *NIX and I am thinking of writing spice code under Emacs. However, I have no idea of Emacs Lisp. Hence, I could not write a packa... [comp.publish.cdrom] CD-Recordable FAQ, Part 1/4 - comp.publish ...Archive-name: cdrom/cd-recordable/part1 Posting-Frequency: monthly Last-modified: 2008/10/09 Version: 2.71 Send corrections and updates to And... Character Recognition: Constant and Linear Models - comp.soft-sys ...Calculating propagation delay & transmission delay - comp.dcom.sys ... optimac character recognition using back propogation - comp.soft ... ... soft-sys.matlab ... Character Recognition: Constant and Linear Models - Newsreader ...File exchange, MATLAB Answers, newsgroup access, Links, and Blogs for the MATLAB & Simulink user community 7/24/2012 11:55:13 AM
|
|
|
|
|
|
|
|
|