Distribution 8 0 0 0 0 0 0 0 .
Box A.
P[A,t] = 8/8 = 1 .
Peq[A] = 1/8 .
P[A,t] / Peq[A] = 1 / (1/8) = 8 .
log ( P[A,t] / Peq[A] ) = log 8 = 2.08 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = 1 x 2.08 = 2.08 .
Box B.
P[B,t] = 0/8 = 0, so
P[B,t] . { log ( P[B,t] / Peq[B] ) } = 0 .
The same goes for all the remaining boxes ( P[C,t] = 0/8, P[D,t] = 0/8, etc.).
So the H value for this distribution is
2.08 + 0 + 0 + 0 + 0 + 0 + 0 + 0 = 2.08 .
Distribution 7 1 0 0 0 0 0 0 .
Box A.
P[A,t] = 7/8.
Peq[A] = 1/8 .
P[A,t] / Peq[A] = 7/8 / (1/8) = 7 .
log ( P[A,t] / Peq[A] ) = log 7 = 1.95 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (7/8)(1.95) = 1.70 .
Box B.
P[B,t] = 1/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (1/8) / (1/8) = 1 .
log ( P[B,t] / Peq[B] ) = log 1 = 0 .
P[B,t] . { log ( P[B,t] / Peq[B] ) } = (1/8)(0) = 0 .
Box C.
P[C,t] = 0/8 = 0, so
P[C,t] . { log ( P[C,t] / Peq[C] ) } = 0 .
The same goes for all the remaining boxes ( P[D,t] = 0/8, P[E,t] = 0/8, etc.).
So the H value for this distribution is
1.70 + 0 + 0 + 0 + 0 + 0 + 0 + 0 = 1.70 .
Distribution 6 2 0 0 0 0 0 0 .
Box A.
P[A,t] = 6/8.
Peq[A] = 1/8 .
P[A,t] / Peq[A] = 6/8 / (1/8) = 6 .
log ( P[A,t] / Peq[A] ) = log 6 = 1.79 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (6/8)(1.79) = 1.34 .
Box B.
P[B,t] = 2/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (2/8) / (1/8) = 2 .
log ( P[A,t] / Peq[A] ) = log 2 = 0.69 .
P[B,t] . { log ( P[A,t] / Peq[A] ) } = (2/8)(0.69) = 0.17 .
Box C.
P[C,t] = 0/8 = 0, so
P[C,t] . { log ( P[C,t] / Peq[C] ) } = 0 .
The same goes for all the remaining boxes ( P[D,t] = 0/8, P[E,t] = 0/8, etc.).
So the H value for this distribution is
1.34 + 0.17 + 0 + 0 + 0 + 0 + 0 + 0 = 1.51 .
Distribution 4 4 0 0 0 0 0 0 .
Box A.
P[A,t] = 4/8.
Peq[A] = 1/8 .
P[A,t] / Peq[A] = 4/8 / (1/8) = 4 .
log ( P[A,t] / Peq[A] ) = log 4 = 1.39 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (4/8)(1.39) = 0.69 .
Box B.
P[B,t] = 4/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (4/8) / (1/8) = 4 .
log ( P[A,t] / Peq[A] ) = log 4 = 1.39 .
P[B,t] . { log ( P[A,t] / Peq[A] ) } = (4/8)(1.39) = 0.69 .
Box C.
P[C,t] = 0/8 = 0, so
P[C,t] . { log ( P[C,t] / Peq[C] ) } = 0 .
The same goes for all the remaining boxes ( P[D,t] = 0/8, P[E,t] = 0/8, etc.).
So the H value for this distribution is
0.69 + 0.69 + 0 + 0 + 0 + 0 + 0 + 0 = 1.39 .
Distribution 6 1 1 0 0 0 0 0 .
Box A.
P[A,t] = 6/8.
Peq[A] = 1/8 .
P[A,t] / Peq[A] = 6/8 / (1/8) = 6 .
log ( P[A,t] / Peq[A] ) = log 6 = 1.79 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (6/8)(1.79) = 1.34 .
Box B.
P[B,t] = 1/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (1/8) / (1/8) = 1 .
log ( P[A,t] / Peq[A] ) = log 1 = 0 .
P[B,t] . { log ( P[A,t] / Peq[A] ) } = (1/8)(0) = 0 .
Box C.
P[C,t] = 1/8.
Peq[B] = 1/8 .
P[C,t] / Peq[C] = (1/8) / (1/8) = 1 .
log ( P[C,t] / Peq[C] ) = log 1 = 0 .
P[C,t] . { log ( P[C,t] / Peq[C] ) } = (1/8)(0) = 0 .
Box D.
P[D,t] = 0/8 = 0, so
P[D,t] . { log ( P[D,t] / Peq[D] ) } = 0 .
The same goes for all the remaining boxes ( P[E,t] = 0/8, P[F,t] = 0/8, etc.).
So the H value for this distribution is
1.34 + 0 + 0 + 0 + 0 + 0 + 0 + 0 = 1.34 .
Distribution 5 2 1 0 0 0 0 0 .
Box A.
P[A,t] = 5/8.
Peq[A] = 1/8 .
P[A,t] / Peq[A] = 5/8 / (1/8) = 5 .
log ( P[A,t] / Peq[A] ) = log 5 = 1.61 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (5/8)(1.61) = 1.01 .
Box B.
P[B,t] = 2/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (2/8) / (1/8) = 2 .
log ( P[A,t] / Peq[A] ) = log 2 = 0.69 .
P[B,t] . { log ( P[A,t] / Peq[A] ) } = (2/8)(0.69) = 0.17 .
Box C.
P[C,t] = 1/8.
Peq[B] = 1/8 .
P[C,t] / Peq[C] = (1/8) / (1/8) = 1 .
log ( P[C,t] / Peq[C] ) = log 1 = 0 .
P[C,t] . { log ( P[C,t] / Peq[C] ) } = (1/8)(0) = 0 .
Box D.
P[D,t] = 0/8 = 0, so
P[D,t] . { log ( P[D,t] / Peq[D] ) } = 0 .
The same goes for all the remaining boxes ( P[E,t] = 0/8, P[F,t] = 0/8, etc.).
So the H value for this distribution is
1.01 + 0.17 + 0 + 0 + 0 + 0 + 0 + 0 = 1.18 .
Distribution 4 3 1 0 0 0 0 0 .
Box A.
P[A,t] = 4/8.
Peq[A] = 1/8 .
P[A,t] / Peq[A] = 4/8 / (1/8) = 4 .
log ( P[A,t] / Peq[A] ) = log 4 = 1.39 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (4/8)(1.39) = 0.69 .
Box B.
P[B,t] = 3/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (3/8) / (1/8) = 3 .
log ( P[B,t] / Peq[B] ) = log 3 = 1.10 .
P[B,t] . { log ( P[B,t] / Peq[B] ) } = (3/8)(1.10) = 0.41 .
Box C.
P[C,t] = 1/8.
Peq[B] = 1/8 .
P[C,t] / Peq[C] = (1/8) / (1/8) = 1 .
log ( P[C,t] / Peq[C] ) = log 1 = 0 .
P[C,t] . { log ( P[C,t] / Peq[C] ) } = (1/8)(0) = 0 .
Box D.
P[D,t] = 0/8 = 0, so
P[D,t] . { log ( P[D,t] / Peq[D] ) } = 0 .
The same goes for all the remaining boxes ( P[E,t] = 0/8, P[F,t] = 0/8, etc.).
So the H value for this distribution is
0.69 + 0.41 + 0 + 0 + 0 + 0 + 0 + 0 = 1.10 .
Distribution 5 1 1 1 0 0 0 0 .
Box A.
P[A,t] = 5/8.
Peq[A] = 1/8 .
P[A,t] / Peq[A] = 5/8 / (1/8) = 5 .
log ( P[A,t] / Peq[A] ) = log 5 = 1.61 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (5/8)(1.61) = 1.01 .
Box B.
P[B,t] = 1/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (1/8) / (1/8) = 1 .
log ( P[B,t] / Peq[B] ) = log 1 = 0 .
P[B,t] . { log ( P[B,t] / Peq[B] ) } = (1/8)(0) = 0 .
Box C.
P[C,t] = 1/8.
Peq[B] = 1/8 .
P[C,t] / Peq[C] = (1/8) / (1/8) = 1 .
log ( P[C,t] / Peq[C] ) = log 1 = 0 .
P[C,t] . { log ( P[C,t] / Peq[C] ) } = (1/8)(0) = 0 .
Box D.
P[D,t] = 1/8.
Peq[D] = 1/8 .
P[D,t] / Peq[D] = (1/8) / (1/8) = 1 .
log ( P[D,t] / Peq[D] ) = log 1 = 0 .
P[D,t] . { log ( P[D,t] / Peq[D] ) } = (1/8)(0) = 0 .
Box E.
P[E,t] = 0/8 = 0, so
P[E,t] . { log ( P[E,t] / Peq[E] ) } = 0 .
The same goes for all the remaining boxes ( P[F,t] = 0/8, P[G,t] = 0/8, etc.).
So the H value for this distribution is
1.01 + 0 + 0 + 0 + 0 + 0 + 0 + 0 = 1.01 .
Distribution 3 3 2 0 0 0 0 0 .
Box A.
P[A,t] = 3/8.
Peq[B] = 1/8 .
P[A,t] / Peq[A] = (3/8) / (1/8) = 3 .
log ( P[A,t] / Peq[A] ) = log 3 = 1.10 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (3/8)(1.10) = 0.41 .
Box B.
P[B,t] = 3/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (3/8) / (1/8) = 3 .
log ( P[B,t] / Peq[B] ) = log 3 = 1.10 .
P[B,t] . { log ( P[B,t] / Peq[B] ) } = (3/8)(1.10) = 0.41 .
Box C.
P[C,t] = 2/8.
Peq[C] = 1/8 .
P[C,t] / Peq[C] = (2/8) / (1/8) = 2 .
log ( P[C,t] / Peq[C] ) = log 2 = 0.69 .
P[C,t] . { log ( P[C,t] / Peq[C] ) } = (2/8)(0.69) = 0.17 .
Box D.
P[D,t] = 0/8 = 0, so
P[D,t] . { log ( P[D,t] / Peq[D] ) } = 0 .
The same goes for all the remaining boxes ( P[E,t] = 0/8, P[F,t] = 0/8, etc.).
So the H value for this distribution is
0.41 + 0.41 + 0.17 + 0 + 0 + 0 + 0 + 0 = 0.99 .
Distribution 4 2 1 1 0 0 0 0 .
Box A.
P[A,t] = 4/8.
Peq[A] = 1/8 .
P[A,t] / Peq[A] = 4/8 / (1/8) = 4 .
log ( P[A,t] / Peq[A] ) = log 4 = 1.39 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (4/8)(1.39) = 0.69 .
Box B.
P[B,t] = 2/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (2/8) / (1/8) = 2 .
log ( P[B,t] / Peq[B] ) = log 2 = 0.69 .
P[B,t] . { log ( P[B,t] / Peq[B] ) } = (2/8)(0.69) = 0.17 .
Box C.
P[C,t] = 1/8.
Peq[C] = 1/8 .
P[C,t] / Peq[C] = (1/8) / (1/8) = 1 .
log ( P[C,t] / Peq[C] ) = log 1 = 0 .
P[C,t] . { log ( P[C,t] / Peq[C] ) } = (1/8)(0) = 0 .
Box D.
P[D,t] = 1/8.
Peq[D] = 1/8 .
P[D,t] / Peq[D] = (1/8) / (1/8) = 1 .
log ( P[D,t] / Peq[D] ) = log 1 = 0 .
P[D,t] . { log ( P[D,t] / Peq[D] ) } = (1/8)(0) = 0 .
Box E.
P[E,t] = 0/8 = 0, so
P[E,t] . { log ( P[E,t] / Peq[E] ) } = 0 .
The same goes for all the remaining boxes ( P[F,t] = 0/8, P[G,t] = 0/8, etc.).
So the H value for this distribution is
0.69 + 0.17 + 0 + 0 + 0 + 0 + 0 + 0 = 0.86 .
Distribution 3 2 2 1 0 0 0 0 .
Box A.
P[A,t] = 3/8.
Peq[B] = 1/8 .
P[A,t] / Peq[A] = (3/8) / (1/8) = 3 .
log ( P[A,t] / Peq[A] ) = log 3 = 1.10 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (3/8)(1.10) = 0.41 .
Box B.
P[B,t] = 2/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (2/8) / (1/8) = 2 .
log ( P[A,t] / Peq[A] ) = log 2 = 0.69 .
P[B,t] . { log ( P[A,t] / Peq[A] ) } = (2/8)(0.69) = 0.17 .
Box C.
P[C,t] = 2/8.
Peq[C] = 1/8 .
P[C,t] / Peq[C] = (2/8) / (1/8) = 2 .
log ( P[C,t] / Peq[C] ) = log 2 = 0.69 .
P[C,t] . { log ( P[C,t] / Peq[C] ) } = (2/8)(0.69) = 0.17 .
Box D.
P[D,t] = 1/8.
Peq[D] = 1/8 .
P[D,t] / Peq[D] = (1/8) / (1/8) = 1 .
log ( P[D,t] / Peq[D] ) = log 1 = 0 .
P[D,t] . { log ( P[D,t] / Peq[D] ) } = (1/8)(0) = 0 .
Box E.
P[E,t] = 0/8 = 0, so
P[E,t] . { log ( P[E,t] / Peq[E] ) } = 0 .
The same goes for all the remaining boxes ( P[F,t] = 0/8, P[G,t] = 0/8, etc.).
So the H value for this distribution is
0.41 + 0.17 + 0.17 + 0 + 0 + 0 + 0 + 0 = 0.75 .
Distribution 4 1 1 1 0 0 0 0 .
Box A.
P[A,t] = 4/8.
Peq[A] = 1/8 .
P[A,t] / Peq[A] = 4/8 / (1/8) = 4 .
log ( P[A,t] / Peq[A] ) = log 4 = 1.39 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (4/8)(1.39) = 0.69 .
Box B.
P[B,t] = 1/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (1/8) / (1/8) = 1 .
log ( P[B,t] / Peq[B] ) = log 1 = 0 .
P[B,t] . { log ( P[B,t] / Peq[B] ) } = (1/8)(0) = 0 .
Box C.
P[C,t] = 1/8.
Peq[C] = 1/8 .
P[C,t] / Peq[C] = (1/8) / (1/8) = 1 .
log ( P[C,t] / Peq[C] ) = log 1 = 0 .
P[C,t] . { log ( P[C,t] / Peq[C] ) } = (1/8)(0) = 0 .
Box D.
P[D,t] = 1/8.
Peq[D] = 1/8 .
P[D,t] / Peq[D] = (1/8) / (1/8) = 1 .
log ( P[D,t] / Peq[D] ) = log 1 = 0 .
P[D,t] . { log ( P[D,t] / Peq[D] ) } = (1/8)(0) = 0 .
Box E.
P[E,t] = 0/8 = 0, so
P[E,t] . { log ( P[E,t] / Peq[E] ) } = 0 .
The same goes for all the remaining boxes ( P[F,t] = 0/8, P[G,t] = 0/8, etc.).
So the H value for this distribution is
0.69 + 0 + 0 + 0 + 0 + 0 + 0 + 0 = 0.69 .
Distribution 2 2 2 2 0 0 0 0 .
Box A.
P[A,t] = 2/8.
Peq[A] = 1/8 .
P[A,t] / Peq[A] = (2/8) / (1/8) = 2 .
log ( P[A,t] / Peq[A] ) = log 2 = 0.69 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (2/8)(0.69) = 0.17 .
Box B.
P[B,t] = 2/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (2/8) / (1/8) = 2 .
log ( P[B,t] / Peq[B] ) = log 2 = 0.69 .
P[B,t] . { log ( P[B,t] / Peq[B] ) } = (2/8)(0.69) = 0.17 .
Box C.
P[C,t] = 2/8.
Peq[C] = 1/8 .
P[C,t] / Peq[C] = (2/8) / (1/8) = 2 .
log ( P[C,t] / Peq[C] ) = log 2 = 0.69 .
P[C,t] . { log ( P[C,t] / Peq[C] ) } = (2/8)(0.69) = 0.17 .
Box D.
P[D,t] = 2/8.
Peq[D] = 1/8 .
P[D,t] / Peq[D] = (2/8) / (1/8) = 2 .
log ( P[D,t] / Peq[D] ) = log 2 = 0.69 .
P[D,t] . { log ( P[D,t] / Peq[D] ) } = (2/8)(0.69) = 0.17 .
Box E.
P[E,t] = 0/8 = 0, so
P[E,t] . { log ( P[E,t] / Peq[E] ) } = 0 .
The same goes for all the remaining boxes ( P[F,t] = 0/8, P[G,t] = 0/8, etc.).
So the H value for this distribution is
0.17 + 0.17 + 0.17 + 0.17 + 0 + 0 + 0 + 0 = 0.68 .
Reflecting on this latter result, see NOTE 1 .
Distribution 2 2 2 1 1 0 0 0 .
Box A.
P[A,t] = 2/8.
Peq[A] = 1/8 .
P[A,t] / Peq[A] = (2/8) / (1/8) = 2 .
log ( P[A,t] / Peq[A] ) = log 2 = 0.69 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (2/8)(0.69) = 0.17 .
Box B.
P[B,t] = 2/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (2/8) / (1/8) = 2 .
log ( P[B,t] / Peq[B] ) = log 2 = 0.69 .
P[B,t] . { log ( P[B,t] / Peq[B] ) } = (2/8)(0.69) = 0.17 .
Box C.
P[C,t] = 2/8.
Peq[C] = 1/8 .
P[C,t] / Peq[C] = (2/8) / (1/8) = 2 .
log ( P[C,t] / Peq[C] ) = log 2 = 0.69 .
P[C,t] . { log ( P[C,t] / Peq[C] ) } = (2/8)(0.69) = 0.17 .
Box D.
P[D,t] = 1/8.
Peq[D] = 1/8 .
P[D,t] / Peq[D] = (1/8) / (1/8) = 1 .
log ( P[D,t] / Peq[D] ) = log 1 = 0 .
P[D,t] . { log ( P[D,t] / Peq[D] ) } = (1/8)(0) = 0 .
Box E.
P[E,t] = 1/8.
Peq[E] = 1/8 .
P[E,t] / Peq[E] = (1/8) / (1/8) = 1 .
log ( P[E,t] / Peq[E] ) = log 1 = 0 .
P[E,t] . { log ( P[E,t] / Peq[E] ) } = (1/8)(0) = 0 .
Box F.
P[F,t] = 0/8 = 0, so
P[F,t] . { log ( P[F,t] / Peq[F] ) } = 0 .
The same goes for all the remaining boxes ( P[G,t] = 0/8, P[H,t] = 0/8).
So the H value for this distribution is
0.17 + 0.17 + 0.17 + 0 + 0 + 0 + 0 + 0 = 0.51 .
Distribution 3 1 1 1 1 1 0 0 .
Box A.
P[A,t] = 3/8.
Peq[B] = 1/8 .
P[A,t] / Peq[A] = (3/8) / (1/8) = 3 .
log ( P[A,t] / Peq[A] ) = log 3 = 1.10 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (3/8)(1.10) = 0.41 .
Box B.
P[B,t] = 1/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (1/8) / (1/8) = 1 .
log ( P[B,t] / Peq[B] ) = log 1 = 0 .
P[B,t] . { log ( P[B,t] / Peq[B] ) } = (1/8)(0) = 0 .
Box C.
P[C,t] = 1/8.
Peq[C] = 1/8 .
P[C,t] / Peq[C] = (1/8) / (1/8) = 1 .
log ( P[C,t] / Peq[C] ) = log 1 = 0 .
P[C,t] . { log ( P[C,t] / Peq[C] ) } = (1/8)(0) = 0 .
Box D.
P[D,t] = 1/8.
Peq[D] = 1/8 .
P[D,t] / Peq[D] = (1/8) / (1/8) = 1 .
log ( P[D,t] / Peq[D] ) = log 1 = 0 .
P[D,t] . { log ( P[D,t] / Peq[D] ) } = (1/8)(0) = 0 .
Box E.
P[E,t] = 1/8.
Peq[E] = 1/8 .
P[E,t] / Peq[E] = (1/8) / (1/8) = 1 .
log ( P[E,t] / Peq[E] ) = log 1 = 0 .
P[E,t] . { log ( P[E,t] / Peq[E] ) } = (1/8)(0) = 0 .
Box F.
P[F,t] = 1/8.
Peq[F] = 1/8 .
P[F,t] / Peq[F] = (1/8) / (1/8) = 1 .
log ( P[F,t] / Peq[F] ) = log 1 = 0 .
P[F,t] . { log ( P[F,t] / Peq[F] ) } = (1/8)(0) = 0 .
Box G.
P[G,t] = 0/8 = 0, so
P[G,t] . { log ( P[G,t] / Peq[G] ) } = 0 .
The same goes for the remaining box ( P[H,t] = 0/8).
So the H value for this distribution is
0.41 + 0 + 0 + 0 + 0 + 0 + 0 + 0 = 0.41 .
Distribution 2 2 1 1 1 1 0 0 .
Box A.
P[A,t] = 2/8.
Peq[A] = 1/8 .
P[A,t] / Peq[A] = (2/8) / (1/8) = 2 .
log ( P[A,t] / Peq[A] ) = log 2 = 0.69 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (2/8)(0.69) = 0.17 .
Box B.
P[B,t] = 2/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (2/8) / (1/8) = 2 .
log ( P[B,t] / Peq[B] ) = log 2 = 0.69 .
P[B,t] . { log ( P[B,t] / Peq[B] ) } = (2/8)(0.69) = 0.17 .
Box C.
P[C,t] = 1/8.
Peq[C] = 1/8 .
P[C,t] / Peq[C] = (1/8) / (1/8) = 1 .
log ( P[C,t] / Peq[C] ) = log 1 = 0 .
P[C,t] . { log ( P[C,t] / Peq[C] ) } = (1/8)(0) = 0 .
Box D.
P[D,t] = 1/8.
Peq[D] = 1/8 .
P[D,t] / Peq[D] = (1/8) / (1/8) = 1 .
log ( P[D,t] / Peq[D] ) = log 1 = 0 .
P[D,t] . { log ( P[D,t] / Peq[D] ) } = (1/8)(0) = 0 .
Box E.
P[E,t] = 1/8.
Peq[E] = 1/8 .
P[E,t] / Peq[E] = (1/8) / (1/8) = 1 .
log ( P[E,t] / Peq[E] ) = log 1 = 0 .
P[E,t] . { log ( P[E,t] / Peq[E] ) } = (1/8)(0) = 0 .
Box F.
P[F,t] = 1/8.
Peq[F] = 1/8 .
P[F,t] / Peq[F] = (1/8) / (1/8) = 1 .
log ( P[F,t] / Peq[F] ) = log 1 = 0 .
P[F,t] . { log ( P[F,t] / Peq[F] ) } = (1/8)(0) = 0 .
Box G.
P[G,t] = 0/8 = 0, so
P[G,t] . { log ( P[G,t] / Peq[G] ) } = 0 .
The same goes for the remaining box ( P[H,t] = 0/8).
So the H value for this distribution is
0.17 + 0.17 + 0 + 0 + 0 + 0 + 0 + 0 = 0.34 .
Distribution 2 1 1 1 1 1 1 0 .
Box A.
P[A,t] = 2/8.
Peq[A] = 1/8 .
P[A,t] / Peq[A] = (2/8) / (1/8) = 2 .
log ( P[A,t] / Peq[A] ) = log 2 = 0.69 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (2/8)(0.69) = 0.17 .
Box B.
P[B,t] = 1/8.
Peq[B] = 1/8 .
P[B,t] / Peq[B] = (1/8) / (1/8) = 1 .
log ( P[B,t] / Peq[B] ) = log 1 = 0 .
P[B,t] . { log ( P[B,t] / Peq[B] ) } = (1/8)(0) = 0 .
Box C.
P[C,t] = 1/8.
Peq[C] = 1/8 .
P[C,t] / Peq[C] = (1/8) / (1/8) = 1 .
log ( P[C,t] / Peq[C] ) = log 1 = 0 .
P[C,t] . { log ( P[C,t] / Peq[C] ) } = (1/8)(0) = 0 .
Box D.
P[D,t] = 1/8.
Peq[D] = 1/8 .
P[D,t] / Peq[D] = (1/8) / (1/8) = 1 .
log ( P[D,t] / Peq[D] ) = log 1 = 0 .
P[D,t] . { log ( P[D,t] / Peq[D] ) } = (1/8)(0) = 0 .
Box E.
P[E,t] = 1/8.
Peq[E] = 1/8 .
P[E,t] / Peq[E] = (1/8) / (1/8) = 1 .
log ( P[E,t] / Peq[E] ) = log 1 = 0 .
P[E,t] . { log ( P[E,t] / Peq[E] ) } = (1/8)(0) = 0 .
Box F.
P[F,t] = 1/8.
Peq[F] = 1/8 .
P[F,t] / Peq[F] = (1/8) / (1/8) = 1 .
log ( P[F,t] / Peq[F] ) = log 1 = 0 .
P[F,t] . { log ( P[F,t] / Peq[F] ) } = (1/8)(0) = 0 .
Box G.
P[G,t] = 1/8.
Peq[G] = 1/8 .
P[G,t] / Peq[G] = (1/8) / (1/8) = 1 .
log ( P[G,t] / Peq[G] ) = log 1 = 0 .
P[G,t] . { log ( P[G,t] / Peq[G] ) } = (1/8)(0) = 0 .
Box H.
P[H,t] = 0/8 = 0, so
P[H,t] . { log ( P[H,t] / Peq[H] ) } = 0 .
So the H value for this distribution is
0.17 + 0 + 0 + 0 + 0 + 0 + 0 + 0 = 0.17 .
Finally we consider the distribution 1 1 1 1 1 1 1 1 .
This is the equilibrium distribution.
Box A.
P[A,t] = 1/8.
Peq[A] = 1/8 .
P[A,t] / Peq[A] = (1/8) / (1/8) = 1 .
log ( P[A,t] / Peq[A] ) = log 1 = 0 .
P[A,t] . { log ( P[A,t] / Peq[A] ) } = (1/8)(0) = 0 .
The same goes for all the remaining boxes, B, C, D, E, F, G, and H.
So the H value for this distribution is
0 + 0 + 0 + 0 + 0 + 0 + 0 + 0 = 0 .
*********************************************************
|