Neural Networks and Deep Learning 学习笔记(二)

1. 第一章习题解答。

There is a way of determining the bitwise representation of a digit by adding an extra layer to the three-layer network above. The extra layer converts the output from the previous layer into a binary representation, as illustrated in the figure below. Find a set of weights and biases for the new output layer. Assume that the first 3 layers of neurons are such that the correct output in the third layer (i.e., the old output layer) has activation at least 0.99, and incorrect outputs have activation less than 0.01.

假设新输出层从上到下依次为高位到低位。

十进制与二进制对照表：

output neuron对应的是：

用i代表原始输出从上到下的次序，用j代表输出的nybble从上到下的次序，