Only briefly skimmed, but don't you need nonlinearity for these things to work (e.g., rectifier, sigmoid...)? Else, it's just linear algebra, and more layers can't help (since matrices can be multiplied, the dimensionality is the only thing that matters). I don't think you can really get nonlinearity with one bit.
Not my field, so I'm sure I'm missing something. If anyone wants to ELI5 though...
Only briefly skimmed, but don't you need nonlinearity for these things to work (e.g., rectifier, sigmoid...)? Else, it's just linear algebra, and more layers can't help (since matrices can be multiplied, the dimensionality is the only thing that matters). I don't think you can really get nonlinearity with one bit.
Not my field, so I'm sure I'm missing something. If anyone wants to ELI5 though...