We didn't have much success with multi-level RNNs, but skip-layer connections represent an important innovation in that regard.