Increase the amount of channels for deeper convolution layers

A main effect of convolution is that the receptive field at deeper layers increases!

This is also why generally you want to increase the amount of channels (i.e. the amount of feature maps) when the network becomes deeper. Because the receptive field increases, the more complex features are there to be learned. Whereas usually we decrease the amount of neurons in dense layers to create bottlenecks, with convolution layers we don't because the complexity of the features increases (i.e. they are combinations of combinations of features etc.).