In order to enhance the perception for the multi-scale image variation and improve the scale invariance of convolutional neural networks,this study proposes a typhoon classification model based on multi-scale convolutional feature fusion. A multi-scale perception layer is added to convolutional neural networks; then, convolutional features are multi-scale perceived and cascaded. A multi-scale regularization term is then incorporated into the loss function. The residual error of hidden layer weight is minimized and the feature extraction ability is optimized with backpropagation. Finally, multi-scale high-level semantic features are normalized to the probability value of each category using Softmax. The maximum probability value is used as the final classification result of the image. Infrared satellite cloud images are used as the dataset in our experiments to validate the multi-scale perception ability of the model. Experimental results show that the model can effectively perceive and extract the local features of the typhoon cloud map. The generalization ability of the model is verified using two general datasets, i.e., MNIST and CIFAR-10.